JP3332897B2 - Imaging device, image processing method, and storage medium - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for capturing an image and / or
Also, the present invention relates to an imaging device, an image processing method, and a storage medium for recording.

[0002]

2. Description of the Related Art Conventionally, imaging devices such as electronic cameras for recording and reproducing still images and moving images captured by a solid-state imaging device such as a CCD using a memory card having a solid-state memory device as a recording medium have already been marketed. .

In the case of an electronic camera using such a solid-state image pickup device such as a CCD, dark image data read out after charge accumulation is performed in the same manner as in actual photographing without exposing the image pickup device, and the image pickup device is exposed. The dark noise correction processing can be performed by performing an arithmetic processing using the actual photographed image data read after the charge accumulation is performed in the state where the electric charge is stored.

[0004] This makes it possible to obtain high-quality captured images by correcting captured image data against image quality deterioration such as dark current noise generated in the image sensor and pixel defects due to minute scratches inherent to the image sensor. .

In particular, since dark current noise increases as the charge storage time of the image sensor and the temperature rise, a large image quality improvement effect can be obtained when performing exposure for a long time or exposure at a high temperature. The dark noise correction processing is a useful function for a camera user.

As described above, the dark current noise increases in accordance with the charge storage time of the image pickup device. Therefore, in each conventional photographing operation, dark image data is retaken by using the charge storage time of the image pickup device at the time of photographing. .

[0007]

For this reason, when performing actual photographing after fetching dark image data, the shutter release time lag becomes longer by the dark image photographing time, and valuable shutter chances may be missed. There was a problem.

On the other hand, when the dark image data is taken in after the actual shooting, the shooting interval of the first and second frames is increased by the dark image shooting time during continuous shooting, and the shooting frame intervals are made uniform. There was a problem that can not be.

Further, in any of the above cases, the dark image capturing operation is repeated for each photographing operation, so that there is a problem that power consumption increases accordingly.

An object of the present invention is to provide an image pickup apparatus and an image processing method capable of preventing a precious shutter chance from being missed, making the interval of photographing frames uniform, and reducing power consumption. , And a storage medium.

[0011]

According to a first aspect of the present invention, there is provided an image pickup apparatus, comprising: an image pickup unit for obtaining an image pickup signal by causing the image pickup unit to perform an image pickup operation in an exposed state; Performing a second imaging operation for obtaining an imaging signal by causing the imaging means to perform an imaging operation in a non-exposure state and an imaging operation in a non-exposure state; and obtaining an imaging signal obtained by the first imaging operation by the second imaging operation. And the imaging time of the first imaging operation was previously performed.
Signal processing means for performing the second imaging operation when the imaging time of the imaging operation is longer than that of the first imaging operation.

According to a sixth aspect of the present invention, there is provided an image pickup device, wherein the first image pickup operation for obtaining an image pickup signal by causing the image pickup device to perform an image pickup operation in an exposure state and the image pickup means in a non-exposure state. A second imaging operation for obtaining an imaging signal by performing an imaging operation is performed, and an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation. Signal processing means for performing the second imaging operation when the imaging time of the imaging operation is longer than a predetermined time.

According to a tenth aspect of the present invention, there is provided an imaging apparatus, comprising: an imaging unit; a first imaging operation for causing the imaging unit to perform an imaging operation in an exposure state to obtain an imaging signal; A second imaging operation for obtaining an imaging signal by performing an imaging operation is performed, and an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation. Is characterized by having signal processing means for determining whether or not to newly perform the second imaging operation according to the imaging time of the first imaging operation.

According to a twenty-first aspect of the present invention, there is provided an imaging apparatus comprising: an imaging unit; a first imaging operation in which the imaging unit performs an imaging operation in an exposure state to obtain an imaging signal; and an imaging unit in a non-exposure state. A second imaging operation is performed to obtain an imaging signal by performing an imaging operation according to the imaging time of the first imaging operation, and an imaging signal obtained by the first imaging operation is obtained by the second imaging operation. Processing with the imaging signal
Signal processing means for performing the second imaging operation when the imaging time of the first imaging operation is longer than the imaging time of the first imaging operation performed earlier.

Further, the image pickup apparatus according to the present invention provides an image pickup means, a first image pickup operation in which the image pickup means performs an image pickup operation in an exposure state to obtain an image pickup signal, and an image pickup means in a non-exposure state. A second imaging operation is performed to obtain an imaging signal by performing an imaging operation according to the imaging time of the first imaging operation, and an imaging signal obtained by the first imaging operation is obtained by the second imaging operation. Processing with the imaging signal
During continuous shooting, a signal processing unit that determines whether to newly perform the second imaging operation according to the imaging time of the first imaging operation is provided.

In the image processing method according to the present invention, a first imaging operation for obtaining an imaging signal by causing the imaging means to perform an imaging operation in an exposure state and an imaging operation to the imaging means in a non-exposure state are performed. In addition, a second imaging operation for obtaining an imaging signal is performed, and an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation. If the imaging time is longer than the imaging time of the previously performed first imaging operation, the second
Is performed.

In the image processing method according to a twenty-fourth aspect of the present invention, a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposure state to obtain an image pickup signal and an image pickup operation to the image pickup means in a non-exposure state are performed. In addition, a second imaging operation for obtaining an imaging signal is performed, and an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation. It is characterized in that whether or not the second imaging operation is newly performed is determined according to the imaging time of the first imaging operation.

Further, in the image processing method according to the twenty-fifth aspect, the first imaging operation in which the imaging means performs the imaging operation in the exposure state to obtain an imaging signal and the first imaging operation in the non-exposure state are performed by the imaging means. A second imaging operation for obtaining an imaging signal by performing an imaging operation according to an imaging time of the imaging operation is performed, and an imaging signal obtained by the first imaging operation is converted into an imaging signal obtained by the second imaging operation. And performing the second imaging operation when the imaging time of the first imaging operation is longer than the imaging time of the previously performed first imaging operation.

The image processing method according to the twenty-sixth aspect is characterized in that the image pickup means performs an image pickup operation in an exposure state to obtain an image pickup signal, and the first image pickup means in the non-exposure state causes the image pickup means to perform the first operation. A second imaging operation for obtaining an imaging signal by performing an imaging operation according to an imaging time of the imaging operation is performed, and an imaging signal obtained by the first imaging operation is converted into an imaging signal obtained by the second imaging operation. And during continuous shooting,
It is characterized in that whether to newly perform the second imaging operation is determined according to the imaging time of the first imaging operation.

A computer-readable storage medium according to claim 27, wherein a first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and an imaging operation performed by the imaging unit in a non-exposure state. Performing a second imaging operation of obtaining an imaging signal by performing an operation, processing an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation, and A program for performing the second imaging operation when the imaging time of the imaging operation is longer than the imaging time of the first imaging operation performed earlier.

A computer-readable storage medium according to claim 29, wherein the first imaging operation in which the imaging means performs an imaging operation in an exposure state to obtain an imaging signal, and the imaging means in the non-exposure state. A second imaging operation is performed to obtain an imaging signal by performing an operation, and an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation. And a program for determining whether to newly perform the second imaging operation according to the imaging time of the first imaging operation.

A computer-readable storage medium according to claim 29, wherein the first imaging operation for causing the imaging means to perform an imaging operation in an exposure state to obtain an imaging signal and the non-exposure state to the imaging means in the non-exposure state. A second imaging operation is performed to obtain an imaging signal by performing an imaging operation according to an imaging time of the first imaging operation, and an imaging signal obtained by the first imaging operation is obtained by the second imaging operation. A program that performs processing with an imaging signal and performs the second imaging operation when the imaging time of the first imaging operation is longer than the imaging time of the first imaging operation performed earlier. And

A computer-readable storage medium according to claim 29, wherein the first image-capturing operation in which the image-capturing means performs an image-capturing operation in an exposure state to obtain an image-capturing signal, and the image-capturing means in the non-exposure state. A second imaging operation is performed to obtain an imaging signal by performing an imaging operation according to an imaging time of the first imaging operation, and an imaging signal obtained by the first imaging operation is obtained by the second imaging operation. In addition to a program for processing with an image pickup signal, during continuous shooting, there is provided a program for determining whether or not to newly perform the second image pickup operation according to the image pickup time of the first image pickup operation.

[0024]

[0025]

[0026]

[0027]

[0028]

[0029]

[0030]

[0031]

[0032]

[0033]

[0034]

[0035]

[0036]

[0037]

[0038]

[0039]

[0040]

[0041]

[0042]

[0043]

[0044]

[0045]

[0046]

[0047]

[0048]

[0049]

[0050]

[0051]

[0052]

[0053]

[0054]

[0055]

[0056]

[0057]

[0058]

[0059]

[0060]

[0061]

[0062]

[0063]

[0064]

[0065]

[0066]

[0067]

[0068]

[0069]

[0070]

[0071]

[0072]

[0073]

[0074]

[0075]

[0076]

[0077]

[0078]

[0079]

[0080]

[0081]

[0082]

[0083]

[0084]

[0085]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of an image pickup apparatus, an image processing apparatus, an image processing method and a storage medium according to the present invention will be described. The image processing device according to the present embodiment is applied to an electronic camera.

[First Embodiment] FIG. 1 is a block diagram showing a configuration of an electronic camera according to a first embodiment.
In the figure, reference numeral 100 denotes an image processing device. Reference numeral 12 denotes a shutter having an aperture function for controlling the amount of exposure of the image sensor 14. An image sensor 14 converts an optical image into an electric signal.

The photographing lens 31 in the lens unit 300
The light beam incident on the lens mount 30 is
The optical image is formed as an optical image on the image sensor 14 guided by the single-lens reflex method through the mirrors 6 and 106, the mirror 130 and the shutter 12.

Reference numeral 16 denotes an A / D converter for converting an analog signal output from the image sensor 14 into a digital signal. Reference numeral 18 denotes an image sensor 14, an A / D converter 16, and a D /
This is a timing generation circuit that supplies a clock signal and a control signal to the A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on data from the A / D converter 16 or data from the memory control circuit 22.
The image processing circuit 20 performs predetermined arithmetic processing using the captured image data as needed, and the system control circuit 50 executes the exposure (shutter) control unit 4 based on the obtained arithmetic result.
A TTL (through-the-lens) type AF (autofocus) process, an AE (automatic exposure) process, and an EF (flash pre-emission) process for controlling the distance measurement control unit 42 are performed. Further, the image processing circuit 20 performs predetermined arithmetic processing using the captured image data, and performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

In this embodiment, since the distance measurement control unit 42 and the photometry control unit 46 are provided exclusively, the system control circuit 50 uses the distance measurement control unit 42 and the photometry control unit 46 to perform an AF (automatic Focus) processing, AE (auto exposure) processing, EF (flash light control) processing, and AF (auto focus) processing, AE (auto exposure) processing, EF (flash light control) using the image processing circuit 20. A configuration may be adopted in which each processing of the processing is not performed.

The distance measurement control section 42 and the photometry control section 4
6 to perform each of an AF (autofocus) process, an AE (automatic exposure) process, and an EF (flash light control) process. Further, the image processing circuit 20 performs an AF (autofocus) process and an AE (automatic Exposure) processing and EF (flash light control) processing may be performed.

Reference numeral 22 denotes a memory control circuit, which includes an A / D converter 16, a timing generation circuit 18, an image processing circuit 20,
It controls the image display memory 24, D / A converter 26, memory 30, and compression / decompression circuit 32.

The data from the A / D converter 16 is supplied to the image display memory 2 via the image processing circuit 20 and the memory control circuit 22 or directly via the memory control circuit 22.
4 or the memory 30.

24 is an image display memory, and 26 is a D / A converter. Reference numeral 28 denotes an image display unit composed of a TFT type LCD. The image data for display written in the image display memory 24 is sent to the image display unit 28 via the D / A converter 26.
Will be displayed. When sequentially displaying image data captured by the image display unit 28, an electronic finder function can be realized. Further, the image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50. When the display is turned off, the power consumption of the image processing apparatus 100 can be significantly reduced. Can be.

Reference numeral 30 denotes a memory for storing photographed still images and moving images, and has a sufficient storage capacity to store a predetermined number of still images and moving images for a predetermined time. Therefore, even in continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed. The memory 30 can also be used as a work area for the system control circuit 50.

32 is an adaptive discrete cosine transform (ADCT)
A compression / decompression circuit for compressing / decompressing image data by, for example, reading an image stored in the memory 30 and performing compression or decompression processing, and writing the processed data to the memory 30. These data are stored in a recording medium together with information at the time of capturing the image data, for example, information such as shooting date and time, continuous shooting, panoramic shooting, and the like.

Reference numeral 40 denotes a shutter control unit that controls the shutter 12 in cooperation with an aperture control unit 340 that controls the aperture 312 based on photometric information from the photometric control unit 46.
Reference numeral 42 denotes a distance measurement control unit for performing AF (auto focus) processing, and the photographing lens 3 in the lens unit 300
The beam incident on the lens 10 is stopped by the aperture 312 and the lens mount 30.
By entering through a single-lens reflex system via the mirrors 6, 106, the mirror 130, and the sub-mirror for distance measurement (not shown),
The in-focus state of an image formed as an optical image is measured.

Reference numeral 46 denotes a photometric control unit for performing AE (automatic exposure) processing. The photometric control unit 46 converts the light incident on the photographing lens 310 in the lens unit 300 into an aperture 312, lens mounts 306 and 106, a mirror 130, and a photometric submirror The exposure state of the image formed as an optical image is measured by entering the image through a single-lens reflex system via a (not shown). The photometry control unit 46 also has an EF (flash light control) processing function in cooperation with the flash unit 48. 4
Reference numeral 8 denotes a flash unit, which has a function of projecting AF auxiliary light and a function of controlling flash light.

As described above, the system control circuit 50 operates based on the operation result calculated by the image processing circuit 20 using the image data picked up by the image pickup device 14.
Can perform exposure control and AF (autofocus) control using the video TTL method for the exposure (shutter) control unit 40, aperture control unit 340, and distance measurement control unit 342.

Also, the measurement result by the distance measurement control unit 42
The AF is performed by using the calculation result obtained by calculating the image data captured by the image sensor 14 by the image processing circuit 20.
(Autofocus) control may be performed. Further, the measurement result by the photometry control unit 46 and the image sensor 14
Exposure control may be performed using the calculation result obtained by calculating the image data captured by the image processing circuit 20 using the image data.

Reference numeral 50 denotes a system control circuit for controlling the entire image processing apparatus 100, which includes a well-known CPU and the like. Reference numeral 52 denotes a memory for storing constants, variables, programs, and the like for the operation of the system control circuit 50. Reference numeral 54 denotes a display unit having a liquid crystal display device, a speaker, and the like for displaying an operation state, a message, and the like in characters, images, sounds, and the like in accordance with the execution of the program in the system control circuit 50. It is installed at one or more places that are easily visible in the vicinity. The display unit 54
It is composed of a combination of a CD, an LED, a sounding element, and the like. Some functions of the display unit 54 are provided in the optical viewfinder 104.

Among the display contents of the display unit 54, those displayed on the LCD or the like include a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, a remaining number of images that can be shot. Display, shutter speed display, aperture value display, exposure compensation display, flash display, red-eye reduction display, macro shooting display, buzzer setting display,
Clock battery level display, battery level display, error display, information display with multiple digits, display of detached state of recording media 200 and 210, communication I / F operation display, date / time display, connection with external computer There is a display indicating the status.

Of the display contents of the display unit 54, those displayed in the optical viewfinder 104 include a focus display, a shooting ready display, a camera shake warning display, a flash charge display, a flash charge completion display, and a shutter speed display. , An aperture value display, an exposure correction display, a recording medium writing operation display, and the like.

Further, among the display contents of the display unit 54, L
The display on the ED etc. includes, for example, an in-focus display, a shooting ready display, a camera shake warning display, a flash charging display, a flash charging completed display, a recording medium writing operation display, a macro shooting setting notification display, and a secondary battery charging display. and so on.

[0105] Of the display contents of the display unit 54, those displayed on a lamp or the like include, for example, a self-timer notification lamp. This self-timer notification lamp is AF
It may be shared with the auxiliary light.

Reference numeral 56 denotes an electrically erasable and recordable nonvolatile memory in which a program described later is stored, and an EEPROM or the like is used as the nonvolatile memory. 6
Reference numerals 0, 62, 64, 66, 68, and 70 denote operation units for inputting various operation instructions of the system control circuit 50. The operation unit includes one or more switches, dials, a touch panel, pointing by gaze detection, and a voice recognition device. Composed of combinations. Details of these operation units are shown below.

Reference numeral 60 denotes a mode dial switch, which is an automatic shooting mode, a program shooting mode, a shutter speed priority shooting mode, an aperture priority shooting mode, a manual shooting mode, a depth of focus priority (depth) shooting mode, a portrait shooting mode, and a landscape shooting. Each function shooting mode such as a mode, a close-up shooting mode, a sports shooting mode, a night scene shooting mode, and a panoramic shooting mode can be switched and set.

Reference numeral 62 denotes a shutter switch (SW1), which is turned on during the operation of a shutter button (not shown), and performs AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and E
An instruction to start an operation such as F (flash pre-emission) processing is given.

Reference numeral 64 denotes a shutter switch (SW2) which is turned on when the operation of a shutter button (not shown) is completed. The shutter switch (SW2) 64 performs an exposure process of writing a signal read out from the image sensor 12 to the memory 30 via the A / D converter 16 and the memory control circuit 22, an image processing circuit 20 and a memory control circuit 22.
Instruct the start of a series of processing, that is, a developing process using the calculation in step 3, reading image data from the memory 30, compressing by the compression / decompression circuit 32, and writing image data to the recording media 200 and 201.

Reference numeral 66 denotes a reproduction switch which stores an image photographed in the photographing mode in the memory 30 or the recording medium 20.
0, 210, and instructs the start of a reproduction operation to be displayed on the image display unit 28.

Reference numeral 68 denotes a single / continuous shooting switch. When the shutter switch SW2 is pressed, a single shooting mode in which one frame is shot and a standby state is set, and a shutter switch SW2
While the button is pressed, a continuous shooting mode in which shooting is continuously performed can be set.

An operation unit 70 includes various buttons, a touch panel, etc., and includes a menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single-shot / continuous-shot / self-timer switching button,
Menu move + (plus) button, menu move-(minus) button, playback image move + (plus) button, playback image-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, panorama mode A selection / switch button for setting selection and switching of various functions when performing shooting and playback of an image and the like; a determination / execution button for setting determination and execution of various functions when performing shooting and playback of a panorama mode and the like; An image display ON / OFF switch for setting ON / OFF of the image display unit 28, and a quick review ON for setting a quick review function for automatically reproducing image data taken immediately after shooting.
A / OFF switch, a compression mode switch which is a switch for selecting a compression rate of JPEG compression, or a CCD RAW mode for digitizing a signal of an image sensor as it is and recording it on a recording medium;
The auto-focus operation starts when a playback switch and a shutter switch SW1 that can set various function modes such as a multi-screen playback / erase mode and a PC connection mode are pressed, and once in focus, the focus state is maintained. Servo AF that continues autofocus operation continuously during one-shot AF mode and pressing shutter switch SW1
There is an AF mode setting switch capable of setting a mode.

The functions of the plus button and the minus button are provided with a rotary dial switch so that numerical values and functions can be selected more easily.

Reference numeral 72 denotes a power switch, which can be set to switch between a power-on mode and a power-off mode of the image processing apparatus 100. Further, a lens unit 300 connected to the image processing apparatus 100, an external strobe, a recording medium 200,
The power-on and power-off settings of various accessory devices such as 210 can also be switched and set.

Reference numeral 80 denotes a power supply control unit, which includes a battery detection circuit,
It comprises a DC-DC converter, a switch circuit for switching a block to be energized, and the like, and detects the presence / absence of a battery, the type of the battery, the remaining battery level, and based on the detection result and an instruction from the system control circuit 50. DC-D
The C converter is controlled to supply a required voltage to each unit including the recording medium for a required period.

Reference numerals 82 and 84 denote connectors, 86 a primary battery such as an alkaline battery or a lithium battery, a NiCd battery,
The power supply unit includes a secondary battery such as a NiMH battery and a Li battery, and an AC adapter.

Reference numerals 90 and 94 denote interfaces with recording media such as memory cards and hard disks, reference numerals 92 and 96 denote connectors for connection to recording media such as memory cards and hard disks, and reference numeral 98 denotes recording media 200 and 210 to connectors 92 and 96. Is a recording medium attachment / detachment detection unit that detects whether or not is attached.

In the present embodiment, two interfaces and connectors for attaching a recording medium are provided, but the interface and connectors for attaching a recording medium may be provided in a single or an arbitrary number. In addition, as an interface and a connector of different standards, those conforming to standards such as a PCMCIA card and a CF (compact flash) card may be used.

Further, when the interfaces 90 and 94 and the connectors 92 and 96 are configured using a standard such as a PCMCIA card or a CF (Compact Flash) card, a LAN card, a modem card, a US
By connecting various communication cards such as a B card, an IEEE 1394 card, a P1284 card, a SCSI card, a PHS and other communication cards, image data and management attached to the image data with other peripheral devices such as a computer and a printer. It is possible to transfer information to each other.

Reference numeral 104 denotes an optical finder, which converts a light beam incident on the taking lens 310 into a stop 312, lens mounts 306 and 106, and a mirror 13 by a single-lens reflex method.
It is possible to guide the light through 0, 132 and display it as an optical image. Thus, it is possible to perform photographing using only the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, such as a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display,
An exposure compensation display and the like are provided.

Reference numeral 110 denotes a communication unit, and RS232C, U
It has various communication functions such as SB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication. 1
Reference numeral 12 denotes a connector for connecting the image processing apparatus 100 to another device by the communication unit 110, or an antenna for performing wireless communication.

Reference numeral 120 denotes an interface for connecting the image processing apparatus 100 to the lens unit 300 in the lens mount 106. Reference numeral 122 denotes a connector for electrically connecting the image processing apparatus 100 to the lens unit 300. Reference numeral 124 denotes a lens attachment / detachment detection unit that detects whether the lens unit 300 is attached to the lens mount 106 and / or the connector 122.

The connector 122 has functions for transmitting control signals, status signals, data signals, and the like between the image processing apparatus 100 and the lens unit 300, and for supplying currents of various voltages. Further, the connector 122 may be configured to transmit not only electric communication but also optical communication, voice communication, and the like.

Reference numerals 130 and 132 denote mirrors, which guide light rays incident on the photographing lens 310 to the optical finder 104 by a single-lens reflex method. The mirror 132 may have either a quick return mirror configuration or a half mirror configuration.

[0125] Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 including a semiconductor memory and a magnetic disk, an interface 204 with the image processing apparatus 100, and a connector 206 for connecting to the image processing apparatus 100. Reference numeral 210 denotes a recording medium such as a memory card or a hard disk, similar to the recording medium 200. Recording medium 21
Reference numeral 0 denotes a recording unit 212 including a semiconductor memory or a magnetic disk, an interface 214 with the image processing apparatus 100, and a connector 216 for connecting to the image processing apparatus 100.

Reference numeral 300 denotes an interchangeable lens type lens unit. A lens mount 306 mechanically couples the lens unit 300 with the image processing apparatus 100. The lens mount 306 includes various functions for electrically connecting the lens unit 300 to the image processing apparatus 100.

Reference numeral 310 denotes a photographing lens, and reference numeral 312 denotes an aperture. Reference numeral 320 denotes an interface for connecting the lens unit 300 to the image processing apparatus 100 in the lens mount 306. A connector 322 electrically connects the lens unit 300 to the image processing apparatus 100.

The connector 322 transmits a control signal, a status signal, a data signal, and the like between the image processing apparatus 100 and the lens unit 300, and has a function of supplying various currents or supplying a current. Further, the connector 322 may be configured to transmit not only an electric signal but also an optical signal, an audio signal, and the like.

Reference numeral 340 denotes a shutter control unit 40 for controlling the shutter 12 based on the photometric information from the photometric control unit 46.
An aperture control unit that controls the aperture 312 in cooperation with. Reference numeral 342 denotes a distance measurement control unit that controls focusing of the photographing lens 310. A zoom control unit 344 controls zooming of the photographing lens 310. Reference numeral 350 denotes a lens system control circuit that controls the entire lens unit 300. The lens system control circuit 350 includes identification information such as a memory for storing constants, variables, and programs for operation, numbers unique to the lens unit 300, management information,
It also has a function of a non-volatile memory that holds function information such as an open aperture value, a minimum aperture value, and a focal length, and current and past set values.

An operation of the electronic camera having the above configuration will be described. 2, 3 and 4 show the image processing apparatus 10
9 is a flowchart showing a shooting operation processing procedure of No. 0. This processing program is stored in a storage medium such as the nonvolatile memory 56, is loaded into the memory 52, and is executed by the CPU in the system control circuit 50.

When the power is turned on such as when the battery is replaced, the system control circuit 50 initializes flags, control variables, and the like, and performs necessary predetermined initial settings for each unit of the image processing apparatus 100 (step S101). Further, the system control circuit 5
0 clears both the dark capture flag and the continuous shooting start flag stored in the internal memory or the memory 52 (steps S102 and S103).

The system control unit 50 includes a power switch 72
Is determined, and it is determined whether or not the power switch 72 is set to power OFF (step S10).
4). When the power switch 72 is set to power-off, the display on each display unit is changed to an end state, necessary parameters including flags and control variables, setting values, and setting modes are recorded in the nonvolatile memory 56, After performing a predetermined end process such as shutting off unnecessary power of each unit of the image processing apparatus 100 including the image display unit 28 by the power supply control unit 80 (Step S105), the process returns to Step S102.

On the other hand, when the power switch 72 is set to power ON, the system control circuit 50
Based on 0, it is determined whether or not the remaining capacity of the power supply 86 such as a battery or the operation state has a problem in the operation of the image processing apparatus 100 (step S106). If you determine that there is a problem,
After giving a predetermined warning by displaying an image or outputting a sound on the display unit 54 (step S107), the process returns to the step S102.

On the other hand, if it is determined that there is no problem with the power supply 86, the system control circuit 50 determines the setting position of the mode dial switch 60, and
It is determined whether or not is set to the shooting mode (step S108). When the mode dial switch 60 is set to another mode, the system control circuit 50
Executes a process according to the selected mode (step S
109), after execution, the process returns to step S102.

On the other hand, when the mode dial switch 60 is set to the photographing mode, the recording media 200, 201
To determine whether or not the recording media 200, 20
Acquisition of the management information of the image data recorded in the image processing apparatus 1 and the operation state of the recording media 200 and 201
It is determined whether or not there is a problem in the operation of step S11, particularly in the operation of recording and reproducing image data on the recording medium (step S11)
0). When it is determined that there is a problem, a predetermined warning is issued by displaying an image or outputting sound on the display unit 54 (step S107), and the process returns to step S102.

On the other hand, if it is determined in step S110 that there is no problem, the system control circuit 50 checks the selection state of the single / continuous shooting switch 68 for selecting single / continuous shooting (step S111). If single shooting is selected, the single shooting / continuous shooting flag is set to single shooting (step S1).
12) If the continuous shooting is selected, the single shooting / continuous shooting flag is set to continuous shooting (step S113). In the single / continuous shooting switch 68, when the shutter switch SW2 is pressed, a single shooting mode in which one frame is shot and a standby state is set, and continuous shooting in which shooting is continuously performed while the shutter switch SW2 is pressed. It is possible to arbitrarily switch between the modes. The state of the single / continuous shooting flag is stored in the internal memory of the system control circuit 50 or the memory 52.
Is stored.

The system control circuit 50 uses the display unit 54 to display various setting states of the image processing apparatus 100 using images and sounds (step S114). Here, when the image display switch of the image display unit 28 is ON, various setting states of the image processing apparatus 100 may be displayed by the image display unit 28 using images and sounds.

It is determined whether or not the shutter switch SW1 has been pressed (step S115). If the shutter switch SW1 has not been pressed, the process returns to step S102. On the other hand, when the shutter switch SW1 is pressed, the system control circuit 50 performs a distance measurement process to focus the photographing lens 310 on a subject, performs a photometry process, and determines an aperture value and a shutter speed. Photometric processing is performed (step S116). In the photometric processing, flash setting is performed if necessary. The details of the distance measurement / photometry processing will be described later.

The aperture value (Av) is set according to the stored photometric data and / or setting parameters and the photographing mode set by the mode dial switch 60.
Value) and the shutter speed (Tv value), and the charge accumulation time Tn is determined according to the determined shutter speed (Tv value) and stored in the internal memory or the memory 52 of the system control circuit 50 (step S117). ).

The system control circuit 50 determines the state of the single shooting / continuous shooting flag stored in the internal memory or the memory 52 (step S118). If single shooting has been set, the process proceeds to step S125. The state of the shutter switch SW2 is determined.

As described above, if single shooting is set in step S118, the process proceeds to step S125 without performing the dark capture process in step S122 described later, and the shutter switch SW is set in step S125.
It is possible to reduce the release time lag when 2 is pressed.

On the other hand, if continuous shooting has been set in step S118, the system control circuit 50 determines the state of the continuous shooting start flag stored in its internal memory or memory 52 (step S119). If the continuous shooting start flag has been set, the process proceeds to step S125.

As described above, if the continuous shooting start flag has been set in step S119, the process proceeds to step S125 without performing the dark capture process in step S122, so that once the continuous shooting is started, After the next frame is photographed in the process of step S129, the dark capture process is performed in step S134 if necessary.

As a result, during continuous shooting, it is possible to reduce the shutter release time lag by giving priority to the shooting timing over the dark capture process.

On the other hand, if the continuous shooting start flag has been cleared in step S119, the system control circuit 50 determines the state of the dark capture flag stored in its internal memory or memory 52 (step S120), and Has been released, step S12
Proceed to step 2.

On the other hand, if the dark capture flag has been set in step S120, the system control circuit 50
Is determined by the system control circuit 5 in step S117.
It is determined whether the relationship between the new charge storage time Tn stored in the internal memory 0 or the memory 52 and the previous charge storage time Tn-1 is Tn> Tn-1 (step S12).
1) If Tn> Tn−1 is not satisfied, the process proceeds to step S125.

As described above, when the newly determined charge storage time Tn is equal to or shorter than the previously used charge storage time Tn-1, the dark image correction processing is performed using the already captured dark image data in step S136. Since it is possible to perform the processing, new dark capture processing is not performed in step S122.

On the other hand, if Tn> Tn-1 in step S121, that is, if the newly determined charge storage time Tn is longer than the previously used charge storage time Tn-1, a new charge storage time Tn is set. To perform the dark capture process again (step S122). In the dark capture process,
With the shutter 12 closed, the system control circuit 50 accumulates noise components such as dark current of the image sensor 14 for the same time as the main photographing, and reads out the noise image signal after the accumulation.

By performing a correction calculation process using the dark image data captured in the dark capture process,
The captured image data can be corrected for image quality deterioration such as dark current noise generated in the image sensor 14 and pixel defects due to scratches unique to the image sensor 14. The details of this dark capture processing will be described later.

As described above, continuous shooting is set in step S118, the shutter switch SW2 has not been pressed to start continuous shooting, and the shutter switch SW1 has been set.
If the dark capture process has not yet been performed since the button was pressed, or the dark capture process was performed since the shutter switch SW1 was pressed, but the charge accumulation time Tn
In the case where it is determined that the imaging condition has changed due to the change and the dark capture process is performed again, the dark capture process is performed prior to the execution of the continuous shooting, thereby performing step S12.
When the shutter switch SW2 is pressed in step 5 to perform continuous shooting, if it is not necessary to repeat the dark capture process during continuous shooting, the continuous shooting frame interval can be made substantially constant.

When the dark capture processing is completed in step S122, the system control circuit 50 stores the charge storage time Tn used this time as Tn-1 indicating the charge storage time used last time. Tn-1 is replaced by Tn as Tn-1 = Tn and updated (step S12).
3) The dark capture flag is set and stored in the internal memory of the system control circuit 50 or the memory 52 (step S124).

It is determined whether or not the shutter switch SW2 is pressed (step S125). If not, the system control circuit 50 determines whether or not the shutter switch SW1 is pressed (step S126). If the shutter switch SW1 is pressed, the process proceeds to step S
Returning to the process at 116, a series of processes is repeated. On the other hand, when the shutter switch SW1 is released in step S126, the process returns to step S102.

On the other hand, if the shutter switch SW2 is pressed in step S125, the system control circuit 50 determines whether or not the image storage buffer area capable of storing the captured image data is in the memory 30 (step S12).
7) If there is no area capable of storing new image data in the image storage buffer area of the memory 30, a predetermined warning is given on the display unit 54 by displaying an image or outputting sound (step S128), and then the processing in step S102 is performed. Return to processing.

For example, immediately after the maximum number of continuous shots that can be stored in the image storage buffer area of the memory 30 has been performed, the data is read from the memory 30 and stored in the storage media 200, 210.
Has not yet been recorded on the recording medium 200 or 210, and one empty area cannot be secured in the image storage buffer area of the memory 30 yet.

When the photographed image data is compressed and stored in the image storage buffer area of the memory 30,
In consideration of the fact that the amount of image data after compression differs according to the setting of the compression mode, it is determined whether or not the storable area is in the image storage buffer area of the memory 30 in step S12.
7 is determined.

If the memory 30 has an image storage buffer area capable of storing the captured image data, the system control circuit 50 reads out the image pickup signal which has been picked up and stored for a predetermined time from the image pickup device 12, and outputs the signal to the A / D converter 16. , Via the image processing circuit 20 and the memory control circuit 22, or
A photographing process for writing photographed image data in a predetermined area of the memory 30 is executed directly from the D converter via the memory control circuit 22 (step S129). Details of this photographing process will be described later.

When the photographing process is completed, the system control circuit 5
0 determines the state of the single shooting / continuous shooting flag stored in the internal memory or the memory 52 (step S13).
0). As a result of determining the state of the single shooting / continuous shooting flag, if single shooting has been set, the system control circuit 50 performs dark capture processing (step S134).

As described above, when single shooting is set in step S130, the release time lag when the shutter switch SW2 is pressed can be reduced by performing the dark capturing process after performing the shooting process. Becomes

On the other hand, if the state of the single / continuous shooting flag is determined in step S130, and if continuous shooting is set,
The system control circuit 50 determines the state of the continuous shooting start flag stored in the internal memory or the memory 52 (step S131).

If the continuous shooting start flag has been released, the system control circuit 50 sets the continuous shooting start flag (step S132).

As described above, when the continuous shooting start flag has been cleared, since the dark image data necessary for the developing process in step S136 has already been captured in the dark capturing process in step S122, the continuous shooting is performed. Is started and the first frame shooting is performed in step S129,
The process proceeds to the second frame of the continuous shooting without performing the dark capture process in step S134.

As a result, it is possible to shorten the interval between the consecutively shot frames of the first frame and the second frame during the continuous shooting to shorten the shutter release time lag of the second frame.

On the other hand, if the continuous shooting start flag has been set in step S131, the system control circuit 50 determines a new charge accumulation time Tn stored in the internal memory or the memory 52 of the system control circuit 50 in step S117. And the relationship between the previous charge accumulation time Tn-1 and Tn> Tn-1
Is determined (step S133), and Tn> Tn
If not -1, the process proceeds to step S136.

As described above, when the newly determined charge storage time Tn is equal to or shorter than the previously used charge storage time Tn-1, the dark image correction processing is performed using the already captured dark image data, and the development in step S136 is performed. Since it is possible to perform the processing, new dark capture processing is not performed in step S134.

Thus, if continuous shooting is set in step S130 and the shutter switch SW2 is kept pressed and the second and subsequent frames of continuous shooting are performed, it is not necessary to perform the dark capture process again. The shutter release time lag for the second and subsequent frames can be reduced. On the other hand, if Tn> Tn−1 in step S133,
That is, if the newly determined charge storage time Tn is longer than the previously used charge storage time Tn-1, a new charge storage time Tn is set and the dark capture processing in step S134 is performed again.

As described above, when the continuous shooting is set in step S130 and the shutter switch SW2 is continuously pressed and the second and subsequent frames of the continuous shooting are being performed, the dark capture process has already been performed. However, only when it is determined that the imaging condition has changed due to the change in the charge accumulation time Tn and it is necessary to perform the dark capture process again, the step S
At 134, dark capture processing is performed.

Thus, if the exposure of the subject is kept constant during continuous shooting, there is no need to repeat the dark capture process during continuous shooting, and the intervals between continuous shooting frames are made substantially constant. Becomes possible.

In step S134, the system control circuit 50 accumulates noise components such as dark current of the image pickup device 14 in the state where the shutter 12 is closed for the same time as the actual photographing, and reads out the noise image signal that has been accumulated. I do.

By performing a correction calculation process using the dark image data captured in the dark capture process,
The captured image data can be corrected for image quality degradation such as dark current noise generated in the image sensor 14 and pixel defects due to flaws inherent in the image sensor 14. The details of this dark capture processing will be described later.

When the dark capture processing has been completed, the system control circuit 50 stores the charge accumulation time Tn used this time as Tn-1 indicating the charge accumulation time used last time. = Tn and Tn-1 is replaced with Tn and updated (step S135).

The system control circuit 50 reads out a part of the image data written in a predetermined area of the memory 30 through the memory control circuit 22 and performs a WB (white balance) integration operation necessary for performing a developing process. OB (optical black) integration calculation processing is performed, and the calculation results are stored in the internal memory of the system control circuit 50 or the memory 52.

The system control circuit 50 uses the memory control circuit 22 and, if necessary, the image processing circuit 20 to read the photographed image data written in a predetermined area of the memory 30 and to read the internal memory of the system control circuit 50. Alternatively, using the operation result stored in the memory 52, the AW
B (auto white balance) processing, gamma conversion processing,
Various development processes including a color conversion process are performed (Step S13)
6).

In the development processing in step S136, a dark correction calculation processing for canceling the dark current noise of the image sensor 14 is performed by performing a subtraction processing using the dark image data captured in the dark capture processing.

Then, the system control circuit 50 reads out the image data written in a predetermined area of the memory 30, and
The image compression processing corresponding to the set mode is performed by the compression / decompression circuit 32, and the image data that has been photographed and subjected to a series of processing is written in the empty image portion of the image storage buffer area of the memory 30 (step S138). .

With the execution of a series of photographing operations, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30, and
4. A recording process for writing to the recording media 200, 210 such as a memory card or a compact flash card via the connectors 92, 96 is started (step S13).
8).

This recording start process is executed on the image data each time a new series of image data is written into a free image portion of the image storage buffer area of the memory 30.

While the image data is being written to the recording media 200 and 210, the display 54 displays a recording medium writing operation display such as blinking an LED to clearly indicate that the writing operation is being performed. I do.

Then, the system control circuit 50 determines whether or not the shutter switch SW1 has been pressed (step S139). If the shutter switch SW1 has been released, the process returns to step S102. On the other hand, if the shutter switch SW1 is in the pressed state, the state of the single / continuous shooting flag stored in the internal memory of the system control circuit 50 or the memory 52 is determined (step S140), and single shooting is set. If the shutter switch SW1 is released, the current process is repeated until the shutter switch SW1 is released.

On the other hand, if continuous shooting has been set, the process returns to step S116 to perform continuous shooting, and
Repeat a series of processing.

FIG. 5 is a flowchart showing the distance measuring / photometric processing procedure in step S116. In the distance measurement / photometry processing, various signals are exchanged between the system control circuit 50 and the aperture control unit 340 or the distance measurement control unit 342 through the interface 120, the connector 122, the connector 322, the interface 320, and the lens system control circuit 350. Done through.

The system control circuit 50 includes the image pickup device 14,
Using the distance measurement control unit 42 and the distance measurement control unit 342, the AF
(Autofocus) processing is started (step S20)
1).

The system control circuit 50 controls the taking lens 31
The light rays incident on the lens mount 30 are
The focus state of the image formed as an optical image is determined by causing the light to enter the distance measurement control unit 42 via the mirrors 6 and 106, the mirror 130, and the distance measurement sub-mirror (not shown),
Until it is determined that the distance measurement (AF) is in focus, the distance measurement control unit 34
While the photographing lens 310 is driven by using the AF control 2, the AF control for detecting the in-focus state using the distance measurement control unit 42 is executed (steps S202 and S203).

If it is determined that the focus detection (AF) is in focus, the system control circuit 50 determines the focus detection point from among the plurality of focus detection points in the shooting screen, and determines the determined focus detection point. The distance measurement data and / or the setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52 together with the data (step S204).

Subsequently, the system control circuit 50 starts AE (auto exposure) processing using the photometry control section 46 (step S205). The system control circuit 50 causes the light beam incident on the photographing lens 310 to enter the photometric control unit 46 via the stop 312, the lens mounts 306 and 106, the mirrors 130 and 132, and a photometric lens (not shown). Then, the exposure state of the image formed as an optical image is measured, and photometric processing is performed using the exposure (shutter) control unit 40 until the exposure (AE) is determined to be appropriate (steps S206 and S207).

If it is determined in step S207 that the exposure (AE) is appropriate, the system control circuit 50 stores the photometric data and / or the setting parameters in the internal memory or the memory 52 of the system control circuit 50 (step S207A). ).

The system control circuit 50 determines the aperture value (Av value) and the shutter speed (Av value) according to the exposure (AE) result detected in the photometry processing in step S206 and the photographing mode set by the mode dial switch 60. Tv value) is determined.

Here, the determined shutter speed (Tv
Value), the system control circuit 50 controls the imaging device 14
Is determined, and the photographing process and the dark capture process are performed in the same charge accumulation time.

On the basis of the measurement data obtained in the photometry processing in step S206, the system control circuit 50 determines whether or not a flash is required (step S208). If a flash is required, a flash flag is set. The flash unit 48 is charged until the charging is completed (steps S209 and S210). Then, when the charging of the flash unit 48 is completed, the present process is terminated and the process returns to the main process.

FIGS. 6 and 7 are flowcharts showing the photographing processing procedure in step S129. In this photographing processing, the system control circuit 50 and the aperture control unit 340
Alternatively, exchange of various signals with the distance measurement control unit 342 is performed via the interface 120, the connector 122, the connector 322, the interface 320, and the lens system control circuit 350.

The system control circuit 50 moves the mirror 130 to the mirror-up position by a mirror driving section (not shown) (step S301).
The aperture control unit 340 drives the aperture 312 to a predetermined aperture value in accordance with the photometric data stored in the internal memory or the memory 52 (step S302).

After performing the charge clear operation of the image pickup device 14 (step S303), the system control circuit 50 starts the charge accumulation of the image pickup device 14 (step S304), and opens the shutter 12 by the shutter control section 40 (step S304). In step S305, the exposure of the image sensor 14 is started (step S306).

Then, it is determined whether or not the flash unit 48 is necessary based on the flash flag (step S30).
7) If necessary, the flash unit 48 emits light (step S308).

The system control circuit 50 waits for the end of exposure of the image sensor 14 in accordance with the photometric data (step S3).
09) When the exposure is completed, the shutter 12 is closed by the shutter control unit 40 (step S310), and the exposure of the image sensor 14 is completed.

The system control circuit 50 includes the aperture control unit 34
The aperture 312 is driven to an open aperture value by 0 (step S311), and the mirror 130 is moved to a mirror down position by a mirror driving unit (not shown) (step S312).

It is determined whether or not the set charge accumulation time has elapsed (step S313). If the set charge accumulation time has elapsed, the system control circuit 50 terminates the charge accumulation of the image sensor 14 (step S314). ), The charge signal is read from the image sensor 14, and the memory 30 is read via the memory control circuit 22 via the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16. The photographed image data is written in the predetermined area (step S315). When a series of processes is completed, the present process is completed and the process returns to the main process.

FIG. 8 shows step S122 and step S122.
14 is a flowchart illustrating a dark capture processing procedure in 134. The system control circuit 50 controls the imaging device 14
After the charge clearing operation (step S401), the charge accumulation of the image sensor 14 is started with the shutter 12 closed (step S402).

It is determined whether or not the set predetermined charge accumulation time has elapsed (step S403). When the charge accumulation time has elapsed, the system control circuit 50
Is completed (step S404), the charge signal is read out from the imaging device 14, and is read via the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16. Then, the image data (dark image data) is written in a predetermined area of the memory 30 via the memory control circuit 22 (step S405). Thereafter, the present process is terminated and the process returns to the main process.

By performing development processing using the dark captured data, the captured image data is corrected for image quality deterioration such as dark current noise generated in the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14. It is possible to

The dark image data is held in a predetermined area of the memory 30 until a new distance measurement and photometry processing is performed or the power of the image processing apparatus 100 is turned off. Then, the dark image data is used when the image data captured by the subsequent execution of the photographing process is read out from the image sensor 14 and subjected to the developing process. Alternatively, the image data obtained by executing the shooting process first is
It is used when developing processing using this dark image data in a state where it is read from the image sensor 14 and written in the memory 30.

FIG. 9 is a diagram showing the flow of the photographing operation of this embodiment. As described in detail with reference to FIGS. 2 to 8, in the case of single shooting, when the shutter switch SW1 is pressed, the AF
The (auto focus) operation and the AE (auto exposure) operation are repeatedly performed until the shutter switch SW2 is pressed, and when the shutter switch SW2 is pressed, dark capture processing is performed after photographing is performed.

On the other hand, in the case of continuous shooting, when the shutter switch SW1 is pressed, an AF (auto focus) operation is performed.
After performing the AE (auto exposure) operation and the dark capture processing, the AF (auto focus) operation and the AE (auto exposure) operation are repeatedly performed until the shutter switch SW2 is pressed. At this time, the shutter speed (Tv value) is reduced. If it is determined that the imaging condition has changed due to the change in the charge storage time Tn determined accordingly, dark capture processing is performed again. When the shutter switch SW2 is pressed, the photographing process, the AF (autofocus) operation, and the AE (auto exposure) operation are continuously performed while the shutter switch SW2 is pressed. At this time, the shutter speed (Tv value)
When it is determined that the imaging condition has changed due to the change in the charge accumulation time Tn determined according to the above, the dark capture processing is performed again.

[Second Embodiment] The electronic camera of the second embodiment has the same hardware configuration as that of the first embodiment. However, the electronic camera of the second embodiment has the same hardware configuration as that of the electronic camera shown in FIGS. 2, 3 and 4. Some differences. The different imaging operation processing will be described below.

FIG. 10, FIG. 11, FIG. 12, and FIG. 13 are flowcharts showing the procedure of the photographing operation of the image processing apparatus 100 according to the second embodiment. This processing program is stored in a storage medium such as the nonvolatile memory 56 as in the first embodiment, loaded into the memory 52, and executed by the CPU in the system control circuit 50.

When the power is turned on, such as when the battery is replaced, the system control circuit 50 initializes flags, control variables, and the like, and performs necessary initial settings for each part of the image processing apparatus 100 (step S501). Further, the system control circuit 5
0 clears both the dark capture flag and the continuous shooting start flag stored in the internal memory or the memory 52 (steps S502 and S503).

The system control unit 50 includes a power switch 72
Is determined, and it is determined whether or not the power switch 72 is set to power-off (step S50).
4). When the power switch 72 is set to power-off, the display on each display unit is changed to an end state, necessary parameters including flags and control variables, setting values, and setting modes are recorded in the nonvolatile memory 56, After performing a predetermined end process such as shutting off unnecessary power of each unit of the image processing apparatus 100 including the image display unit 28 by the power supply control unit 80 (step S505), the process returns to the step S502.

On the other hand, when the power switch 72 is set to power ON, the system control circuit 50
Based on 0, it is determined whether or not the remaining capacity of the power supply 86 such as a battery or the operation state has a problem in the operation of the image processing apparatus 100 (step S506). If you determine that there is a problem,
After giving a predetermined warning by displaying an image or outputting a sound on the display unit 54 (step S507), the process returns to the step S502.

On the other hand, if it is determined that there is no problem with the power supply 86, the system control circuit 50 determines the setting position of the mode dial switch 60, and
It is determined whether or not is set to the photographing mode (step S508). When the mode dial switch 60 is set to another mode, the system control circuit 50
Executes a process according to the selected mode (step S
509), and returns to the processing of step S502 after execution.

On the other hand, when the mode dial switch 60 is set to the photographing mode, the recording media 200, 201
To determine whether or not the recording media 200, 20
Acquisition of the management information of the image data recorded in the image processing apparatus 1 and the operation state of the recording media 200 and 201
It is determined whether or not there is a problem in the operation of step S51, in particular, the operation of recording and reproducing image data on the recording medium (step S51)
0). If it is determined that there is a problem, a predetermined warning is issued by displaying an image or outputting sound on the display unit 54 (step S507), and the process returns to step S502.

On the other hand, if it is determined in step S510 that there is no problem, the system control circuit 50 checks the selection state of the single shooting / continuous shooting switch 68 for selecting single shooting / continuous shooting (step S511). If single shooting is selected, the single shooting / continuous shooting flag is set to single shooting (step S5).
12) If the continuous shooting is selected, the single / continuous shooting flag is set to continuous shooting (step S513). In the single / continuous shooting switch 68, when the shutter switch SW2 is pressed, a single shooting mode in which one frame is shot and a standby state is set, and continuous shooting in which shooting is continuously performed while the shutter switch SW2 is pressed. It is possible to arbitrarily switch between the modes. The state of the single / continuous shooting flag is stored in the internal memory of the system control circuit 50 or the memory 52.
Is stored.

[0210] The system control circuit 50 displays various setting states of the image processing apparatus 100 using images and sounds using the display unit 54 (step S514). Here, when the image display switch of the image display unit 28 is ON, various setting states of the image processing apparatus 100 may be displayed by the image display unit 28 using images and sounds.

[0211] It is determined whether or not the shutter switch SW1 has been pressed (step S515). If the shutter switch SW1 has not been pressed, the process returns to step S502. On the other hand, when the shutter switch SW1 is pressed, the system control circuit 50 performs a distance measurement process to focus the photographing lens 310 on a subject, performs a photometry process, and determines an aperture value and a shutter speed. Photometric processing is performed (step S516). In the photometric processing, flash setting is performed if necessary. This distance measurement / photometry processing is the same as in the first embodiment.

The aperture value (Av) is set according to the stored photometric data and / or setting parameters and the photographing mode set by the mode dial switch 60.
Value) and shutter speed (Tv value), and the charge accumulation time Tn is determined according to the determined shutter speed (Tv value) and stored in the internal memory of the system control circuit 50 or the memory 52 (step S517). ).

[0213] The system control circuit 50 proceeds to step S51.
It is determined whether or not the relationship between the new charge storage time Tn determined in Step 7 and the predetermined charge storage time Tc is Tn> Tc (Step S518). If Tn> Tc, the process proceeds directly to step S520, and if Tn> Tc, Tn = Tc is set (step S519), and the process proceeds to step S520.

As described above, when the newly determined charge storage time Tn is equal to or shorter than the predetermined charge storage time Tc, the newly determined charge storage time Tc is used to perform the dark capture process. The storage time Tn is replaced with a predetermined charge storage time Tc.

[0215] With this arrangement, when the exposure time is within the predetermined charge accumulation time Tc, it is not necessary to frequently change the charge accumulation time and repeat the dark capture process according to the change in the exposure condition of the subject, and the shutter release time lag is reduced. In addition to the reduction, it is possible to make the continuous shooting frame interval during continuous shooting substantially uniform.

Further, since it is not necessary to repeat the dark capture process frequently, unnecessary power consumption can be suppressed.

As the predetermined charge storage time Tc, a charge storage time used for photographing at a shutter speed faster than 1/60 second and dark capture processing is appropriate. In this case, the predetermined charge accumulation time Tc is an appropriate value exceeding 17 milliseconds.
This is a time such as 0 millisecond. Further, the predetermined charge accumulation time Tc may be another arbitrary value, or may have a plurality of values in a stepwise manner instead of one, and among them, an appropriate value according to the operation mode or the photographing mode of the image processing apparatus 100. May be selected.

If the newly determined charge storage time Tn is longer than the predetermined charge storage time Tc, the newly determined charge storage time Tn is not replaced with the predetermined charge storage time Tc. Thereby, the predetermined charge accumulation time T
When a change in the exposure state of the subject (a change in the imaging condition) that exceeds c occurs, the dark capture process can be performed again using the newly determined charge accumulation time.

Subsequently, the system control circuit 50 determines the state of the single / continuous shooting flag stored in the internal memory or the memory 52 (step S520). If single shooting has been set, the process proceeds to step S527. Then, the state of the shutter switch SW2 is determined.

As described above, if single shooting has been set in step S520, the process proceeds to step S527 without performing the dark capture process in step S524 described later.
It is possible to reduce the release time lag when 2 is pressed.

On the other hand, if continuous shooting has been set in step S520, the system control circuit 50 determines the state of the continuous shooting start flag stored in its internal memory or memory 52 (step S521). If the continuous shooting start flag has been set, the process proceeds to step S527.

As described above, when the continuous shooting start flag is set in step S521, the process proceeds to step S527 without performing the dark capturing process in step S524, and once the continuous shooting is started, After taking the next frame in the process of step S531, dark capture processing is performed as necessary.

Thus, during continuous shooting, it is possible to reduce the shutter release time lag by giving priority to the shooting timing over the dark capture process.

On the other hand, if the continuous shooting start flag has been cleared in step S521, the system control circuit 50 determines the state of the dark capture flag stored in its internal memory or memory 52 (step S522), Has been released, step S52
Proceed to step 4.

On the other hand, if the dark capture flag has been set in step S522, the system control circuit 50
Is determined by the system control circuit 5 in step S517.
It is determined whether the relationship between the new charge storage time Tn stored in the internal memory 0 or the memory 52 and the previous charge storage time Tn-1 is Tn> Tn-1 (step S52).
3) If Tn> Tn−1 is not satisfied, the process proceeds to step S527.

As described above, when the newly determined charge storage time Tn is equal to or shorter than the previously used charge storage time Tn-1, the dark image correction processing is performed using the already captured dark image data in step S538. Since it is possible to perform the processing, new dark capture processing in step S524 is not performed.

On the other hand, if Tn> Tn-1 in step S523, that is, if the newly determined charge storage time Tn is longer than the previously used charge storage time Tn-1, a new charge storage time Tn is set. To perform the dark capture process again (step S524). In the dark capture process,
With the shutter 12 closed, the system control circuit 50 accumulates noise components such as dark current of the image sensor 14 for the same time as the main photographing, and reads out the noise image signal after the accumulation.

By performing a correction calculation process using the dark image data captured in the dark capture process,
The captured image data can be corrected for image quality deterioration such as dark current noise generated in the image sensor 14 and pixel defects due to scratches unique to the image sensor 14. This dark capture processing is the same as in the first embodiment.

As described above, continuous shooting is set in step S520, the shutter switch SW2 has not been pressed to start continuous shooting, and the shutter switch SW1 has been set.
If the dark capture process has not yet been performed since the button was pressed, or the dark capture process was performed since the shutter switch SW1 was pressed, but the charge accumulation time Tn
When the dark capture process is performed again after it is determined that the imaging condition has changed due to the change in the image capturing condition, the dark capture process is performed prior to the execution of the continuous shooting, thereby performing step S5.
If the shutter switch SW2 is pressed at 27 and the continuous shooting is performed, and if it is not necessary to repeat the dark capture process during the continuous shooting, the continuous shooting frame interval can be made substantially constant.

When the dark capture processing is completed in step S524, the system control circuit 50 stores the charge storage time Tn used this time as Tn-1 indicating the charge storage time used last time. Tn-1 is replaced with Tn as Tn-1 = Tn and updated (step S52).
5), a dark capture flag is set and stored in the internal memory of the system control circuit 50 or the memory 52 (step S526).

It is determined whether or not the shutter switch SW2 is pressed (step S527). If not, the system control circuit 50 determines whether or not the shutter switch SW1 is pressed (step S528). If the shutter switch SW1 is pressed, the process proceeds to step S
Returning to the process of 516, a series of processes is repeated. On the other hand, if the shutter switch SW1 is released in step S528, the process returns to step S502.

On the other hand, if the shutter switch SW2 is pressed in step S527, the system control circuit 50 determines whether or not there is an image storage buffer area capable of storing captured image data in the memory 30 (step S52).
9) If there is no area in the image storage buffer area of the memory 30 where new image data can be stored, a predetermined warning is given on the display unit 54 by displaying an image or outputting sound (step S530). Return to processing.

For example, immediately after the maximum number of continuous shots that can be stored in the image storage buffer area of the memory 30 has been performed, the storage media 200 and 210 are read from the memory 30 and read.
Has not yet been recorded on the recording medium 200 or 210, and one empty area cannot be secured in the image storage buffer area of the memory 30 yet.

In the case where the photographed image data is compressed and stored in the image storage buffer area of the memory 30,
In consideration of the fact that the amount of image data after compression differs according to the setting of the compression mode, it is determined whether or not the storable area is in the image storage buffer area of the memory 30 in step S52.
This is determined by the process of No. 9.

If the memory 30 has an image storage buffer area capable of storing the captured image data, the system control circuit 50 reads out the image pickup signal which has been picked up and stored for a predetermined time from the image pickup device 12, and reads out the A / D converter 16. , Via the image processing circuit 20 and the memory control circuit 22, or
A photographing process for writing photographed image data in a predetermined area of the memory 30 is executed directly from the D converter via the memory control circuit 22 (step S531). This photographing process is the same as in the first embodiment.

When the photographing processing is completed, the system control circuit 5
0 determines the state of the single shooting / continuous shooting flag stored in the internal memory or the memory 52 (step S53).
2). As a result of the determination of the single shooting / continuous shooting flag, if single shooting has been set, the system control circuit 50 performs dark capture processing (step S536).

As described above, when single shooting is set in step S532, the release time lag when the shutter switch SW2 is pressed can be reduced by performing the dark capturing process after performing the shooting process. Becomes

On the other hand, as a result of determining the state of the single shooting / continuous shooting flag in step S532, if continuous shooting is set,
The system control circuit 50 determines the state of the continuous shooting start flag stored in the internal memory or the memory 52 (step S533).

If the continuous shooting start flag has been released, the system control circuit 50 sets a continuous shooting start flag (step S534).

As described above, when the continuous shooting start flag has been cleared, since the capture of the dark image data necessary for the development processing in step S538 has already been performed in the dark capture processing in step S524, the continuous shooting is performed. Is started and the first frame shooting is performed in step S531,
The process proceeds to the shooting of the second frame in the continuous shooting without performing the dark capture process in step S536.

As a result, it is possible to shorten the interval between the consecutively shot frames of the first frame and the second frame during the continuous shooting to shorten the shutter release time lag of the second frame.

On the other hand, if the continuous shooting start flag has been set in step S533, the system control circuit 50 determines in step S517 and stores the new charge accumulation time Tn stored in the internal memory of the system control circuit 50 or the memory 52. And the relationship between the previous charge accumulation time Tn-1 and Tn> Tn-1
Is determined (step S535), and Tn> Tn
If it is not -1, the process proceeds to step S538.

As described above, when the newly determined charge storage time Tn is equal to or shorter than the previously used charge storage time Tn-1, the dark image correction processing is performed using the already captured dark image data, and the development in step S538 is performed. Since processing can be performed, new dark capture processing is not performed in step S536.

In this manner, if continuous shooting is set in step S532 and the shutter switch SW2 is kept pressed and the second and subsequent frames of continuous shooting are performed, it is not necessary to perform the dark capture process again. The shutter release time lag for the second and subsequent frames can be reduced. On the other hand, if Tn> Tn−1 in step S535,
That is, if the newly determined charge storage time Tn is longer than the previously used charge storage time Tn-1, the new charge storage time Tn is set and the dark capture processing in step S536 is performed again.

As described above, when the continuous shooting is set in step S532, and the shutter switch SW2 is kept pressed and the second and subsequent frames of the continuous shooting are being performed, the dark capture processing has already been performed. However, only when it is determined that the imaging condition has changed due to the change in the charge accumulation time Tn and it is necessary to perform the dark capture process again, step S5
At 36, dark capture processing is performed.

Thus, if the exposure of the subject is kept constant during continuous shooting, there is no need to repeat the dark capture process during continuous shooting, and the intervals between continuous shooting frames are made substantially constant. Becomes possible.

[0247] In step S536, the system control circuit 50 accumulates noise components such as dark current of the image sensor 14 with the shutter 12 closed in the same time as the main photographing, and reads out a noise image signal that has been accumulated. I do.

By performing a correction calculation process using the dark image data captured in the dark capture process,
The captured image data can be corrected for image quality degradation such as dark current noise generated in the image sensor 14 and pixel defects due to flaws inherent in the image sensor 14. This dark capture processing is the same as in the first embodiment.

When the dark capture processing is completed, the system control circuit 50 stores the charge accumulation time Tn used this time as Tn-1 indicating the charge accumulation time used last time. = Tn and replace Tn-1 with Tn and update (step S537).

The system control circuit 50 reads out a part of the image data written in a predetermined area of the memory 30 through the memory control circuit 22 and performs a WB (white balance) integration operation necessary for performing a developing process. OB (optical black) integration calculation processing is performed, and the calculation results are stored in the internal memory of the system control circuit 50 or the memory 52.

The system control circuit 50 reads out the photographed image data written in a predetermined area of the memory 30 by using the memory control circuit 22 and, if necessary, the image processing circuit 20. Alternatively, using the operation result stored in the memory 52, the AW
B (auto white balance) processing, gamma conversion processing,
Various development processes including a color conversion process are performed (step S53).
8).

In the development processing of step S538, a subtraction processing is performed using the dark image data captured in the dark capture processing, and a dark correction calculation processing for canceling dark current noise or the like of the image sensor 14 is also performed.

Then, the system control circuit 50 reads out the image data written in a predetermined area of the memory 30 and
An image compression process corresponding to the set mode is performed by the compression / decompression circuit 32, and image data that has been shot and subjected to a series of processes is written in a free image portion of the image storage buffer area of the memory 30 (step S539). .

With the execution of a series of photographing operations, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30, and
4. A recording process for writing to the recording media 200, 210 such as a memory card or a compact flash card via the connectors 92, 96 is started (step S54).
0).

This recording start process is executed on the image data each time a new series of image data is written into the empty image portion of the image storage buffer area of the memory 30.

While the image data is being written to the recording media 200 and 210, the display 54 displays a recording medium writing operation display such as blinking an LED to clearly indicate that the writing operation is being performed. I do.

Then, the system control circuit 50 determines whether or not the shutter switch SW1 has been pressed (step S541). If the shutter switch SW1 has been released, the process returns to step S502. On the other hand, if the shutter switch SW1 has been pressed, the state of the single / continuous shooting flag stored in the internal memory of the system control circuit 50 or the memory 52 is determined (step S542), and single shooting is set. If the shutter switch SW1 has been released, the current process is repeated until the shutter switch SW1 is released.

On the other hand, if continuous shooting has been set, the process returns to step S516 to perform continuous shooting, and
Repeat a series of processing.

In the second embodiment, as the predetermined charge accumulation time Tc, the charge accumulation time used for photographing at a shutter speed faster than 1/60 second and dark capture processing is appropriate. In this case, the predetermined charge accumulation time Tc is an appropriate value exceeding 17 milliseconds.
For example, 20 milliseconds and 30 milliseconds.

The predetermined charge accumulation time Tc may be another arbitrary value, or may have a plurality of values in a stepwise manner instead of one, and among them, an appropriate value according to the operation mode or the photographing mode of the image processing apparatus 100. The value may be selected.

An appropriate value may be selected according to the characteristics of the lens unit 300 to be mounted. For example, since the camera shake limit shutter speed changes depending on the focal length of the attached lens unit and the presence or absence of the anti-shake function, the predetermined charge accumulation time Tc may be set accordingly.

As described above, the predetermined charge accumulation time Tc is:
The time may be set to be equal to or longer than the time corresponding to the shutter speed at which shooting can be performed without camera shake. Further, the predetermined charge accumulation time Tc may be set equal to 1/60 second or longer.
Further, the predetermined charge accumulation time Tc may be set to be equal to or longer than the time corresponding to the shutter speed that can be tuned to the flash.

In the above embodiment, the single / continuous shooting is switched using the single / continuous shooting switch 68. However, the single shooting / continuous shooting is switched according to the operation mode selection by the mode dial switch 60.
Switching of continuous shooting may be performed.

Further, in the above embodiment, the charge accumulation time of the main photographing process and the charge accumulation time of the dark capture process are equal. However, the charge accumulation time is within a range in which sufficient data for correcting dark current noise and the like can be obtained. Alternatively, different charge accumulation times may be used.

Further, steps S122, S134, S
During the execution of the dark capture processing operation in 524 and S536, the photographing operation cannot be performed, so that the display unit 54 and / or the image display unit 28 displays an image indicating that the image processing apparatus 100 is in a busy state, You may make it output a sound.

In the above embodiment, the photographing operation is performed by moving the mirror 130 to the mirror up position and the mirror down position. However, the photographing operation is performed without moving the mirror 130 as a half mirror. Is also good.

Further, the recording media 200 and 210 are
Not only memory cards such as MCIA cards and compact flashes, hard disks, but also micro DATs, magneto-optical disks, optical disks such as CD-R and CD-WR, DV
It may be constituted by a phase change type optical disk such as D. Also,
The recording media 200 and 210 may be composite media in which a memory card and a hard disk are integrated. further,
A configuration may be adopted in which a part of the composite medium is removable.

In the above embodiment, the recording medium 20
Although 0 and 210 are separated from the image processing apparatus 100 and can be connected arbitrarily, any or all of the recording media may be fixed to the image processing apparatus 100.

Further, the recording media 200 and 210 may be configured to be singly or arbitrarily connected to the image processing apparatus 100.

Further, in the above embodiment, the case where the present invention is applied to an electronic camera for photographing a still image has been described, but the present invention can also be applied to a digital video camera for photographing a moving image.

Further, in the above-described embodiment, the case where the charge accumulation time Tn is determined and the dark capture processing is performed after the distance measurement / photometry processing is completed has been described.
When c is used, it is not necessary to wait for the AE to be determined in the distance measurement / photometry processing, so that the dark capture processing may be performed without waiting for the end of the distance measurement / photometry. In this case, AF
The processing operation, the AE processing operation, and the dark capture processing operation may be started simultaneously, or the AF processing operation and / or the AE processing operation may be started after the dark capture processing operation is started.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of one device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or an apparatus. In this case, by reading out a storage medium storing a program represented by software for achieving the present invention into a system or an apparatus, the system or the apparatus can enjoy the effects of the present invention.

FIG. 14 is a diagram showing a memory map of the nonvolatile memory 56 as a storage medium. The nonvolatile memory 56 composed of an EEPROM includes a main photographing operation processing program module shown in the flowcharts of FIGS. 2, 3 and 4, a distance measurement / photometry processing program module shown in a flowchart of FIG. A shooting processing program module shown in the flowchart, a dark capture processing program module shown in the flowchart of FIG. 8, a main shooting operation processing program module shown in the flowcharts of FIGS. 10, 11, 12 and 13, and the like are stored.

The storage medium for supplying the program module is not limited to ROM, but may be, for example, a floppy disk, hard disk, optical disk, magneto-optical disk,
A D-ROM, a CD-R, a DVD, a magnetic tape, a nonvolatile memory card, or the like can be used.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, The case where the CPU of the function expansion board or the function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is realized by the processing.

The above is the description of the embodiments of the present invention. However, the present invention is not limited to the structures of these embodiments, and the functions described in the claims or the structures of the embodiments are described. The present invention can be applied to any configuration that can achieve the functions of the.

For example, in the above embodiment, during continuous shooting, a dark image is taken in before shooting.
This can be applied to the present invention even after photographing.

In the above embodiment, whether or not to take in a dark image is determined at the time of continuous shooting or at the time of servo auto-focusing. The present invention can be applied to any occasion such as at the time.

Further, the present invention is not limited to the determination of whether or not to take in a dark image according to the above embodiment, but takes in a dark image every time the imaging time for taking in a dark image changes. And so on.

Further, the software configuration and the hardware configuration of the above embodiments can be replaced as appropriate.

Further, the present invention may combine the above-described embodiments or their technical elements as necessary.

Further, the present invention is directed to a system in which the whole or a part of the configuration of the claims or the embodiment forms one unit, but is combined with another unit. Or it may be an element that constitutes the means.

Further, the present invention relates to an electronic still camera, a video movie camera, a camera using a silver halide film, and the like.
The present invention can be applied to various forms of cameras, image capturing means other than cameras, means applied to these cameras and image capturing means, and elements constituting these means.

[0284]

As described above, according to the present invention,
It is possible to prevent missing a precious shutter opportunity, to keep the shooting frame interval constant,
It is possible to provide an imaging device, an image processing method, and a storage medium that can reduce power consumption.

[0285]

[0286]

[0287]

[0288]

[0289]

[0290]

[0291]

[0292]

[0293]

[0294]

[0295]

[0296]

[0297]

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an electronic camera according to a first embodiment.

FIG. 2 is a flowchart showing a shooting operation processing procedure of the image processing apparatus 100.

FIG. 3 is a flowchart illustrating a shooting operation processing procedure of the image processing apparatus 100 continued from FIG. 2;

FIG. 4 is a flowchart illustrating a shooting operation processing procedure of the image processing apparatus 100 following FIGS. 2 and 3;

FIG. 5 is a flowchart showing a ranging / photometry processing procedure in step S116.

FIG. 6 is a flowchart showing a shooting processing procedure in step S129.

FIG. 7 is a flowchart illustrating a shooting processing procedure in step S129 following FIG. 6;

FIG. 8 is a flowchart showing a dark capture processing procedure in steps S122 and S134.

FIG. 9 is a diagram illustrating a flow of a shooting operation according to the present embodiment.

FIG. 10 is an image processing apparatus 100 according to a second embodiment.
9 is a flowchart showing a shooting operation processing procedure of FIG.

FIG. 11 is a flowchart illustrating a shooting operation processing procedure of the image processing apparatus 100 continued from FIG. 10;

FIG. 12 is an image processing apparatus 1 following FIGS. 10 and 11;
9 is a flowchart illustrating a shooting operation processing procedure of a shooting operation 00;

FIG. 13 is a flowchart illustrating a shooting operation processing procedure of the image processing apparatus 100 following FIG. 10, FIG. 11, and FIG.

FIG. 14 is a diagram showing a memory map of a nonvolatile memory 56 as a storage medium.

[Explanation of symbols]

 14 Image sensor 30, 52 Memory 50 System control circuit 56 Non-volatile memory 60 Mode dial switch 62 Shutter switch SW1 64 Shutter switch SW2 68 Single shooting / continuous shooting switch

──────────────────────────────────────────────────続 き Continuation of front page (56) References JP-A-8-51571 (JP, A) JP-A-62-107579 (JP, A) JP-A-4-109777 (JP, A) JP-A-8-108 307775 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) H04N 5/225-5/243 H04N 5/335

Claims (30)

(57) [Claims] An imaging unit that performs an imaging operation in an exposed state to obtain an imaging signal, and an imaging unit that performs an imaging operation in a non-exposure state to obtain an imaging signal. A second imaging operation is performed, an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation, and an imaging time of the first imaging operation is set earlier. An imaging device comprising: a signal processing unit that performs the second imaging operation when the imaging time is longer than the imaging time of the first imaging operation. 2. The image processing apparatus according to claim 1, wherein the signal processing unit is configured to, if the imaging time of the first imaging operation is not longer than the imaging time of the previously performed first imaging operation, perform the previously performed second imaging operation. The imaging apparatus according to claim 1, wherein an imaging signal obtained by the first imaging operation is processed by an imaging signal of the second imaging operation performed according to an imaging time of the first imaging operation. 3. The image processing apparatus according to claim 2, further comprising a storage unit configured to store an image signal of the second image capturing operation performed according to an image capturing time of the previously performed first image capturing operation. Imaging device. 4. The storage device according to claim 2, wherein the storage unit stores the second data.
The imaging apparatus according to claim 3, wherein an imaging signal of the second imaging operation performed according to a longest imaging time of the first imaging operation is stored as an imaging signal of the imaging operation. 5. The signal processing unit newly executes the second imaging operation when the imaging time of the first imaging operation is the same as the imaging time of the first imaging operation performed earlier. The imaging apparatus according to claim 1, wherein the processing is not performed. 6. An image pickup means, a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposure state to obtain an image pickup signal, and an image pickup signal for obtaining an image pickup signal by causing the image pickup means to perform an image pickup operation in a non-exposure state. A second imaging operation is performed, an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation, and an imaging time of the first imaging operation is longer than a predetermined time. An image pickup apparatus comprising: signal processing means for performing the second image pickup operation when the length is long. 7. The image processing apparatus according to claim 1, wherein, when the imaging time of the first imaging operation is not longer than the predetermined time, the signal processing unit converts the imaging signal of the second imaging operation performed according to the predetermined time before. The imaging apparatus according to claim 6, wherein the imaging apparatus processes an imaging signal obtained by the first imaging operation. 8. The method according to claim 2, wherein the second operation is performed according to the predetermined time.
8. The imaging apparatus according to claim 7, further comprising storage means for storing an imaging signal of said imaging operation. 9. The imaging apparatus according to claim 6, wherein the signal processing unit does not newly perform the second imaging operation when the imaging time of the first imaging operation is a predetermined time. apparatus. 10. An image pickup means, a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposure state to obtain an image pickup signal, and an image pickup signal for obtaining an image pickup signal by causing the image pickup means to perform an image pickup operation in a non-exposure state. A second imaging operation is performed, and an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation.
And a signal processing unit for determining whether to newly perform the second imaging operation according to the imaging time of the imaging operation. 11. The signal processing means performs the second imaging operation when the imaging time of the first imaging operation is longer than the imaging time of the first imaging operation previously performed during continuous shooting. The imaging device according to claim 10, wherein the imaging is performed. 12. The signal processing means, if the imaging time of the first imaging operation is not longer than the imaging time of the first imaging operation previously performed during the continuous shooting, The imaging signal obtained by the first imaging operation is processed by the imaging signal of the second imaging operation performed according to the imaging time of the first imaging operation. Imaging device. 13. The storage device according to claim 12, further comprising a storage unit configured to store an image signal of the second imaging operation performed in accordance with an imaging time of the previously performed first imaging operation. Imaging device. 14. The storage means, as the stored image signal of the second image capturing operation, stores the image signal of the second image capturing operation performed according to the longest image capturing time of the first image capturing operation. 14. The method according to claim 13, wherein the information is stored.
An imaging device according to any one of the preceding claims. 15. The imaging apparatus according to claim 12, wherein the signal processing unit performs the second imaging operation when an imaging time of the first imaging operation is longer than a predetermined time. 16. The signal processing unit, when the imaging time of the first imaging operation is not longer than the predetermined time,
The second time previously performed according to the predetermined time during continuous shooting;
16. The imaging apparatus according to claim 15, wherein an imaging signal obtained by said first imaging operation is processed by an imaging signal of said imaging operation. 17. The imaging apparatus according to claim 16, further comprising storage means for storing an imaging signal of said second imaging operation performed according to said predetermined time. 18. The image processing apparatus according to claim 18, wherein the second imaging is performed when the imaging time of the first imaging operation is the same as the imaging time of the first imaging operation performed earlier during the continuous shooting. The imaging device according to claim 12, wherein no operation is performed. 19. The imaging apparatus according to claim 12, wherein the signal processing unit does not perform the second imaging operation when the imaging time of the first imaging operation is a predetermined time. 20. The image processing apparatus according to claim 10, wherein, when the imaging time of the first imaging operation is a predetermined time, the image processing signal of the second imaging operation previously performed according to the predetermined time during continuous shooting. 13. The imaging apparatus according to claim 12, wherein an imaging signal obtained by the first imaging operation is processed. 21. An image pickup means, wherein a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposure state to obtain an image pickup signal and an image pickup means in a non-exposure state to the image pickup means for an image pickup time of the first image pickup operation. Performing a second imaging operation of obtaining an imaging signal by performing a corresponding imaging operation, processing an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation, An imaging apparatus comprising: a signal processing unit configured to perform the second imaging operation when the imaging time of the first imaging operation is longer than the imaging time of the first imaging operation performed earlier. 22. An image pickup means, a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposure state to obtain an image pickup signal, and an image pickup means in the non-exposure state, for the image pickup time of the first image pickup operation A second imaging operation for obtaining an imaging signal by performing an imaging operation according to the second imaging operation is performed, and an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation. An imaging apparatus comprising: a signal processing unit that determines whether to newly perform the second imaging operation according to the imaging time of the first imaging operation during shooting. 23. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and a second imaging operation in which the imaging unit performs an imaging operation in a non-exposure state to obtain an imaging signal. Performing an image pickup signal obtained by the first image pickup operation with an image pickup signal obtained by the second image pickup operation, and processing the image pickup signal obtained by the first image pickup operation before the first image pickup time. The second imaging operation is performed when the imaging time of the imaging operation is longer than the imaging time of the imaging operation. 24. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and a second imaging operation in which the imaging unit performs an imaging operation in a non-exposure state to obtain an imaging signal. Performing an image pickup signal obtained by the first image pickup operation with an image pickup signal obtained by the second image pickup operation, and during continuous shooting, the image pickup signal according to the image pickup time of the first image pickup operation. An image processing method comprising: determining whether to newly perform a second imaging operation. 25. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and an imaging operation according to an imaging time of the first imaging operation in the non-exposure state. Perform a second imaging operation to obtain an imaging signal;
The image pickup signal obtained by the first image pickup operation is
And the second imaging operation is performed when the imaging time of the first imaging operation is longer than the imaging time of the previously performed first imaging operation. An image processing method comprising: 26. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and an imaging operation according to an imaging time of the first imaging operation in the non-exposure state. Perform a second imaging operation to obtain an imaging signal;
The image pickup signal obtained by the first image pickup operation is
Processing is performed using an imaging signal obtained by the imaging operation, and during continuous shooting, it is determined whether to newly perform the second imaging operation according to the imaging time of the first imaging operation. Image processing method. 27. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and a second imaging operation in which the imaging unit performs an imaging operation in a non-exposure state to obtain an imaging signal. Performing an image pickup signal obtained by the first image pickup operation with an image pickup signal obtained by the second image pickup operation, and processing the image pickup signal obtained by the first image pickup operation before the first image pickup time. A computer-readable storage medium having a program for performing the second imaging operation when the imaging time is longer than the imaging time of the imaging operation. 28. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and a second imaging operation in which the imaging unit performs an imaging operation in a non-exposure state to obtain an imaging signal. Performing an image pickup signal obtained by the first image pickup operation with an image pickup signal obtained by the second image pickup operation, and during continuous shooting, the image pickup signal according to the image pickup time of the first image pickup operation. A computer-readable storage medium having a program for determining whether to newly perform a second imaging operation. 29. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and an imaging operation according to an imaging time of the first imaging operation in the non-exposure state. Perform a second imaging operation to obtain an imaging signal;
The image pickup signal obtained by the first image pickup operation is
And the second imaging operation is performed when the imaging time of the first imaging operation is longer than the imaging time of the previously performed first imaging operation. A computer-readable storage medium having a program. 30. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and an imaging operation according to an imaging time of the first imaging operation in the non-exposure state. Perform a second imaging operation to obtain an imaging signal;
The image pickup signal obtained by the first image pickup operation is
And a program that determines whether or not to newly perform the second imaging operation according to the imaging time of the first imaging operation during continuous shooting while performing processing with the imaging signal obtained by the imaging operation. A computer-readable storage medium characterized by the above-mentioned.