JP2000228746A - Image pickup device, image processor, image processing method and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent deceleration of consecutively photographing frame by providing a first image pickup mode for executing storing of electric charges without exposing and a second image pickup mode for executing storing of electric charges by exposing, setting the electric charge storing time of an image pickup means in setting an automatic step exposure photographing mode and consecutively storing first and second picture data in respectively plural different exposing state. SOLUTION: A system control circuit 50 starts electric charge storing of an image pickup element 14 in a state where a shutter 12 is closed after executing the electric charge clearing operation of the element 14. In the case of passing a set prescribed electric charge storing time, the circuit 50 finishes the electric charge storing of the element 14 and after then reads an electric charge signal from the element 14 to write image data in the prescribed area of a memory 30 through an A/D converter 16, an image processing circuit 20 and a memory control circuit 22 or through the circuit 22 directly from the converter 16. Photographed image data can be corrected by develop-processing by using this image data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus, an image processing apparatus, an image processing method, and a storage medium, and more particularly, to an image pickup apparatus for capturing and recording a still image and / or a moving image, an image processing apparatus, and an image processing apparatus. The present invention relates to an image processing method to be applied and a storage medium storing a program for executing the image processing method.

[0002]

2. Description of the Related Art Conventionally, imaging devices such as electronic cameras for recording and reproducing still images and moving images captured by a solid-state imaging device such as a CCD using a memory card having a solid-state memory device as a recording medium have already been marketed. .

Further, by selecting a shooting mode, an aperture (A) for automatically increasing or decreasing the shutter speed so as to obtain an appropriate exposure according to an arbitrarily set aperture value.
v) Switching between a priority shooting mode and a shutter speed (Tv) priority shooting mode in which the aperture value is automatically increased or decreased so as to obtain an appropriate exposure according to an arbitrary set shutter speed. Some electronic still cameras make this possible.

In one photographing, a standard exposure value,
Some electronic still cameras have an AEB (Auto Exposure Bracketing) shooting mode that automatically exposes three frames of overexposure value and underexposure value. In an electronic camera provided with an image sensor having a narrow width, it is possible to easily obtain an optimal exposure.

When an image is picked up using a solid-state image pickup device such as a CCD, charge is accumulated in the solid-state image pickup device without exposure of the image pickup device in the same manner as in actual photographing, and the image pickup device is read out using dark image data read out therefrom. In this state, the actual photographed image data read out by accumulating electric charges in a state where the image is exposed is subjected to arithmetic processing to perform dark noise correction.

Accordingly, it is possible to correct high quality image data by correcting main photographed image data accompanied with image quality deterioration such as dark current noise generated in the image sensor and pixel defects due to minute scratches inherent to the image sensor. .

In particular, the dark current noise increases as the charge storage time of the image sensor increases and as the temperature rises. Therefore, a large image quality improvement effect is obtained when performing exposure for a long time or exposure at a high temperature. The dark noise correction process is a useful function for the user of the electronic camera.

[0008]

As described above, the dark current noise increases as the charge storage time of the image sensor increases, so that the charge storage time of the image sensor for acquiring this dark image data is increased. Needs to be determined according to the shutter speed (Tv value) obtained by exposure measurement.

On the other hand, in the aperture (Av) priority photographing mode, the AE
When performing B shooting, it is necessary to change the shutter speed for each frame when performing automatic step exposure shooting for three frames.

Therefore, in an image processing apparatus such as an electronic camera, when the shutter speed changes, a different charge accumulation time is set, and when the charge accumulation time changes, it becomes necessary to retake a dark image. In other words, when performing the automatic step-exposure shooting for three frames, the dark image must be shot again for each main shooting of one frame.

For this reason, when performing continuous shooting AEB in the aperture (Av) priority shooting mode, the dark image must be shot three times for each shot of continuous shooting, and each shot during continuous shooting is performed. The shooting interval is increased by the dark image shooting time, and the shutter release time lag is increased, so that valuable shutter chances are missed or the speed of continuous shooting frames is reduced.

An object of the present invention is to provide an image pickup apparatus, an image processing apparatus, an image processing method, and a storage medium capable of preventing a precious shutter chance from being missed and preventing a continuous shooting frame speed from lowering. Is what you do.

[0013]

According to the first aspect of the present invention, there is provided an image processing apparatus for recording a captured still image and / or a moving image on a recording medium without exposure. An imaging unit having a first imaging mode for accumulating electric charges in a second imaging mode and a second imaging mode for accumulating electric charges by performing exposure; a storage unit for storing imaging data output from the imaging unit; Automatic step-exposure shooting mode setting means for setting an automatic step-exposure shooting mode for continuously performing exposure state shooting; and when the automatic step-exposure shooting mode is set by the automatic step-exposure shooting mode setting means, A charge accumulation time determining unit that determines a charge accumulation time of the imaging unit based on imaging that requires the longest charge accumulation time in imaging in different exposure states; First control means for storing, in the storage means, first image data obtained by the imaging means in the first imaging mode for the charge accumulation time determined by the interval determination means; The storage of the second image data obtained by the imaging unit in the second imaging mode over the charge storage time determined by the charge storage time determination unit in a plurality of different ways. And a second control unit that continuously performs the exposure state.

According to the sixth aspect of the present invention, there is provided an image processing apparatus for recording a captured still image and / or moving image on a recording medium, wherein a first imaging mode in which charge is stored without exposure, Imaging means having a second imaging mode for performing and accumulating charge, storage means for storing imaging data output from the imaging means, and signal calculation means for reading and calculating the imaging data stored in the storage means An automatic step-exposure photographing mode setting means for setting an automatic step-exposure photographing mode for continuously photographing a plurality of different exposure states; and an automatic step-exposure photographing mode set by the automatic step-exposure photographing mode setting means. Occasionally, the charge accumulation that determines the charge accumulation time of the imaging unit based on the imaging that requires the longest charge accumulation time among the plurality of different exposure states And storing the unexposed image data obtained by the imaging means in the first imaging mode for the charge accumulation time determined by the charge accumulation time determination means in the storage means. After the first control unit and the storage of the unexposed image data in the storage unit, the imaging unit operates in the second imaging mode for the charge accumulation time determined by the charge accumulation time determination unit. An operation of storing image data of a subject obtained by imaging in the storage unit, and performing an image correction by the signal calculation unit based on the unexposed image data and the image data of the subject stored in the storage unit. And a second control means for continuously performing the operation for performing the process in a plurality of different exposure states.

Further, according to the present invention, there is provided an image pickup means comprising a first image pickup mode in which charge is stored without exposure and a second image pickup mode in which charge is stored by exposure. A storage unit for storing imaging data output by the imaging unit; and an automatic step exposure shooting mode setting unit for setting an automatic step exposure shooting mode for continuously shooting a plurality of different exposure states, and In an image processing method applied to an image processing apparatus that captures and records a moving image, when an automatic step-exposure shooting mode is set by the automatic step-exposure shooting mode setting unit, the automatic step-exposure shooting mode can be used during shooting in the plurality of different exposure states. A charge accumulation time determining step for determining a charge accumulation time of the imaging means based on photographing requiring the longest charge accumulation time; and a charge accumulation time determining step A first control step of causing the storage unit to store first image data obtained by the imaging unit in the first imaging mode over the determined charge storage time; and determining the charge storage time. Storing the second image data obtained by the imaging means in the second imaging mode in the storage means for the charge accumulation time determined in the step in a plurality of different exposure states; And a second control step.

According to the sixteenth aspect of the present invention, there is provided an image pickup means having a first image pickup mode in which charge is stored without exposure and a second image pickup mode in which charge is stored by performing exposure, and the image pickup means. Storage means for storing the image data output from the storage means, signal calculation means for reading and calculating the image data stored in the storage means, and an automatic step-exposure shooting mode for continuously shooting a plurality of different exposure states. Automatic step exposure photographing mode setting means for setting a still image and / or
Alternatively, in the image processing method applied to an image processing apparatus that captures and records a moving image, when the automatic step-exposure shooting mode setting unit sets the automatic step-exposure shooting mode, the plurality of shots in different exposure states are A charge accumulation time determining step for determining the charge accumulation time of the imaging means based on the imaging requiring the longest charge accumulation time, and the imaging over the charge accumulation time determined in the charge accumulation time determination step. After the first control step of storing unexposed image data obtained by capturing the image in the first imaging mode in the storage unit, and storing the unexposed image data in the storage unit, Image data of a subject obtained by the imaging means taking an image in the second imaging mode over the charge accumulation time determined in the charge accumulation time determining step The operation of storing in the storage means and the operation of causing the signal calculation means to perform image correction processing based on the unexposed image data and the image data of the subject stored in the storage means are performed by a plurality of different exposure operations. And a second control step performed continuously in the state.

Further, according to the twenty-first aspect of the present invention,
An imaging unit having a first imaging mode for performing charge accumulation without exposure and a second imaging mode for performing charge accumulation by performing exposure; a storage unit configured to store imaging data output by the imaging unit; Image processing apparatus which includes an automatic step exposure shooting mode setting means for setting an automatic step exposure shooting mode for continuously shooting different exposure states, and which is applied to an image processing apparatus which captures and records a still image and / or a moving image In a computer-readable storage medium storing a method as a program, the image processing method is configured such that when the automatic step exposure shooting mode is set by the automatic step exposure shooting mode setting means, the plurality of different exposure states are set. Charge accumulation time determination for determining the charge accumulation time of the imaging means based on the imaging requiring the longest charge accumulation time in imaging A first step of storing the first image data obtained by the imaging means in the first imaging mode over the charge accumulation time determined in the charge accumulation time determination step in the storage means in the storage means. And storing the second image data obtained by the imaging means in the second imaging mode over the charge accumulation time determined in the charge accumulation time determination step in the storage means. And a second control step of continuously performing this in a plurality of different exposure states.

According to the twenty-sixth aspect of the present invention, there is provided an imaging means having a first imaging mode in which charge is stored without exposure and a second imaging mode in which charge is stored by performing exposure, and the imaging means. Storage means for storing the image data output from the storage means, signal calculation means for reading and calculating the image data stored in the storage means, and an automatic step-exposure shooting mode for continuously shooting a plurality of different exposure states. Automatic step exposure photographing mode setting means for setting a still image and / or
Alternatively, in a computer-readable storage medium storing, as a program, an image processing method applied to an image processing apparatus that captures and records a moving image, the image processing method may include an automatic step exposure by the automatic step exposure shooting mode setting unit. A charge accumulation time determining step of determining the charge accumulation time of the imaging means based on the imaging requiring the longest charge accumulation time among the plurality of different exposure states when the imaging mode is set; A first control for storing, in the storage unit, unexposed image data obtained by the imaging unit in the first imaging mode over the charge storage time determined in the charge storage time determination step. And storing the unexposed image data in the storage means, and then determining the charge storage time determined in the charge storage time determining step. An operation of storing the image data of the subject obtained by the imaging unit in the second imaging mode over a period of time in the storage unit; and an operation of storing the unexposed image data stored in the storage unit. A second control step of continuously performing the operation of causing the signal calculation unit to perform the image correction process based on the image data of the subject in a plurality of different exposure states.

According to the thirty-first aspect of the present invention, an image pickup means, a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposure state to obtain an image pickup signal, and the image pickup means in a non-exposure state to the image pickup means. Performing a second imaging operation for obtaining an imaging signal by performing an imaging operation according to the first imaging operation, and converting an imaging signal obtained by the first imaging operation to an imaging signal obtained by the second imaging operation; Signal processing means for processing;
Instruction means for instructing to perform a predetermined plurality of times of imaging by changing the imaging time of the imaging operation of the second imaging operation, wherein the signal processing means responds to the instruction of the instruction means, and An image pickup apparatus for changing an operation method of the operation with respect to the first image pickup operation.

According to the invention described in claim 41, an image pickup means, a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposure state to obtain an image pickup signal, and an image pickup operation for the image pickup means in a non-exposure state Performing a second imaging operation to obtain an imaging signal by performing the second imaging operation, and processing the imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation; Instruction means for instructing to perform predetermined plural times of imaging by changing the imaging time of the first imaging operation, wherein the signal processing means responds to the instruction of the instruction means, This is an imaging apparatus that does not perform an imaging operation for each imaging.

According to the fifty-first aspect of the present invention, the first imaging operation in which the imaging means performs the imaging operation in the exposure state to obtain an imaging signal, and the first imaging operation in the non-exposure state is performed by the imaging means. Performing a second imaging operation of obtaining an imaging signal by performing a corresponding imaging operation, processing an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation, An image processing method for changing the manner of operation of the second imaging operation with respect to the first imaging operation in response to an instruction to perform a predetermined plurality of imagings with different imaging times of the first imaging operation. Things.

According to the invention of claim 52, the first imaging operation in which the imaging means performs an imaging operation in an exposure state to obtain an imaging signal, and the imaging operation in which the imaging means performs an imaging operation in a non-exposure state. A second imaging operation for obtaining a signal is performed, an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation, and the first imaging operation is performed.
An image processing method is provided in which the second imaging operation is not performed for each imaging in response to an instruction to perform a plurality of predetermined imaging operations by changing the imaging time of the imaging operation.

According to the invention of claim 53, the first imaging operation in which the imaging means performs the imaging operation in the exposure state to obtain an imaging signal, and the first imaging operation in the non-exposure state is performed by the imaging means. Performing a second imaging operation of obtaining an imaging signal by performing a corresponding imaging operation, processing an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation, A storage medium having contents for changing the manner of operation of the second imaging operation with respect to the first imaging operation in response to an instruction to perform a predetermined plurality of imagings with different imaging times of the first imaging operation It is assumed that.

According to the fifty-fourth aspect, an image pickup operation is performed by the image pickup means in the exposure state to obtain an image pickup signal, and an image pickup operation is performed by the image pickup means in the non-exposure state. A second imaging operation for obtaining a signal is performed, an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation, and the first imaging operation is performed.
In this case, the second imaging operation is not performed for each imaging in response to an instruction to perform a plurality of predetermined imaging operations by changing the imaging time of the imaging operation.

[0025]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing a configuration of an image processing apparatus according to an embodiment of the present invention.

In the figure, reference numeral 100 denotes an image processing device.

Reference numeral 12 denotes a shutter for controlling the amount of exposure to the image sensor 14, and reference numeral 14 denotes an image sensor for converting an optical image into an electric signal.

The light beam incident on the lens 310 is guided to the image sensor 14 via the stop 312, the lens mounts 306 and 106, the mirror 130, and the shutter 12 by the single-lens reflex method, and is formed on the image sensor 14 as an optical image. Image.

Reference numeral 16 denotes an A / D converter for converting an analog signal output of the image sensor 14 into a digital signal.

Reference numeral 18 denotes an image sensor 14, an A / D converter 16,
This is a timing generation circuit that supplies a clock signal and a control signal to the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

Reference numeral 20 denotes an image processing circuit which performs predetermined pixel interpolation processing and color conversion processing on data from the A / D converter 16 or data from the memory control circuit 22.

Further, in the image processing circuit 20, if necessary, predetermined arithmetic processing is performed by using the captured image data, and based on the obtained arithmetic result, the system control circuit 50 causes the exposure control means 40 to perform measurement. TTL (through-the-lens) AF that controls the distance control means 42
(Auto focus) processing, AE (auto exposure) processing, E
F (flash light control) processing can be performed.

Further, in the image processing circuit 20, predetermined arithmetic processing is performed using the captured image data, and TTL AWB (auto white balance) processing is also performed based on the obtained arithmetic result.

In this embodiment, since the distance measuring means 42 and the light measuring means 46 are provided exclusively,
The AF (auto focus), AE (auto exposure), and EF (flash light control) processes are performed using the distance measuring unit 42 and the photometric unit 46, and the image processing circuit 20 is used.
It is also possible to adopt a configuration in which the AF (autofocus) processing, the AE (automatic exposure) processing, and the EF (flash dimming) processing using the processing are not performed.

Alternatively, AF (auto focus) processing, AE (auto exposure) processing, and EF (flash light control) processing are performed by using the distance measuring means 42 and the light measuring means 46. It may be configured to perform each of AF (auto focus) processing, AE (auto exposure) processing, and EF (flash light control) processing using.

Reference numeral 22 denotes a memory control circuit, which includes an A / D converter 16, a timing generation circuit 18, an image processing circuit 20,
Image display memory 24, D / A converter 26, memory 30,
The compression / decompression circuit 32 is controlled.

The data of the A / D converter 16 is transmitted via the image processing circuit 20 and the memory control circuit 22 or the data of the A / D converter 16 is transmitted directly via the memory control circuit 22 to the image display memory 24. Is written to the memory 30.

Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, and 28 denotes an image display unit comprising a TFT LCD or the like.
The display image data written in the image display memory 24 is displayed by the image display unit 28 via the D / A converter 26.

If the captured image data is sequentially displayed using the image display unit 28, an electronic finder function can be realized.

The image display unit 28 can turn on / off the display in accordance with an instruction from the system control circuit 50. When the display is turned off, the image processing unit 10
0 power consumption can be significantly reduced.

Reference numeral 30 denotes a memory for storing photographed still images and moving images, which has a sufficient storage capacity for storing a predetermined number of still images and moving images over a predetermined time. Therefore, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed.

The memory 30 is provided with a system control circuit 50.
Can also be used as a work area.

32 is an adaptive discrete cosine transform (ADCT)
A compression / decompression circuit for compressing / decompressing image data by, for example, reading an image stored in the memory 30 and performing compression or decompression processing, and storing the processed data in the memory 3
Write to 0.

Reference numeral 40 denotes shutter control means for controlling the shutter 12 in cooperation with aperture control means 340 for controlling the aperture 312 based on photometric information from the photometric means 46.

Reference numeral 42 denotes distance measuring means for performing AF (auto focus) processing. The light beam incident on the lens 310 is incident on the distance measuring means 42 via the diaphragm 312, the lens mounts 306 and 106, the mirror 130, and the distance measuring sub-mirror (not shown) by a single-lens reflex method, thereby forming an optical image. The focus state of the formed image can be measured.

Reference numeral 46 denotes a photometry means for performing AE (automatic exposure) processing. The light beam incident on the lens 310 is converted into a stop 312 and a lens mount 306 by a single-lens reflex method.
And 106, mirrors 130 and 132, and a photometric lens (not shown), the light is incident on the photometric means 46, whereby the exposure state of the image formed as an optical image can be measured.

The photometric unit 46 also has an EF (flash dimming) processing function in cooperation with the flash 48.

Reference numeral 48 denotes a flash, which also has a function of projecting AF auxiliary light and a function of controlling flash light.

The image data from the image sensor 14 is calculated by the image processing circuit 20 based on the calculation result.
The system control circuit 50 can also perform exposure control and AF (autofocus) control on the shutter control means 40, the aperture control means 340, and the distance measurement control means 342 using the video TTL method.

Further, the measurement result by the distance measuring means 42 and
The AF (autofocus) control may be performed by using the image data from the image sensor 14 together with the calculation result obtained by the image processing circuit 20.

The exposure control may be performed by using both the measurement result by the photometry means 46 and the calculation result obtained by calculating the image data from the image sensor 14 by the image processing circuit 20.

Reference numeral 50 denotes a system control circuit for controlling the entire image processing apparatus 100. Reference numeral 52 denotes a system control circuit.
Is a memory for storing constants, variables, programs, and the like for the operation of.

Reference numeral 54 denotes a display unit comprising a liquid crystal display device, a speaker, and the like for displaying an operation state, a message, and the like using characters, images, sounds, and the like in accordance with the execution of the program by the system control circuit 50. A single or a plurality of units are installed at easily visible positions near the operation unit of the processing apparatus 100, and are configured by, for example, a combination of an LCD, an LED, and a sound generating element. The display unit 54 has a part of its functions installed in the optical viewfinder 104.

Among the display contents of the display unit 54, those displayed on the LCD or the like include, for example, a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, and a remaining image capturing. Available number display, Shutter speed display, Aperture value display, Exposure compensation display, Flash display, Red-eye reduction display, Macro shooting display, Buzzer setting display, Battery remaining battery display, Battery remaining display, Error display, Multi-digit number , Display of the attachment / detachment state of the recording media 200 and 210, indication of the attachment / detachment state of the lens unit 300, communication I / F operation display, date / time display, display indicating the connection state with an external computer, and the like.

Of the display contents of the display unit 54, those displayed in the optical viewfinder 104 include, for example, an in-focus display, a shooting ready display, a camera shake warning display, a flash charging display, a flash charging completion display, and a shutter charging display. There are a speed display, an aperture value display, an exposure correction display, a recording medium writing operation display, and the like.

Further, among the display contents of the display unit 54, L
The display on the ED or the like includes, for example, an in-focus display, a shooting ready display, a camera shake warning display, a camera shake warning display, a flash charge display, a flash charge completion display, a recording medium writing operation display, a macro shooting setting notification display, and a And the next battery charge state display.

Among the display contents of the display unit 54, those displayed on a lamp or the like include, for example, a self-timer notification lamp. This self-timer notification lamp may be shared with the AF auxiliary light.

Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory, for example, an EEPROM or the like.

60, 62, 64, 66, 68 and 70
Is an operation means for inputting various operation instructions to the system control circuit 50, and is constituted by one or a combination of a switch, a dial, a touch panel, pointing by gaze detection, a voice recognition device, and the like.

Here, these operation means will be specifically described.

Reference numeral 60 denotes a mode dial switch, which is an automatic shooting mode, a program shooting mode, a shutter speed priority shooting mode, an aperture priority shooting mode, a manual shooting mode, a depth of focus priority (depth) shooting mode, a portrait shooting mode, and a landscape shooting mode. Each function photographing mode such as a mode, a close-up photographing mode, a sports photographing mode, a night scene photographing mode, a panoramic photographing mode can be switched and set.

Reference numeral 62 denotes a shutter switch SW1,
ON when the shutter button (not shown) is being operated (half-pressed)
AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, E
An instruction is issued to start an operation such as F (flash light control) processing.

Reference numeral 64 denotes a shutter switch SW2.
Turns on when shutter button operation (not shown) is completed (fully pressed)
Exposure processing for writing the image data into the memory 30 via the A / D converter 16 and the memory control circuit 22 with the signal read from the image sensor 12, and development using the calculation in the image processing circuit 20 and the memory control circuit 22 Processing, the image data is read from the memory 30, compressed by the compression / decompression circuit 32, and an operation of a series of processing of writing image data to the recording medium 200 or 210 is instructed to start.

Reference numeral 66 denotes an AEB (auto exposure bracketing) setting switch for setting an AEB photographing mode in which three frames of a standard exposure value, an over exposure value and an under exposure value are automatically stepwise exposed in one photographing operation. At the same time, it is used when setting a correction step value at that time.

The plus and minus buttons,
Alternatively, if a rotary dial switch is used, the correction step value can be set more easily.

Reference numeral 68 denotes a single shooting / continuous shooting switch, which is a single shooting mode in which when a shutter switch SW2 is pressed, a single frame is shot and a standby state is set;
A continuous shooting mode in which shooting is continuously performed while the button 2 is pressed can be set.

An operation unit 70 includes various buttons, a touch panel, etc., and includes a menu button, a set button, a macro button, a multi-screen playback change button, a flash setting button, a single-shot / continuous-shot / self-timer switching button, and a menu shift. + (Plus) button, menu move-
(Minus) button, playback image move + (plus) button, playback image-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, panorama mode, etc. Selection / switch button for setting selection and switching of functions, decision / execution button for setting and execution of various functions when executing shooting and playback in panorama mode, etc., and image display unit 2
8 Image display 0N / OFF switch for setting 0N / OFF, quick review ON / setting for quick review function to automatically play back image data taken immediately after shooting
OFF switch, select the compression rate of JPEG compression,
Sets each function mode such as a compression mode switch, which is a switch for selecting the CCD RAW mode in which the signal of the image sensor is digitized as it is and records it on the recording medium, a reproduction mode, a multi-screen reproduction / erase mode, and a PC connection mode. The auto-focus operation starts when the playback switch and the shutter switch SW1 are pressed, and the one-shot AE mode that keeps the in-focus state once the focus is achieved, and continuously while the shutter switch SW1 is pressed. Servo A that keeps auto focus operation
An AF mode setting switch for setting an F mode;
0 or a reproduction switch for instructing the start of a reproduction operation to be read from the recording medium 200 or 210 and displayed by the image display unit 28.

The functions of the plus button and the minus button are provided with a rotary dial switch, so that numerical values and functions can be more easily selected.

Reference numeral 72 denotes a power switch, which can switch and set the power-on and power-off modes of the image processing apparatus 100. Further, a lens unit 300 connected to the image processing apparatus 100, an external strobe, a recording medium 2
The power-on and power-off settings of various accessory devices such as 00 and 210 can also be switched and set.

Reference numeral 80 denotes a power supply control means, which comprises a battery detection circuit, a DC-DC converter, a switch circuit for switching a block to be energized, and the like, and detects whether or not a battery is installed, the type of battery, and the remaining battery level. The DC-DC based on the detection result and the instruction of the system control circuit 50.
The converter is controlled to supply a required voltage to each unit including a recording medium for a required period.

Reference numeral 82 denotes a connector, 84 denotes a connector, and 86 denotes a power supply. The power supply unit 86 is a power supply unit including a primary battery such as an alkaline battery and a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, and a Li battery, and an AC adapter.

Reference numerals 90 and 94 denote interfaces with recording media such as memory cards and hard disks. Reference numerals 92 and 96 denote connectors for connection to recording media such as memory cards and hard disks. Reference numeral 98 denotes connectors 92 and / or 96. This is a recording medium attachment / detachment detection unit that detects whether the recording medium 200 or 210 is mounted.

In this embodiment, the description has been made assuming that there are two interfaces and connectors for attaching a recording medium. Instead, the interface and the connector for attaching the recording medium may have a single or plural number of systems. Also,
It may be configured to include a combination of interfaces and connectors of different standards.

As the interface and the connector,
You may comprise using what conformed to standards, such as a PCMCIA card and a CF (compact flash) card.

Further, the interfaces 90 and 94 and the connectors 92 and 96 are connected to a PCMCIA card or CF.
(Compact flash) When using a card conforming to the standard such as a card, a LAN card, a modem card, a USB card, an IEEE1394 card, a P128
By connecting various communication cards such as a 4-card, a SCSI card, a communication card such as a PHS, and the like, image data and management information attached to the image data are transferred to and from other peripheral devices such as a computer and a printer. I can do it.

Reference numeral 104 denotes an optical finder;
The light beam incident on the lens 10 is converted to a stop 3
12, lens mounts 306 and 106, mirror 130
And 132, and can be displayed as an optical image. Thus, it is possible to perform photographing using only the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are provided.

A communication unit 110 has various communication functions such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication.

Reference numeral 112 denotes a connector for connecting the image processing apparatus 100 to another device by the communication unit 110 or an antenna in the case of wireless communication.

Reference numeral 120 denotes an interface for connecting the image processing apparatus 100 to the lens unit 300 in the lens mount 106; 122, a connector for electrically connecting the image processing apparatus 100 to the lens unit 300; Denotes a lens attachment / detachment detecting unit that detects whether the lens unit 300 is mounted on the lens mount 106 and / or the connector 122.

The connector 122 has a function of transmitting control signals, status signals, data signals, and the like between the image processing apparatus 100 and the lens unit 300 and supplying currents of various voltages. Further, the connector 122 may be configured to transmit not only electric communication but also optical communication, voice communication, and the like.

Reference numerals 130 and 132 denote mirrors, and a lens 310
Can be guided to the optical finder 104 by a single-lens reflex method. The mirror 132 is
Either the configuration of the quick return mirror or the configuration of the half mirror may be used.

Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 including a semiconductor memory or a magnetic disk, an interface 204 with the image processing apparatus 100, and the image processing apparatus 1
00 is provided with a connector 206 for making a connection.

Reference numeral 210 denotes a recording medium such as a memory card or a hard disk. The recording medium 210 includes a recording unit 212 including a semiconductor memory and a magnetic disk, an interface 214 with the image processing apparatus 100, and the image processing apparatus 1
00 and a connector 216 for making connection with the 00.

Reference numeral 300 denotes an interchangeable lens type lens unit.

Reference numeral 306 denotes a lens mount for mechanically connecting the lens unit 300 to the image processing apparatus 100. In the lens mount 306, the lens unit 30
0 is electrically connected to the image processing apparatus 100.

Reference numeral 310 denotes a photographing lens, and reference numeral 312 denotes an aperture.

Reference numeral 320 denotes an interface in the lens mount 306 for connecting the lens unit 300 to the image processing apparatus 100. Reference numeral 322 denotes a connector for electrically connecting the lens unit 300 to the image processing apparatus 100. The connector 322 is connected to the image processing apparatus 100.
Control signals, status signals,
In addition to transmitting data signals and the like, it also has a function of supplying or supplying currents of various voltages. Note that the connector 322 may be configured to transmit not only electrical communication but also optical communication, voice communication, and the like.

Reference numeral 340 denotes an aperture control unit that controls the aperture 312 in cooperation with the shutter control unit 40 that controls the shutter 12 based on photometric information from the photometric unit 46.

Reference numeral 342 denotes a distance measurement control unit that controls focusing of the photographing lens 310, and 344 denotes a zoom control unit that controls zooming of the photographing lens 310.

A lens system control circuit 350 controls the entire lens unit 300. The lens system control circuit 350 includes constants for operating the lens unit 300,
A function of a memory for storing variables, programs, and the like, identification information such as a number unique to the lens unit 300, management information, function information such as an open aperture value, a minimum aperture value, and a focal length, and current and past set values. It also has the function of a non-volatile memory to hold.

Next, the operation of the image processing apparatus having the above configuration will be described with reference to FIGS.

FIGS. 2 to 6 are flowcharts of a main routine showing a control procedure of the image processing apparatus 100.

First, in FIG. 2, when the power is turned on upon replacement of a battery or the like, the system control circuit 50 initializes flags, control variables, and the like, and performs necessary predetermined initialization in each section of the image processing apparatus 100 (S101). .

The system control circuit 50 includes a power switch 6
6 is set, and the power switch 66 is turned off.
(S102), the display of each display unit is changed to the end state, and necessary parameters including flags, control variables, etc., setting values, and setting modes are set in the non-volatile memory 56.
After performing predetermined termination processing such as shutting off unnecessary power of each unit of the image processing apparatus 100 including the image display unit 28 by the power supply control unit 80 (S103), the process returns to S102.

If the power switch 66 is set to power ON (S 102), the remaining capacity of the power source 86 composed of a battery or the like and the operating condition may interfere with the operation of the image processing apparatus 100. It is determined whether or not a problem occurs (S104). If a problem does occur, the system control circuit 50 uses the display unit 54 to display a predetermined warning using an image or sound (S105), and then proceeds to S102. Return.

If there is no problem in the power supply 86 (S10
4), the system control circuit 50 checks the set position of the mode dial 60, and if the mode dial 60 has been set to the shooting mode (S106), the process proceeds to S108.

If the mode dial 60 has been set to another mode (S106), the system control circuit 5
0 executes a process according to the selected mode (S10
7) When the processing is completed, the process returns to S102.

The system control circuit 50 controls the recording medium 200
Alternatively, determine whether 210 is mounted,
Further, management information of the image data recorded on the recording medium 200 or 210 is obtained, and whether or not the operation state of the recording medium 200 or 210 has a problem in the operation of the image processing apparatus 100, It is determined whether there is a problem in the data recording / reproducing operation (S10).
8) If there is a problem, a predetermined warning is displayed by image or sound using the display unit 54 (S105), and then S1
Return to 02.

If there is no problem, the process proceeds to S109, where the system control circuit 50 checks the setting state of the single / continuous shooting switch 68 for selectively setting single / shooting / continuous shooting (S10).
9) If single shooting is selected, the single shooting / continuous shooting flag is set to single shooting (S110). If continuous shooting is selected, the single shooting / continuous shooting flag is set to continuous shooting. (S11
1) When the setting of the flag is completed, the process proceeds to S112.

According to the single shooting / continuous shooting switch 68, a single shooting mode in which the photographing is performed once when the shutter switch SW2 is pressed and the standby state is set, and the shutter switch SW
While the button 2 is pressed, a continuous shooting mode in which shooting is continuously performed can be arbitrarily switched and set.

Note that the state of the single / continuous shooting flag is stored in the internal memory of the system control circuit 50 or the memory 52.

Next, proceeding to FIG. 3, the system control circuit 50
Checks the setting state of the AE mode on the mode dial 60 (S112), and determines the shutter speed (Tv value).
If the priority shooting mode has been selected, the AE mode flag is set to Tv priority (S113), and the aperture (Av value) is set.
If the priority shooting mode is selected, the AE mode flag is set to Av priority (S114), and if the setting of the flag is completed, the process proceeds to S115.

The shooting modes in which the shutter speed (Tv value) is prioritized include a sports shooting mode and the like in addition to the shutter speed priority shooting mode.

The aperture (Av value) priority shooting modes include a portrait shooting mode, a landscape shooting mode, and a depth of focus priority (depth) shooting mode, in addition to the aperture priority shooting mode.

Note that the state of the AE mode flag is stored in the internal memory of the system control circuit 50 or the memory 52.

The system control circuit 50 checks the setting state of the AEB setting switch 66 for setting the AEB (auto exposure bracketing) photographing mode for performing the automatic stepwise exposure (S115), and if the AEB photographing mode has been set. If the AEB flag is set (S1
16), a correction step value is set (S117), and S11 is set.
Go to 9.

If the AEB shooting mode has not been set, the AEB flag is released (S118), and the flow advances to S119.

According to the correction step value, it is possible to set a difference in the number of exposure steps when three frames of a standard exposure value, an over exposure value, and an under exposure value are exposed in the automatic step exposure. Generally, this correction step value is 1/3 step, 1 step,
The value of about / 2 stage or 1 stage is often used.

Note that the state of the AEB flag and the AEB correction step value are stored in the internal memory of the system control circuit 50 or the memory 52.

The system control circuit 50 determines whether the AEB setting switch 66 has been set to the release state, the AEB correction step value has been set to zero, or a predetermined setting for canceling the shooting operation during the AEB shooting. If AEB shooting mode has been set, it is determined that the setting has been made to terminate the AEB shooting mode halfway (S119), and the AEB execution flag stored in the internal memory or the memory 52 of the system control circuit 50 is released (S121). Return.

If the setting has not been made to terminate the AEB photographing mode in the middle (S119), the system control circuit 50 uses the display unit 54 to display various setting states of the image processing apparatus 100 using images and sounds. (S12
0). If the image display of the image display unit 28 is ON, various setting states of the image processing apparatus 100 are displayed by the image using the image display unit 28.

Next, proceeding to FIG. 4, the shutter switch SW
If 1 is not pressed (S131), the process returns to S102.

If the shutter switch SW1 is pressed (S131), the system control circuit 50 checks the state of the AEB execution flag stored in the internal memory or the memory 52 of the system control circuit 50 (S132), and the AEB
If the execution flag has been set, it is determined that AEB shooting has already been started, and the process proceeds to S141.

If the AEB execution flag has been cleared (S132), a variable N is set, initialized to N = 0 (S133), and the routine proceeds to S134.

The system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on the subject, and further performs a photometry process to perform a distance measurement / photometry process for determining an aperture value and a shutter time (S134). The process proceeds to S135. In the photometric processing, the flash setting is also performed if necessary.

The details of the distance measurement / photometry processing S134 will be described later with reference to FIG.

The system control circuit 50 controls the AE stored in the internal memory of the system control circuit 50 or the memory 52.
The state of the mode flag is confirmed (S135), and the reference shutter speed for calculating the charge accumulation time in the image sensor 14 set in S138 is determined according to the state of the AE mode flag.

Here, if the AE mode flag has been set to Av priority (S135), the reference shutter speed as a basis for calculating the charge accumulation time is determined by the shutter speed obtained in the distance measurement / photometry processing S134. (Tv value), S
The value is determined by adding the correction step value set in 117 (S136). This determined reference shutter speed is
This corresponds to a shutter speed (slow shutter speed) used for shooting an overexposure value in AEB shooting.

As described above, if the reference shutter speed is set to the shutter speed used for photographing the overexposure value, and the dark capture processing is performed according to this speed, the AEB photographing is performed in the aperture (Av) priority photographing mode. In this case, it is not necessary to change the shutter speed for each of three frames. That is, even if the dark capture processing is performed for a time slightly longer than the regular time, there is no problem in the correction processing based on the data, and thus such setting is possible. Therefore, the reference shutter speed is set to the shutter speed (Tv value) obtained in the distance measurement / photometry processing S134 by S.
The value may be set to a value obtained by adding a value slightly larger than the correction step value set in 117.

On the other hand, if the AE mode flag has been set to Tv priority (S135), the reference shutter speed is determined to be the same as the shutter speed (Tv value) obtained in the distance measurement / photometry processing S134 (S137). ).

As described above, if the AE mode flag is set to Tv priority (shutter speed priority), in the shutter speed priority mode, three times in AEB photography.
Since the shooting must be performed at the same shutter speed for both frames, the shutter speed obtained in the distance measurement / photometry processing S134 is selected as it is as the reference shutter speed for calculating the charge accumulation time.

The system control circuit 50 sets the charge accumulation time in the image pickup device 14 in accordance with the reference shutter speed selected in S136 or S137 (S138).
Proceed to 39.

The charge accumulation is performed in the photographing process S164 and the dark capture process S140 or S167, respectively, using the charge accumulation time set here.

The system control circuit 50 checks the state of the single-shot / continuous-shot flag stored in the internal memory of the system control circuit 50 or the memory 52 (S139), and if single-shot is set, proceeds to S141. .

As described above, when single shooting is set in S139, the process proceeds to S141 without performing the dark capture process S140, thereby reducing the release time lag when the shutter switch SW2 is pressed in S141. Becomes possible.

If continuous shooting has been set (S13)
9) Perform dark capture processing (S140). That is, unexposed shooting is performed with the shutter 12 closed, noise components such as dark current of the image sensor 14 are accumulated for the same time as the main shooting, and after the accumulation is completed, a noise image signal is read. Thereafter, the process proceeds to S141.

The dark image data fetched in the dark fetching process is used later in the correction calculation process, and is accompanied by image quality deterioration such as dark current noise generated by the image pickup device 14 and pixel defects due to scratches inherent to the image pickup device 14. The correction processing is performed on the image data.

The details of the dark capture processing S140 will be described later with reference to FIG.

As described above, if continuous shooting is set in S139, dark capture processing S140 is performed prior to execution of continuous shooting, so that the shutter switch SW2 is pressed in S141 to perform continuous shooting. In this case, the interval between consecutively shot frames can be made substantially constant.

In S141, the shutter switch SW2
Is pressed or not, and the shutter switch S
If W2 is not pressed, shutter switch SW
Until 1 is released (S142), the current processing is repeated.

If the shutter switch SW1 is released (S142), the process returns to S102.

If the shutter switch SW2 has been pressed (S141), the flow moves to FIG.
Indicates that an area in which captured image data can be stored is stored in the memory 30
Is determined in the image storage buffer area (S1).
61) If there is no area capable of storing new image data in the image storage buffer area of the memory 30, the display unit 5
After performing a predetermined warning display using an image or a sound using No. 4 (S162), the process returns to S102.

For example, immediately after the maximum number of continuous shots that can be stored in the image storage buffer area of the memory 30 has been performed, the data is read out from the memory 30 and stored in the storage medium 200 or 2.
10, the first image to be written is still the recording medium 200
Or the state not recorded in 210,
An example of this state is a state in which one free area cannot be secured in the image storage buffer area of the memory 30 yet.

When the photographed image data is compressed and stored in the image storage buffer area of the memory 30, the amount of compressed image data differs depending on the setting of the compression mode. The area that can be stored is memory 3.
In step S161, it is determined whether or not the image is in the image storage buffer area 0.
Will be determined.

In the image storage buffer area of the memory 30,
If there is an area where new image data can be stored (S1
61), the system control circuit 50
The state of the AEB flag stored in the internal memory 0 or the memory 52 is checked (S181). If the AEB flag has been set, the process proceeds to S163, and if the AEB flag has been cleared, the process proceeds to S164.

In S163, the system control circuit 50
Set the EB execution flag. The state of the AEB execution flag is stored in the internal memory of the system control circuit 50 or the memory 52.

Next, the system control circuit 50 checks the value of the variable N. If N = 0, the AEB correction side light data is set as underexposure and stored in the internal memory or the memory 52 of the system control circuit 50 (S182). ).

If N = 1, the AEB correction side light data is stored in the internal memory of the system control circuit 50 or the memory 52 as the exposure standard setting (S183).

If N = 2, the AEB correction side light data is stored in the internal memory of the system control circuit 50 or the memory 52 as overexposure setting (S184).

Next, the system control circuit 50 reads out the image pickup signal which has been picked up and stored for a predetermined time from the image pickup device 12, and receives the read out signal via the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or A photographing process for writing photographed image data into a predetermined area of the memory 30 directly from the A / D converter via the memory control circuit 22 is executed (S16).
4).

The details of the photographing process S164 will be described later with reference to FIG.

After the photographing process S164 is completed, the system control circuit 50 checks the state of the AEB flag stored in the internal memory of the system control circuit 50 or the memory 52 (S185), and if the AEB flag has been set. If the AEB flag has been cleared, the process proceeds to S166.

In S165, the system control circuit 50
With N = N + 1 for the variable N, the process proceeds to S166.

The system control circuit 50 checks the state of the single / continuous shooting flag stored in the internal memory of the system control circuit 50 or the memory 52 (S166). If continuous shooting has been set, the process proceeds to S168. move on.

If the continuous shooting has been set in S166, the dark capture processing has already been performed in S140 prior to the execution of the continuous capture, so that development is performed without performing the dark capture processing in S167 as described later. Step S168 is executed. As a result, it is possible to make the interval between consecutively shot frames almost constant.

If single shooting has been set (S16
6) In the state where the shutter 12 is closed, noise components such as dark current of the image sensor 14 are accumulated for the same time as the main photographing, and a dark capture process for reading out the noise image signal after the accumulation is performed (S167), and the process proceeds to S168. .

By performing correction calculation processing later using the dark image data captured in the dark capture processing, image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14 is performed. Can be corrected.

The details of the dark capture processing S167 will be described later with reference to FIG.

As described above, in the case where single shooting is set in S166, the dark capture process S167 is performed after the shooting process S164 is performed, so that the shutter release time lag (SW2) when the shutter switch SW2 is pressed in S141 is performed. (The time lag from when is pressed until the image is actually taken) can be reduced.

Next, in S168 of FIG. 6, the system control circuit 50 reads out a part of the image data written in a predetermined area of the memory 30 via the memory control circuit 22 and performs a developing process. The WB (white balance) integration calculation process and the OB (optical black) integration calculation process are performed, and the calculation result is stored in the internal memory or the memory 52 of the system control circuit 50.

The system control circuit 50 reads out the photographed image data written in a predetermined area of the memory 30 by using the memory control circuit 22 and the image processing circuit 20 as necessary. Using the operation result stored in the internal memory or the memory 52, the AWB
Various development processing including (auto white balance) processing, gamma conversion processing, and color conversion processing is performed.

Further, in the developing process, a subtraction process is performed using the dark image data captured in the dark capturing process, so that a dark correction calculation process for canceling a dark current noise of the image sensor 14 is also performed.

Then, the system control circuit 50 reads out the image data written in a predetermined area of the memory 30 and performs image compression processing according to the set mode by the compression / decompression circuit 32 (S169). The image data is written to a free image portion of the image storage buffer area of the memory 30.

After executing a series of photographing, the system control circuit 5
0 performs a recording start process, reads out image data stored in the image storage buffer area of the memory 30, and stores the image data in a recording medium 200 or 210 such as a memory card or a compact flash card via the interface 90 or 94 and the connector 92 or 96. Starts writing to (S1
70).

This recording start process is performed every time image data that has been photographed and has undergone a series of processes is newly written in a free image portion of the image storage buffer area of the memory 30.
The operation is performed on the image data.

While the image data is being written to the recording medium 200 or 210, the display unit 54 displays, for example, L
A recording medium writing operation display such as blinking of the ED is performed.

The system control circuit 50 controls the AE stored in the internal memory of the system control circuit 50 or the memory 52.
The state of the B flag is checked (S186). If the AEB flag has been set, the process proceeds to S171, and if the AEB flag has been cleared, the process proceeds to S173.

In S171, the system control circuit 50 determines whether the variable N has reached N = 3, and if it has reached N = 3, releases the AEB execution flag (S17).
2) Return to S102.

If the variable N has not reached N = 3 (S171), the system control circuit 50 changes the state of the single / continuous shooting flag stored in the internal memory of the system control circuit 50 or the memory 52. Confirmation (S173), and if continuous shooting is set, S1 to continuously shoot
Returning to 41, the next photographing is performed.

If single shooting has been set, the system control circuit 50 determines whether or not the shutter switch SW1 has been pressed (S174).

If the shutter switch SW1 has been pressed (S174), the shutter switch SW
Repeat the current process until 1 is released. If the shutter switch SW1 has been released (S17)
4) Return to S102.

FIG. 7 is a flowchart showing a detailed procedure of the distance measurement / photometry processing in S134 of FIG. In the distance measurement / photometry processing, the system control circuit 50
The transmission and reception of various signals between the aperture control unit 340 and the distance measurement control unit 342 are performed by the interface 12.
0, the connector 122, the connector 322, the interface 320, and the lens control means 350.

The system control circuit 50 includes the image pickup device 14,
AF using the distance measuring means 42 and the distance measuring control means 342
(Autofocus) processing is started (S201).

The system control circuit 50 causes the light beam incident on the lens 310 to enter the distance measuring means 42 via the stop 312, the lens mounts 306 and 106, the mirror 130, and a distance measuring sub-mirror (not shown). The focus state of the image formed as the optical image is determined, and the distance measurement (A
Until F) is determined to be in focus (S203), AF control for detecting the in-focus state using the distance measuring means 42 is performed while driving the lens 310 using the distance measuring control means 342 (S202). .

If it is determined that the distance measurement (AF) is in focus (S203), the system control circuit 50 determines the focused distance measurement point from a plurality of distance measurement points in the photographing screen.
The distance measurement data and / or the set parameters together with the determined distance measurement point data are stored in the internal memory or the memory 52 of the system control circuit 50, and the process proceeds to S205.

Subsequently, the system control circuit 50 starts AE (automatic exposure) processing using the photometric means 46 (S
205).

The system control circuit 50 causes the light beam incident on the lens 310 to enter the photometric means 46 via the stop 312, lens mounts 306 and 106, mirrors 130 and 132, and a photometric lens (not shown). The exposure state of the image formed as an optical image is measured, and the exposure (AE) is determined to be appropriate (S20).
7) A photometric process is performed using the exposure control means 40 (S2).
06).

If the exposure (AE) is determined to be appropriate (S207), the system control circuit 50 stores the photometric data and / or setting parameters in the internal memory or the memory 52 of the system control circuit 50, and proceeds to S208. .

The system control circuit 50 determines the aperture value (Av value) and shutter speed (Tv value) according to the exposure (AE) result detected in the photometric processing S206 and the photographing mode set by the mode dial 60. ).

Then, according to the shutter speed (Tv value) determined here, the system control circuit 50 determines the charge accumulation time of the image pickup device 14, and performs the photographing process and the dark capture process with this charge accumulation time. .

Based on the measurement data obtained in the photometric processing S206, the system control circuit 50 determines whether or not a flash is necessary (S208). If a flash is required, a flash flag is set, and the charging of the flash 48 is completed. Until (S210), the flash 48 is charged (S2).
09).

When the charging of the flash 48 is completed (S210), the distance measurement / photometry processing routine S134 ends.

FIG. 8 is a flowchart showing a detailed procedure of the photographing process in S164 of FIG.

In the photographing process, the system control circuit 50 and the aperture control means 340 or the distance measurement control means 3
The transmission and reception of various signals to and from the CPU 42 are performed via the interface 120, the connector 122, the connector 322, the interface 320, and the lens control unit 350.

The system control circuit 50 includes a mirror 130
Is moved to a mirror-up position by a mirror driving unit (not shown) (S301), and when the AEB flag is not set, according to the photometric data stored in the internal memory of the system control circuit 50 or the memory 52,
On the other hand, if the AEB flag is set, the aperture control means 340 drives the aperture 312 to a predetermined aperture value according to the AEB correction side light data (S302).

The system control circuit 50 performs a charge clear operation of the image pickup device 14 (S303), and after the charge accumulation of the image pickup device 14 is started (S304), the shutter 12 is opened by the shutter control means 40 (S305). The exposure of the element 14 is started (S306).

Here, it is determined whether or not the flash 48 is necessary based on the flash flag (S307). If necessary, the flash is fired (S308).

When the AEB flag is not set, the system control circuit 50 follows the photometric data.
If the B flag is set, the exposure of the image sensor 14 is waited for in accordance with the AEB correction side light data (S30).
9) The shutter 1 is controlled by the shutter control means 40.
2 is closed (S310), and the exposure of the image sensor 14 is completed.

The system control circuit 50 controls the aperture control means 3
The aperture 312 is driven to the open aperture value by 40 (S311), and the mirror 130 is moved to the mirror down position by a mirror driving unit (not shown) (S31).
2).

If the set charge accumulation time has elapsed (S313), the system control circuit 50
(S314), and thereafter, the image sensor 1
4 is read out from the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or
The captured image data is written from the D converter 16 directly to a predetermined area of the memory 30 via the memory control circuit 22 (S3).
15). When a series of processing is completed, the photographing processing routine S164 ends.

FIG. 9 shows S140 of FIG. 4 and S16 of FIG.
7 is a flowchart showing a detailed procedure of dark capture processing in FIG.

After performing the charge clearing operation of the image pickup device 14 (S401), the system control circuit 50 starts the charge accumulation of the image pickup device 14 with the shutter 12 closed (S402).

If the set predetermined charge accumulation time has elapsed (S403), the system control circuit 50 terminates the charge accumulation of the image pickup device 14 (S404), and thereafter reads out the charge signal from the image pickup device 14 and The image data (dark image data) is transferred to a predetermined area of the memory 30 via the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16 via the memory control circuit 22. Write (S405).

By performing development processing using the dark captured data, the captured image data is corrected with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14. Can be done.

The dark image data is held in a predetermined area of the memory 30 until a new distance measurement and photometry processing is performed or the power of the image processing apparatus 100 is turned off.

Then, the dark image data is subjected to a photographing process thereafter, and the photographed image data is read out from the image pickup device 14 and used for the developing process.

Alternatively, the photographing processing is executed first, and the photographed image data is read out from the image pickup device 14 and read out from the memory 3.
It is used when developing processing using this dark image data in a state where it is written to 0.

When a series of processing is completed, the dark capture processing routines S140 and S167 are completed.

FIG. 10 is a timing chart showing the flow of the photographing operation in the above embodiment.

In the above embodiment, the AEB
In the description above, the exposure stage during shooting was described as shooting in the order of under, standard, over, but instead of this, standard,
The order of under, over, the order of standard, over, under, the order of over, standard, under, may be any combination, including other combinations .

In the above embodiment, the continuous shooting A
In EB shooting, one shot of dark capture is performed, and then underexposure, standard exposure, and overexposure are performed. In single-shot AEB shooting, underexposure, standard exposure, and overexposure are performed each time. Described that dark capture is performed three times in total, but instead of this, continuous shooting A
In both EB shooting and single-shot AEB shooting, dark capture may be performed once in accordance with the longest charge accumulation time.

In this case, in single-shot AEB shooting, dark capture is performed once in the first shooting in accordance with the longest charge accumulation time, and in the second and third shootings, the first time is performed without performing dark capture. The dark correction calculation can be performed by using the dark capture data. According to this, it is possible to reduce the photographing interval of the second and subsequent frames in single-shot AEB photographing.

Further, in the above embodiment, the single shot /
Although the description has been given on the assumption that the continuous shooting is switched using the single shooting / continuous shooting switch 68, a configuration in which the single shooting / continuous shooting is switched in accordance with the operation mode selection by the mode dial 60 may be used instead. Good.

AEB shooting mode setting and AEB
Although the setting of the correction step value has been described as being set simultaneously with the AEB setting switch, the AEB shooting mode and the AEB
The correction step value may be individually set at a completely different timing.

In this case, as the configuration of the independent operation switches, the setting of the AEB photographing mode and the setting of the AEB correction step value may be performed separately.

Although the setting of the AE mode has been described as being performed in accordance with the setting of the photographing mode with the mode dial 60, the AE mode setting switch is provided separately.
The AE mode may be set separately from the mode dial 60.

In addition, the number of frames to be shot at one time in AEB shooting is 3
Although the number of frames has been described, any number of frames may be used as long as the number of frames is plural.

The correction step value in the AEB photographing need not be a fixed correction step value between each photographing frame. For example, the step between the standard exposure value and the over-exposure value may be 1/2 step, and the step between the standard exposure value and the under-exposure value may be 1/3 step.

The different correction step values may be set by the user of the image processing apparatus 100.

Further, the image processing apparatus 100 sets the overexposure side and the underexposure side to different values in accordance with the inherent gradation characteristics of the image pickup device 14, and
The effect of EB photography may be enhanced.

Further, in the above embodiment, the charge accumulation time of the main photographing process and the charge accumulation time of the dark capture process have been described as being equal. However, data sufficient for correcting dark current noise and the like has been described. Is within the range where
Different charge accumulation times may be set.

During the execution of the dark capture processing operation in S140 and S167, the photographing operation cannot be performed, so that the image processing apparatus 100 is in a busy state by the display unit 54 and / or the image display unit 28. May be displayed.

In the above embodiment, the mirror 130 is moved to the mirror-up position and the mirror-down position. However, the mirror 130 is configured as a half mirror, and the photographing operation is performed without moving. It may be performed.

The recording media 200 and 210 are PC
Not only memory cards such as MCIA cards and compact flash, hard disks, but also micro DATs, magneto-optical disks, optical disks such as CD-Rs and CD-WRs,
It may be composed of a phase change optical disk such as a DVD.

[0206] The recording media 200 and 210 may be composite media in which a memory card and a hard disk are integrated. Further, it is of course possible to adopt a configuration in which a part of the composite medium is detachable.

In the above-described embodiment, the recording media 200 and 210 have been described as being separated from the image processing apparatus 100 and can be arbitrarily connected. Of course, it may be fixed to the device 100.

Further, the recording medium 20 is stored in the image processing apparatus 100.
A configuration in which 0 or 210 can be connected to a single or a plurality of arbitrary numbers may be used.

Then, the recording medium 2 is stored in the image processing apparatus 100.
Although described as a configuration in which 00 and 210 are mounted, even if the recording medium is a configuration of a single or a plurality of combinations,
Of course.

The present invention may be applied to a system constituted by a plurality of devices, or may be applied to an apparatus constituted by a single device.

A storage medium storing program codes of software for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus is stored in the storage medium. It goes without saying that the present invention is also achieved by reading and executing the program code.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS and the like running on the computer are actually executed based on the instructions of the program code. It is needless to say that the present invention also includes the case where the functions of the above-described embodiments are realized by performing a part or all of the processing described above.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, It is needless to say that the present invention includes a case where a CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

The above is the description of the embodiments of the present invention. However, the present invention is not limited to the structures of these embodiments, and the functions described in the claims or the structures of the embodiments are described. The present invention can be applied to any configuration that can achieve the functions of the.

For example, the software configuration and the hardware configuration of the above embodiments can be replaced as appropriate.

Further, the present invention may combine the above-described embodiments or their technical elements as necessary.

[0219] Further, the present invention is such that the whole or part of the structure of the claims or the embodiment forms one device and is combined with another device. However, it may be an element constituting the device.

Further, the present invention relates to an electronic still camera, a video movie camera, a camera using a silver halide film, and the like.
The present invention can be applied to various types of cameras, imaging devices other than cameras, devices applied to these cameras and imaging devices, and elements constituting these devices.

[0221]

As described above, according to the present invention,
An object of the present invention is to provide an imaging device, an image processing device, an image processing method, and a storage medium that can prevent a precious shutter opportunity from being missed and a reduction in the continuous shooting frame speed.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a flowchart of a main routine showing a control procedure of the image processing apparatus.

FIG. 3 is a flowchart of a main routine subsequent to FIG. 2 and illustrating a control procedure of the image processing apparatus.

FIG. 4 is a flowchart of a main routine continued from FIG. 3 showing a control procedure of the image processing apparatus.

FIG. 5 is a flowchart of a main routine continued from FIG. 4 showing a control procedure of the image processing apparatus.

FIG. 6 is a flowchart of a main routine subsequent to FIG. 5 and illustrating a control procedure of the image processing apparatus.

FIG. 7 is a flowchart illustrating a detailed procedure of a distance measurement / photometry process in S134 of FIG. 4;

FIG. 8 is a flowchart illustrating a detailed procedure of a photographing process in S164 of FIG. 5;

FIG. 9 is a flowchart showing a detailed procedure of dark capture processing in S140 of FIG. 4 and S167 of FIG. 5;

FIG. 10 is a timing chart illustrating a flow of a shooting operation in the image processing apparatus.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 12 Shutter 14 Image sensor 16 A / D converter 18 Timing generation circuit 20 Image processing circuit 22 Memory control circuit 24 Image display memory 26 D / A converter 28 Image display unit 30 Memory 32 Image compression / expansion circuit 40 Shutter control means 42 Distance measuring unit 46 Photometric unit 48 Flash 50 System control circuit 52 Memory 54 Display unit 56 Non-volatile memory 60 Mode dial switch 62 Shutter switch SW1 64 Shutter switch SW2 66 AEB setting switch 68 Single shooting / continuous shooting switch 70 Operation unit 72 Power switch Reference Signs List 80 power control means 82 connector 84 connector 86 power supply means 90 interface 92 connector 94 interface 96 connector 98 recording medium attachment / detachment detection means 100 image processing device 104 optical fiber Lens 106 Lens mount 110 Communication means 112 Connector (or antenna) 120 Interface 122 Connector 130 Mirror 132 Mirror 200 Recording medium 202 Recording unit 204 Interface 206 Connector 210 Recording medium 212 Recording unit 214 Interface 216 Connector 300 Lens unit 306 Lens mount 310 Photographing lens 312 Aperture 320 Interface 322 Connector 340 Exposure control means 342 Distance measurement control means 344 Zoom control means 350 Lens system control circuit

Claims (54)

[Claims] 1. An image processing apparatus for recording a captured still image and / or a moving image on a recording medium, comprising: a first imaging mode in which electric charges are accumulated without exposure, and a second imaging mode in which electric charges are accumulated by performing exposure. An image pickup unit having an image pickup mode; a storage unit for storing image pickup data output from the image pickup unit; Setting means, when the automatic step exposure shooting mode is set by the automatic step exposure shooting mode setting means, based on the shooting requiring the longest charge accumulation time in the shooting of the plurality of different exposure states, A charge accumulation time determining means for determining a charge accumulation time of the imaging means; and the first imaging means for the charge accumulation time determined by the charge accumulation time determining means. First control means for storing first image data obtained by imaging in the imaging mode in the storage means; and the imaging means for the charge accumulation time determined by the charge accumulation time determination means. An image characterized by comprising a second control means for continuously storing, in the storage means, second image data obtained by imaging in the second imaging mode in a plurality of different exposure states. Processing equipment. 2. An image according to claim 1, wherein said first image data is dark current noise data of said image pickup means, and said second image data is photographed image data of said image pickup means. Processing equipment. 3. The charge accumulation time of the imaging means in the first imaging mode and the charge accumulation time of the imaging means in the second imaging mode are equal or almost equal. Alternatively, the image processing apparatus according to claim 2. 4. The charge accumulation time determining means determines an aperture value and a shutter speed according to an exposure measurement value of a subject, and determines a step exposure amount in the automatic step exposure shooting mode from the determined shutter speed. 4. The image processing apparatus according to claim 1, wherein the charge accumulation time is determined based on a longest shutter speed determined accordingly. 5. The charge storage time determined by the charge storage time determination means is longer than the longest shutter speed determined from the determined shutter speed in accordance with a step exposure amount in the automatic step exposure photographing mode. 5. The image processing apparatus according to claim 4, wherein the time is a time. 6. An image processing apparatus for recording a captured still image and / or moving image on a recording medium, comprising: a first imaging mode in which charge accumulation is performed without exposure, and a second imaging mode in which charge accumulation is performed by exposure. Imaging means comprising: an imaging mode; a storage means for storing imaging data output from the imaging means; a signal calculation means for reading and calculating the imaging data stored in the storage means; An automatic step-exposure photographing mode setting means for setting an automatic step-exposure photographing mode for continuously performing photographing; and the plurality of different exposure states when the automatic step-exposure photographing mode is set by the automatic step-exposure photographing mode setting means. Charge accumulation time determination means for determining the charge accumulation time of the imaging means based on the imaging requiring the longest charge accumulation time in the imaging, First control means for storing unexposed image data obtained by the imaging means in the first imaging mode over the charge accumulation time determined by the accumulation time determination means in the storage means; After storing the unexposed image data in the storage means,
An operation of storing, in the storage unit, image data of a subject obtained by the imaging unit imaging in the second imaging mode over the charge storage time determined by the charge storage time determination unit; A second control unit for continuously performing an operation of causing the signal calculation unit to perform an image correction process based on the unexposed image data and the image data of the subject stored in a plurality of different exposure states. An image processing apparatus comprising: 7. The image according to claim 6, wherein the unexposed image data is dark current noise data of the imaging unit, and the image correction process is a dark current noise correction process of the imaging unit. Processing equipment. 8. The charge accumulation time of the imaging means in the first imaging mode is equal to or substantially equal to the charge accumulation time of the imaging means in the second imaging mode. Alternatively, the image processing apparatus according to claim 7. 9. The charge accumulation time determining means determines an aperture value and a shutter speed in accordance with an exposure measurement value of a subject, and determines a step exposure amount in the automatic step exposure shooting mode from the determined shutter speed. 9. The image processing apparatus according to claim 6, wherein the charge accumulation time is determined based on a longest shutter speed determined accordingly. 10. The charge storage time determined by the charge storage time determination means is longer than the longest shutter speed determined from the determined shutter speed in accordance with the step exposure amount in the automatic step exposure shooting mode. The image processing apparatus according to claim 9, wherein the time is a time. 11. An imaging unit having a first imaging mode for performing charge accumulation without exposure and a second imaging mode for performing charge accumulation by performing exposure, and stores imaging data output from the imaging unit. An image processing apparatus for storing a still image and / or a moving image, comprising: a storage unit; and an automatic step exposure shooting mode setting unit that sets an automatic step exposure shooting mode for continuously shooting a plurality of different exposure states. In the image processing method applied, when the automatic step-exposure shooting mode setting unit sets the automatic step-exposure shooting mode, the shooting requiring the longest charge accumulation time among the plurality of different exposure states is performed. A charge accumulation time determining step of determining a charge accumulation time of the imaging unit based on the charge accumulation time, and a charge accumulation time determined in the charge accumulation time determination step. A first control step of storing the first image data obtained by the imaging means in the first imaging mode in the storage means; and a charge accumulation time determined in the charge accumulation time determination step. A second control step of continuously storing the second image data obtained by the imaging unit in the second imaging mode in the second imaging mode in a plurality of different exposure states. An image processing method comprising: 12. An image according to claim 11, wherein said first image data is dark current noise data of said image pickup means, and said second image data is photographed image data of said image pickup means. Processing method. 13. The charge accumulation time of the image pickup means in the first image pickup mode is equal to or substantially equal to the charge accumulation time of the image pickup means in the second image pickup mode. Or the image processing method according to claim 12. 14. The charge storage time determining step includes determining an aperture value and a shutter speed in accordance with an exposure measurement value of a subject, and determining a step exposure amount in the automatic step exposure shooting mode from the determined shutter speed. 14. The image processing method according to claim 11, wherein the charge accumulation time is determined based on a longest shutter speed determined accordingly. 15. The charge storage time determined in the charge storage time determination step is longer than the longest shutter speed determined from the determined shutter speed in accordance with the step exposure amount in the automatic step exposure shooting mode. The image processing method according to claim 14, wherein the time is a time. 16. An image pickup means having a first image pickup mode for performing charge accumulation without exposure and a second image pickup mode for performing charge accumulation by performing exposure, and stores image pickup data output from the image pickup means. Storage means, signal calculation means for reading and calculating the image data stored in the storage means, and automatic step-exposure shooting mode setting means for setting an automatic step-exposure shooting mode for continuously shooting a plurality of different exposure states An image processing method applied to an image processing apparatus that captures and records a still image and / or a moving image, wherein the automatic step exposure shooting mode setting unit sets the automatic step exposure shooting mode. A charge accumulation time determining unit that determines the charge accumulation time of the imaging unit based on the imaging that requires the longest charge accumulation time among the imagings in different exposure states. And storing the unexposed image data obtained by the imaging means in the first imaging mode over the charge accumulation time determined in the charge accumulation time determination step in the storage means. 1 and after storing the unexposed image data in the storage means,
An operation of storing, in the storage unit, image data of a subject obtained by the imaging unit imaging in the second imaging mode over the charge storage time determined in the charge storage time determination step; Controlling the signal calculation means to perform image correction processing continuously in a plurality of different exposure states based on the unexposed image data and the image data of the subject stored in the second control step. An image processing method comprising: 17. The image according to claim 16, wherein the unexposed image data is dark current noise data of the imaging unit, and the image correction process is a dark current noise correction process of the imaging unit. Processing method. 18. The charge accumulation time of the image pickup means in the first image pickup mode is equal to or substantially equal to the charge accumulation time of the image pickup means in the second image pickup mode. Alternatively, the image processing method according to claim 17. 19. The charge storage time determining step includes determining an aperture value and a shutter speed according to an exposure measurement value of a subject, and converting the determined shutter speed to a step exposure amount in the automatic step exposure shooting mode. 19. The image processing method according to claim 16, wherein the charge accumulation time is determined based on a longest shutter speed determined accordingly. 20. The charge storage time determined in the charge storage time determination step is longer than the longest shutter speed determined according to the step exposure amount in the automatic step exposure shooting mode from the determined shutter speed. The image processing method according to claim 19, wherein the time is a time. 21. An imaging unit having a first imaging mode in which charge accumulation is performed without exposure and a second imaging mode in which charge accumulation is performed by exposure, and imaging data output by the imaging unit. An image processing apparatus for storing a still image and / or a moving image, comprising: a storage unit; and an automatic step exposure shooting mode setting unit that sets an automatic step exposure shooting mode for continuously shooting a plurality of different exposure states. In a computer-readable storage medium storing an applied image processing method as a program, the image processing method may be configured such that when the automatic step exposure shooting mode is set by the automatic step exposure shooting mode setting means, The charge accumulation time of the imaging unit is determined based on the photographing requiring the longest charge accumulation time among the photographing in different exposure states. Loading the first image data obtained by the imaging means in the first imaging mode over the charge accumulation time determined in the charge accumulation time determination step; A first control step of storing, and storing the second image data obtained by the imaging unit in the second imaging mode over the charge accumulation time determined in the charge accumulation time determination step. A second control step of continuously storing in the means in a plurality of different exposure states. 22. The storage according to claim 21, wherein said first image data is dark current noise data of said image pickup means, and said second image data is photographed image data of said image pickup means. Medium. 23. The charge accumulation time of the image pickup means in the first image pickup mode is equal to or approximately equal to the charge accumulation time of the image pickup means in the second image pickup mode. Or the storage medium according to claim 22. 24. The charge storage time determining step includes determining an aperture value and a shutter speed according to an exposure measurement value of a subject, and setting a step exposure amount in the automatic step exposure shooting mode from the determined shutter speed. The storage medium according to any one of claims 21 to 23, wherein the charge accumulation time is determined based on a longest shutter speed determined accordingly. 25. The charge storage time determined in the charge storage time determination step is longer than the longest shutter speed determined according to the step exposure amount in the automatic step exposure shooting mode from the determined shutter speed. The image processing method according to claim 24, wherein the time is a time. 26. An imaging unit having a first imaging mode for performing charge accumulation without exposure and a second imaging mode for performing charge accumulation by performing exposure, and stores imaging data output from the imaging unit. Storage means, signal calculation means for reading and calculating the image data stored in the storage means, and automatic step-exposure shooting mode setting means for setting an automatic step-exposure shooting mode for continuously shooting a plurality of different exposure states A computer-readable storage medium storing, as a program, an image processing method applied to an image processing apparatus that captures and records a still image and / or a moving image, wherein the image processing method includes: When the automatic step exposure photographing mode is set by the photographing mode setting means, the longest charge storage among the plurality of different exposure conditions is taken. A charge accumulation time determining step of determining a charge accumulation time of the imaging means based on time-consuming photographing; and the first imaging means determining the first charge accumulation time over the charge accumulation time determined in the charge accumulation time determination step. A first control step of storing unexposed image data obtained by imaging in the imaging mode in the storage unit, and after storing the unexposed image data in the storage unit,
An operation of storing, in the storage unit, image data of a subject obtained by the imaging unit imaging in the second imaging mode over the charge storage time determined in the charge storage time determination step; Controlling the signal calculation means to perform image correction processing continuously in a plurality of different exposure states based on the unexposed image data and the image data of the subject stored in the second control step. And a storage medium comprising: 27. The storage device according to claim 26, wherein said unexposed image data is dark current noise data of said image pickup means, and said image correction processing is dark current noise correction processing of said image pickup means. Medium. 28. The charge accumulation time of the imaging means in the first imaging mode is equal to or substantially equal to the charge accumulation time of the imaging means in the second imaging mode. 28. The storage medium according to claim 27. 29. The charge storage time determining step includes determining an aperture value and a shutter speed according to an exposure measurement value of a subject, and converting the determined shutter speed to a step exposure amount in the automatic step exposure shooting mode. The storage medium according to any one of claims 26 to 28, wherein the charge accumulation time is determined based on a longest shutter speed determined accordingly. 30. The charge storage time determined in the charge storage time determination step is longer than the longest shutter speed determined according to the step exposure amount in the automatic step exposure shooting mode from the determined shutter speed. 30. The storage medium of claim 29, wherein the time is time. 31. An image pickup means, a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposure state to obtain an image pickup signal, and an image pickup in the non-exposure state according to the first image pickup operation. Signal processing means for performing a second imaging operation for obtaining an imaging signal by performing an operation, and processing an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation; Instruction means for instructing the imaging time of the first imaging operation to be different and performing predetermined plural times of imaging, and wherein the signal processing means responds to the instruction of the instruction means, An image pickup apparatus, wherein an operation method of the first image pickup operation is changed with respect to the first image pickup operation. 32. The signal processing unit selects an imaging time of the first imaging operation of a predetermined imaging of the plurality of imagings in response to the instruction of the instruction unit, and selects the selected imaging time. 32. The imaging apparatus according to claim 31, wherein the second imaging operation for performing the plurality of imagings is performed according to an imaging time. 33. The imaging apparatus according to claim 32, further comprising a storage unit configured to store an imaging signal of the second imaging operation according to the selected imaging time. 34. The image processing apparatus according to claim 28, wherein, in the photographing other than the predetermined photographing of the plurality of photographing, the image processing apparatus obtains an image signal obtained by the first image capturing operation based on the image signal stored in the storage unit. The imaging apparatus according to claim 33, wherein the processing is performed. 35. The signal processing means selects a longest imaging time of the first imaging operation among the plurality of imagings in response to the instruction of the instruction means, and selects the selected imaging time. 32. The imaging apparatus according to claim 31, wherein the second imaging operation for performing the plurality of shootings is performed according to the following. 36. The imaging apparatus according to claim 35, further comprising a storage unit configured to store an imaging signal of the second imaging operation according to the selected imaging time. 37. The image processing apparatus according to claim 27, wherein in the photographing other than the photographing of the longest photographing time of the first photographing operation of the plurality of photographing, the signal processing unit performs the signal processing on the basis of the photographing signal stored in the memory unit. 37. The imaging apparatus according to claim 36, wherein an imaging signal obtained by one imaging operation is processed. 38. The signal processing unit, in response to the instruction of the instruction unit, designating an imaging time of the first imaging operation of a predetermined imaging, and executing the plurality of imagings in accordance with the specified imaging time. 32. The imaging apparatus according to claim 31, wherein the second imaging operation is performed. 39. The imaging apparatus according to claim 38, further comprising a storage unit configured to store an imaging signal of the second imaging operation according to the designated imaging time. 40. The signal processing unit processes an imaging signal obtained by the first imaging operation based on an imaging signal stored in the storage unit in an imaging other than the predetermined imaging out of the plurality of imagings. 4. The method according to claim 3, wherein
9. The imaging device according to 9. 41. An image pickup means, a first image pickup operation for causing the image pickup means to perform an image pickup operation in an exposed state to obtain an image pickup signal, and an image pickup signal for causing the image pickup means to perform an image pickup operation in a non-exposed state A signal processing unit that performs a second imaging operation, processes an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation, and sets an imaging time of the first imaging operation to Instruction means for instructing to perform predetermined plural times of imaging differently, wherein the signal processing means does not perform the second imaging operation for each imaging in response to the instruction of the instruction means An imaging device characterized in that: 42. The signal processing means selects an imaging time of the first imaging operation of a predetermined imaging of the plurality of imagings in response to the instruction of the instruction means, and selects the selected imaging time. 42. The imaging apparatus according to claim 41, wherein the second imaging operation for the plurality of imagings is performed according to an imaging time. 43. The imaging apparatus according to claim 42, further comprising a storage unit configured to store an imaging signal of the second imaging operation according to the selected imaging time. 44. An image pickup signal obtained by the first image pickup operation based on an image pickup signal stored in the storage means, in the photographing other than the predetermined photographing of the plural times of photographing, the signal processing means. 44. The imaging device according to claim 43, wherein processing is performed. 45. The signal processing means selects a longest imaging time of the first imaging operation among the plurality of imagings in response to the instruction of the instruction means, and selects the selected imaging time. 42. The imaging apparatus according to claim 41, wherein the second imaging operation for the plurality of shootings is performed according to the following. 46. The imaging apparatus according to claim 45, further comprising a storage unit configured to store an imaging signal of the second imaging operation according to the selected imaging time. 47. The image processing apparatus according to claim 27, wherein in the imaging other than the imaging of the longest imaging time of the first imaging operation among the plurality of imagings, the signal processing unit performs the second processing based on the imaging signal stored in the storage unit. 47. The imaging apparatus according to claim 46, wherein an imaging signal obtained by the first imaging operation is processed. 48. The signal processing means, in response to the instruction of the instruction means, specifies an imaging time of the first imaging operation of a predetermined imaging, and performs the imaging of the plurality of times according to the specified imaging time. The image pickup apparatus according to claim 41, wherein the second image pickup operation for performing the second image pickup operation is performed. 49. The imaging apparatus according to claim 48, further comprising a storage unit configured to store an imaging signal of the second imaging operation according to the designated imaging time. 50. The signal processing unit processes an imaging signal obtained by the first imaging operation using an imaging signal stored in the storage unit in an imaging other than the predetermined imaging out of the plurality of imagings. 5. The method according to claim 4, wherein
9. The imaging device according to 9. 51. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and an imaging operation in accordance with the first imaging operation in the non-exposure state. A second imaging operation for obtaining an imaging signal is performed, an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation, and the first imaging operation is performed.
Image processing characterized by changing the manner of operation of the second imaging operation with respect to the first imaging operation in response to an instruction to perform a predetermined plurality of imaging operations with different imaging times of the first imaging operation Method. 52. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and a second imaging operation in which the imaging unit performs an imaging operation in a non-exposure state to obtain an imaging signal. Is performed, and the image pickup signal obtained by the first image pickup operation is processed by the image pickup signal obtained by the second image pickup operation, and the image pickup time of the first image pickup operation is made different to perform a predetermined number of times. An image processing method, wherein the second imaging operation is not performed for each imaging in response to an instruction to perform imaging. 53. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and a non-exposure state in which the imaging unit performs an imaging operation according to the first imaging operation. A second imaging operation for obtaining an imaging signal is performed, an imaging signal obtained by the first imaging operation is processed by an imaging signal obtained by the second imaging operation, and the first imaging operation is performed.
A method of changing an operation mode of the second imaging operation with respect to the first imaging operation in response to an instruction to perform a predetermined plurality of imaging operations by changing an imaging time of the imaging operation. Storage media. 54. A first imaging operation in which an imaging unit performs an imaging operation in an exposure state to obtain an imaging signal, and a second imaging operation in which the imaging unit performs an imaging operation in a non-exposure state to obtain an imaging signal. Is performed, and the image pickup signal obtained by the first image pickup operation is processed by the image pickup signal obtained by the second image pickup operation, and the image pickup time of the first image pickup operation is made different to perform a predetermined number of times. A storage medium characterized by having a content in which the second imaging operation is not performed for each imaging in response to an instruction to perform imaging.