JP3332895B2 - Imaging device, image processing device, image processing method, and storage medium - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus, an image processing apparatus, an image processing method, and a storage medium, and more particularly to an image processing apparatus for recording a captured still image and / or moving image on a recording medium, and the image processing apparatus. The present invention relates to an image processing method applied to a processing device and a storage medium storing a program for executing the image processing method.

[0002]

2. Description of the Related Art Conventionally, an image processing apparatus such as an electronic camera for recording and reproducing a still image or a moving image picked up by a solid-state image pickup device such as a CCD using a memory card having a solid-state memory device as a recording medium is commercially available. .

[0003] According to these electronic cameras, a user of the electronic camera can easily take a picture by providing an auto focus (AF) function and an automatic exposure (AE) function.

In particular, in a servo AF operation that keeps in focus following the movement of the subject, the focus continues to follow the movement of the subject, and the exposure measurement (A
E) can be followed, and the aperture (Av value) and shutter speed (Tv value) can be updated as needed.

If an AE lock function is further provided, the auto-focus (AF) and the auto-exposure (AE) can be operated independently by fixing and not updating the exposure measurement value of the subject. Is also possible.

When an image is picked up by using a solid-state image pickup device such as a CCD, charge is stored in the same manner as in actual photographing without exposing the image pickup device, and dark image data is read out when the image pickup device is exposed. The dark noise correction processing can be performed by performing an arithmetic processing using the actual photographed image data read out after the above processing.

As a result, high quality image data can be obtained by correcting image data accompanied by image quality deterioration such as dark current noise generated by the image sensor and pixel defects due to minute scratches inherent to the image sensor.

In particular, the dark current noise increases as the charge storage time becomes longer and the temperature of the image pickup device rises, so that a large image quality improvement effect is obtained when long-time exposure or high-temperature exposure is performed. The dark noise correction process is a useful function for the user of the electronic camera.

The charge accumulation time needs to be determined according to the shutter speed (Tv value) obtained by exposure measurement.

In the servo AF operation in which the focus is kept following the movement of the subject, it is necessary to update the exposure measurement value every time the brightness of the subject changes, so that the shutter speed is reduced after the shutter switch is pressed to determine the exposure. Decided
The CCD charge accumulation time is determined accordingly. For this reason, after the shutter switch is pressed, the main shooting and the dark image shooting are performed.

[0011]

For this reason, in the case of performing photographing for obtaining dark image data after the actual photographing, the time between the first and second frames during the continuous photographing is equal to the dark image photographing time. However, there is a problem that it is not possible to make the photographing frame intervals uniform.

On the other hand, in the case where the actual photographing is performed after the photographing for obtaining the dark image data, since the actual photographing cannot be started until the dark image data acquiring process is completed, the shutter release time lag becomes large and the valuable photographing operation becomes valuable. There is a problem that you may miss a photo opportunity.

An object of the present invention is to provide an image pickup apparatus, an image processing apparatus, an image processing method, and a storage medium which can prevent a precious shutter chance from being missed and can make a photographing frame interval uniform. It is assumed that.

[0014]

According to the first aspect of the present invention, there is provided an image processing apparatus for recording a captured still image and / or a moving image on a recording medium without exposure. An imaging unit having a first imaging mode in which electric charge is stored in a memory and a second imaging mode in which electric charge is stored by performing exposure; a storage unit that stores imaging data output from the imaging unit; and the imaging unit. Accumulation time determination means for repeatedly determining the charge accumulation time, accumulation time lock instruction means, imaging instruction means, and if the accumulation time lock instruction is issued by the accumulation time lock instruction means, the imaging means The first image obtained by imaging in the first imaging mode
Is stored in the storage means, and thereafter, when an imaging instruction is issued by the imaging instruction means, the second image data obtained by the imaging means taking an image in the second imaging mode is stored. A first control unit to be stored in the storage unit; and an imaging instruction issued by the imaging instruction unit without the storage time lock instruction being issued by the accumulation time lock instruction unit. The second image data obtained by imaging in the imaging mode is stored in the storage means, and the first image data obtained by the imaging means in the first imaging mode is stored in the storage means. And a second control means for storing the information in the storage device.

According to the tenth aspect of the present invention, in an image processing apparatus for recording a captured still image and / or moving image on a recording medium, a first imaging mode in which charge accumulation is performed without performing exposure, An imaging unit having a second imaging mode for performing and accumulating charge, a storage unit for storing imaging data output from the imaging unit, an accumulation time determining unit for repeatedly determining a charge accumulation time of the imaging unit, When a storage time lock instruction is issued by the accumulation time lock instructing means, the imaging instruction means, and the accumulation time lock instructing means, a first image acquired by the imaging means in the first imaging mode is obtained. The image data is stored in the storage means. After that, if an imaging instruction is issued by the imaging instruction means, a second image data obtained by the imaging means taking an image in the second imaging mode is obtained. First storage means for storing the storage time in the storage means, and if an imaging instruction is given by the imaging instruction means without giving a storage time lock instruction by the accumulation time lock instruction means, the imaging means The first image data obtained by imaging in the first imaging mode is stored in the storage unit, and the second image data obtained by the imaging unit in the second imaging mode is stored in the storage unit. And a second control means for storing in the means.

According to the nineteenth aspect of the present invention, in an image processing apparatus for recording a captured still image and / or moving image on a recording medium, a first imaging mode in which charge is accumulated without performing exposure, Imaging means having a second imaging mode for performing and accumulating charge, storage means for storing imaging data output from the imaging means, and signal calculation means for reading and calculating the imaging data stored in the storage means When,
An accumulation time determining means for repeatedly determining a charge accumulation time of the imaging means; an accumulation time lock instructing means; an imaging instruction means; and a storage time lock instruction issued by the accumulation time lock instructing means. Means for storing unexposed image data obtained by imaging in the first imaging mode in the storage means, and thereafter, if an imaging instruction is issued by the imaging instruction means, the imaging means A first control unit for storing image data of a subject obtained by imaging in the second imaging mode in the storage unit; and an imaging operation performed by the imaging instruction unit without performing an accumulation time lock instruction by the accumulation time lock instruction unit. If the instruction has been given, the image data of the subject obtained by the imaging means in the second imaging mode is stored in the storage means, and thereafter,
A second control unit for storing unexposed image data obtained by the imaging unit in the first imaging mode in the storage unit; and an unexposed image data stored in the storage unit. Third control means for causing the signal calculation means to perform image correction processing based on the image data.

According to the twenty-eighth aspect of the present invention, in an image processing apparatus for recording a captured still image and / or moving image on a recording medium, a first imaging mode in which electric charge is accumulated without performing exposure, Imaging means having a second imaging mode for performing and accumulating charge, storage means for storing imaging data output from the imaging means, and signal calculation means for reading and calculating the imaging data stored in the storage means When,
An accumulation time determining means for repeatedly determining a charge accumulation time of the imaging means; an accumulation time lock instructing means; an imaging instruction means; and a storage time lock instruction issued by the accumulation time lock instructing means. Means for storing unexposed image data obtained by imaging in the first imaging mode in the storage means, and thereafter, if an imaging instruction is issued by the imaging instruction means, the imaging means A first control unit for storing image data of a subject obtained by imaging in the second imaging mode in the storage unit; and an imaging operation performed by the imaging instruction unit without performing an accumulation time lock instruction by the accumulation time lock instruction unit. If the instruction is issued, the image capturing unit stores unexposed image data obtained by imaging in the first image capturing mode in the storage unit, and thereafter,
Second control means for storing image data of a subject obtained by the imaging means in the second imaging mode in the storage means; unexposed image data and image of the subject stored in the storage means; A third control unit for causing the signal operation unit to perform an image correction process based on the data.

According to the invention described in claim 37, the image pickup means includes a first image pickup mode in which charge is stored without exposure and a second image pickup mode in which charge is stored by exposure. An image processing method applied to an image processing apparatus that includes a storage unit that stores imaging data output from an imaging unit, an accumulation time lock instruction unit, and an imaging instruction unit, and that captures and records a still image and / or a moving image. An accumulation time determining step of repeatedly determining the charge accumulation time of the imaging means, and if the storage time lock instruction means instructs to lock the accumulation time, the imaging means performs imaging in the first imaging mode. The first image data thus obtained is stored in the storage means. After that, if the imaging instruction is issued by the imaging instruction means, the imaging means
A first control step of storing second image data obtained by imaging in the imaging mode in the storage means, and imaging by the imaging instruction means without performing an accumulation time lock instruction by the accumulation time lock instruction means. When the instruction is given, the storage means stores second image data obtained by the imaging means in the second imaging mode, and thereafter, the imaging means sets the first imaging mode to the first imaging mode. And a second control step of storing the first image data obtained by the imaging in the storage means.

According to the forty-sixth aspect of the present invention, there is provided an imaging means having a first imaging mode in which charge is stored without exposure and a second imaging mode in which charge is stored by performing exposure, and the imaging means. An image processing method comprising: a storage unit for storing imaging data output from a storage unit; an accumulation time lock instruction unit; and an imaging instruction unit, and applied to an image processing apparatus that captures and records a still image and / or a moving image. An accumulation time determining step of repeatedly determining the charge accumulation time of the imaging means; and if the storage time lock instruction means instructs to lock the accumulation time, the imaging means sets the first time.
The first image data obtained by imaging in the imaging mode is stored in the storage unit, and thereafter, when an imaging instruction is issued by the imaging instruction unit, the imaging unit is switched to the second imaging mode in the second imaging mode. A first control step of storing the second image data obtained by imaging in the storage means, and an imaging instruction is issued by the imaging instruction means without the storage time lock instruction being issued by the accumulation time lock instruction means. If
The first image data obtained by the image pickup means taking an image in the first image pickup mode is stored in the storage means, and thereafter,
A second control step of storing second image data obtained by the imaging means in the second imaging mode in the storage means.

According to the fifty-fifth aspect of the present invention, there is provided an image pickup means having a first image pickup mode in which charge is stored without exposure and a second image pickup mode in which charge is stored by exposure. Storage means for storing the image data output from the storage means, signal calculation means for reading and calculating the image data stored in the storage means, storage time lock instructing means,
An image processing method that is applied to an image processing apparatus that captures and records a still image and / or a moving image, comprising: an imaging instruction unit; an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit; If a lock instruction for the storage time is issued by the lock instruction means, the image data is stored in the storage means, and the unexposed image data obtained by the imaging means in the first imaging mode is stored in the storage means. A first control step of storing, in the storage means, image data of a subject obtained by the imaging means in the second imaging mode, when the imaging instruction is issued by the instruction means; If the imaging instruction is issued by the imaging instruction means without the lock instruction of the storage time being issued by the instruction means, the imaging means performs imaging in the second imaging mode. A second control step of storing the image data of the subject in the storage unit, and thereafter storing the unexposed image data obtained by the imaging unit in the first imaging mode. A third control step of causing the signal calculation means to perform an image correction process based on the unexposed image data and the subject image data stored in the storage means.

According to the invention of claim 64, an image pickup means having a first image pickup mode in which charge is stored without exposure and a second image pickup mode in which charge is stored by exposure, and the image pickup means Storage means for storing the image data output from the storage means, signal calculation means for reading and calculating the image data stored in the storage means, storage time lock instructing means,
An image processing method that is applied to an image processing apparatus that captures and records a still image and / or a moving image, comprising: an imaging instruction unit; an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit; If a lock instruction for the storage time is issued by the lock instruction means, the image data is stored in the storage means, and the unexposed image data obtained by the imaging means in the first imaging mode is stored in the storage means. A first control step of storing, in the storage means, image data of a subject obtained by the imaging means in the second imaging mode, when the imaging instruction is issued by the instruction means; If an imaging instruction is issued by the imaging instruction means without the locking instruction of the storage time being issued by the instruction means, the imaging means performs imaging in the first imaging mode. A second control step of storing the unexposed image data in the storage means, and thereafter storing the image data of the subject obtained by the imaging means in the second imaging mode. A third control step of causing the signal calculation means to perform an image correction process based on the unexposed image data and the subject image data stored in the storage means.

Further, according to the invention of claim 73,
Imaging means having a first imaging mode for performing charge accumulation without exposure and a second imaging mode for performing charge accumulation by performing exposure; storage means for storing imaging data output from the imaging means; In a computer-readable storage medium comprising a time lock instructing unit and an imaging instructing unit, and storing, as a program, an image processing method applied to an image processing apparatus that captures and records a still image and / or a moving image. An image processing method, an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit,
If a storage time lock instruction is issued by the accumulation time lock instruction means, first image data obtained by the imaging means taking an image in the first imaging mode is stored in the storage means. A first control step of storing, in the storage unit, second image data obtained by the imaging unit in the second imaging mode when the imaging instruction is issued by the imaging instruction unit; If an image capturing instruction is issued by the image capturing instruction unit without the storage time lock instruction being issued by the storage time lock instruction unit, a second image obtained by the image capturing unit capturing an image in the second image capturing mode A second control step of storing data in the storage unit, and thereafter, storing the first image data obtained by the imaging unit in the first imaging mode in the storage unit. And butterflies.

According to the 74th aspect of the present invention, there is provided an image pickup means having a first image pickup mode in which charge is stored without exposure and a second image pickup mode in which charge is stored by performing exposure, and the image pickup means An image processing method including an image processing apparatus for storing a still image and / or a moving image, which includes a storage unit for storing imaging data output from the image processing unit, an accumulation time lock instruction unit, and an imaging instruction unit, is provided as a program. In the stored storage medium readable by the computer, the image processing method repeatedly determines the charge storage time of the imaging unit, and the storage time lock instructing unit issues a storage time lock instruction. Then, the first image data obtained by the imaging means in the first imaging mode is stored in the storage means. A first control step of storing, in the storage unit, second image data obtained by the imaging unit in the second imaging mode when the imaging instruction is issued by the image instruction unit; If the imaging instruction is issued by the imaging instruction means without the locking instruction of the accumulation time being issued by the time lock instruction means, the first image data obtained by the imaging means taking an image in the first imaging mode is displayed. A second control step of causing the storage means to store the second image data obtained by the imaging means in the second imaging mode, and then storing the second image data in the storage means. I do.

According to the 75th aspect of the present invention, there is provided an image pickup means having a first image pickup mode in which charge is stored without exposure and a second image pickup mode in which charge is stored by exposure, and the image pickup means Storage means for storing the image data output from the storage means, signal calculation means for reading and calculating the image data stored in the storage means, storage time lock instructing means,
A computer-readable storage medium that includes an imaging instruction unit and stores, as a program, an image processing method applied to an image processing apparatus that captures and records a still image and / or a moving image. An accumulation time determining step of repeatedly determining the charge accumulation time of the imaging means, and if the storage time lock instruction is issued by the accumulation time lock instruction means, the imaging means obtains an image in the first imaging mode. The unexposed image data is stored in the storage unit, and thereafter, if an imaging instruction is given by the imaging instruction unit, an image of the subject obtained by the imaging unit taking an image in the second imaging mode. A first control step of storing data in the storage means, and the storage time lock instructing means does not issue a storage time lock instruction. If the imaging instruction is given by the image instruction means, the image data of the subject obtained by the imaging means taking an image in the second imaging mode is stored in the storage means. A second control step of storing unexposed image data obtained by imaging in the first imaging mode in the storage unit, and based on the unexposed image data and the subject image data stored in the storage unit, A third control step of causing the signal calculation means to perform an image correction process.

According to the invention of claim 76, an image pickup means having a first image pickup mode in which electric charge is stored without exposure and a second image pickup mode in which electric charge is stored by performing exposure, and the image pickup means Storage means for storing the image data output from the storage means, signal calculation means for reading and calculating the image data stored in the storage means, storage time lock instructing means,
A computer-readable storage medium that includes an imaging instruction unit and stores, as a program, an image processing method applied to an image processing apparatus that captures and records a still image and / or a moving image. An accumulation time determining step of repeatedly determining the charge accumulation time of the imaging means, and if the storage time lock instruction is issued by the accumulation time lock instruction means, the imaging means obtains an image in the first imaging mode. The unexposed image data is stored in the storage unit, and thereafter, if an imaging instruction is given by the imaging instruction unit, an image of the subject obtained by the imaging unit taking an image in the second imaging mode. A first control step of storing data in the storage means, and the storage time lock instructing means does not issue a storage time lock instruction. If the imaging instruction is given by the image instruction means, the unexposed image data obtained by the imaging means taking an image in the first imaging mode is stored in the storage means. A second control step of storing the image data of the subject obtained by imaging in the second imaging mode in the storage unit, and based on the unexposed image data and the image data of the subject stored in the storage unit, A third control step of causing the signal calculation means to perform an image correction process.

According to the invention of claim 77, the imaging means, the imaging time fixing instructing means for instructing fixing of the imaging time so that the imaging time of the imaging means does not change for each imaging, and Performing a first imaging operation of causing the imaging unit to perform an imaging operation to obtain an imaging signal and a second imaging operation of causing the imaging unit to perform an imaging operation in a non-exposure state to obtain an imaging signal; Processing an imaging signal obtained by the imaging operation with an imaging signal obtained by the second imaging operation; and causing the imaging means to perform the first imaging operation and then perform the second imaging operation. The first mode and the second mode in which the first imaging operation is performed after the second imaging operation is performed. When the imaging time fixing instruction unit issues an instruction to fix the imaging time, In the second mode It is an imaging apparatus having a signal processing means for work.

[0027] According to the invention described in claim 83, the imaging means, the imaging time fixing instructing means for instructing the imaging time to be fixed so that the imaging time of the imaging means does not change for each imaging, and the shutter release member. Exposure instructing means for giving an exposure preparation instruction in a first stroke and an exposure start instruction in a second stroke, a first imaging operation for obtaining an imaging signal by causing the imaging means to perform an imaging operation in an exposure state, and a non-exposure state Performing a second imaging operation for obtaining an imaging signal by causing the imaging means to perform an imaging operation, and processing an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation. A signal processing unit that performs the second imaging operation in response to the exposure preparation instruction from the exposure instruction unit, when there is an instruction to fix the imaging time from the imaging time fixing instruction unit; It is an imaging apparatus having.

Further, according to the invention of claim 88, it is possible to instruct the image pickup means to fix the image pickup time so that the image pickup time of the image pickup means does not change for each image pickup, and to cause the image pickup means to perform the image pickup operation in the exposure state. A first imaging operation for obtaining an imaging signal by performing a second imaging operation for obtaining an imaging signal by causing the imaging unit to perform an imaging operation in a non-exposure state, and obtaining an imaging signal obtained by the first imaging operation. A first mode in which the second imaging operation is performed after the first imaging operation is performed by the imaging unit while processing is performed using an imaging signal obtained by a second imaging operation; An image processing method that operates in the second mode when a second mode in which the first imaging operation is performed after the operation is performed and an instruction to fix the imaging time is provided. is there.

Further, according to the invention of claim 89, it is possible to instruct to fix the imaging time so that the imaging time of the imaging means does not change for each imaging, and to issue an exposure preparation instruction with the first stroke of the shutter release member. An exposure start instruction is given in a second stroke, and a first imaging operation in which the imaging means performs an imaging operation in an exposure state to obtain an imaging signal, and an imaging operation is performed in the non-exposure state by the imaging means to obtain an imaging signal. Performing a second imaging operation to obtain, processing an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation, and when there is an instruction to fix the imaging time, And an image processing method for performing the second imaging operation in response to the exposure preparation instruction.

According to the present invention, it is possible to instruct the image pickup means to fix the image pickup time so that the image pickup time does not change for each image pickup, and to cause the image pickup means to perform the image pickup operation in the exposure state. A first imaging operation for obtaining an imaging signal by performing a second imaging operation for obtaining an imaging signal by causing the imaging unit to perform an imaging operation in a non-exposure state, and obtaining an imaging signal obtained by the first imaging operation. A first mode in which the second imaging operation is performed after the first imaging operation is performed by the imaging unit while processing is performed using an imaging signal obtained by a second imaging operation; A second mode in which the first imaging operation is performed after the operation is performed. If there is an instruction to fix the imaging time, a computer-readable program having a program that operates in the second mode is provided. Storage media It is intended to.

According to the nineteenth aspect, it is possible to instruct to fix the imaging time so that the imaging time of the imaging means does not change for each imaging, and to issue an exposure preparation instruction with the first stroke of the shutter release member. An exposure start instruction is given in a second stroke, and a first imaging operation in which the imaging means performs an imaging operation in an exposure state to obtain an imaging signal, and an imaging operation is performed in the non-exposure state by the imaging means to obtain an imaging signal. Performing a second imaging operation to obtain, processing an imaging signal obtained by the first imaging operation with an imaging signal obtained by the second imaging operation, and when there is an instruction to fix the imaging time, And a computer-readable storage medium having a program for performing the second imaging operation in response to the exposure preparation instruction.

[0032]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) FIG. 1 is a block diagram showing a configuration of an image processing apparatus according to a first embodiment of the present invention.

In the figure, reference numeral 100 denotes an image processing device.

Reference numeral 12 denotes a shutter for controlling the amount of exposure to the image pickup device 14, and 14 denotes an image pickup device such as a CCD or CMOS for converting an optical image into an electric signal.

The light beam incident on the lens 310 is guided to the image sensor 14 via the stop 312, the lens mounts 306 and 106, the mirror 130, and the shutter 12 by the single-lens reflex method, and is formed on the image sensor 14 as an optical image. Image.

Reference numeral 16 denotes an A / D converter for converting an analog signal output of the image sensor 14 into a digital signal.

Reference numeral 18 denotes an image sensor 14, an A / D converter 16,
This is a timing generation circuit that supplies a clock signal and a control signal to the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on data from the A / D converter 16 or data from the memory control circuit 22.

Further, in the image processing circuit 20, predetermined arithmetic processing is performed as needed using the captured image data, and based on the obtained arithmetic result, the system control circuit 50 causes the exposure control means 40 to perform measurement. TTL (through-the-lens) AF that controls the distance control means 42
(Auto focus) processing, AE (auto exposure) processing, E
F (flash light control) processing can be performed.

Further, in the image processing circuit 20, predetermined arithmetic processing is performed using the captured image data, and TTL AWB (auto white balance) processing is also performed based on the obtained arithmetic result.

In this embodiment, since the distance measuring means 42 and the light measuring means 46 are provided exclusively,
The AF (auto focus), AE (auto exposure), and EF (flash light control) processes are performed using the distance measuring unit 42 and the photometric unit 46, and the image processing circuit 20 is used.
It is also possible to adopt a configuration in which the AF (autofocus) processing, the AE (automatic exposure) processing, and the EF (flash dimming) processing using the processing are not performed.

Alternatively, AF (auto focus) processing, AE (auto exposure) processing, and EF (flash light control) processing are performed by using the distance measuring means 42 and the light measuring means 46. It may be configured to perform each of AF (auto focus) processing, AE (auto exposure) processing, and EF (flash light control) processing using.

Reference numeral 22 denotes a memory control circuit, which includes an A / D converter 16, a timing generation circuit 18, an image processing circuit 20,
Image display memory 24, D / A converter 26, memory 30,
The compression / decompression circuit 32 is controlled.

The data of the A / D converter 16 is transmitted through the image processing circuit 20 and the memory control circuit 22, or the data of the A / D converter 16 is transmitted directly through the memory control circuit 22, and the image display memory 24 is controlled. Is written to the memory 30.

Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, and 28 denotes an image display unit comprising a TFT LCD or the like.
The display image data written in the image display memory 24 is displayed by the image display unit 28 via the D / A converter 26.

If the captured image data is sequentially displayed using the image display section 28, an electronic finder function can be realized.

The image display unit 28 can turn on / off the display in accordance with an instruction from the system control circuit 50. When the display is turned off, the image processing unit 10
0 power consumption can be significantly reduced.

Reference numeral 30 denotes a memory for storing photographed still images and moving images, which has a sufficient storage capacity to store a predetermined number of still images and moving images for a predetermined time. Therefore, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed.

The memory 30 is provided with a system control circuit 50.
Can also be used as a work area.

32 is an adaptive discrete cosine transform (ADCT)
And a compression / decompression circuit for compressing / decompressing image data by wavelet transformation or the like. The compression / decompression circuit reads an image stored in the memory 30, performs compression processing or decompression processing, and writes the processed data to the memory 30.

Reference numeral 40 denotes shutter control means for controlling the shutter 12 in cooperation with aperture control means 340 for controlling the aperture 312 based on photometric information from the photometric means 46.

Reference numeral 42 denotes distance measuring means for performing AF (auto focus) processing. The light beam incident on the lens 310 is incident on the distance measuring means 42 via the diaphragm 312, the lens mounts 306 and 106, the mirror 130, and the distance measuring sub-mirror (not shown) by a single-lens reflex method, thereby forming an optical image. The focus state of the formed image can be measured.

Reference numeral 46 denotes a photometry means for performing AE (automatic exposure) processing. The light beam incident on the lens 310 is converted into a stop 312 and a lens mount 306 by a single-lens reflex method.
And 106, mirrors 130 and 132, and a photometric lens (not shown), the light is incident on the photometric means 46, whereby the exposure state of the image formed as an optical image can be measured.

The photometric means 46 also has an EF (flash light control) processing function in cooperation with the flash 48.

Reference numeral 48 denotes a flash, which also has a function of projecting AF auxiliary light and a function of controlling flash light.

The image data from the image sensor 14 is calculated by the image processing circuit 20 based on the calculation result.
The system control circuit 50 can also perform exposure control and AF (autofocus) control on the shutter control means 40, the aperture control means 340, and the distance measurement control means 342 using the video TTL method.

Further, the result of measurement by the distance measuring means 42 and
The AF (auto focus) control may be performed by using the image data from the image sensor 14 and the calculation result obtained by the image processing circuit 20 together.

The exposure control may be performed by using both the measurement result by the photometry means 46 and the calculation result obtained by the image processing circuit 20 calculating the image data from the image sensor 14.

Reference numeral 50 denotes a system control circuit for controlling the entire image processing apparatus 100;
Is a memory for storing constants, variables, programs, and the like for the operation of.

Reference numeral 54 denotes a display unit comprising a liquid crystal display device, a speaker, and the like for displaying an operation state, a message, and the like using characters, images, sounds, and the like in accordance with the execution of the program by the system control circuit 50. A single or a plurality of units are installed at easily visible positions near the operation unit of the processing apparatus 100, and are configured by, for example, a combination of an LCD, an LED, and a sound generating element. The display unit 54 has a part of its functions installed in the optical viewfinder 104.

Of the display contents of the display unit 54, those displayed on the LCD or the like include, for example, a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, and a remaining image capturing. Available number display, Shutter speed display, Aperture value display, Exposure compensation display, Flash display, Red-eye reduction display, Macro shooting display, Buzzer setting display, Battery remaining battery display, Battery remaining display, Error display, Multi-digit number , Display of the attachment / detachment state of the recording media 200 and 210, indication of the attachment / detachment state of the lens unit 300, communication I / F operation display, date / time display, display indicating the connection state with an external computer, and the like.

Of the display contents of the display section 54, those displayed in the optical viewfinder 104 include, for example, an in-focus display, a shooting ready display, a camera shake warning display, a flash charging display, a flash charging completed display, and a shutter charging display. There are a speed display, an aperture value display, an exposure correction display, a recording medium writing operation display, and the like.

Further, among the display contents of the display unit 54, L
The display on the ED or the like includes, for example, an in-focus display, a shooting ready display, a camera shake warning display, a camera shake warning display, a flash charge display, a flash charge completion display, a recording medium writing operation display, a macro shooting setting notification display, and a And the next battery charge state display.

Among the display contents of the display unit 54, those displayed on a lamp or the like include, for example, a self-timer notification lamp. This self-timer notification lamp may be shared with the AF auxiliary light.

Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory, for example, an EEPROM or the like.

60, 62, 64, 66, 68 and 70
Is an operation means for inputting various operation instructions to the system control circuit 50, and is constituted by one or a combination of a switch, a dial, a touch panel, pointing by gaze detection, a voice recognition device, and the like.

Here, these operation means will be specifically described.

Reference numeral 60 denotes a mode dial switch, which is an automatic shooting mode, a program shooting mode, a shutter speed priority shooting mode, an aperture priority shooting mode, a manual shooting mode, a depth of focus priority (depth) shooting mode, a portrait shooting mode, and a landscape shooting mode. Each function photographing mode such as a mode, a close-up photographing mode, a sports photographing mode, a night scene photographing mode, a panoramic photographing mode can be switched and set.

Reference numeral 62 denotes a shutter switch SW1,
ON when the shutter button (not shown) is being operated (half-pressed)
AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, E
An instruction is issued to start an operation such as F (flash light control) processing.

Reference numeral 64 denotes a shutter switch SW2.
Turns on when shutter button operation (not shown) is completed (fully pressed)
Exposure processing for writing the image data into the memory 30 via the A / D converter 16 and the memory control circuit 22 with the signal read from the image sensor 12, and development using the calculation in the image processing circuit 20 and the memory control circuit 22 Processing, the image data is read from the memory 30, compressed by the compression / decompression circuit 32, and an operation of a series of processing of writing image data to the recording medium 200 or 210 is instructed to start.

Reference numeral 66 denotes an exposure compensation switch, which is used to increase or decrease the exposure value obtained by measuring the exposure of the subject to a desired number of steps (the number of steps) and set the exposure value to an exposure value that is over or under the standard. The exposure compensation switch 66
The number of exposure correction steps (the number of steps) may be more easily selected by using a plus button and a minus button, or a rotary dial switch in combination.

Reference numeral 68 denotes an AE lock switch, which is used to fix an exposure value obtained by measuring the exposure of a subject so as not to update the exposure value. In particular, while the shutter switch SW1 is pressed, the auto focus (A
F) Servo AF that continues operation and automatic exposure (AE) operation
In the mode, the exposure value can be fixed separately from the AF operation, which is very convenient.

An operation unit 70 includes various buttons and a touch panel. The operation unit 70 includes a menu button, a set button, a macro button, a multi-screen playback update button, a flash setting button, a self-timer setting button, and a menu. Move + (plus) button, menu move-
(Minus) button, playback image move + (plus) button, playback image-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, panorama mode, etc. Selection / switch button for setting selection and switching of functions, decision / execution button for setting and execution of various functions when executing shooting and playback in panorama mode, etc., and image display unit 2
8, an image display ON / OFF switch for setting ON / OFF, and a quick review ON / OFF for setting a quick review function for automatically reproducing image data taken immediately after shooting.
A compression mode switch, which is an OFF switch, a switch for selecting a compression ratio of JPEG compression, or a switch for selecting a CCD MW mode in which an output signal of an image sensor is digitized as it is and recorded on a recording medium; A reproduction switch for setting each function mode such as a multi-screen reproduction / erase mode and a PC connection mode, a single shooting mode in which a single frame is photographed when a shutter switch SW2 is pressed and a standby state is set, and a shutter switch SW2 A single / continuous switch to set the continuous shooting mode to keep shooting continuously while pressed,
When the shutter switch SW1 is pressed, an autofocus operation is started, and once focus is achieved, the one-shot AF mode in which the in-focus state is maintained, and the autofocus operation is continuously performed while the shutter switch SW1 is pressed. AF for setting servo AF mode
The mode setting switch, an image captured in the shooting mode state is stored in the memory 30 or the recording medium 200 or 210
And a reproduction switch for instructing the start of a reproduction operation to be read out from the image display unit 28 and displayed on the image display unit 28.

Further, the functions of the plus button and the minus button are provided with a rotary dial switch, so that numerical values and functions can be more easily selected.

Reference numeral 72 denotes a power switch which can be set to switch between a power-on mode and a power-off mode of the image processing apparatus 100. Further, a lens unit 300 connected to the image processing apparatus 100, an external strobe, a recording medium 2
The power-on and power-off settings of various accessory devices such as 00 and 210 can also be switched and set.

Reference numeral 80 denotes a power supply control means, which comprises a battery detection circuit, a DC-DC converter, a switch circuit for switching a block to be energized, and the like, and detects whether or not a battery is mounted, the type of battery, and the remaining battery level. The DC-DC based on the detection result and the instruction of the system control circuit 50.
The converter is controlled to supply a required voltage to each unit including a recording medium for a required period.

Reference numeral 82 denotes a connector, 84 denotes a connector, and 86 denotes a power supply. The power supply unit 86 is a power supply unit including a primary battery such as an alkaline battery and a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, and a Li battery, and an AC adapter.

Reference numerals 90 and 94 denote interfaces with recording media such as a memory card and a hard disk. Reference numerals 92 and 96 denote connectors for connecting to recording media such as a memory card and a hard disk. This is a recording medium attachment / detachment detection unit that detects whether the recording medium 200 or 210 is mounted.

In this embodiment, the description has been made assuming that there are two interfaces and connectors for attaching a recording medium. Instead, the interface and the connector for attaching the recording medium may have a single or plural number of systems. Also,
It may be configured to include a combination of interfaces and connectors of different standards.

As the interface and the connector,
You may comprise using what conformed to standards, such as a PCMCIA card and a CF (compact flash) card.

Further, the interfaces 90 and 94 and the connectors 92 and 96 are connected to a PCMCIA card or CF.
(Compact flash) When using a card conforming to the standard such as a card, a LAN card, a modem card, a USB card, an IEEE1394 card, a P128
By connecting various communication cards such as a 4-card, a SCSI card, a communication card such as a PHS, and the like, image data and management information attached to the image data are transferred to and from other peripheral devices such as a computer and a printer. I can do it.

Reference numeral 104 denotes an optical finder;
The light beam incident on the lens 10 is converted to a stop 3 by a single-lens reflex method.
12, lens mounts 306 and 106, mirror 130
And 132, and can be displayed as an optical image. Thus, it is possible to perform photographing using only the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are provided.

A communication unit 110 has various communication functions such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication.

Reference numeral 112 denotes a connector for connecting the image processing apparatus 100 to another device by the communication unit 110 or an antenna in the case of wireless communication.

Reference numeral 120 denotes an interface in the lens mount 106 for connecting the image processing apparatus 100 to the lens unit 300; 122, a connector for electrically connecting the image processing apparatus 100 to the lens unit 300; Denotes a lens attachment / detachment detecting unit that detects whether the lens unit 300 is mounted on the lens mount 106 and / or the connector 122.

The connector 122 has a function of transmitting control signals, status signals, data signals, and the like between the image processing apparatus 100 and the lens unit 300 and supplying currents of various voltages. Further, the connector 122 may be configured to transmit not only electric communication but also optical communication, voice communication, and the like.

Reference numerals 130 and 132 denote mirrors, and a lens 310
Can be guided to the optical finder 104 by a single-lens reflex method. The mirror 132 is
Either the configuration of the quick return mirror or the configuration of the half mirror may be used.

Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 including a semiconductor memory or a magnetic disk, an interface 204 with the image processing apparatus 100, and the image processing apparatus 1
00 is provided with a connector 206 for making a connection.

Reference numeral 210 denotes a recording medium such as a memory card or a hard disk. The recording medium 210 includes a recording unit 212 including a semiconductor memory and a magnetic disk, an interface 214 with the image processing apparatus 100, and the image processing apparatus 1
00 and a connector 216 for making connection with the 00.

Reference numeral 300 denotes an interchangeable lens type lens unit.

Reference numeral 306 denotes a lens mount for mechanically connecting the lens unit 300 to the image processing apparatus 100. In the lens mount 306, the lens unit 30
0 is electrically connected to the image processing apparatus 100.

Reference numeral 310 denotes a photographing lens, and reference numeral 312 denotes an aperture.

Reference numeral 320 denotes an interface in the lens mount 306 for connecting the lens unit 300 to the image processing apparatus 100. Reference numeral 322 denotes a connector for electrically connecting the lens unit 300 to the image processing apparatus 100. The connector 322 is connected to the image processing apparatus 100.
Control signals, status signals,
It has a function of supplying or supplying currents of various voltages while transmitting data signals and the like. Note that the connector 322 may be configured to transmit not only electric communication but also optical communication, voice communication, and the like.

Reference numeral 340 denotes an aperture control unit that controls the aperture 312 in cooperation with the shutter control unit 40 that controls the shutter 12 based on photometric information from the photometric unit 46.

Reference numeral 342 denotes a distance measurement control unit that controls focusing of the photographing lens 310, and 344 denotes a zoom control unit that controls zooming of the photographing lens 310.

A lens system control circuit 350 controls the entire lens unit 300. The lens system control circuit 350 includes constants for operating the lens unit 300,
A function of a memory for storing variables, programs, and the like, identification information such as a number unique to the lens unit 300, management information, function information such as an open aperture value, a minimum aperture value, and a focal length, and current and past set values. It also has the function of a non-volatile memory to hold.

Next, the operation of the image processing apparatus having the above configuration will be described with reference to FIGS.

FIGS. 2 to 4 are flowcharts of a main routine showing a control procedure of the image processing apparatus 100.

First, in FIG. 2, when the power is turned on upon replacement of a battery or the like, the system control circuit 50 initializes flags, control variables, and the like, and at each part of the image processing apparatus 100 performs necessary predetermined initial settings (S101). ), The AE lock flag stored in the internal memory of the system control circuit 50 or the memory 52 is released (S102).

The system control circuit 50 includes the power switch 6
6 Check the setting position and turn off the power switch 66.
(S103), the display of each display unit is changed to the end state, and necessary parameters including flags, control variables, etc., setting values, and setting modes are set in the nonvolatile memory 56.
After performing predetermined termination processing such as shutting off unnecessary power supply of each unit of the image processing apparatus 100 including the image display unit 28 by the power supply control unit 80 (S104), the process returns to S102.

If the power switch 66 is set to power ON (S103), the system control circuit 50 determines whether the remaining capacity of the power source 86 composed of a battery or the like or the operating condition is
It is determined whether or not the operation of the image processing apparatus 100 is hindered (S105). If there is a hindrance, a predetermined warning is displayed by image or sound using the display unit 54 (S10).
6) Return to S102.

If there is no problem in the power supply 86 (S10
5), the system control circuit 50 checks the set position of the mode dial 60, and if the mode dial 60 has been set to the photographing mode (S107), the process proceeds to S109.

If the mode dial 60 has been set to another mode (S107), the system control circuit 5
0 executes a process according to the selected mode (S10
8) When the processing is completed, the process returns to S102.

The system control circuit 50 controls the recording medium 200
Alternatively, it is determined whether or not 210 is mounted, management information of image data recorded on the recording medium 200 or 210 is obtained, and the operation state of the recording medium 200 or 210 causes a problem in the operation of the image processing apparatus 100. It is determined whether or not there is a problem, in particular, whether or not there is a problem in the operation of recording and reproducing the image data on the recording medium (S109). After performing (S106), the process returns to S102.

If the result of determination in S109 is that there is no problem, the flow proceeds to S110.

The system control circuit 50 uses the display unit 54 to display various setting states of the image processing apparatus 100 using images and sounds (S110). If the image display of the image display unit 28 is ON, various setting states of the image processing apparatus 100 are displayed by the image using the image display unit 28.

Next, referring to FIG.
It is determined whether or not W1 is pressed (S121). If not, the process returns to S102.

When the shutter switch SW1 is pressed (S121), the system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on a subject, and performs a photometry process to set an aperture value and a shutter time. The determined distance measurement and photometry processing is performed (S122), and the process proceeds to S123.

In the photometric processing, if necessary, flash setting is also performed.

The detailed procedure of the distance measurement / photometry processing S122 will be described later with reference to FIGS.

The system control circuit 50 checks the setting state of the exposure compensation switch 66. If the exposure compensation has not been set (S123), the process proceeds to S126.

If the exposure compensation has been set (S12
3), the system control circuit 50 determines whether it is necessary to change the shutter speed (Tv value) according to the exposure correction value in accordance with the setting of the shooting mode and / or the exposure mode (S124). , Shutter speed (Tv
If it is not necessary to change (value), the process proceeds to S126.

The exposure compensation switch 66 can more easily set the number of exposure compensation steps (the number of steps) by using a plus button, a minus button, or a rotary dial switch together.

If it is necessary to change the shutter speed (Tv value) according to the exposure correction value, the system control circuit 50 changes the shutter speed (Tv value) and changes the shutter speed (Tv value) according to the changed shutter speed (Tv value). Then, the charge accumulation time of the image sensor 14 is newly set (S125).

For example, aperture (Av) priority shooting mode, automatic shooting mode, program shooting mode, depth of focus priority (depth) shooting mode, portrait shooting mode, landscape shooting mode, close-up shooting mode, night view shooting mode, panoramic shooting mode In each shooting mode such as, it is necessary to change the shutter speed in accordance with the exposure correction, and in this case, it is necessary to newly set the charge accumulation time of the image sensor 14.

It is to be noted that a photographing process S133 and a dark capture process S128 or S136, which will be described later, are performed using the charge accumulation time set here.

The system control circuit 50 checks the state of the AE lock switch 68 (S126). If the AE lock switch 68 has not been pressed, the process proceeds to S129.

If the AE lock switch 68 has been depressed, the system control circuit 50 sets an AE lock flag (S127). With the shutter 12 closed, noise components such as dark current of the image sensor 14 are actually photographed. A dark capture process is performed to accumulate the same time as that and read the accumulated noise image signal (S128), and the process proceeds to S129.

The state of the AE lock flag is stored in the internal memory of the system control circuit 50 or the memory 52.

By performing a correction calculation process using the dark image data captured in the dark capture process,
The captured image data can be corrected with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches unique to the image sensor 14.

The detailed procedure of the dark capture process S128 will be described later with reference to FIG.

As described above, if the AE lock switch has been set in S126, dark capture processing S128 is performed prior to the execution of continuous shooting. As a result, in S129 described later, the shutter switch SW2
When the continuous shooting is performed by pressing, the interval between the continuous shooting frames can be made substantially constant.

Next, proceeding to FIG. 4, the shutter switch SW
It is determined whether or not the shutter switch SW2 is pressed (S129). If the shutter switch SW2 is not pressed, the system control circuit 50 checks the state of the shutter switch SW1 (S130).

If the shutter switch SW1 is released (S130), the process returns to S102. If the shutter switch SW1 has been pressed (S130), the process returns to S122.

If the shutter switch SW2 is depressed (S129), the system control circuit 50 determines whether or not an area where the captured image data can be stored is in the image storage buffer area of the memory 30 (S131). If there is no area in the image storage buffer area of the memory 30 where new image data can be stored, a predetermined warning display is performed using an image or a sound using the display unit 54 (S132).
It returns to S102.

For example, immediately after the maximum number of continuous shots that can be stored in the image storage buffer area of the memory 30 has been performed, and the first image to be read from the memory 30 and written to the storage medium 200 or 210, An example of this state is a state in which the recording medium 200 or 210 has not yet been recorded, and thus one empty area cannot be secured in the image storage buffer area of the memory 30 yet.

When the photographed image data is compressed and stored in the image storage buffer area of the memory 30, the amount of compressed image data differs depending on the setting of the compression mode. The area that can be stored is memory 3.
In step S131, it is determined whether the image data is in the image storage buffer area 0.
Will be determined.

If there is an area in the image storage buffer area of the memory 30 in which captured image data can be stored (S1)
31), the system control circuit 50 reads out the image pickup signal that has been imaged and accumulated for a predetermined time from the image pickup device 12, and performs A / D
The memory control circuit 2 is connected via the converter 16, the image processing circuit 20, the memory control circuit 22 or directly from the A / D converter.
Then, a photographing process for writing photographed image data in a predetermined area of the memory 30 via the memory 2 is executed (S133).

The detailed procedure of this photographing process S133 will be described later with reference to FIGS.

When the photographing process S133 is completed, the system control circuit 50 checks the state of the AE lock flag stored in the internal memory of the system control circuit 50 or the memory 52 (S134), and the AE lock flag is set. If so, the process proceeds to S137.

If the AE lock flag has been set in S134, the dark capture process has already been performed in S128 prior to the execution of the continuous shooting, so the dark capture process is not performed in S136 described later. The development process S137 is executed. As a result, it is possible to make the interval between consecutively shot frames almost constant.

If the AE lock flag is not set (S134), the system control circuit 50 determines whether it is necessary to newly execute the dark capture process, or changes the charge accumulation time in the photographing process S133. In response to this, the set time for charge accumulation in the dark capture process is changed, and it is determined whether the dark capture process needs to be performed again (S135). If the dark capture process needs to be performed, the process proceeds to S136. .

For example, if continuous shooting is started in a state where the AE lock flag is not set, a new dark capture process must be performed immediately after the first frame has been shot. Therefore, the set time used in S403 in the dark capture process of FIG. 9 described later is newly set.

Alternatively, continuous shooting is performed in a state where the AE lock flag is not set, and during the continuous shooting, the exposure (AE) result detected in the photometry processing S207 described later is changed. If the shutter speed (Tv value) and the set time for charge accumulation in the photographing process S133 change, the process proceeds to S40 in the dark capture process of FIG.
The set time for charge storage used in step 3 will be changed.

On the other hand, if it is not necessary to change the set time (S135), the process proceeds to S137 without performing the new dark image data fetching process.

In this case, the dark noise correction processing may be performed in the development processing S137 using the dark capture data that has already been captured.

The system control circuit 50 controls the shutter 12
In a state in which the noise component such as dark current of the image sensor 14 is accumulated for the same time as the main photographing in a state where is closed, a dark capture process for reading out the noise image signal after the accumulation is performed (S136).
Proceed to 137.

By performing a correction calculation process using the dark image data captured in the dark capture process,
The captured image data can be corrected with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches unique to the image sensor 14.

A detailed procedure of the dark capture processing S136 will be described later with reference to FIG.

As described above, when the AE lock flag is not set in S134, the photographing process S133 is performed, and then the dark capture process S136 is performed, so that the release time lag when the shutter switch SW2 is pressed in S129 is reduced. It is possible to reduce it.

The system control circuit 50 reads out a part of the image data written in a predetermined area of the memory 30 via the memory control circuit 22 and performs a WB (white balance) integration operation necessary for performing a developing process. Processing and OB (optical black) integration operation processing are performed, and the operation result is stored in the internal memory of the system control circuit 50 or the memory 52.

The system control circuit 50 reads out the photographed image data written in a predetermined area of the memory 30 by using the memory control circuit 22 and the image processing circuit 20 as necessary. Using the operation result stored in the internal memory or the memory 52, the AWB
Various development processes including (auto white balance) process, gamma conversion process, and color conversion process are performed (S137).

Further, in the development processing, a dark correction calculation processing for canceling the dark current noise of the image sensor 14 is performed by performing a subtraction processing using the dark image data captured in the dark capture processing.

Then, the system control circuit 50 reads out the image data written in a predetermined area of the memory 30 and performs image compression processing according to the set mode by the compression / decompression circuit 32 (S138). The image data that has been photographed and has undergone a series of processing is written in the empty image portion of the image storage buffer area.

With the execution of a series of photographing operations, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30 and transmits the image data via the interface 90 or 94 and the connector 92 or 96 to a memory card or a compact card. A recording process for writing to the recording medium 200 or 210 such as a flash card is started (S13).
9).

This recording start processing is performed every time image data that has been photographed and subjected to a series of processing is newly written in a free image portion of the image storage buffer area of the memory 30.
The operation is performed on the image data.

While the image data is being written to the recording medium 200 or 210, the display unit 54 displays, for example, L
A recording medium writing operation display such as blinking of the ED is performed.

The system control circuit 50 determines whether or not the shutter switch SW1 has been pressed (S14).
0).

If the shutter switch SW1 has been released (S140), the process returns to S102. If the shutter switch SW1 has been pressed (S
140), and return to S122.

FIGS. 5 and 6 are flowcharts showing the detailed procedures of the distance measurement and photometry processing in S122 of FIG.

In the distance measurement / photometry processing, transmission and reception of various signals between the system control circuit 50 and the aperture control means 340 or the distance measurement control means 342 are performed by the interface 120, the connector 122, the connector 322, the interface 320, through the lens control means 350.

First, in FIG. 5, the system control circuit 50
Are the image sensor 14, the distance measuring means 42 and the distance measuring control means 34
The AF (autofocus) process is started by using 2 (S201).

The system control circuit 50 causes the light beam incident on the lens 310 to enter the distance measuring means 42 via the stop 312, the lens mounts 306 and 106, the mirror 130, and the distance measuring sub-mirror (not shown). The focus state of the image formed as the optical image is determined, and the distance measurement (A
Until F) is determined to be in focus (S203), AF control for detecting the in-focus state using the distance measuring means 42 is performed while driving the lens 310 using the distance measuring control means 342 (S202). .

If it is determined that the distance measurement (AF) is the in-focus point (S203), the system control circuit 50 determines the in-focus distance measurement point from the plurality of distance measurement points in the photographing screen (S20).
4) The ranging data and / or the setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50 together with the determined ranging point data, and the process proceeds to S205.

The system control circuit 50 controls the AE stored in the internal memory of the system control circuit 50 or the memory 52.
The state of the lock flag is determined (S205). If the AE lock flag has been set, the distance measurement / photometry processing routine S122 ends.

As described above, when the AE lock flag has been set, the photometry processing S207 described later has already been performed one or more times, and the AE lock switch 68
Is pressed and the exposure value is fixed, so that the distance measurement / photometry processing routine S122 ends without performing new photometry processing.

If the AE lock flag is not set, the system control circuit 50
The AE (automatic exposure) process is started (S206).

Turning to FIG. 6, the system control circuit 50
An image formed as an optical image by causing the light beam incident on the lens 310 to enter the photometric unit 46 via the stop 312, the lens mounts 306 and 106, the mirrors 130 and 132, and a photometric lens (not shown). Is measured, and a photometric process is performed using the exposure control means 40 (S207) until the exposure (AE) is determined to be appropriate (S208).

If it is determined that the exposure (AE) is appropriate (S
208), the system control circuit 50 outputs the photometric data and / or
Alternatively, the setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52, and the process proceeds to S209.

The system control circuit 50 determines the aperture value (Av value) and shutter speed (Tv value) according to the exposure (AE) result detected in the photometry processing S207 and the photographing mode set by the mode dial 60. To determine.

Then, in accordance with the shutter speed (Tv value) determined here, the system control circuit 50 determines the charge accumulation time of the image sensor 14, and performs the photographing process and the dark capture process with the same charge accumulation time. Do.

Based on the measurement data obtained in the photometry processing S207, the system control circuit 50 determines whether or not a flash is necessary (S209). If a flash is required, a flash flag is set, and the charging of the flash 48 is completed. Until (S211), the flash 48 is charged (S2
10).

When the charging of the flash 48 is completed (S211), the system control circuit 50 sets the shutter speed (Tv value) and the shutter speed (Tv value) based on the set photographing mode and exposure mode, and the exposure measurement result in the photometry processing S207. The aperture (Av value) is determined, and the photographing process S133 and the dark capture process S128 or S1 are performed according to the determined Tv value.
After setting the charge accumulation time of the image sensor 14 used in S36 (S212), the distance measurement / photometry processing routine S122 ends.

FIGS. 7 and 8 are flowcharts showing the detailed procedure of the photographing process in S133 of FIG.

In the photographing process, the system control circuit 50 and the aperture control means 340 or the distance measurement control means 34
The transmission and reception of various signals between the two are performed via the interface 120, the connector 122, the connector 322, the interface 320, and the lens control means 350.

First, in FIG. 7, the system control circuit 50
Moves the mirror 130 to a mirror-up position by a mirror driving unit (not shown) (S301), and sets a stop 312 by a stop control unit 340 according to photometric data stored in the internal memory or the memory 52 of the system control circuit 50. (S302).

The system control circuit 50 performs a charge clear operation of the image pickup device 14 (S303), and after the charge accumulation of the image pickup device 14 is started (S304), the shutter 12 is opened by the shutter control means 40 (S305). The exposure of the image sensor 14 is started (S306).

Here, it is determined from the flash flag whether or not the flash 48 is necessary (S307), and if necessary, the flash is fired (S308).

Next, referring to FIG.
Waits for the end of exposure of the image sensor 14 in accordance with the photometric data (S309), closes the shutter 12 by the shutter control means 40 (S310), and ends the exposure of the image sensor 14.

The system control circuit 50 controls the aperture control means 3
The aperture 312 is driven to the open aperture value by 40 (S311), and the mirror 130 is moved to the mirror down position by a mirror driving unit (not shown) (S31).
2).

If the set charge accumulation time has elapsed (S 313), the system control circuit 50
(S314), the charge signal is read from the image sensor 14, and the A / D converter 16 and the image processing circuit 2
0, the memory 30 via the memory control circuit 22 or directly from the A / D converter 16 via the memory control circuit 22.
Then, the photographed image data is written in the predetermined area (S315).

When a series of processing is completed, the photographing processing routine S133 ends.

FIG. 9 shows S128 of FIG. 3 and S13 of FIG.
6 is a flowchart illustrating a detailed procedure of dark capture processing in No. 6;

The system control circuit 50 performs a charge clear operation of the image pickup device 14 (S401), and thereafter, starts accumulating charges in the image pickup device 14 with the shutter 12 closed (S402).

When the set predetermined charge accumulation time has elapsed (S403), the system control circuit 50 ends the charge accumulation of the image pickup device 14 (S404), reads out a charge signal from the image pickup device 14, and performs A / D conversion. The image data (dark image data) is written to a predetermined area of the memory 30 via the converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16 via the memory control circuit 22 ( S405).

By performing development processing using the dark captured data, the captured image data is corrected with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14. Can be done.

The dark image data is held in a predetermined area of the memory 30 until a new distance measurement and photometry processing is performed or the power of the image processing apparatus 100 is turned off.

Then, the dark image data is subjected to a photographing process thereafter, where the photographed image data is read out from the image pickup device 14 and used for the developing process.

Alternatively, if the shooting processing has been executed first,
In a state where the photographed image data is read from the image sensor 14 and written in the memory 30, the dark image data is used to perform a developing process.

When a series of processing is completed, the dark capture processing routines S128 and S136 are completed.

FIG. 10 is a time chart showing the flow of the photographing operation in the first embodiment.

As can be seen from FIG. 10, when the AE lock is not set, the photographing is immediately performed when the shutter switch SW2 is pressed, so that the release time lag is reduced.

On the other hand, if the AE lock is set, dark capture processing is performed prior to execution of continuous shooting. Thus, when the shutter switch SW2 is pressed and continuous shooting is performed, it is possible to make the continuous shooting frame intervals substantially uniform.

(Second Embodiment) Next, a second embodiment will be described.

Since the configuration of the second embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the second embodiment.

In the second embodiment, the contents of the control processing performed by the image processing apparatus are different from those in the first embodiment. In the first embodiment, when the shutter switch SW2 is pressed, The dark capture process S136 is performed after the AE lock flag determination process S134 after performing the shooting process S133. However, in the second embodiment, when the shutter switch SW2 is pressed, A
After the dark capture process S136 is performed after the E lock flag determination process S134, the photographing process S133 is performed.

FIGS. 11 to 13 are flowcharts of a main routine showing a control procedure of the image processing apparatus according to the second embodiment.

First, in FIG. 11, the system control circuit 50 initializes flags, control variables, and the like when the power is turned on upon battery replacement or the like.
Necessary predetermined initialization is performed (S501), and the AE lock flag stored in the internal memory of the system control circuit 50 or the memory 52 is released (S502).

The system control circuit 50 includes the power switch 6
6 Check the setting position and turn off the power switch 66.
(S503), the display on each display unit is changed to the end state, and necessary parameters including flags, control variables, and the like, setting values, and setting modes are set in the non-volatile memory 56.
After performing predetermined termination processing such as shutting off unnecessary power supply of each unit of the image processing apparatus 100 including the image display unit 28 by the power supply control unit 80 (S504), the process returns to S502.

If the power switch 66 is set to power ON (S503), the system control circuit 50 determines whether the remaining capacity of the power source 86 composed of a battery or the like and the operating conditions are
It is determined whether or not the operation of the image processing apparatus 100 is hindered (S505). If there is a hindrance, a predetermined warning is displayed by an image or sound using the display unit 54 (S50).
6) Return to S502.

If there is no problem with the power supply 86 (S50)
5), the system control circuit 50 checks the set position of the mode dial 60, and if the mode dial 60 has been set to the photographing mode (S507), the process proceeds to S509.

If the mode dial 60 has been set to another mode (S507), the system control circuit 5
0 executes a process according to the selected mode (S50).
8) When the processing is completed, the process returns to S502.

The system control circuit 50 stores the recording medium 200
Alternatively, it is determined whether or not 210 is mounted, management information of image data recorded on the recording medium 200 or 210 is obtained, and the operation state of the recording medium 200 or 210 causes a problem in the operation of the image processing apparatus 100. It is determined whether or not there is a problem, in particular, whether or not there is a problem in the operation of recording and reproducing image data on the recording medium (S509). After performing (S506), the process returns to S502.

If the result of determination in S509 is that there is no problem, the flow proceeds to S510.

The system control circuit 50 uses the display unit 54 to display various setting states of the image processing apparatus 100 using images and sounds (S510). If the image display of the image display unit 28 is ON, various setting states of the image processing apparatus 100 are displayed by the image using the image display unit 28.

Next, in FIG. 12, it is determined whether or not the shutter switch SW1 has been pressed (S521). If not, the flow returns to S502.

If the shutter switch SW1 is pressed (S521), the system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on the subject, and performs a photometry process to set the aperture value and the shutter time. The determined distance measurement and photometry processing is performed (S522), and the process proceeds to S523.

In the photometric processing, flash setting is performed if necessary.

The detailed procedure of the distance measurement / photometry processing S522 is the same as that of the first embodiment shown in FIGS.

The system control circuit 50 checks the setting state of the exposure compensation switch 66. If the exposure compensation has not been set (S523), the process proceeds to S526.

If exposure compensation has been set (S52)
3), the system control circuit 50 determines whether it is necessary to change the shutter speed (Tv value) according to the exposure correction value in accordance with the setting of the shooting mode and / or the exposure mode (S524). , Shutter speed (Tv
If it is not necessary to change (value), the process proceeds to S526.

The exposure correction switch 66 can more easily set the number of exposure correction steps (the number of steps) by using a plus button, a minus button, or a rotary dial switch together.

If it is necessary to change the shutter speed (Tv value) according to the exposure correction value, the system control circuit 50 changes the shutter speed (Tv value) and changes the shutter speed (Tv value) according to the changed shutter speed (Tv value). Then, the charge accumulation time of the image sensor 14 is newly set (S525).

For example, aperture (Av) priority shooting mode, automatic shooting mode, program shooting mode, depth of focus priority (depth) shooting mode, portrait shooting mode, landscape shooting mode, close-up shooting mode, night view shooting mode, panoramic shooting mode In each shooting mode such as, it is necessary to change the shutter speed in accordance with the exposure correction, and in this case, it is necessary to newly set the charge accumulation time of the image sensor 14.

It is to be noted that a photographing process S536 and a dark capture process S528 or S535, which will be described later, are performed using the charge accumulation time set here.

The system control circuit 50 checks the state of the AE lock switch 68 (S526). If the AE lock switch 68 has not been pressed, the process proceeds to S529.

If the AE lock switch 68 has been depressed, the system control circuit 50 sets an AE lock flag (S527). With the shutter 12 closed, a noise component such as dark current of the image sensor 14 is actually photographed. A dark capture process is performed to accumulate the same amount of time and read out the noise image signal that has been accumulated (S528), and the process proceeds to S529.

The state of the AE lock flag is stored in the internal memory of the system control circuit 50 or the memory 52.

By performing a correction calculation process using the dark image data captured in the dark capture process,
The captured image data can be corrected with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches unique to the image sensor 14.

The detailed procedure of the dark capture processing S528 is the same as that of the first embodiment shown in FIG.

As described above, if the AE lock switch has been set in S526, dark capture processing S528 is performed prior to the execution of continuous shooting. As a result, in S529 described later, the shutter switch SW2
When the continuous shooting is performed by pressing, the interval between the continuous shooting frames can be made substantially constant.

Next, proceeding to FIG. 13, the shutter switch S
It is determined whether or not W2 is pressed (S529). If the shutter switch SW2 is not pressed, the system control circuit 50 checks the state of the shutter switch SW1 (S530). If the shutter switch SW1 is released (S530), the process returns to S502. If the shutter switch SW1 has been pressed (S530),
It returns to S522.

If the shutter switch SW2 is depressed (S529), the system control circuit 50 determines whether or not an area in which captured image data can be stored is in the image storage buffer area of the memory 30 (S531). If there is no area in the image storage buffer area of the memory 30 where new image data can be stored, a predetermined warning display is performed using an image or a sound using the display unit 54 (S532).
It returns to S502.

For example, immediately after performing the maximum number of continuous shots that can be stored in the image storage buffer area of the memory 30 and the first image to be read from the memory 30 and written to the storage medium 200 or 210, An example of this state is a state in which the recording medium 200 or 210 has not yet been recorded, and thus one empty area cannot be secured in the image storage buffer area of the memory 30 yet.

When the photographed image data is compressed and stored in the image storage buffer area of the memory 30, the amount of compressed image data differs depending on the setting of the compression mode. The area that can be stored is memory 3.
S531 whether or not the image is in the image storage buffer area 0
Will be determined.

If there is an area in the image storage buffer area of the memory 30 in which captured image data can be stored (S5).
31), the system control circuit 50
0 or the AE stored in the memory 52
The state of the lock flag is confirmed (S533), and if the AE lock flag has been set, the flow proceeds to S536.

As described above, when the AE lock flag has been set in S533, since the dark capture processing has already been performed in S528, the processing will be described later in S53.
Shooting processing S5 without performing the dark capture processing in step 5
Execute 36. This makes it possible to reduce the release time lag when the shutter switch SW2 is pressed in S529.

If the AE lock flag is not set (S533), the system control circuit 50 determines whether it is necessary to newly execute the dark capture process or changes the charge accumulation time in the photographing process S533. Accordingly, the set time for charge accumulation in the dark capture process is changed, and it is determined whether the dark capture process needs to be performed again (S534). If the dark capture process needs to be performed, the process proceeds to S535. .

For example, when continuous shooting is started in a state where the AE lock flag is not set, a new dark capture process needs to be performed immediately after the first frame has been shot. For this reason, the set time used in S403 in the dark capture process of FIG. 9 (the same process as this process is also performed in the second embodiment) is newly set.

Alternatively, continuous shooting is performed in a state where the AE lock flag is not set, and during the continuous shooting, the light is detected in the photometric processing S207 (the same processing as this processing is also performed in the second embodiment). The exposure (AE) result is changed, and the shutter speed (Tv value) in the photographing process S536 is accordingly changed.
If the set time for charge accumulation changes, FIG.
In this case, the set time for charge accumulation used in S403 in the dark capture process is changed.

On the other hand, if there is no need to change the set time (S534), the process proceeds to S536 without performing the new dark image data fetching process.

In this case, the dark noise correction processing may be performed in the development processing S537 by using the already captured dark capture data.

The system control circuit 50 controls the shutter 12
In a state in which is closed, noise components such as dark current of the image sensor 14 are accumulated for the same time as the actual photographing, and a dark capture process for reading out the noise image signal after the accumulation is performed (S535).
Proceed to 536.

By performing a correction calculation process using the dark image data captured in the dark capture process,
The captured image data can be corrected with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches unique to the image sensor 14.

The detailed procedure of the dark capture processing S535 is the same as that of the first embodiment shown in FIG.

As described above, when the AE lock flag is not set in S533, the photographing process S536 is performed after the dark capture process S535 is performed, and the shutter switch SW2 is pressed in S529 to perform continuous shooting. In this case, the interval between continuous shooting frames can be made substantially constant.

The system control circuit 50 reads out the image pickup signal accumulated for a predetermined time from the image pickup device 12 and
/ D converter 16, image processing circuit 20, memory control circuit 2
Then, a photographing process for writing photographed image data in a predetermined area of the memory 30 is executed via the memory control circuit 22 via the memory control circuit 22 or via the A / D converter (S536).

The detailed procedure of this photographing processing S536 is the same as that of the first embodiment shown in FIGS.

Next, the system control circuit 50 performs a developing process (S537). That is, a part of the image data written to the predetermined area of the memory 30 is transferred to the memory control circuit 22.
WB necessary to read out and develop through
A (white balance) integration calculation process and an OB (optical black) integration calculation process are performed, and the calculation result is stored in the internal memory of the system control circuit 50 or the memory 52.

The system control circuit 50 reads the photographed image data written in a predetermined area of the memory 30 by using the memory control circuit 22 and the image processing circuit 20 as necessary. Using the operation result stored in the internal memory or the memory 52, the AWB
Various development processing including (auto white balance) processing, gamma conversion processing, and color conversion processing is performed.

Further, in the developing process, a subtraction process is performed using the dark image data captured in the dark capturing process, so that a dark correction calculation process for canceling a dark current noise of the image sensor 14 is also performed.

Then, the system control circuit 50 reads out the image data written in a predetermined area of the memory 30 and performs an image compression process according to the set mode by the compression / decompression circuit 32 (S538). The image data that has been photographed and has undergone a series of processing is written in the empty image portion of the image storage buffer area.

With the execution of a series of photographing operations, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30 and transmits the image data via the interface 90 or 94 and the connector 92 or 96 to a memory card or A recording process for writing to the recording medium 200 or 210 such as a flash card is started (S53).
9).

This recording start process is performed every time image data that has been photographed and a series of processes has been completed is newly written in an empty image portion of the image storage buffer area of the memory 30.
The operation is performed on the image data.

While writing image data to the recording medium 200 or 210, the display unit 54 displays, for example, L
A recording medium writing operation display such as blinking of the ED is performed.

The system control circuit 50 determines whether or not the shutter switch SW1 has been pressed (S54).
0). If the shutter switch SW1 has been released (S540), the process returns to S502. If the shutter switch SW1 has been pressed (S54)
0), and return to S522.

FIG. 14 is a time chart showing the flow of the photographing operation in the second embodiment.

As can be seen from FIG. 14, in the second embodiment, when the AE lock is not set,
When the shutter switch SW2 is pressed, dark capture processing is performed prior to execution of continuous shooting, so that the intervals between successive shots are made substantially constant.

On the other hand, if the AE lock is set, dark capture processing is performed prior to execution of continuous shooting. Thus, when the shutter switch SW2 is pressed to perform continuous shooting, the continuous shooting frame interval can be made substantially constant. Also, a shutter switch SW2
Since the dark capture processing is completed before is pressed, the release time lag when the shutter switch SW2 is pressed can be reduced.

The above is a description of the embodiments of the present invention. However, the present invention is not limited to the configurations of these embodiments.
The present invention can be applied to any configuration that can achieve the functions described in the claims or the functions of the configuration of the embodiment.

For example, in the description of each of the above embodiments, the AE lock operation is set using the AE lock switch 68. However, the shutter switch SW1 is set according to the operation mode selection by the mode dial 60. AE lock may be set if is pressed.

Further, in each of the above embodiments, the charge accumulation time of the main photographing process and the charge accumulation time of the dark capture process have been described as being equal, but data sufficient for correcting dark current noise and the like has been described. Is within the range where
Different charge accumulation times may be used. In particular, it is desirable to make the charge storage time of the dark capture process longer than the charge storage time of the main photographing process in order to obtain sufficient data.

During the dark capture processing in S128 and S136 in the first embodiment and in S528 and S535 in the second embodiment, since the photographing operation cannot be performed, the display unit 54 and / or The display unit 28 may display an image or sound indicating that the image processing apparatus 100 is busy.

In each of the above embodiments, the description has been made on the assumption that the photographing operation is performed by moving the mirror 130 to the mirror up position and the mirror down position. However, the mirror 130 is configured as a half mirror and does not move. The photographing operation may be performed first.

The recording media 200 and 210 are PC
Not only memory cards such as MCIA cards and compact flash, hard disks, but also micro DATs, magneto-optical disks, optical disks such as CD-Rs and CD-WRs,
It may be composed of a phase change optical disk such as a DVD.

[0247] The recording media 200 and 210 may be composite media in which a memory card and a hard disk are integrated. Further, it is of course possible to adopt a configuration in which a part of the composite medium is detachable.

Further, in each of the above embodiments, the recording media 200 and 210 have been described as being separated from the image processing apparatus 100 and can be arbitrarily connected. Of course, it may be fixed to the processing apparatus 100.

Further, the recording medium 20 is stored in the image processing apparatus 100.
A configuration in which 0 or 210 can be connected to a single or a plurality of arbitrary numbers may be used.

Further, the recording medium 20 is stored in the image processing apparatus 100.
Although the configuration in which the recording media 0 and 210 are mounted has been described, the recording medium may be of a single configuration or a combination of multiple recording media.

In each of the above embodiments, the description has been made using a CCD as an example of the image pickup device 14. However, an effective effect can be obtained by using a CMOS as the image pickup device.

Further, the software configuration and the hardware configuration of the above embodiments can be appropriately replaced.
In addition, the present invention may combine the above-described embodiments or the technical elements as needed.

Further, the present invention may be applied to a case where the claim or the whole or a part of the structure of the embodiment forms one device or is combined with another device. , Which may be a constituent element of the device.

Also, the present invention relates to an electronic still camera, a video movie camera, a camera using a silver halide film, and the like.
The present invention can be applied to various types of cameras, imaging devices other than cameras, devices applied to these cameras and imaging devices, and elements constituting these devices.

Further, the present invention may be applied to a system including a plurality of devices, or may be applied to an apparatus including a single device.

A storage medium storing program codes of software for realizing the functions of the above-described embodiments is supplied to a system or an apparatus, and a computer (or CPU or MPU) of the system or the apparatus stores the storage medium in the storage medium. It goes without saying that the present invention is also achieved by reading and executing the program code thus set.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiments are realized, but also the OS running on the computer based on the instructions of the program code. It is needless to say that the present invention includes a case where a part or all of the actual processing is performed and the function of each embodiment described above is realized by the processing.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, It is needless to say that the present invention includes a case where the CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments. .

[0261]

As described above, according to the present invention,
An object of the present invention is to provide an image pickup apparatus, an image processing apparatus, an image processing method, and a storage medium that can prevent a precious shutter opportunity from being missed and that can make a photographing frame interval uniform.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an image processing apparatus according to a first embodiment of the present invention.

FIG. 2 is a flowchart of a main routine showing an image processing apparatus control procedure.

FIG. 3 is a main routine showing an image processing apparatus control procedure.
It is a flowchart following [of].

FIG. 4 is a main routine showing an image processing apparatus control procedure;
It is a flowchart following [of].

FIG. 5 is a flowchart showing a detailed procedure of a distance measurement / photometry process in S122 of FIG. 3;

FIG. 6 is a flowchart continued from FIG. 5 showing a detailed procedure of the distance measurement / photometry processing in S122 of FIG. 3;

FIG. 7 is a flowchart showing a detailed procedure of a photographing process in S133 of FIG. 4;

FIG. 8 is a continuation of the flowchart of FIG. 7 showing a detailed procedure of the photographing process in S133 of FIG. 4;

FIG. 9 is a flowchart showing a detailed procedure of dark capture processing in S128 of FIG. 3 and S136 of FIG. 4;

FIG. 10 is a time chart illustrating a flow of a shooting operation according to the first embodiment.

FIG. 11 is a flowchart of a main routine showing a control procedure of the image processing apparatus according to the second embodiment.

FIG. 12 is a continuation of the flowchart of FIG. 11 of a main routine showing a control procedure of the image processing apparatus according to the second embodiment.

FIG. 13 is a flowchart continued from FIG. 12 of a main routine showing a control procedure of the image processing apparatus according to the second embodiment.

FIG. 14 is a time chart illustrating a flow of a photographing operation according to the second embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 12 Shutter 14 Image sensor 16 A / D converter 18 Timing generation circuit 20 Image processing circuit 22 Memory control circuit 24 Image display memory 26 D / A converter 28 Image display unit 30 Memory 32 Image compression / expansion circuit 40 Shutter control means 42 Distance measuring means 46 Photometric means 48 Flash 50 System control circuit 52 Memory 54 Display section 56 Non-volatile memory 60 Mode dial switch 62 Shutter switch SW1 64 Shutter switch SW2 66 Exposure compensation switch 68 AE lock switch 70 Operation section 72 Power switch 80 Power control Means 82 Connector 84 Connector 86 Power Supply Means 90 Interface 92 Connector 94 Interface 96 Connector 98 Recording Medium Detachment Detecting Means 100 Image Processing Device 104 Optical Fine Da 106 Lens mount 110 Communication means 112 Connector (or antenna) 120 Interface 122 Connector 130 Mirror 132 Mirror 200 Recording medium 202 Recording unit 204 Interface 206 Connector 210 Recording medium 212 Recording unit 214 Interface 216 Connector 300 Lens unit 306 Lens mount 310 Photographing lens 312 Aperture 320 Interface 322 Connector 340 Exposure control means 342 Distance measurement control means 344 Zoom control means 350 Lens system control circuit

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int.Cl. ⁷ , DB name) H04N 5/225-5/243 H04N 5/335

Claims (91)

(57) [Claims] 1. An image processing apparatus for recording a captured still image and / or a moving image on a recording medium, comprising: a first imaging mode in which electric charges are accumulated without exposure, and a second imaging mode in which electric charges are accumulated by performing exposure. Imaging means having the following imaging modes; storage means for storing imaging data output by the imaging means; accumulation time determining means for repeatedly determining a charge accumulation time of the imaging means; accumulation time lock instructing means; When the storage time lock instruction is issued by the instruction means and the accumulation time lock instruction means, first image data obtained by the imaging means taking an image in the first imaging mode is stored in the storage means. Then, if an imaging instruction is given by the imaging instruction means, second image data obtained by the imaging means taking an image in the second imaging mode is stored in the storage means. The first control means, and if the imaging instruction is issued by the imaging instruction means without the storage time lock instruction being issued by the accumulation time lock instruction means, the imaging means performs imaging in the second imaging mode. The second image data obtained by storing the second image data obtained in the first imaging mode in the first imaging mode is stored in the storage unit, and the second image data obtained by the imaging unit in the first imaging mode is stored in the storage unit. An image processing apparatus comprising: 2. An image according to claim 1, wherein said first image data is dark current noise data of said image pickup means, and said second image data is photographed image data of said image pickup means. Processing equipment. 3. The charge accumulation time of the imaging unit in the first imaging mode is equal to or approximately equal to the charge accumulation time of the imaging unit in the second imaging mode. 3. The image processing device according to 1 or 2. 4. The storage time determining means determines an aperture value and a shutter speed according to an exposure measurement value of a subject, and determines the charge storage time based on the determined shutter speed. The image processing apparatus according to claim 1. 5. The image processing apparatus according to claim 4, wherein the determined charge accumulation time is a time longer than the determined shutter speed. 6. The accumulation time determination means performs an autofocus operation for focusing on a subject, determines an aperture value and a shutter speed according to an exposure measurement value of the subject corresponding to the focused ranging point, and The image processing apparatus according to claim 1, wherein the charge accumulation time is determined based on the determined shutter speed. 7. When the storage time lock instruction is issued by the storage time lock instructing means, the accumulation time determining means determines and holds the accumulation time of the charge accumulation performed by the imaging means. The image processing apparatus according to claim 1, wherein: 8. The imaging in the first imaging mode and the imaging in the second imaging mode, in which the imaging unit performs charge accumulation using the accumulation time determined by the accumulation time determination unit. The image processing apparatus according to claim 1, wherein: 9. A storage time changing unit that changes the shutter speed determined by the storage time determining unit and changes the determined storage time according to the changed shutter speed. The image processing apparatus according to claim 8, wherein 10. An image processing apparatus for recording a captured still image and / or moving image on a recording medium, comprising: a first imaging mode in which charge is stored without exposure, and a second imaging mode in which charge is stored by exposure. Imaging means having the following imaging modes; storage means for storing imaging data output by the imaging means; accumulation time determining means for repeatedly determining a charge accumulation time of the imaging means; accumulation time lock instructing means; When the storage time lock instruction is issued by the instruction means and the accumulation time lock instruction means, first image data obtained by the imaging means taking an image in the first imaging mode is stored in the storage means. After that, when an imaging instruction is issued by the imaging instruction means, second image data obtained by the imaging means taking an image in the second imaging mode is stored in the storage means. A first control unit for causing the imaging unit to perform imaging in the first imaging mode if an imaging instruction is issued by the imaging instruction unit without a storage time lock instruction being issued by the accumulation time locking instruction unit. Storing the first image data obtained in the second storage unit in the storage unit, and then storing the second image data obtained by the imaging unit in the second imaging mode in the storage unit. An image processing apparatus comprising: 11. An image according to claim 10, wherein said first image data is dark current noise data of said image pickup means, and said second image data is photographed image data of said image pickup means. Processing equipment. 12. The charge accumulation time of the imaging means in the first imaging mode is equal to or approximately equal to the charge accumulation time of the imaging means in the second imaging mode. An image processing apparatus according to claim 10. 13. The storage time determination means determines an aperture value and a shutter speed according to an exposure measurement value of a subject,
The image processing apparatus according to claim 10, wherein the charge accumulation time is determined based on the determined shutter speed. 14. The image processing apparatus according to claim 13, wherein the determined charge accumulation time is a time longer than the determined shutter speed. 15. The accumulation time determination means performs an autofocus operation for focusing on a subject, determines an aperture value and a shutter speed according to an exposure measurement value of the subject corresponding to the focused ranging point, and 15. The image processing apparatus according to claim 10, wherein the charge accumulation time is determined based on the determined shutter speed. 16. When the storage time lock instruction is issued by the accumulation time lock instructing means, the accumulation time determining means determines and holds the accumulation time of charge accumulation performed by the imaging means. Claims 10 to 15
The image processing device according to any one of the above. 17. The imaging in the first imaging mode and the imaging in the second imaging mode, in which the imaging unit performs charge accumulation using the accumulation time determined by the accumulation time determination unit. Claim 10 characterized by the following.
The image processing apparatus according to any one of the sixteenth aspects. 18. A storage time changing unit that changes the shutter speed determined by the storage time determining unit and changes the determined storage time according to the changed shutter speed. The image processing apparatus according to claim 17, wherein 19. An image processing apparatus for recording a captured still image and / or moving image on a recording medium, comprising: a first imaging mode in which charge is stored without exposure, and a second imaging mode in which charge is stored by exposure. Imaging means comprising: an imaging mode; a storage means for storing imaging data output from the imaging means; a signal calculation means for reading and calculating the imaging data stored in the storage means; Accumulation time determination means for repeatedly determining a time; accumulation time lock instruction means; imaging instruction means; if the accumulation time lock instruction is issued by the accumulation time lock instruction means, the imaging means sets the first Unexposed image data obtained by imaging in the imaging mode is stored in the storage means, and thereafter, if an imaging instruction is issued by the imaging instruction means, the imaging means First control means for storing image data of a subject obtained by imaging in the second imaging mode in the storage means; and the imaging instruction means without the storage time lock instruction being issued by the accumulation time lock instruction means When the image capturing instruction is given by the user, the image data of the subject obtained by the image capturing unit capturing the image in the second image capturing mode is stored in the storage unit, and thereafter, the image capturing unit performs the first image capturing. Second control means for storing unexposed image data obtained by imaging in the mode in the storage means, and the signal calculation based on the unexposed image data and the subject image data stored in the storage means. And a third control unit for causing the unit to perform an image correction process. 20. The image according to claim 19, wherein the unexposed image data is dark current noise data of the imaging unit, and the image correction process is a dark current noise correction process of the imaging unit. Processing equipment. 21. The charge accumulation time of the imaging means in the first imaging mode is equal to or substantially equal to the charge accumulation time of the imaging means in the second imaging mode. 21. The image processing device according to 19 or 20. 22. The storage time determining means determines an aperture value and a shutter speed according to an exposure measurement value of a subject,
22. The image processing apparatus according to claim 19, wherein the charge accumulation time is determined based on the determined shutter speed. 23. The image processing apparatus according to claim 22, wherein the determined charge accumulation time is a time longer than the determined shutter speed. 24. The storage time determining means performs an autofocus operation for focusing on a subject, determines an aperture value and a shutter speed according to an exposure measurement value of the subject corresponding to the focused ranging point, and The image processing apparatus according to any one of claims 19 to 23, wherein the charge storage time is determined based on the determined shutter speed. 25. When the storage time lock instruction is issued by the accumulation time lock instructing means, the accumulation time determining means determines and holds the accumulation time of the charge accumulation performed by the imaging means. Claims 19 to 24 characterized by the above-mentioned.
The image processing device according to any one of the above. 26. The imaging in the first imaging mode and the imaging in the second imaging mode, in which the imaging unit performs charge accumulation using the accumulation time determined by the accumulation time determination unit. 20. The method according to claim 19, wherein
The image processing device according to any one of claims 25. 27. A storage time changing unit that changes the shutter speed determined by the storage time determining unit and changes the determined storage time according to the changed shutter speed. The image processing apparatus according to claim 26, wherein 28. An image processing apparatus for recording a captured still image and / or moving image on a recording medium, comprising: a first imaging mode in which charge is stored without exposure, and a second imaging mode in which charge is stored by exposure. Imaging means comprising: an imaging mode; a storage means for storing imaging data output from the imaging means; a signal calculation means for reading and calculating the imaging data stored in the storage means; Accumulation time determination means for repeatedly determining a time; accumulation time lock instruction means; imaging instruction means; if the accumulation time lock instruction is issued by the accumulation time lock instruction means, the imaging means sets the first Unexposed image data obtained by imaging in the imaging mode is stored in the storage means, and thereafter, if an imaging instruction is issued by the imaging instruction means, the imaging means First control means for storing image data of a subject obtained by imaging in the second imaging mode in the storage means; and the imaging instruction means without the storage time lock instruction being issued by the accumulation time lock instruction means When the imaging instruction is given by the camera, the unexposed image data obtained by the imaging means in the first imaging mode is stored in the storage means, and thereafter, the imaging means A second control unit for storing image data of a subject obtained by imaging in an imaging mode in the storage unit; and the signal calculation based on unexposed image data and image data of the subject stored in the storage unit. And a third control unit for causing the unit to perform an image correction process. 29. The image according to claim 28, wherein the unexposed image data is dark current noise data of the imaging unit, and the image correction process is a dark current noise correction process of the imaging unit. Processing equipment. 30. The charge accumulation time of the imaging means in the first imaging mode is equal to or approximately equal to the charge accumulation time of the imaging means in the second imaging mode. The image processing device according to claim 28 or 29. 31. The storage time determining means determines an aperture value and a shutter speed according to an exposure measurement value of a subject,
31. The image processing apparatus according to claim 28, wherein the charge accumulation time is determined based on the determined shutter speed. 32. The image processing apparatus according to claim 31, wherein the determined charge accumulation time is a time longer than the determined shutter speed. 33. The storage time determination means performs an autofocus operation for focusing on a subject, determines an aperture value and a shutter speed according to an exposure measurement value of the subject corresponding to the focused ranging point, and 33. The image processing apparatus according to claim 28, wherein the charge accumulation time is determined based on the determined shutter speed. 34. When the accumulation time lock instruction is issued by the accumulation time lock instruction means, the accumulation time determination means determines and holds the accumulation time of charge accumulation performed by the imaging means. Claims 28-33
The image processing device according to any one of the above. 35. The imaging in the first imaging mode and the imaging in the second imaging mode, in which the imaging unit performs charge accumulation using the accumulation time determined by the accumulation time determination unit. 28. The method according to claim 28, wherein
35. The image processing device according to any one of 34. 36. A storage time changing unit that changes the shutter speed determined by the storage time determining unit and changes the determined storage time according to the changed shutter speed. The image processing apparatus according to claim 35, wherein: 37. An image pickup device having a first image pickup mode for performing charge accumulation without exposure and a second image pickup mode for performing charge accumulation by performing exposure, and stores image pickup data output from the image pickup device. An image processing method applied to an image processing apparatus that includes a storage unit, an accumulation time lock instruction unit, and an imaging instruction unit, and that captures and records a still image and / or a moving image, wherein the charge accumulation time of the imaging unit is repeated. A storage time determining step for determining, and if a storage time lock instruction is issued by the storage time lock instructing means, the first image data obtained by the imaging means taking an image in the first imaging mode is obtained. When the imaging instruction is given by the imaging instruction means, the second image data obtained by the imaging means taking an image in the second imaging mode is stored in the storage means. A first control step of storing in the storage means, and if the imaging instruction is issued by the imaging instruction means without the storage time lock instruction being issued by the accumulation time locking instruction means, the imaging means The second image data obtained by imaging in the imaging mode is stored in the storage unit, and then the first image data obtained by the imaging unit imaging in the first imaging mode is stored in the storage unit. And a second control step of storing. 38. The image according to claim 37, wherein said first image data is dark current noise data of said image pickup means, and said second image data is photographed image data of said image pickup means. Processing method. 39. The charge accumulation time of the imaging means in the first imaging mode and the charge accumulation time of the imaging means in the second imaging mode are equal or substantially equal. The image processing method according to claim 37 or claim 38. 40. The storage time determination step, wherein an aperture value and a shutter speed are determined according to an exposure measurement value of a subject, and the charge storage time is determined based on the determined shutter speed. Claims 37-39
The image processing method according to any one of the above. 41. The image processing method according to claim 40, wherein the determined charge accumulation time is a time longer than the determined shutter speed. 42. The storage time determining step includes performing an autofocus operation for focusing on a subject, determining an aperture value and a shutter speed according to an exposure measurement value of the subject corresponding to the focused ranging point, and 42. The image processing method according to claim 37, wherein the charge accumulation time is determined based on the determined shutter speed. 43. When the storage time lock instruction is issued by the storage time lock instructing means, the accumulation time determining step determines and holds the accumulation time of the charge accumulation performed by the imaging means. Claims 37-
42. The image processing method according to any one of 42. 44. The imaging in the first imaging mode and the imaging in the second imaging mode, in which the imaging unit performs charge accumulation using the accumulation time determined in the accumulation time determination step. 4. The method according to claim 3, wherein
44. The image processing method according to any one of 7 to 43. 45. A storage time changing step of changing the shutter speed determined in the storage time determination step and changing the determined storage time according to the changed shutter speed. The image processing method according to claim 44, wherein 46. An image pickup means having a first image pickup mode for performing charge accumulation without exposure and a second image pickup mode for carrying out charge accumulation by performing exposure, and stores image pickup data output from the image pickup means. An image processing method applied to an image processing apparatus that includes a storage unit, an accumulation time lock instruction unit, and an imaging instruction unit, and that captures and records a still image and / or a moving image, wherein the charge accumulation time of the imaging unit is repeated. A storage time determining step for determining, and if a storage time lock instruction is issued by the storage time lock instructing means, the first image data obtained by the imaging means taking an image in the first imaging mode is obtained. When the imaging instruction is given by the imaging instruction means, the second image data obtained by the imaging means taking an image in the second imaging mode is stored in the storage means. A first control step of storing in the storage means, if the storage time lock instructing means does not issue a lock instruction for the storage time and the imaging instruction means gives an imaging instruction, the imaging means makes the first The first image data obtained by imaging in the imaging mode is stored in the storage unit, and the second image data obtained by the imaging unit in the second imaging mode is stored in the storage unit. And a second control step of storing. 47. The image according to claim 46, wherein said first image data is dark current noise data of said imaging means, and said second image data is photographed image data of said imaging means. Processing method. 48. The charge accumulation time of the imaging means in the first imaging mode is equal to or approximately equal to the charge accumulation time of the imaging means in the second imaging mode. 48. The image processing method according to 46 or 47. 49. The storage time determination step, wherein an aperture value and a shutter speed are determined according to an exposure measurement value of a subject, and the charge storage time is determined based on the determined shutter speed. Claims 46-48
The image processing method according to any one of the above. 50. The image processing method according to claim 49, wherein the determined charge accumulation time is a time longer than the determined shutter speed. 51. The storage time determining step includes performing an autofocus operation of focusing on a subject, determining an aperture value and a shutter speed according to an exposure measurement value of the subject corresponding to the focused ranging point, and The image processing method according to any one of claims 46 to 50, wherein the charge accumulation time is determined based on the determined shutter speed. 52. When a storage time lock instruction is issued by the storage time lock instructing means, the accumulation time determining step determines and holds the accumulation time of charge accumulation performed by the imaging means. Claim 46-
51. The image processing method according to any one of 51. 53. The imaging in the first imaging mode and the imaging in the second imaging mode, in which the imaging unit performs charge accumulation using the accumulation time determined in the accumulation time determination step. 5. The method according to claim 4, wherein
The image processing method according to any one of claims 6 to 52. 54. A storage time changing step of changing the shutter speed determined in the storage time determination step and changing the determined storage time according to the changed shutter speed. The image processing method according to claim 53, wherein 55. An image pickup means having a first image pickup mode in which charge accumulation is performed without exposure and a second image pickup mode in which charge accumulation is performed by exposure, and image pickup data output from the image pickup means. Image processing for capturing and recording a still image and / or a moving image, comprising: a storage unit; a signal calculation unit that reads out and calculates the imaging data stored in the storage unit; an accumulation time lock instruction unit; and an imaging instruction unit. In the image processing method applied to the device, an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit, and if the storage time lock instruction unit issues a storage time lock instruction, the imaging unit If unexposed image data obtained by imaging in the first imaging mode is stored in the storage unit, and then, if an imaging instruction is issued by the imaging instruction unit, A first control step of storing image data of a subject obtained by the imaging means in the second imaging mode in the storage means, and a storage time lock instruction is not issued by the accumulation time lock instruction means. If the imaging instruction is given by the imaging instruction means, the image data of the subject obtained by the imaging means taking an image in the second imaging mode is stored in the storage means. A second control step of storing unexposed image data obtained by imaging in the first imaging mode in the storage unit, based on the unexposed image data and the subject image data stored in the storage unit. And a third control step of causing the signal calculation means to perform an image correction process. 56. The image according to claim 55, wherein said unexposed image data is dark current noise data of said image pickup means, and said image correction processing is dark current noise correction processing of said image pickup means. Processing method. 57. The charge accumulation time of the imaging means in the first imaging mode and the charge accumulation time of the imaging means in the second imaging mode are equal or substantially equal. 55. The image processing method according to 55 or 56. 58. The storage time determining step includes determining an aperture value and a shutter speed according to a measured exposure value of a subject, and determining the charge storage time based on the determined shutter speed. 55-57.
The image processing method according to any one of the above. 59. The image processing method according to claim 58, wherein the determined charge accumulation time is a time longer than the determined shutter speed. 60. The storage time determining step includes performing an autofocus operation of focusing on a subject, determining an aperture value and a shutter speed according to an exposure measurement value of the subject corresponding to the focused ranging point, and The image processing method according to any one of claims 55 to 59, wherein the charge accumulation time is determined based on the determined shutter speed. 61. When a storage time lock instruction is issued by the storage time lock instructing means, the accumulation time determining step determines and holds the accumulation time of charge accumulation performed by the imaging means. 55. The feature of claim 55
60. The image processing method according to any one of 60. 62. The imaging in the first imaging mode and the imaging in the second imaging mode, in which the imaging unit performs charge accumulation using the accumulation time determined in the accumulation time determination step. 6. The method according to claim 5, wherein
The image processing method according to any one of Items 5 to 61. 63. A storage time changing step of changing the shutter speed determined in the storage time determination step and changing the determined storage time according to the changed shutter speed. The image processing method according to claim 62, wherein: 64. An image pickup device having a first image pickup mode for performing charge accumulation without exposure and a second image pickup mode for performing charge accumulation by performing exposure, and stores image pickup data output from the image pickup device. Image processing for capturing and recording a still image and / or a moving image, comprising: a storage unit; a signal calculation unit that reads out and calculates the imaging data stored in the storage unit; an accumulation time lock instruction unit; and an imaging instruction unit. In the image processing method applied to the device, an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit, and if the storage time lock instruction unit issues a storage time lock instruction, the imaging unit If unexposed image data obtained by imaging in the first imaging mode is stored in the storage unit, and then, if an imaging instruction is issued by the imaging instruction unit, A first control step of storing image data of a subject obtained by the imaging means in the second imaging mode in the storage means, and a storage time lock instruction is not issued by the accumulation time lock instruction means. If the imaging instruction is issued by the imaging instruction means, the image data is stored in the storage means, and the unexposed image data obtained by imaging in the first imaging mode is stored in the storage means. A second control step of storing image data of a subject obtained by imaging in the second imaging mode in the storage unit, based on the unexposed image data and the image data of the subject stored in the storage unit. And a third control step of causing the signal calculation means to perform an image correction process. 65. The image according to claim 64, wherein said unexposed image data is dark current noise data of said imaging means, and said image correction processing is dark current noise correction processing of said imaging means. Processing method. 66. The charge accumulation time of the imaging means in the first imaging mode and the charge accumulation time of the imaging means in the second imaging mode are equal or substantially equal. 64. The image processing method according to 64 or 65. 67. The storage time determining step, wherein an aperture value and a shutter speed are determined according to an exposure measurement value of a subject, and the charge storage time is determined based on the determined shutter speed. Claims 64-66
The image processing method according to any one of the above. 68. The image processing method according to claim 67, wherein the determined charge accumulation time is a time longer than the determined shutter speed. 69. The accumulation time determining step includes performing an autofocus operation of focusing on a subject, determining an aperture value and a shutter speed according to an exposure measurement value of the subject corresponding to the focused ranging point, and 69. The image processing method according to claim 64, wherein the charge accumulation time is determined based on the determined shutter speed. 70. If the storage time lock instruction is issued by the storage time lock instructing means, the accumulation time determining step determines and holds the accumulation time of the charge accumulation performed by the imaging means. Claims 64-
70. The image processing method according to any one of items 69. 71. The imaging in the first imaging mode and the imaging in the second imaging mode, in which the imaging means performs charge accumulation using the accumulation time determined in the accumulation time determination step. 7. The method according to claim 6, wherein
The image processing method according to any one of Items 4 to 70. 72. A storage time changing step of changing the shutter speed determined in the storage time determination step and changing the determined storage time according to the changed shutter speed. The image processing method according to claim 71, wherein: 73. An imaging unit having a first imaging mode for performing charge accumulation without exposure and a second imaging mode for performing charge accumulation by performing exposure, and stores imaging data output from the imaging unit. A computer-readable storage medium for storing an image processing method applied to an image processing apparatus that captures and records a still image and / or a moving image, comprising a storage unit, an accumulation time lock instruction unit, and an imaging instruction unit; In the storage medium, the image processing method may further include: an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit; and a storage time lock instruction unit that issues a storage time lock instruction. First image data obtained by imaging in the first imaging mode is stored in the storage unit, and thereafter, an imaging instruction is issued by the imaging instruction unit. Has been performed, a first control step of storing the second image data obtained by the imaging means in the second imaging mode in the storage means, and storing the second image data by the storage time lock instructing means. If the image capturing instruction is issued by the image capturing instruction unit without the time lock instruction being issued, second image data obtained by the image capturing unit capturing an image in the second image capturing mode is stored in the storage unit. And a second control step for storing, in the storage unit, first image data obtained by the imaging unit in the first imaging mode. 74. An imaging unit having a first imaging mode in which charge accumulation is performed without exposure and a second imaging mode in which charge accumulation is performed by exposure, and imaging data output by the imaging unit. A computer-readable storage medium for storing an image processing method applied to an image processing apparatus that captures and records a still image and / or a moving image, comprising a storage unit, an accumulation time lock instruction unit, and an imaging instruction unit; In the storage medium, the image processing method may further include: an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit; and a storage time lock instruction unit that issues a storage time lock instruction. First image data obtained by imaging in the first imaging mode is stored in the storage unit, and thereafter, an imaging instruction is issued by the imaging instruction unit. Has been performed, a first control step of storing the second image data obtained by the imaging means in the second imaging mode in the storage means, and storing the second image data by the storage time lock instructing means. If an imaging instruction is issued by the imaging instruction means without a time lock instruction being issued, first image data obtained by the imaging means taking an image in the first imaging mode is stored in the storage means. A second control step of storing, in the storage unit, second image data obtained by the imaging unit in the second imaging mode. 75. An imaging unit having a first imaging mode in which charge accumulation is performed without exposure and a second imaging mode in which charge accumulation is performed by exposure, and imaging data output by the imaging unit. Image processing for capturing and recording a still image and / or a moving image, comprising: a storage unit; a signal calculation unit that reads out and calculates the imaging data stored in the storage unit; an accumulation time lock instruction unit; and an imaging instruction unit. In a computer-readable storage medium storing an image processing method applied to an apparatus as a program, the image processing method includes: an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit; and an accumulation time lock. If the storage unit is instructed to lock the storage time, an unexposed image obtained by the imaging unit in the first imaging mode Data is stored in the storage unit, and thereafter, when an imaging instruction is issued by the imaging instruction unit, image data of a subject obtained by the imaging unit imaging in the second imaging mode is stored in the storage unit. A first control step of causing the second imaging mode to be stored in the second imaging mode if an imaging instruction is issued by the imaging instruction means without the storage time lock instruction being issued by the accumulation time locking instruction means. Storing the image data of the subject obtained by the imaging in the storage unit, and thereafter storing the unexposed image data obtained by the imaging unit in the first imaging mode in the storage unit. A second control step, and a third control step of causing the signal calculation unit to perform an image correction process based on the unexposed image data and the subject image data stored in the storage unit. Storage medium characterized by having. 76. An imaging unit having a first imaging mode for performing charge accumulation without exposure and a second imaging mode for performing charge accumulation by performing exposure, and stores imaging data output from the imaging unit. Image processing for capturing and recording a still image and / or a moving image, comprising: a storage unit; a signal calculation unit that reads out and calculates the imaging data stored in the storage unit; an accumulation time lock instruction unit; and an imaging instruction unit. In a computer-readable storage medium storing an image processing method applied to an apparatus as a program, the image processing method includes: an accumulation time determining step of repeatedly determining a charge accumulation time of the imaging unit; and an accumulation time lock. If the storage unit is instructed to lock the storage time, an unexposed image obtained by the imaging unit in the first imaging mode Data is stored in the storage unit, and thereafter, when an imaging instruction is issued by the imaging instruction unit, image data of a subject obtained by the imaging unit imaging in the second imaging mode is stored in the storage unit. A first control step of causing the first imaging mode to be stored in the first imaging mode if an imaging instruction is issued by the imaging instruction means without a storage time lock instruction being issued by the accumulation time locking instruction means. Storing the unexposed image data obtained by the imaging in the storage unit, and thereafter storing the image data of the subject obtained by the imaging unit in the second imaging mode in the storage unit. A third control step of causing the signal calculation unit to perform an image correction process based on the unexposed image data and the subject image data stored in the storage unit. Storage medium characterized by having. 77. An image pickup means, an image pickup time fixing instruction means for instructing fixing of an image pickup time so that the image pickup time of the image pickup means does not change for each image pickup, and causing the image pickup means to perform an image pickup operation in an exposure state. A first imaging operation for obtaining an imaging signal and a second imaging operation for obtaining an imaging signal by causing the imaging unit to perform an imaging operation in a non-exposure state are performed, and the imaging signal obtained by the first imaging operation is converted to the first imaging operation. A first mode and a second imaging operation in which the second imaging operation is performed after the first imaging operation is performed by the imaging unit while processing is performed using an imaging signal obtained by the second imaging operation. Is performed, and the second imaging mode is set to perform the first imaging operation. When there is an instruction to fix the imaging time from the imaging time fixing instruction unit, the second mode is set.
An image pickup apparatus comprising: a signal processing unit that operates in a mode. 78. The imaging apparatus according to claim 77, wherein said signal processing means operates in said first mode when there is no instruction to fix said imaging time from said imaging time fixing instruction means. apparatus. 79. The apparatus according to claim 77, further comprising storage means for storing the signals of the first mode and the second mode processed by the signal processing means.
9. The imaging device according to 8. 80. The imaging apparatus according to claim 79, wherein said storage means compresses and stores the signal processed by said signal processing means. 81. The imaging apparatus according to claim 80, wherein said storage means is a buffer. 82. The imaging apparatus according to claim 81, further comprising a recording unit that records information stored in said storage unit on a recording medium. 83. An image pickup means, an image pickup time fixing instruction means for instructing fixing of an image pickup time so that the image pickup time of the image pickup means does not change for each image pickup, and an exposure preparation instruction with a first stroke of a shutter release member. Exposure instructing means for instructing an exposure start in a second stroke; first imaging operation in which the imaging means performs an imaging operation in an exposure state to obtain an imaging signal; and instructing the imaging means to perform an imaging operation in a non-exposure state. Performing a second imaging operation to obtain an imaging signal by using the imaging signal obtained by the second imaging operation, and processing the imaging signal obtained by the first imaging operation with the imaging signal obtained by the second imaging operation. An imaging apparatus comprising: a signal processing unit that performs the second imaging operation in response to the exposure preparation instruction from the exposure instruction unit when an instruction to fix the imaging time is issued. . 84. The imaging apparatus according to claim 83, further comprising storage means for storing a signal processed by said signal processing means. 85. The imaging apparatus according to claim 84, wherein said storage means compresses and stores the signal processed by said signal processing means. 86. The imaging apparatus according to claim 85, wherein said storage means is a buffer. 87. The imaging apparatus according to claim 86, further comprising recording means for recording information stored in said storage means on a recording medium. 88. A first imaging operation capable of instructing to fix an imaging time so that an imaging time of an imaging unit does not change for each imaging, and causing the imaging unit to perform an imaging operation in an exposure state to obtain an imaging signal. And performing a second imaging operation for obtaining an imaging signal by causing the imaging unit to perform an imaging operation in a non-exposure state, and converting an imaging signal obtained by the first imaging operation to an imaging signal obtained by the second imaging operation And a first mode in which the imaging means performs the first imaging operation and then performs the second imaging operation, and a first mode in which the second imaging operation is performed and then the first mode. Second to perform imaging operation
And an operation in the second mode when there is an instruction to fix the imaging time. 89. An image capturing time can be instructed so that the image capturing time of the image capturing means does not change for each image capturing, an exposure preparation instruction is issued by a first stroke of a shutter release member, and an exposure start instruction is issued by a second stroke. Performing a first imaging operation of causing the imaging unit to perform an imaging operation in an exposure state to obtain an imaging signal and a second imaging operation of causing the imaging unit to perform an imaging operation in a non-exposure state to obtain an imaging signal; The imaging signal obtained by the first imaging operation is processed by the imaging signal obtained by the second imaging operation, and when there is an instruction to fix the imaging time, the imaging signal is responded to the exposure preparation instruction. An image processing method comprising performing a second imaging operation. 90. A first imaging operation capable of instructing to fix the imaging time so that the imaging time of the imaging means does not change for each imaging, and causing the imaging means to perform an imaging operation in an exposure state to obtain an imaging signal. And performing a second imaging operation for obtaining an imaging signal by causing the imaging unit to perform an imaging operation in a non-exposure state, and converting an imaging signal obtained by the first imaging operation to an imaging signal obtained by the second imaging operation And a first mode in which the imaging means performs the first imaging operation and then performs the second imaging operation, and a first mode in which the second imaging operation is performed and then the first mode. Second to perform imaging operation
A computer-readable storage medium having a program that operates in the second mode when there is an instruction to fix the imaging time in the second mode. 91. An image capturing time can be instructed so that the image capturing time of the image capturing means does not change for each image capturing, an exposure preparation instruction is issued by a first stroke of a shutter release member, and an exposure start instruction is issued by a second stroke. Performing a first imaging operation of causing the imaging unit to perform an imaging operation in an exposure state to obtain an imaging signal and a second imaging operation of causing the imaging unit to perform an imaging operation in a non-exposure state to obtain an imaging signal; The imaging signal obtained by the first imaging operation is processed by the imaging signal obtained by the second imaging operation, and when there is an instruction to fix the imaging time, the imaging signal is responded to the exposure preparation instruction. A computer-readable storage medium having a program for performing a second imaging operation.