JP2008124827A - Photographing control device, photographing control method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing control method capable of efficiently photographing an image close to the desired condition even in continuous photographing, without performing a large number of useless photographing. <P>SOLUTION: An imager 73 photographs an object image formed by an optical system and outputs an imaging signal. A DSP (digital signal processor) portion 75 memorizes the imaging signal successively at a buffer memory (A) 75c and processes the signal. A plurality of sets of combination of setting values are established for predetermined photographing conditions, while the number of photographed sheets is distributed and established for each combination according to distribution ratio for each photographing condition. A desired sequential set value is selected among the combination of setting values according to operation, and the selected combination is set to the photographing condition. The imager 73 and the DSP 75 are controlled to repeat photographing operation for the established number of photographed sheets for each combination. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a shooting control device capable of shooting with a bracket, a shooting control method, and a program shooting control device.

  2. Description of the Related Art Conventionally, in an electronic camera, it is known to perform bracket shooting by changing shooting condition parameters, for example, exposure conditions in stages. In bracket shooting, since a subject is continuously shot in a series of shooting operations, a plurality of images having the same composition but different shooting conditions can be obtained.

  Therefore, according to bracket shooting, for example, even when it is not possible to determine an appropriate exposure condition at the time of shooting, it is possible to select an image with an appropriate exposure from a plurality of images obtained after shooting. Can prevent failure. Further, when bracket shooting is performed, for example, even a moving subject can obtain a plurality of images with different nuances with the same composition without missing a photo opportunity, so that an image intended by the photographer can be easily obtained.

  As an example of such an electronic camera, the “digital camera” described in Patent Document 1 selects the first and second selection parameters from a plurality of parameters such as white balance, exposure, saturation, and sharpness. Then, the first and second selection parameters are set in a plurality of stages, respectively. Next, a plurality of composite parameters are formed by combining each stage of the second selection parameter with each stage of the first selection parameter. Next, substantially the same subject image is converted into a plurality of captured images based on the plurality of composite parameters, and the plurality of captured images are acquired as bracket images. Next, the plurality of captured images are simultaneously displayed on the LCD monitor.

In a digital camera that converts a subject image into a captured image based on a plurality of parameters, there is an advantage that a plurality of captured images generated by changing the plurality of parameters stepwise can be obtained by a series of shooting operations. Have.
JP 2006-67464 A

  However, in Patent Document 1, since a plurality of captured images are converted based on a plurality of composite parameters, a large number of useless images corresponding to combinations of unnecessary composite parameters are acquired, and desired conditions are satisfied. There was a problem that the efficiency deteriorated to obtain a close image.

  The present invention has been made in view of the above, and as its purpose, a shooting control apparatus capable of efficiently shooting images close to desired conditions without performing many unnecessary shots even during continuous shooting, To provide a photographing control method and program.

  (1) The present invention provides an imaging unit that captures a subject image formed by an optical system and outputs an imaging signal, an imaging condition setting unit that sets a plurality of combinations of imaging conditions according to a predetermined condition, and the imaging Continuous imaging control means for controlling the imaging means so as to repeatedly execute the imaging operation based on a combination of a plurality of imaging conditions set by the condition setting means.

  (2) The present invention is characterized in that the photographing condition setting means changes the number of combinations of photographing conditions according to a predetermined condition.

  (3) The present invention includes a shooting mode selection unit that selects a desired shooting mode from a plurality of shooting modes, and the shooting condition setting unit corresponds to the shooting mode selected by the shooting mode selection unit. A plurality of combinations of shooting conditions are set according to setting data for setting a combination of shooting conditions for each of a plurality of shooting scenes.

  (4) The present invention includes photometric means for measuring the luminance or illuminance of external light or subject light, and the photographing condition setting means is adapted to take photographing conditions according to photographing condition setting data corresponding to a measurement signal from the photometric means. A plurality of combinations are set.

  (5) The present invention includes distance measuring means for measuring a distance to a subject, and the photographing condition setting means sets a plurality of combinations of photographing conditions according to setting data corresponding to a measurement signal from the distance measuring means. It is characterized by doing.

  (6) The present invention is characterized in that the shooting condition setting means distributes and sets the number of shots for each combination of shooting conditions according to setting data of a distribution ratio for each of the shooting conditions to be combined.

  (7) The present invention includes continuous shooting number setting means for setting the total number of continuous shooting based on operation information from the operation input unit, and the shooting condition setting means is set by the continuous shooting number setting means. A plurality of combinations of the photographing conditions are set according to the total number of continuous photographing.

  (8) The present invention provides continuous shooting number setting means for setting the total number of continuous shooting based on operation information from the operation input unit, and dispersion of shooting conditions according to the set total number of continuous shooting. Dispersion degree setting means for setting the degree, the shooting condition setting means increases or decreases the dispersion range of the shooting conditions according to the dispersion degree set by the dispersion degree setting means, and in the increased and decreased dispersion range, A plurality of combinations of shooting conditions are set, and the number of shots for each combination is automatically distributed and set.

  (9) The present invention provides an image display unit and a plurality of images continuously captured by the imaging unit or a reduced image of the image according to a combination of a plurality of imaging conditions at the time of capturing the image, or a predetermined number. Selected from among the images displayed on the image display means based on the operation information from the operation input unit, and the display control means for controlling to reproduce and display on the image display means arranged according to the shooting conditions And recording control means for controlling to encode and store the image data of the image in a memory medium.

  (10) In the present invention, the shooting condition setting means is configured to set shooting conditions according to shooting condition setting data based on setting data for setting a combination of shooting conditions based on pre-stored shooting condition frequency data or statistical data. A plurality of combinations are set.

  (11) According to the present invention, the shooting condition setting means is configured to select one of shooting conditions among an exposure correction condition, a white balance setting condition, a flash emission condition, an automatic focusing condition, and a depth of field condition according to the setting data. A plurality of combinations are set.

  (12) The present invention repeatedly executes a shooting operation based on a shooting condition setting step for setting a plurality of combinations of shooting conditions according to a predetermined condition and a combination of the plurality of shooting conditions set in the shooting condition setting step. As described above, a continuous shooting control step of controlling an image pickup device that picks up a subject image formed by an optical system and outputs an image pickup signal is provided.

  (13) The present invention repeatedly executes a shooting operation based on a shooting condition setting step for setting a plurality of combinations of shooting conditions according to a predetermined condition and a combination of the plurality of shooting conditions set in the shooting condition setting step. As described above, the computer is caused to execute a continuous shooting control step of controlling an image pickup element that picks up a subject image formed by an optical system and outputs an image pickup signal.

  According to the present invention, it is possible to efficiently shoot an image close to a desired condition without performing many unnecessary shoots even during continuous shooting.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  [Outline of the Present Invention] (High-speed Continuous Shooting by Changing Combination of Shooting Conditions) FIG. 1 is a system configuration diagram showing an outline when the shooting control apparatus according to the embodiment of the present invention is applied to an electronic camera.

  As shown in FIG. 1, the electronic camera includes an operation input unit 11, a control unit 13, a zoom lens / focus lens driving unit 15, an aperture / shutter driving unit 16, a strobe driving unit 17, a strobe 18, an angular velocity sensor / acceleration sensor 19. , Camera shake / vibration detection unit 20, light receiving sensor / AF sensor 21, photometry / ranging / AF detection unit 22, optical system 23, image sensor 25, buffer memory unit 29, image encoding / decoding unit 31, image recording / I / O unit 33, image memory medium 35, display unit 37, and display control unit 39.

  Specifically, the control unit 13 includes a shooting mode / shooting scene selection unit 13a, a scene-specific shooting program 13b, a shooting condition 113c1, a shooting condition n13cn, a combination of a plurality of shooting conditions / a set number of consecutive shots 13d, and a combination of shooting conditions. Setting data 13e, shooting condition frequency statistical data 13f, shooting condition 13g, shooting control unit 13h, normal shooting control unit 13h1, high-speed continuous shooting control unit 13h2, multi-shot continuous shooting unit 13h3, image evaluation control unit 13i The image recording / input / output control unit 13j.

  Specifically, the shooting mode / shooting scene selection unit 13a selects a shooting scene to be shot from a plurality of displayed scene names and sample images according to the operation of the operation input unit.

  In accordance with the setting data read from the combination setting data 13e of the combination / multiple shooting condition combination setting data 13e and the shooting condition combination setting data 13e, a plurality of shooting condition setting value combinations are set and the number of shots for each combination is automatically set. Set distribution to. The combination setting unit 13d for the combination of multiple shooting conditions / the number of continuous shots reads shooting condition setting data from the shooting condition combination setting data 13e of the shooting conditions in accordance with the measurement signal from the photometry / ranging / AF detection unit 22. In accordance with the read setting data, a plurality of combinations of set values of shooting conditions are set, and the number of shots for each combination is set to be distributed.

  In addition, the combination / multiple shooting number setting unit 13d of multiple shooting conditions sets the total number of continuous shooting. Furthermore, the combination / multiple shooting number setting unit 13d of the plurality of shooting conditions sets the continuous shooting set according to the setting data of the distribution ratio for each combination of the shooting condition setting values read from the shooting condition setting data storage means. The number of shots for each combination of set values of shooting conditions is distributed and set according to the total number of shots.

  The combination / multiple shooting number setting unit 13d for multiple shooting conditions sets the degree of dispersion of the set values of shooting conditions according to the set total number of continuous shootings. The combination of multiple shooting conditions / number of consecutive shots setting unit 13d increases or decreases the dispersion range of the setting values of the shooting conditions according to the set degree of dispersion, and the combination of the setting values of the shooting conditions within the increased or decreased dispersion range. A plurality of sets are set, and the number of shots for each combination is automatically distributed and set.

  The combination of multiple shooting conditions / number of consecutive shots setting unit 13d reads shooting condition setting data based on the frequency data from the shooting condition frequency statistical data 13f, and sets the shooting condition setting values according to the read setting data. A plurality of sets are set, and the number of shots for each combination is set to be distributed.

  In accordance with the setting data, the setting unit 13d for combinations of multiple shooting conditions / number of continuous shots shoots exposure correction conditions, white balance setting conditions, flash emission conditions, AF (autofocus) conditions, depth of field conditions, and the like. Among the conditions, a plurality of combinations of set values of any shooting condition are set, and the number of shots for each combination is set to be distributed.

  The shooting condition combination setting data 13e stores in advance a plurality of sets of setting data for setting a combination of setting values of shooting conditions in association with the high-speed shooting mode or the continuous shooting mode. The shooting condition combination setting data 13e stores setting data for setting a combination of setting values of shooting conditions for each of a plurality of scenes. Further, in the shooting condition combination setting data 13e, the shooting condition setting data of the corresponding scene is read from the shooting condition combination setting data 13e in accordance with the shooting scene selected by the shooting mode / shooting scene selection unit 13a. In accordance with the read setting data, a plurality of combinations of set values of shooting conditions are set, and the number of shots for each combination is set to be distributed.

  The imaging condition frequency statistical data 13f stores imaging condition frequency data or statistical data in advance, and stores setting data for setting a combination of imaging condition setting values based on the imaging condition frequency data.

  The high-speed continuous shooting control unit 13h2 performs an operation from among a plurality of setting value combinations set by the combination of a plurality of shooting conditions / continuous shooting number setting unit 13d in association with the high-speed shooting mode or the continuous shooting mode. The combination of the set values is sequentially selected according to the above, and the combination is set as a shooting condition, and control is performed to repeatedly execute the shooting operation for each set number of shots.

  The photometry / ranging / AF detection unit 22 measures the brightness or illuminance of the external light or subject light and the distance to the subject based on the detection signal from the light receiving sensor / AF sensor 21. The display unit 37 displays the name of the shooting scene and a sample image.

  The image sensor 25 captures a subject image formed by the optical system and outputs an imaging signal. The image sensor 25 reads an image pickup signal of pixels in all areas in the effective image pickup area in accordance with the input control signal, and a selected portion in the effective image pickup area in accordance with the control signal. Selective readout mode for selecting and reading out image signals of pixels in the area, and adding and reading image signals of a plurality of pixels in the horizontal and / or vertical direction of the entire area or selected partial area according to the control signal. An addition readout mode to be output, and a non-addition readout mode to read out the imaging signals of the pixels in the entire region or the selected partial region in accordance with the control signal without adding them, and provided in the imaging signal output circuit A serial conversion circuit is provided, and the read imaging signal is output to the signal processing unit 27 at high speed as a serial digital signal converted into a serial signal by the parallel / serial conversion circuit.

  The display control unit 39 displays a plurality of continuously shot images or reduced images (thumbnail images) for each combination of a plurality of shooting conditions at the time of shooting the image or for each set value of a predetermined shooting condition. The display unit 37 is controlled to reproduce and display on the display unit 37. The display control unit 39 sequentially evaluates the image quality of a plurality of continuously photographed images by the image evaluation processing unit 27h, and displays the plurality of continuously photographed images or reduced images (thumbnail images) of the images. A selection is made based on the superiority, inferiority, or magnitude of the evaluation value of a predetermined image quality, and control is performed so that a plurality of selected images are arranged and reproduced and displayed on the image display means.

  The image recording / input / output unit 33 encodes the image data of the image selected from the images displayed on the display unit 37 according to the operation of the operation input unit 11, and saves and records the image data in the image memory medium 35. Control. The image recording / input / output unit 33 encodes any image data of a predetermined number of images selected based on the superiority or inferiority of the image quality evaluation value, or an image selected according to the operation of the operation input unit. And control to save and record in the memory medium.

  The signal processing unit 27 writes image data read from the image sensor 25 at high speed to an image memory unit provided therein, and performs high-speed encoding processing. Image memory unit composed of a plurality of frame memories, an image signal processing unit, an image correction processing unit, an image feature extraction unit, an image recognition processing unit, an evaluation value of image quality by evaluating a predetermined image quality characteristic of a captured image It is comprised from the image evaluation process part which outputs.

  In FIG. 1, a DSP capable of high-speed encoding processing includes an image sensor 25 made of CMOS capable of high-speed reading by parallel reading and an image memory unit 27c capable of high-speed writing of image data read at high speed from the image sensor 25. Using the signal processing unit 27, the continuous shooting or moving image shooting is performed at a high speed.

  In shooting by one release operation, a plurality of images are continuously shot at high speed while changing a combination of a plurality of shooting conditions little by little, and a large number of subjects having substantially the same timing are shot with a combination of different shooting conditions. This makes it possible to easily record an image with a good image quality and a desired image.

  When a desired scene or sample image is selected from a plurality of images, the shooting speed (continuous shooting interval), the number of continuous shooting frames, The high-speed shooting operation may be controlled by automatically setting the captured image size (number of pixels) and the like so as to be optimal for high-speed continuous shooting of the selected scene.

  In addition, since continuous shooting is performed at a high speed, such as 20 to 300 images / second, the number of images to be shot increases even if one image is taken. Therefore, a large amount of memory is consumed at one time, and many unnecessary images are saved. It takes time and effort to delete memory.

  Therefore, an image evaluation processing unit 27h that evaluates the image quality of the captured image and a scene-specific shooting program are provided, and “best 3” or “best” is selected from a plurality of images continuously shot while changing the shooting conditions. Images selected according to the magnitude of the evaluation value, such as “10” and “Best 3 by shooting condition and image quality item”, are displayed on the display unit 37 as recording candidates, and the selected image or a user among them is displayed. An image selected by the operation is stored and recorded in the image memory medium 35.

  [Summary 1 of the invention] As shown in FIG. 1, a plurality of shootings are performed even in a still shooting by a single release operation using a large number of ultra high-speed continuous shooting functions such as a CMOS image sensor capable of high-speed operation. While changing the combination of conditions little by little, (multiple L photographing conditions of item A) × (multiple m photographing conditions of item B) × (multiple n photographing conditions of item C)..., L × m × n × ············· Enables continuous recording of images at a high speed.

  In addition, a desired image is selected from the continuously shot images so that only the selected image can be stored and recorded in the image memory medium 35. Further, a plurality of p images may be repeatedly captured under the same conditions so that L × m × n ×... × p images can be continuously captured.

  At that time, depending on the selected shooting mode and shooting scene, the ratio and distribution setting data for each shooting condition, or the measurement value such as the subject brightness value and the situation of the subject, By automatically setting the range to be distributed, the distribution ratio for each combination, and the number of shots (frames), the number of shots set for each combination can be set to high-speed continuous shooting, revealing the difference from the conventional example. To.

  [Summary 2 of the invention] Further, based on statistical data such as frequency data of actual shooting conditions, combinations of shooting conditions, a distribution ratio for each combination, and the number of shots are changed.

  [Key point of the invention 3] The ratio of shooting and the number of shots for each combination of the above shooting conditions are automatically set according to the total number (N) of continuous shooting, the selected shooting scene, and the predetermined shooting conditions. Control to increase / decrease or change the degree of dispersion of shooting conditions.

  [Guide 4 of the Invention] When continuous shooting is performed under the above-described multi-conditions, a plurality of photographed images, L × m × n,..., L × m, m × n,. The images are arranged side by side according to the combination of the conditions, and the images having different shooting conditions are compared with each other so that the user's favorite image or a good image can be selected and recorded by the operation.

  [Summary 5 of the Invention] An image evaluation processing unit 27h for evaluating the image quality of a photographed image and a program are provided, and “best 3” and “best” are automatically selected from images continuously taken while changing photographing conditions. Images selected according to the magnitude of the image quality evaluation value, such as “10” and “Best 3 by shooting condition and image quality item”, are displayed as recording candidate images, and the selected images are stored and recorded.

  For example, (a) an image close to the appropriate exposure condition, (b) an image with a wide distribution range of luminance histogram distribution or histogram for each RGB, whiteout or blackout, etc. Evaluate the image quality of images with high resolution and contrast, images with little blurring and blurring, etc., based on features of spatial frequency characteristics, such as images with low luminance distribution characteristics, (c) image frequency components, and Fourier transform transform coefficients. To do. Alternatively, (d) detecting and evaluating red eyes, a human image with a closed eye, an image with a lot of halation and reflection, an image taken with backlight, an image with noticeable blurring and blurring, etc. A method may be used in which the image to be judged is preferentially dropped from the candidates and selected from the remaining images according to a user operation. Further, the user may be able to select from a plurality of evaluation methods.

  First Embodiment FIG. 2 is a block diagram showing the overall configuration of a high-speed camera according to the first embodiment of the present invention.

  As shown in FIG. 2, the high-speed camera includes an operation input unit 51, a control circuit 53, a shutter drive unit 55, an aperture drive unit 56, a zoom lens drive unit 57, a focus lens drive unit 58, and a photographing optical system (zoom lens). 59, strobe drive circuit 60, strobe 61, photometry / ranging sensor 62, detection circuit 63, angular velocity sensor (Y / Pitch) 64, detection circuit 65, angular velocity sensor (X / Yaw) 66, detection circuit 67, HDD storage device 68, program memory 69, data memory 70, image memory medium 71, image sensor 73, DSP unit 75, buffer memory (B) 77, image CODEC (encoder / decoder) 79, moving image CODEC (encoder / decoder) Decoder) 81, display drive circuit 83, and image display unit 85.

  The control circuit 53 includes an input / output port 53a, an input / output port 53b, an HDD / IF 53c, an interface 53d, an input circuit 53e, a memory card / IF 53f, and a CPU 53g.

  The DSP unit 75 includes a controller 75a, an S / P conversion circuit 75b, a buffer memory (A) 75c, a WB correction circuit 75d, a pixel interpolation / resizing circuit 75e, a color interpolation circuit 75f, a contour correction circuit 75g, a gamma correction circuit 75h, and a matrix. A circuit 75i, an image feature processing unit 75j, an image recognition processing unit 75k, and an image evaluation processing unit 75m are included.

  Hereinafter, the operation of the high-speed camera will be briefly described with reference to FIG.

  A subject image formed on the imaging surface by the imaging optical system 59 is photoelectrically converted by an imaging element 73 such as a CCD or a CMOS image sensor, and a DSP (digital signal processing circuit) unit as an imaging signal of a through image or a captured image. 75, and is input to a buffer memory (A) 75c provided with a plurality of frame memories and the like provided in the DSP unit 75, and is subjected to signal processing. It is output as a signal and temporarily stored in the buffer memory (B) 77 or the like.

  When a release button (not shown) provided in the operation input unit 51 is pressed and a still image shooting instruction is input to the control circuit 53, an exposure operation and a shooting operation are performed based on the set shooting conditions, The image sensor 73 picks up an image pickup signal of a high-resolution subject image for different still recording, and the image data signal-processed by the DSP unit 75 is output by an image CODEC (Coder & Decoder, encoder / decoder) 79 to the JPEG standard. Compressed encoded image data conforming to the above, or non-compressed encoded image data such as RAW data, and a data memory 70 comprising a memory medium such as a built-in memory or a flash memory card, or a small HDD storage Device (Hard Disk Drive: hard disk recording device) 68 etc., EXIF JPEG etc. It is recorded in a file format.

  Also in the case of continuous shooting, the still shooting is repeatedly performed at high speed, and the image signal read out from the image sensor 73 at high speed is output to the DSP unit 75 or the like at high speed. At this time, similarly, the encoded image data is stored in the data memory 70 or the HDD storage device 68.

  Similarly, in the case of moving image shooting, an image pickup signal of a subject image is picked up by the image pickup device 73, and image data subjected to signal processing by the DSP unit 75 is converted by a moving image CODEC encoder / decoder 81 to MPEG4 or H.264. The data is compressed and encoded in accordance with a compression encoding method such as H.264 / AVC, and is recorded in the data memory 70 or the HDD storage device 68 in a file format such as AVI or MP4.

  The image data file recorded in the data memory 70 or the HDD storage device 68 is transferred to a personal computer or printer via an image memory medium or an external input / output interface such as a USB interface (not shown). Image data files can be stored and recorded in a large-capacity HDD device in a personal computer, stored and recorded on a disk medium such as a CD-R or DVD, or a captured image can be reproduced and displayed on a monitor. The photographed image and recorded video can be edited using an image editing software in a personal computer or printed by a printer.

  [Image Sensor] When the imaging device 73 is configured by a CCD (Charge Coupled Device) image sensor as in the past, the signal charge generated in the photodiode by the incident light is not amplified and is directly vertical. Are sequentially transferred by a horizontal CCD transfer path, and are first amplified and output to a signal voltage by an FD (Floating Diffusion) amplifier in the output circuit. The image pickup signal output from the CCD is subjected to noise removal and sample-and-hold processing by a CDS circuit (Correlated Double Sampling), amplified by an AGC (automatic gain control) amplifier, and ADC (Analog-Digital Converter), A digital image signal is converted by an A / D converter and output to the DSP unit 75.

  On the other hand, when the imaging device 73 is configured by a CMOS (Complementary Metal Oxide Semiconductor) image sensor, in a general APS (Active Pixel Sensor) type CMOS sensor, An amplification element is built in each unit pixel circuit including a photodiode, and signal charges photoelectrically converted by the photodiode are once amplified by an amplifier in the pixel circuit, and a row address selection signal from a vertical scanning circuit and a horizontal scanning circuit The image pickup signal for each pixel selected by the column selection signal from the XY address method can be sequentially extracted from the output as voltage or current.

  Even if it is not taken out sequentially like a CCD, the CMOS sensor can take out only the image signals of any pixel or area in any order, so when reading out only a predetermined area by digital zoom processing, it reads at high speed. I can put it out. In CCD, signal charges are transferred as they are, so they are vulnerable to smear and noise. However, in CMOS sensors, each pixel is read out by random access, and each pixel circuit is electrically separated, so it is resistant to transmission noise. Similar to a CMOS LSI or the like, there is an advantage that a digital logic circuit such as an addition operation circuit, a signal processing circuit, etc. can be highly integrated around the image sensor portion in the same manufacturing process and can be relatively easily formed together.

  On the other hand, in the above CMOS sensor, fixed pattern noise (FPN), dark current, and kTC noise due to variations in individual elements such as the threshold value of the amplifier for each pixel have been difficult, but recently, embedded photo (similar to CCD) A structure using a diode and an FD amplifier can reduce the dark current flow and the kTC noise. Also, fixed pattern noise (FPN) is obtained by subtracting the signal before and after resetting the photodiode by a column type CDS / A / D conversion circuit provided in a column circuit arranged in parallel for each column signal line. It has become possible to remove the signal, and an integration type, a cyclic type, or a sequential type AD converter is incorporated in each column circuit, so that it is easy to output an imaging signal as a digital signal.

  [High-Speed Image Sensor, Selective Reading and Pixel Addition, High-Speed Output of Imaging Signal] FIG. 3 is a block diagram showing the configuration of the imaging device of the high-speed camera according to the first embodiment of the present invention.

  As shown in FIG. 3, the image sensor 73 includes an image sensor unit 73a including a plurality of unit pixel circuits 73a1, a CDS circuit 73b, an A / D conversion circuit 73c, a pixel addition circuit 73d, an encoder 73e, a parallel / It is composed of a serial conversion circuit 73f, a timing generation circuit 73g, a vertical scanning circuit 73h, a horizontal scanning circuit 73i, and a transmitter 73j.

  In an imaging element employed in a high-speed camera, a CDS / A / D conversion circuit / pixel addition circuit is provided in each column circuit (column circuit) unit, and digital imaging signals are parallel / serialized by a P / S conversion circuit. A CMOS image sensor configured to convert and output is effective.

  [CDS / A / D Conversion Circuit, Pixel Adder Circuit] FIG. 4 is a circuit diagram showing a detailed configuration of the image sensor of the high-speed camera according to the first embodiment of the present invention. Pixels provided in the image sensor As an example of the addition circuit, an example in which a pixel addition circuit is provided in a column circuit unit such as the CDS circuit 73b and the A / D circuit 73c in the CMOS image sensor will be described.

  As shown in FIG. 4, the image sensor 73 includes a unit pixel circuit 73a1, an ADC reference signal (Ramp waveform) 73n, a 10-bit counter 73p, a latch 73c1, an arithmetic circuit 73k, a latch 73k1, a latch 73k2, an ALU 73k3, a latch 73k4, and a horizontal. The scanning circuit 73i, the arithmetic circuit 73m, the latch 73m1, the latch 73m2, the ALU 73m3, the latch 73m4, the encoder 73e, the parallel / serial conversion circuit 73f, the transmitter 73j, the DSP 75, the P / S conversion circuit 75b, and the receiver 75b1.

  As shown in FIG. 4, in order to construct a high-speed CMOS image sensor, an adder circuit and a high-speed transfer circuit are provided in the column circuit of the Column ADC system. It is configured to be able to perform selective reading by selecting an image area of a size and reading out an imaging signal of a pixel in the area.

  As shown in FIG. 3 and FIG. 4, imaging of a plurality of pixels of the same color filter adjacent to each pixel is performed in a subsequent stage portion of the CDS circuit 73 b, the A / D conversion circuit 73 c and the horizontal scanning circuit 73 i provided in the column circuit unit. ALU 73k3 and ALU 73m3 for adding signals as digital signals are provided with arithmetic circuits 73k and 73m, and at the time of digital zooming or high-sensitivity shooting, an imaging signal obtained by adding pixel data in a selected region for a plurality of pixels for each arbitrary matrix is provided. It is configured so that it can be read out, and the shooting sensitivity per pixel can be increased substantially by the number of additions, shooting with good exposure can be achieved even with a short exposure time and fast shutter speed, and high-speed movie shooting and continuous shooting. However, it can be converted into an imaging signal with a small amount of image data and output.

  The picked-up image signal of the selected area and the image signal obtained by adding the pixels are selected from the CDS circuit 73b and the A / D conversion circuit 73c provided in the column circuit section by the column selection signal of the horizontal scanning circuit 73i. The column signals are sequentially output. At this time, they are output as parallel digital signals in synchronization with the high-speed clock, or the parallel digital signals are encoded and parallel / serial converted by the parallel / serial conversion circuit 73f. By outputting to the DSP unit 75 as a serial digital imaging signal from the transmitter 73j, it is possible to transfer and output a high-resolution imaging signal to the DSP unit 75 at a high frame rate.

  [Operations of CDS Circuit and A / D Conversion Circuit] As shown in FIG. 4, various methods have been developed for specific configurations of the CDS circuit and the A / D conversion circuit provided in the column circuits arranged in parallel. In this embodiment, a fixed pattern noise (FPN) of a pixel is suppressed by an A / D converter that performs parallel processing for each column using a so-called “Column ADC method” CDS circuit 73b and an A / D conversion circuit 73c. While converting to a digital signal. The Column ADC type CDS circuit 73b uses a two-stage clamp circuit of coarse accuracy and high accuracy in order to suppress fixed pattern noise. Generally, clamping is an operation of replacing a certain level of a signal with a reference voltage, and the clamp circuit is composed of, for example, a capacitor and a switch, and the output side of the capacitor is set to the reference voltage by the switch.

  FIG. 5 is a timing chart for explaining operations of the CDS circuit and the A / D conversion circuit. In the timing chart shown in FIG. 5, first, when the clamp switches S1 and S2 connected in parallel to the inverting buffers A1 and A2 of the column circuit portion are simultaneously closed in the first clamp period, the clamp switch S1 is opened first. The potential of Vin is clamped with a rough accuracy to the voltage obtained by adding the variation of S1 switching to the threshold voltage of A1, but since S2 remains closed, the voltage becomes the threshold voltage of the A2 input. Thereafter, when S2 is opened, a voltage including the variation in switching is clamped in A2, and the clamping operation is completed. The variation component of S2 switching divided by the gain of A2 is reduced to the variation on the Vin side, so that when viewed from the Vin side, the clamp accuracy is improved, and the vertical streak fixed pattern noise (FPN) generated in the clamp circuit ) Is suppressed.

  Next, when a pulse rises on the row readout line (transfer gate line TG), a pixel signal appears on the column signal line. Therefore, the switch S4 is closed and sampling is performed. When the sampling is completed, the switch S3 is opened, and a reference signal having a ramp waveform for A / D conversion (a RAMP waveform, a ramp-like waveform in which the voltage rises sequentially, a stepped waveform) is applied from the switch S4. The voltage of Vin eventually exceeds the threshold value of the clamp circuit and the output of A2 is inverted. The value of the 10-bit counter 73p until the voltage to be inverted is stored in the latch 73c1 as a digital pixel signal value, and the A / D conversion process is completed. To do.

  [Pixel Addition Operation] An arithmetic circuit 73k such as a column adder circuit (vertical adder circuit) is provided after such a column circuit including the CDS circuit 73b and the A / D converter circuit 73c, and a signal of a pixel whose row address is selected is provided. The digital parallel signal read from the column signal line, noise-removed and digitally converted by the CDS circuit 73b and the A / D conversion circuit 73c is latched in the latch 73k1 by the latch clock signal, and pixels in different rows in the same selected column Similarly, the digital parallel signal is latched in another latch 73k2 by a latch clock signal of another timing, and the outputs of both latch circuits are digitally added by the ALU 73k3 constituting the column addition circuit.

  Further, an arithmetic circuit 73m such as a row addition circuit (horizontal addition circuit) is provided in the signal output section from the horizontal signal line, and the column-added signals are selected by the latch clock signal and read out to the horizontal signal line and latch 73m1. , 73m2, and the outputs of both latch circuits are digitally added by the ALU 73k4 constituting the row adder circuit.

  In the case of color imaging, for example, the same color filter adjacent in the column direction (by skipping one) from each pixel corresponding to each RGB color filter arranged alternately in a two-pixel cycle in a staggered pattern such as “Bayer array” The R pixels are R pixels, the G pixels are G pixels, the B pixels are B pixels, and a plurality of pixels are added in the column direction, and adjacent in the row direction (one skipped) By adding and reading a plurality of pixels of the filter in the row direction, signals of pixels of the same color can be added for a plurality of pixels.

  The added digital signal of the imaging signal is subjected to predetermined encoding by the encoder 73e, and parallel / serial converted by the parallel / serial conversion circuit 73f to be sequentially converted into a serial (serial) digital signal to be transmitted to the transmitter 73j. Is transferred to the receiver 75b1 of the DSP unit 75.

  [Other CDS circuit, A / D conversion circuit, addition circuit] In this embodiment, the CDS circuit and the A / D conversion circuit are configured by the Column ADC system. However, for example, a simple Column CDS system, a DDS, or the like is used. Other CDS circuits, A / D conversion circuits, and addition circuits, such as a method (Double Data Sampling) and a charge region difference method, may be used.

  For example, Japanese Patent Laid-Open No. 2005-278135 “Driving Method of Solid-State Imaging Device and Group Imaging Device” (not shown) uses an integrating ADC using a column parallel ADC comparator and an up / down counter, a CDS circuit, A CMOS image in which an A / D conversion circuit is configured and a digital pixel value is written in a memory unit, for example, the next pixel value is continuously counted without resetting the counter, and an addition operation can be performed without an adder. A configuration example of the sensor is disclosed. Also in the present embodiment, pixel addition processing may be performed using such an addition circuit.

  [High-Speed Serial Transfer Circuit such as CML, LVDS] As described above, the digital signal of the added imaging signal is sequentially converted into a serial (serial) digital signal by the parallel / serial conversion circuit 73f. The data is transferred to a receiver 75 b 1 provided in 75. In order to capture an image with a high resolution and a high-speed frame, it is necessary to transfer an imaging signal to the DSP unit 75 at a high speed.

  In an input / output circuit made of a general CMOS, the amplitude of the input / output signal is swung within the full range of the power supply voltage, so that not only the power consumption increases, but also the transfer speed becomes slow.

  For example, in a CML (Current Mode Logic) input / output circuit, a transistor is used in an unsaturated region to reduce impedance and turn on / off current (rather than swinging voltage). Thus, it is operated with a low amplitude centered on the potential of (Vdd−0.4V). High speed operation is possible because the amount of charge / discharge of stray capacitance is reduced.

  The LVDS system (Low-Voltage Differential Signaling) is a differential signal system that carries information using two signal lines, and is several hundred to several thousand Mbps (megabit / bit). In order to reduce the number of signal lines of the internal bus as a differential data transmission method with a low power consumption of mW level, it is possible to transmit data at a high speed (seconds), so communication equipment, display devices, and digital video signals Widely used as an input / output interface.

  The LVDS system requires two wires, but common mode noise can be removed by adopting a current mode driver and a small amplitude that swings within a vertical amplitude of 0.3 V around the +1.2 V potential, High noise resistance can be obtained over a wide frequency range.

  As described above, even in a CMOS circuit, a digital imaging signal converted into a serial signal is transmitted from an output circuit (transmission transmitter) of an imaging device using a low-amplitude input / output interface such as a CML system or an LVDS system capable of serial transmission at high speed. After the serial digital signal is output and transmitted to the DSP section 75 at a high speed and received by the input circuit (reception receiver) provided in the DSP section 75, it is converted into a parallel digital signal by the S / P conversion circuit 75b. It can be used for video signal processing as a digital imaging signal.

  [DSP Unit (Digital Signal Processing Unit)] When the image sensor 73 is an image sensor made of CMOS, noise is removed and digitally converted by a CDS circuit and an A / D conversion circuit with a built-in CMOS sensor, and also a built-in high-speed output circuit. The digital imaging signal transferred as a serial digital signal is input to the DSP unit 75.

  The DSP unit 75 converts the digital imaging signal transferred as a serial digital signal from the imaging device 73 into a parallel digital signal by the S / P conversion circuit 75b, and sequentially stores the parallel digital signal in the buffer memory (A) 75c. At the same time, the parallel digital signal read from the buffer memory (A) 75c is output to the WB correction circuit 75d. Next, after white balance adjustment and color balance adjustment are performed by the WB correction circuit 75d, pixels are arranged in accordance with a mosaic “Bayer array” provided on the front surface of the image sensor 73 or a color filter array such as staggered RGB. Each pixel has only one color component, but the pixel values of the other color difference components are also obtained by pixel interpolation (pixel interpolation) from neighboring pixel values (color interpolation processing), and the RGB color difference components for each pixel It is converted into digital image data having each gradation value.

  Also, before color interpolation, resolution conversion processing (Resolution Conversion) for converting the captured image size to a different image size may be performed by the pixel interpolation / resizing circuit 75e as necessary.

  In the pixel interpolation / resizing circuit 75e, for example, a predetermined image (such as a VGA size) is written in order to write a through image or a reproduced image in a video RAM or a display RAM area in a display driver in order to display on a finder or an image monitor. Resizing (Resize) for conversion into size (number of pixels) or interpolation processing (Interpolation) is performed. Alternatively, at the time of shooting and recording, processing for reducing / enlarging to a set recording image size, resizing / interpolation processing, or resolution conversion processing is performed in order to record at a desired recording image size.

  Further, in the DSP unit 75, the RGB digital image signal whose gradation has been corrected by the gamma correction circuit 75h is temporarily stored in the buffer memory (B) 77 and then reproduced and displayed on an electronic viewfinder such as an LCD monitor, or a matrix. The circuit 75i converts the RGB system to an image signal of a predetermined color space such as a YUV system / YCbCr system, and the image CODEC 79 converts the JPEG still image data, MPEG4, H.264, etc. H.264 moving image data or the like is compressed / encoded. It should be noted that the controller 75a has an S / P conversion circuit 75b, a buffer memory (A) 75c, a WB correction circuit 75d, a pixel interpolation / resize provided in the DSP unit 75 in accordance with the data and shooting conditions set by the CPU 53g. Each circuit such as a circuit 75e, a color interpolation circuit 75f, a contour correction circuit 75g, a gamma correction circuit 75h, a matrix circuit 75i, an image feature processing unit 75j, an image recognition processing unit 75k, and an image evaluation processing unit 75m is controlled.

  [Shooting speed for high-speed shooting] In conventional high-speed cameras for business use, etc., a time interval of about 5 times the exposure time required for each frame is provided due to restrictions of the film feeding mechanism in the silver halide film era. In many cases, continuous shooting speed and frame speed were set. On the basis of this, the shutter coefficient is often set to about α = 5, but this is not always determined from the required shooting speed, but is restricted due to limitations of the film feed mechanism or customarily. It was often decided.

  Further, even with a conventional digital camera, the exposure time can be taken in a minute time such as 1/1000 second to 1/8000 second. However, the speed of continuous shooting is limited by an image sensor used such as a CCD, for example, an imaging charge. Due to the principle of transmitting and reading sequentially on the vertical and horizontal transfer paths, continuous shooting of only about 3 to 8 frames / second could be performed due to restrictions such as the time required for reading the imaging signal and the signal processing time after reading.

  As in the present embodiment, the image pickup signal can be obtained even when the image pickup element 73 made of a high speed CMOS capable of reading the image pickup signal at a high speed and the DSP unit 75 capable of performing a signal processing or an encoding process at a high speed are used. However, it can be read and processed at a speed several tens of times faster than conventional digital cameras such as CCDs. The restriction such as the shutter coefficient α described above can be arbitrarily set as long as the phenomenon and the like satisfy the conditions such that the image can be taken under appropriate exposure conditions and without blurring.

For example, the shooting speed (frame speed) R (fps) is set according to setting information such as the shooting magnification M and the moving speed V of the subject set for each scene.
R = (M × X) / (d × α) (1)

  However, R: shooting speed (frame / second), M: shooting magnification = image size (Y ′) / subject size (Y), V: moving speed of subject (mm / second), d: allowable circle of confusion, α : Estimated shooting speed is calculated from a calculation formula such as a Schottky coefficient (α = 1-5, etc.), and the shooting speed R is set based on it.

  Even in the same scene, the user can select conditions such as shooting speed, shooting time, image size, shooting sensitivity, and sensitivity increase by pixel addition according to the operation or according to the desired drawing expression. The automatic setting may be performed while satisfying the condition.

[Necessary exposure time for high-speed shooting] For example, the required exposure time (T) is determined according to setting information such as the shooting magnification (M) and the moving speed (V) of the subject set for each scene.
T = β × d / (M × V) (2)
Where T: exposure time (seconds), d: permissible circle of confusion, M: shooting magnification = image size (Y ′) / subject size (Y), V: subject moving speed (mm / second), β: coefficient (Β = 0.2-1.0), or
T = β × Y ′ / (m × M × V) (3)

  Where T: exposure time (seconds), Y ′: image size of the image sensor (mm), m: number of pixels of the image sensor, M: photographing magnification, V: moving speed of the subject (mm / sec), β: coefficient A guideline for the required exposure time is calculated by a calculation formula such as (β = 0.2 to 1.0), and the exposure time T is set in accordance with the photometric value and illumination conditions within a range satisfying the required exposure time.

  [Multi-Continuous Continuous Shooting Operation] FIG. 6A is a schematic operation when the high-speed camera according to the embodiment of the present invention performs multi-condition continuous shooting in which continuous shooting is performed while gradually changing the combination of a plurality of shooting conditions. 6B is an example of a screen for explaining the operation corresponding to each step shown in FIG. 6A.

  The flowchart shown in FIG. 6A will be described with reference to the overall configuration diagram of the high-speed camera shown in FIG.

  First, in step S10, the CPU 53g selects a desired shooting mode or shooting scene according to operation information input from the operation input unit 51 via the input circuit 53e. This state is displayed on the image display unit 85 as shown in 6B (a).

  Next, in step S20, the CPU 53g automatically selects a combination of a plurality of shooting conditions in accordance with the shooting mode and shooting scene, and automatically assigns the number of shots for each combination of shooting conditions as appropriate. Set to 75a. Here, when a shooting operation is started in response to a single release operation input from the operation input unit 51, a set number of images are respectively set according to a combination of a plurality of shooting conditions set in the controller 75a. The image sensor 73 and the DSP unit 75 are controlled so as to continuously shoot at a high speed. At this time, the captured images are sequentially recorded in the frame memory in the buffer memory (A) 75c, and are subjected to signal processing. FIG. 6B (b) shows the number of shots corresponding to the combination of the shooting conditions (1), (2), and (3).

  Next, in step S30, the CPU 53g sets a plurality of shooting conditions in combination and performs high-speed continuous shooting for each set of images. Here, the captured images are displayed in a list on the image display unit 85 in a row × column arrangement for each combination of shooting conditions. In this state, as shown in FIG. 6B (c), the number of images corresponding to the combination of the shooting condition (1) and the shooting condition (2) is displayed.

  Next, in step S40, the CPU 53g causes the image evaluation processing unit 75m to evaluate the image quality of the high-speed continuous shot image. Here, the image quality of a plurality of image data shot is evaluated according to the setting in the controller 75a.

  Next, in step S50, the CPU 53g selects an image according to the superiority or inferiority of the image quality evaluation value, and displays the image on the image display unit 85 as a candidate to be stored and recorded. Here, the CPU 53g automatically selects an image according to the evaluation value, and for each predetermined image quality characteristic such as resolution, contrast (intermediate gradation expression), sharpness, and less blur and blurring. In order to be able to simultaneously compare the candidate images to be stored and recorded, such as displaying the best 3 and the best 10 in order from the image with the highest image quality, for example, the images are displayed on the switching image display unit 85 in order of whether images are displayed simultaneously. . As shown in FIG. 6B (d), the halftone Best3, the sharpness Best3, and the resolution Best3 are displayed on the image display unit 85.

Finally, in step S60, the CPU 53g encodes the image selected according to the evaluation value or the image selected by the user with the image CODEC 79, and saves and records it in the image memory medium 71. In step S60, the image selected in step S50 with excellent image quality or the desired image selected by the user by viewing the image displayed on the image display unit 85 in step S30 or step S50 is given priority. It is stored and recorded in the image memory medium 71, and other images can be deleted at once. As shown in FIG. 6B (e), the selected image is displayed on the image display unit 85.
[First Embodiment] (Combination of multiple shooting conditions and number of sheets are set according to the selected scene)

  In FIG. 7, as a first embodiment of the present invention, a combination of a plurality of shooting conditions for multi-condition continuous shooting is set in advance in the controller 75a according to a selected scene, and stored in advance for each shooting scene. An example of shooting condition setting data is shown.

  When each shooting scene is selected, each shooting condition is set to a setting data condition stored in advance for each scene. In each shooting condition setting data for each scene, “auto” or “multiple” is set. If there are shooting conditions that are set to “Continuous Shooting” and multi-condition continuous shooting is selected during shooting, these shooting conditions are selected as a combination of multiple shooting conditions (multi-conditions) A combination of the conditions dispersed by changing the shooting conditions little by little, and the number of sheets for each combination are automatically set, and continuous shooting (multi-condition continuous shooting) is performed while sequentially changing the shooting conditions and the number of sheets. For other shooting conditions, the setting data condition stored in advance in the data memory 70 for each scene is also set in the controller 75a.

  In FIG. 7, the case where the shooting conditions of exposure correction and white balance are set to “multi-condition continuous shooting” in the shooting scenes of “person (portrait)” and “snow scene, skiing” will be described as an example. To do. As shown in FIG. 8, the distribution ratio of the exposure correction condition is set according to the selected exposure correction condition distribution setting data for each scene, and as shown in FIG. 9, the distribution ratio of the white balance for each scene is set. In accordance with the setting data, the white balance condition is set to be distributed to the WB correction circuit 75d, and the multi-condition continuous shooting is controlled with the number of shots at the distribution ratio for each combination of these shooting conditions.

  [Specific Example of Distribution of Numbers for Each Combination of Shooting Conditions] That is, in the “person” scene, the brightness of the face of a person often varies depending on the situation, so that the face and skin color are shot relatively brightly. The exposure ratio is set to 19% for ± 0EV, 37% for + 0.3EV correction, 33% for + 0.7EV correction, 11% for + 1EV correction, and so on. In the scene, the exposure correction is +0.3 EV correction, 6%, and +0 .0 so that “snow white” appears “white” and the “sparkling brightness of the snow scene” is emphasized. 7EV is 21%, + 1EV is 21%, + 1.3EV is 18%, + 1.7EV is 15%, + 2EV is 9%, and so on. Are distributed and distributed.

  In addition, under the white balance conditions of the “snow scene, ski” scene, the color temperature is originally relatively high, but the color temperature is 3500K, 4000K, so that the color of the snow scene is “blueish” and “snow-like”.・ ・ In case of shooting at a low color temperature like an incandescent bulb, and a scene that you want to shoot in a `` natural color '' without `` blue fogging '', such as skiing on a slope or shooting a person, the original color The distribution is also made when photographing at a color temperature in the vicinity of 4500K to 6000K close to the temperature. On the other hand, in scenes where people are photographed with “indoor lighting”, it is highly possible to shoot subjects under various types of lighting, such as incandescent bulbs and fluorescent lamps. Allocation.

  10A and 10B show examples in which the number of shots for each combination of shooting conditions is allocated according to the selected scene. For example, when shooting a "person" scene "indoor" so that the ratio for each combination of a plurality of shooting conditions set for each shooting scene becomes the ratio of the respective distribution setting data, In the case where the total number of shots N by multi-condition continuous shooting is set to 60 so that the exposure correction condition is the ratio of the distributed distribution of the exposure correction conditions of the above-mentioned “person” scene, FIG. ), (C), ± 0EV is 11 (19%), + 0.3EV is 22 (37%), + 0.7EV is 20 (33%), + 1EV is 7 (11%) ,..., The number of shots is set to be 60 (100%) in total.

  In addition, the white balance condition at that time is, for example, among the 11 sheets (19%) of ± 0 EV correction distributed as described above so that the white balance distribution ratio of “indoor, lighting” is the same. 1 sheet (19% x 12%) at 2000K, 1 sheet (19% x 10%) at 2500K, 2 sheets (19% x 19%) at 3000K, 2 sheets (19% x 15%) at 3500K, The number of shots is set in the controller 75a so that the total number of shots is 1 (19% × 7%) at 4000K, and so on.

  In this way, the total number of shots is 60, and the number of shots for each combination is automatically calculated so that both the exposure correction condition distribution ratio and the white balance condition distribution ratio for each scene are satisfied. A total of 60 images are continuously photographed at a high speed by the number set in the controller 75a for each combination while changing the combination of photographing conditions in accordance with one release operation. The same applies to other numbers.

Exposure correction setting value ΔEV (i) where N is the total number of shots in multi-condition shooting, and ΔEV (i) is the (i) th exposure correction setting value of the first exposure condition “exposure correction condition”. number of images n _(i) is each, the distribution setting percentage R _EV of ΔEV in the scene _(i) (i), calculated by multiplying the total number of shots (n), for example, integer such rounding off decimals Turn into
n _(i) = INT (N × R _{EV (i)} +0.5) (4)
What is necessary is just to calculate and set by calculation formulas, such as.

Shooting is performed by setting the setting value of the “exposure correction condition” of the first shooting condition to ΔEV (i) and the setting value of the “WB (white balance) condition” of the second shooting condition to WB (j). The number m _{(i, j)} is also multiplied by the set number R _{WB (j)} of each WB set value WB (j) by the number of shots n _(i) of ΔEV (i) obtained above.
m _{(i, j)} = INT (n _(i) * _{RWB (j)} +0.5) (5)
The WB correction circuit 75d may be set by roughly calculating with the above calculation formula.

  In the distribution by rounding off after the decimal point, there are many deviations, and when the total is added, it may increase or decrease (decrease or increase) with respect to the set total number of sheets. Adjustments may be made such that the number is increased in order from the condition and adjusted to the total number of sheets, or the calculation is performed with a decimal number and then the combinations are combined in order from the condition with the largest proportion until the total number is reached.

  11A and 11B are flowcharts for explaining the control of the number of shots for each combination of shooting conditions according to the shooting scene as an example of shooting control of the electronic camera of the first embodiment.

  First, in step S110, the CPU 53g determines whether or not the setting in the operation input unit 51 is the shooting mode. If the shooting mode is not set, the process proceeds to step S115, and the CPU 53g proceeds to other mode processing.

  Next, in the shooting mode, the process proceeds to step S120, and the CPU 53g sets the shooting scene in the controller 75a according to the setting of the operation input unit 51. Next, in step S130, the CPU 53g determines whether or not the continuous shooting mode based on the multi-condition. If the continuous shooting mode based on the multi-condition is not set, the process proceeds to step S135, and the CPU 53g proceeds to other shooting mode processing. If the multi-condition continuous shooting mode is selected, the process proceeds to step S140, and the CPU 53g sets the number N of multi-condition continuous shooting to the controller 75a based on the operation information input from the operation input unit 51.

Next, in step S150, the CPU 53g sets a plurality of exposure correction setting values and the number of shots to the controller 75a based on the exposure correction distribution setting data for each selected scene.
For example, the number of shots N is distributed according to the set ratio R _{EV (i)} of each exposure correction setting value ΔEV (i) in the scene, and the number of shots n _(i) for each exposure correction setting value ΔEV (i) is assigned. This is determined by applying the above equation (4).

Next, in step S160, the CPU 53g sets the WB setting value and the number of shots in the controller 75a according to the selected WB distribution setting data for each scene and the number of shots for each exposure correction.
For example, the number of shots n _(i) for each exposure correction value is distributed according to the set ratio R _{WB (j)} of each WB set value WB (j), and the condition of ΔEV (i) and WB (j) The number m _{(i, j)} to be photographed is determined by applying the above equation (5).

  Next, in step S170, the CPU 53g determines whether there is a release or photographing operation from the operation input unit 51. Here, when there is no release or shooting operation, the CPU 53g returns.

  If there is a release or shooting operation from the operation input unit 51, the process proceeds to step S175, and the CPU 53g performs photometry processing based on detection signals from the photometry / ranging sensor 62 and the detection circuit 63, and according to the photometry value. An appropriate exposure condition EV is set in the controller 75a.

  Next, in step S180, the CPU 53g sets I = 1 and SS = 0. Next, in step S185, the CPU 53g corrects the exposure condition to EV + ΔEV (i) according to the setting value ΔEV (i) of the (i) th exposure correction, and sets it in the controller 75a.

  Next, in step S190, the CPU 53g sets J = 1 and S = 0. Next, in step S195, the CPU 53g sets the (j) th WB setting value to WB (j), and sets K = 0.

  Next, in step S200, the CPU 53g performs exposure and shooting processing by the controller 75a controlling the image sensor 73 under the set exposure correction condition and the WB setting condition, and temporarily stores the shot image in the buffer memory (A) 75c. To do. Next, in step S205, the CPU 53g sets K = K + 1, S = S + 1, and SS = SS + 1.

  Next, in step S210, the CPU 53g determines whether or not the set number m (i, j) has been shot, that is, whether K ≧ m (i, j). If K ≧ m (i, j) is not satisfied, the process returns to step S200, and the CPU 53g repeats the above-described processing. If K ≧ m (i, j), the process proceeds to step S215, and the CPU 53g sets J = J + 1.

  Next, in step S220, the CPU 53g determines whether or not to finish photographing under the last WB condition, that is, whether J ≧ Jmax or S ≧ n (i). If J ≧ Jmax or S ≧ n (i) is not satisfied, the process returns to step S195, and the CPU 53g repeats the above-described processing.

  When J ≧ Jmax or S ≧ n (i), the process proceeds to step S225, and the CPU 53g sets I = I + 1.

  Next, in step S230, the CPU 53g determines whether or not to finish photographing under the final exposure correction condition, that is, whether I ≧ Imax or SS ≧ N. Here, when I ≧ Imax or SS ≧ N is not satisfied, the process returns to step S185, and the CPU 53g repeats the above-described processing. If I ≧ Imax or SS ≧ N, the process proceeds to step S235, and the CPU 53g outputs the captured image stored in the buffer memory (A) 75c to the image CODEC 79 to perform an encoding process, and outputs it to the image memory medium 71. The CPU 53g returns to the memory recording process.

  [Effects of First Embodiment] (1) Since shooting is performed by combining a plurality of shooting conditions, the probability of obtaining a desired image is increased without selecting a scene. When a scene is selected, continuous shooting is performed by combining a plurality of shooting conditions in accordance with the selected scene, so that a desired image with good reflection can be shot. As a result, an image close to a desired condition can be efficiently shot without performing many unnecessary shots even during continuous shooting.

  (2) Unlike conventional bracketing shooting, it is super high-speed continuous shooting, so the shooting timing is almost unchanged, and you can shoot multiple images with slightly different shooting conditions and combinations of shooting conditions in the same scene image. Thus, a desired image with good image quality can be obtained only by shooting with a single release operation.

  (3) Also, unlike bracketing shooting by simply combining a plurality of shooting conditions, the shooting conditions and measurement values suitable for the selected scene are determined based on measurement values such as the selected scene and luminance values, or shooting frequency data. Since continuous shooting is performed with the distribution ratio and number of shots set for each combination of shooting conditions, focusing on the shooting conditions of interest and shooting conditions with a high frequency of shooting, images that are close to the desired conditions are not used unnecessarily. Increases the probability of shooting, and enables efficient shooting.

  (4) Even if an enormous number of continuous shots are made with only one shooting, only images desired by the camera or images selected by the user or images selected by the user can be recorded. Even if a large number of high-speed continuous shots are taken, a large number of failed images and unnecessary images are not recorded, so that the memory does not become full immediately. In addition, since the unselected images are not stored and recorded, there is no trouble of deleting unnecessary images one by one.

  [Second Embodiment] (The number of shots for each condition is set based on measurement data) In FIGS. 12A and 12B, as a second embodiment, a difference between the average luminance of a subject and a luminance difference in a screen is detected. In addition, an example in which a background exposure condition and a light intensity condition of a daytime thin cross strobe (delight strobe) are combined by gradually separating the conditions from the sensor measurement information, and a plurality of images are continuously shot under a plurality of conditions.

  For example, even during daytime shooting, a screen that includes a part of a bright subject may be pulled and the other subject may appear dark. In addition, a backlit person with the sun on his back is also captured darkly. In such a case, it is desirable to illuminate the strobe slightly even during the day (called a daylight synchro strobe, delight strobe, etc.) so that the main subject is shot at an appropriate brightness. If it is too strong, the main subject will appear out of focus.

  This situation is discriminated from the average brightness and the brightness difference, the background exposure conditions are set appropriately, and the light intensity of the daytime cross-stroboscope is adjusted to shoot, but the situation is quite different. In this example, the combinations are appropriately distributed, and a plurality of continuous shots are taken with varying conditions.

  In the present embodiment, as shown in FIG. 12A (a), it is determined how much the intensity of the daytime cross-stroboscopic light emission is suppressed according to the combination of the measurement values of the average luminance and the luminance difference of the subject. Setting data is stored in the data memory 70 in advance. Although the figure is omitted, similarly, depending on the combination of the measurement values of the average luminance and the luminance difference, the background exposure control conditions and the photometry method are AE by average photometry, high-luminance emphasis metering, low-luminance emphasis metering, Conditions such as AE by center-weighted metering are set in advance.

  When the release button is pressed halfway or the AE lock operation is performed from the operation input unit 51 and the average luminance and the luminance difference are measured, the photometric method is selected according to the combination of the measured values, and the background exposure condition is set. When the average luminance is less than or equal to a predetermined value, the high sensitivity mode or the pixel addition readout mode with a predetermined addition number is set.

  As for the strobe emission intensity, as shown in FIG. 12A (b), for example, when average luminance = 2.5 and luminance difference = 3.5, the number N is 20 in accordance with the total number N of continuous shots. When the number is small, the degree of dispersion is reduced to reduce the average brightness: 2.5 ± 0.5, brightness difference: 3.5 ± 0.5, and the number N is as large as 100 In order to increase the variance, the average brightness: 2.5 ± 1.5 and the brightness difference: 3.5 ± 1.5, each corresponding to a combination of measured values within a wide dispersion range The strobe light emission intensity condition is set in the strobe driving circuit 60.

  As a result, as shown in FIG. 12B, according to the number of continuous shots, the number of shots under each condition is set to be distributed to the controller 75a, and when the release button is fully pressed, the shooting conditions are sequentially changed to the set conditions. However, multiple continuous shooting is performed.

  13A and 13B are flowcharts relating to the shooting control of the camera of the second embodiment of the present invention.

  First, in step S310, the CPU 53g determines whether or not the setting in the operation input unit 51 is the shooting mode. If the shooting mode is not set, the process advances to step S315, and the CPU 53g advances to other mode processing. If it is in the shooting mode, the process proceeds to step S320, and the CPU 53g sets the shooting scene, shooting conditions, and the like in the controller 75a according to the setting of the operation input unit 51.

  Next, in step S330, the CPU 53g determines whether the release button is half-pressed or the AE lock operation is performed from the operation input unit 51. Here, if the release button is not half-pressed or the AE lock operation is not performed from the operation input unit 51, the process proceeds to step S335, and the CPU 53g proceeds to other key processes.

  If the release button is half pressed or the AE lock operation is performed from the operation input unit 51, the process proceeds to step S340, and the CPU 53g determines whether or not the continuous shooting mode based on the multi-condition. If the continuous shooting mode is not in the multi-condition, the process proceeds to step S345, and the CPU 53g proceeds to other shooting processes.

  When the continuous shooting mode is based on the multi-condition, the process proceeds to step S350, and the CPU 53g sets the shooting conditions and the number of shots during continuous shooting in the controller 75a based on the operation information input from the operation input unit 51. Next, in step S360, the CPU 53g performs split photometry (multi-pattern photometry) processing. Next, in step S365, the CPU 53g calculates an average luminance value and a luminance difference based on the photometric data from the detection circuit 63.

  Next, in step S370, the CPU 53g sets the subject or background exposure condition (photometric method) in the controller 75a based on the average luminance value and the luminance difference. Next, in step S375, the CPU 53g determines whether or not average luminance <predetermined value. Here, if the average luminance is not smaller than the predetermined value, the process proceeds to step S387, and the CPU 53g sets the controller 75a to the normal reading mode without addition. If the average luminance is smaller than the predetermined value, the process proceeds to step S380, and the CPU 53g sets the high sensitivity mode or the (m × n) pixel addition reading mode according to the average luminance.

  Next, in step S385, the CPU 53g sets the degree of dispersion of the shooting conditions in the controller 75a according to the number of continuous shots. Next, in step S390, the CPU 53g sets strobe issuance basic conditions in the strobe driving circuit 60 in accordance with the average luminance value and the luminance difference.

  Next, in step S400, the CPU 53g distributes and distributes the strobe lighting condition from the basic setting to a plurality of issuing conditions according to the number of continuous shots, the degree of dispersion, the average luminance value of the subject, and the luminance difference. The number of shots is set in the controller 75a.

  Next, in step S410, the CPU 53g determines whether or not the setting in the operation input unit 51 is a release full press or a photographing operation. Here, when the setting in the operation input unit 51 is not fully pressed or no photographing operation is performed, the process returns to step S410, and the CPU 53g repeats the above-described processing.

  If the setting of the operation input unit 51 is full release button or shooting operation, the process proceeds to step S415, and the CPU 53g sets the first flash emission condition and the number of shots in the controller 75a. Next, in step S420, the CPU 53g performs strobe light emission with the strobe driving circuit 60 under the set strobe light emission conditions, and performs exposure and photographing processing under the set exposure conditions and the setting readout mode.

  Next, in step S425, the CPU 53g determines whether or not a set number of images have been shot. If the set number of images has not been shot, the process returns to step S420, and the CPU 53g repeats the above-described processing.

  When the set number of images has been shot, the process proceeds to step S430, and the CPU 53g determines whether or not to end shooting under the last condition. If the shooting under the last condition is not completed, the process proceeds to step S435, and the CPU 53g sets the next strobe lighting condition and the number of shots in the controller 75a. Thereafter, the process proceeds to step S420, and the CPU 53g repeats the above-described processing.

  When the photographing under the last condition is to be ended, the process proceeds to step S440, where the CPU 53g performs the photographing image data encoding process and the memory recording process, and the CPU 53g returns.

  [Effects of the First and Second Embodiments] (1) Since shooting is performed by combining a plurality of shooting conditions, the probability of obtaining a desired image is increased without selecting a scene. When a scene is selected, continuous shooting is performed by combining a plurality of shooting conditions in accordance with the selected scene, so that a desired image with good reflection can be shot. As a result, an image close to a desired condition can be efficiently shot without performing many unnecessary shots even during continuous shooting.

  (2) Unlike conventional bracketing shooting, it is super high-speed continuous shooting, so the shooting timing is almost unchanged, and you can shoot multiple images with slightly different shooting conditions and combinations of shooting conditions in the same scene image. Thus, a desired image with good image quality can be obtained only by shooting with a single release operation.

  (3) Also, unlike bracketing shooting by simply combining a plurality of shooting conditions, the shooting conditions and measurement values suitable for the selected scene are determined based on measurement values such as the selected scene and luminance values, or shooting frequency data. Since continuous shooting is performed with the distribution ratio and number of shots set for each combination of shooting conditions, focusing on the shooting conditions of interest and shooting conditions with a high frequency of shooting, images that are close to the desired conditions are not used unnecessarily. Increases the probability of shooting, and enables efficient shooting.

  (4) Even if an enormous number of continuous shots are made with only one shooting, only images desired by the camera or images selected by the user or images selected by the user can be recorded. Even if a large number of high-speed continuous shots are taken, a large number of failed images and unnecessary images are not recorded, so that the memory does not become full immediately. In addition, since the unselected images are not stored and recorded, there is no trouble of deleting unnecessary images one by one.

  [Third Embodiment] (Set the number of shots for each shooting condition based on shooting frequency data) In FIGS. 14A and 14B, as the third embodiment, the number of shots for each shooting condition is set based on shooting frequency data. An example of setting and performing multi-condition continuous shooting is shown.

  In the present embodiment, as shown in FIG. 14A, shooting statistical data such as shooting frequency data at each focal length is stored in advance in the data memory 70, and based on this shooting frequency data, As shown in 14B (a) and (b), from the focal length of the lens at the time of shooting and the detected subject brightness, a plurality of subject distance conditions estimated to be frequently used in the shooting are estimated, Depending on the subject distance, combinations of a plurality of AE (automatic exposure) conditions, AF (autofocus) conditions, depth of field conditions, etc. are distributed and distributed to the controller 75a, and continuous shooting is performed for each combination of conditions. Control to perform continuous shooting by switching the number of sheets.

  FIGS. 15A and 15B are flowcharts relating to the shooting control of the camera of the third embodiment of the present invention.

  First, in step S510, the CPU 53g determines whether or not the setting in the operation input unit 51 is the shooting mode. If the shooting mode is not set, the process advances to step S515, and the CPU 53g advances to other mode processing. If it is in the shooting mode, the process proceeds to step S520, and the CPU 53g sets the shooting scene and shooting conditions in the controller 75a according to the setting in the operation input unit 51.

  Next, in step S525, the CPU 53g acquires zoom processing information from the zoom lens driving unit 57 and lens focal length information from the focal lens driving unit 58. Next, in step S530, the CPU 53g determines whether there is a release half-press or AE lock operation from the operation input unit 51. If there is no release half-press or AE lock operation from the operation input unit 51, the process proceeds to step S535, and the CPU 53g proceeds to other key processes.

  If there is a release button half-press or AE lock operation from the operation input unit 51, the process proceeds to step S540, and the CPU 53g determines whether or not continuous shooting is performed under multi-conditions. If the continuous shooting is not performed under the multi-condition, the process proceeds to step S545, and the CPU 53g proceeds to other shooting processes.

  In the case of continuous shooting under multi-conditions, the process proceeds to step S550, and the CPU 53g sets the shooting conditions and the number of shots for multi-condition continuous shooting in the controller 75a based on the operation information input from the operation input unit 51. Next, in step S555, the CPU 53g sets the degree of dispersion of the shooting conditions in the controller 75a according to the number of continuous shots.

  Next, in step S560, the CPU 53g performs photometry processing. Next, in step S565, the CPU 53g calculates the luminance (brightness) of the subject based on the photometric data from the detection circuit 63.

  Next, in step S570, the CPU 53g disperses the subject brightness condition around the calculated subject brightness according to the degree of dispersion. That is, the CPU 53g increases or decreases the dispersion range of the shooting conditions according to the set dispersion degree, sets a plurality of combinations of shooting conditions in the increased or decreased dispersion range, and automatically sets the number of shots for each combination. Set distribution. Next, in step S575, the CPU 53g controls the distribution of the plurality of subject distance conditions and the number of shots to be estimated for each dispersed subject brightness based on the subject brightness and subject distance frequency data (at the focal length). Set to 75a.

  Next, in step S585, the CPU 53g determines whether there is a release full press or a photographing operation from the operation input unit 51. If there is no release full press or photographing operation from the operation input unit 51, the process returns to step S585, and the CPU 53g repeats the above-described processing.

  If there is a release button full press or shooting operation from the operation input unit 51, the process proceeds to step S590, and the CPU 53g sets the first subject brightness, the estimated subject distance, and the number of shots to the controller 75a.

  Next, in step S595, the CPU 53g sets an AE (exposure) condition and a WB condition in the controller 75a according to the set subject brightness and the estimated subject distance. Next, in step S600, the CPU 53g performs AF (automatic focusing) processing by the focus lens driving unit 58 according to the estimated subject distance. Next, in step S605, the CPU 53g performs exposure and photographing processing by the controller 75a controlling the image sensor 73 under the set exposure condition, and temporarily stores the photographed image in the buffer memory (A) 75c.

  Next, in step S610, the CPU 53g determines whether or not a set number of images have been shot. If the set number of images has not been shot, the process returns to step S595, and the CPU 53g repeats the above-described processing. When the set number of images has been shot, the process proceeds to step S615, and the CPU 53g determines whether or not to end shooting under the last condition. If the shooting under the last condition is not completed, the process proceeds to step S620, and the CPU 53g sets the subject brightness, the estimated subject distance, and the number of shots in the controller 75a. Then, it progresses to step S595 and repeats the process mentioned above.

  When the photographing under the last condition is finished, the process proceeds to step S625, where the CPU 53g performs the photographing image data encoding process and the memory recording process, and the CPU 53g returns.

  Also in this case, the number of shots for each combination of shooting conditions is automatically distributed and set according to the distributed distribution ratio for each shooting condition. Also, according to the number of shots in multi-condition continuous shooting, the degree of dispersion of the shooting conditions is automatically set in the controller 75a, and when the number of shots is large, the combination of shooting conditions spread more widely. It is desirable to set.

  [Effect of the third embodiment] As frequency data, the frequency of actual shooting is obtained by counting the actual shooting examples and frequency data of each shooting condition in the image database and storing them in the shooting frequency data memory in advance. In addition, since a large number of images are shot under combination conditions including shooting conditions appropriate to the situation of the subject or shooting scene with a high probability, the probability of obtaining a desired image with good image quality and good reflection can be further increased. As a result, an image close to a desired condition can be efficiently shot without performing many unnecessary shots even during continuous shooting.

  [Fourth embodiment] (Evaluation of image quality of continuously shot images and recording with priority given to images with high evaluation values) In this embodiment, after the number of images set for each combination of shooting conditions is taken, Evaluate the image quality of each image, display a list of images according to the evaluation value, preferentially save and record images with high evaluation values and images selected by the user, and save and record images with low evaluation values Control not to.

  FIG. 16A and FIG. 16B are flowcharts relating to the shooting control of the camera of the fourth embodiment of the present invention. First, in step S710, the CPU 53g determines whether the shooting mode is set. If the shooting mode is not set, the process advances to step S715, and the CPU 53g advances to other mode processing. If it is in the shooting mode, the process proceeds to step S720, and the CPU 53g sets a shooting scene and shooting conditions according to the operation input.

  Next, in step S725, the CPU 53g determines whether continuous shooting under the multi-condition is ON. Here, when the setting in the operation input unit 51 is not ON for continuous shooting under the multi-condition, the process proceeds to step S730, and the CPU 53g proceeds to other shooting processes.

  When the continuous shooting under the multi-condition is set to ON in the operation input unit 51, the process proceeds to step S735, and the CPU 53g, based on the operation information input from the operation input unit 51, the shooting conditions and the shooting during the continuous shooting. The number of sheets is set in the controller 75a. Next, in step S740, the CPU 53g performs photometric processing based on the detection signal from the detection circuit 63, and measures subject light, subject characteristics, and subject status.

  Next, in step S745, the CPU 53g distributes one of the shooting conditions to a plurality of conditions according to the selected scene or measurement value and the distribution setting data of each shooting condition, and sets it in the controller 75a. Next, in step S760, the CPU 53g from the operation input unit 51 determines whether there is a release or shooting operation. If there is no release or shooting operation from the operation input unit 51, the CPU 53g returns.

  If there is a release button or shooting operation from the operation input unit 51, the process proceeds to step S765, and the CPU 53g sets the first shooting condition as the initial set value and the number of shots (N11) in the controller 75a. Next, in step S770, the CPU 53g sets the second shooting condition to the initial set value and the number of shots (N21) to the controller 75a. In step S775, the CPU 53g sets the last shooting condition to the first set value and sets the number of shots (Nn1) in the controller 75a.

  Next, in step S780, the CPU 53g performs exposure and shooting processing under the set shooting conditions. Next, in step S790, the CPU 53g determines whether or not the set number (Nnk) of images has been shot. If the set number (Nnk) has not been shot, the process returns to step S780, and the CPU 53g repeats the above-described processing. When the set number of images (Nnk) has been shot, the process proceeds to step S790, and the CPU 53g determines whether or not the set number of shots (NnN) has been shot. If the set number (NnN) has not been shot, the process proceeds to step S795, and the CPU 53g sets the last shooting condition to the next set value and the set number (Nnk) to the controller 75a. In step S780, the CPU 53g repeats the above-described processing. If the set number (NnN) has been shot, the process proceeds to step S800, and the CPU 53g determines whether or not the set number (N2M) has been shot.

  If the set number (N2M) has not been shot, the process proceeds to step S805, where the CPU 53g sets the second shooting condition to the next set value and the set number (N2j) to the controller 75a. Proceeding to step S775, the above-described processing is repeated. If only the set number (N2M) has been shot, the process proceeds to step S810, and the CPU 53g determines whether or not the set number (N1L) has been shot. If the set number (N1L) has not been shot, the process proceeds to step S815, and the CPU 53g sets the first shooting condition to the next set value and the set number (N1i) to the controller 75a. Proceeding to step S770, the above-described processing is repeated.

  If only the set number (N1L) has been shot, the process proceeds to step S820, and the CPU 53g causes the image evaluation processing unit 75m to perform image quality evaluation processing of the shot continuous shot images. Note that image quality evaluation methods 1 to 4 described later are employed as the image quality evaluation processing in the image evaluation processing unit 75m.

  Next, in step S830, the CPU 53g reads an image with a high evaluation or an item-specific evaluation best image from the buffer memory (A) 75c in accordance with the evaluation result of the image evaluation processing unit 75m, and displays it as a recording candidate image. 85.

  In step S840, the CPU 53g determines whether the selected image can be recorded. If the selected image cannot be recorded, the process proceeds to step S845, and the CPU 53g selects an image to be recorded according to the setting of the operation input unit 51, and the process proceeds to step S850. If recording of the selected image is possible, the CPU 53g performs encoding processing and storage recording processing of the image data of the selected photographed image, and the CPU 53g returns.

  [Image Quality Evaluation Method 1] FIG. 17 is a flowchart showing image quality evaluation from the statistics of luminance histogram distribution of each color of RGB as an image evaluation method (1) in the image evaluation processing unit 75m. In FIG. 17, an example (1) of an image evaluation method is shown. In the image evaluation processing unit 75m, a luminance histogram of each image data or a luminance histogram of each RGB color difference component (frequency distribution table, frequency Distribution map), and the image quality is evaluated from the luminance distribution.

  For example, if the luminance distribution histogram deviates from the center and is biased toward the high luminance side, the image is overexposed and the high luminance area is saturated or so-called “whiteout”, and conversely, the luminance distribution is on the low luminance side. If it is biased, the image becomes underexposed and the low luminance area is saturated or “blackout”. Also, even if the luminance distribution is in the center, if the distribution width is narrow and not uniformly distributed, the dynamic range is narrow, resulting in an image lacking intermediate gradation and fine gradation. Both are typical of images with poor exposure conditions and poor reflection.

  Whether the exposure condition is good or bad can be evaluated from the index value and statistics of the luminance distribution characteristic. Many of the recent digital cameras have a number of models that can calculate the luminance values and display the histogram of the luminance distribution as a graph.

First, in step S860, the CPU 53g represents the luminance of the point (i, j) on the image as f [i, j]. Next, in step S862R, the CPU 53g represents the luminance of the point (i, j) of the R image as R [i, j]. Then, in step S864R, CPU53g creates luminance distribution chart (the _{histogram) P} R _(X). Next, in step S866R, the CPU 53g represents a histogram distribution of R luminance.

Next, in step S862G, the CPU 53g represents the luminance of the point (i, j) of the G image as G [i, j]. Next, in step S864G, the CPU 53g creates a luminance distribution diagram (histogram) P _G (X). Next, in step S866G, the CPU 53g represents a histogram distribution of G luminance.

Next, in step S862B, the CPU 53g represents the luminance of the point (i, j) of the B image as B [i, j]. Next, in step S864B, the CPU 53g creates a luminance distribution diagram (histogram) P _B (X). Next, in step S866B, the CPU 53g represents a histogram distribution of B luminance.

Next, in step S868, the CPU 53g determines the average value of the luminance distribution (Mean) X _M = Σ _iXi / N, the median value ( _Media ) X _med or the mode value (Mode), and the luminance distribution statistic. Variance σ ² = Σ _i (x _i −x _M ) ² / (N−1), standard deviation of luminance distribution (SD) σ = √ (σ ² ), coefficient of variation CV = (standard deviation / average) _{= {σ / x M} ×} 100, skewness SK luminance distribution _{= Σ i {(x i -x} M) / σ} 3 / N, the brightness distribution kurtosis _{K = Σ i {(x i} -x _M ) / σ} ⁴ / N-3.

For example, the average value of the luminance distribution (Mean) X _M = Σ _iXi / N (where Xi is the luminance value for each pixel) (the average value is easily affected by a large outlier value, and therefore, the representative value is the median value. Or median value (Median) X _med : luminance value with the ranking of frequency numbers in the distribution, mode (Mode) Xmode (luminance value with the most frequent frequency), luminance value The maximum value Xmin, the minimum value Xmax, and the variance (Variance) σ ² of the luminance distribution are
σ ² = Σ _i (x _i -x _M ) ² / (N−1) (6)
The evaluation value of the image quality can be calculated from the standard deviation (SD, Standard Deviation) σ = √ (σ ² ) of the luminance distribution (dispersion and standard deviation indicate the extent of the distribution).

Alternatively, the coefficient of variation CV indicating the variation for each RGB is
CV = (standard deviation / average) = {σ / x _M } × 100 (7)
It becomes. In addition, the distortion degree of the luminance distribution (distortion, width, skewness) SK is:
SK = Σ _i {(x _i -x _M ) / σ} ³ / N (8)
Note that the degree of distortion indicates the asymmetry of whether the distribution is symmetrical. If left-right symmetry is 0, the value is positive if there is a large “outlier” on the right, and negative if there is a large “outlier” on the left. The kurtosis (Kurtosis) K of the luminance distribution is
K = Σ _i {(x _i −x _M ) / σ} ⁴ / N−3 (9)

  The kurtosis is 0 when the distribution is a normal distribution, a positive value when the spread is larger than the normal distribution, and a negative value when the spread is smaller than the normal distribution. Based on the index values and statistics of the luminance distribution and the luminance distribution for each RGB, the width and spread of the luminance distribution, its bias, the shape and characteristics of the distribution curve are determined, and the exposure conditions are good and bad. Judgment is possible. Of course, the evaluation value may be calculated using other statistical values.

  Next, in step S870, the CPU 53g sets the characteristics of the image quality to be wider / narrower than the normal distribution and the symmetry of the luminance distribution based on the average of the luminance distribution, the center of the luminance distribution, the degree of spread of the luminance distribution, and the manner of each RGB. . Next, in step S872, the CPU 53g determines an image quality evaluation value.

  Thus, in the image quality evaluation method 1, the distribution histogram of the luminance value of the captured image data or the distribution histogram of the luminance value for each RGB color difference component is calculated, and the luminance distribution characteristic or the index value thereof is calculated. Based on one of the statistics, an image selected according to the magnitude of the image quality evaluation value is evaluated as a recording candidate image by evaluating predetermined image quality characteristics such as exposure conditions or quality of halftone expression. Only an image with the best image quality displayed or automatically selected or a desired image selected by the user from among the displayed images can be easily stored and recorded on a memory card or the like.

  [Image Quality Evaluation Method 2] FIG. 18A shows discrete Fourier transform, discrete cosine transform, and low-frequency / high-frequency components by each transform. 18B and 18C show a method for evaluating the image quality from the spatial frequency distribution and high-frequency components by DFT and DCT of the image data as the image quality evaluation method (2) in the image evaluation processing unit 75m.

  The luminance value f (x, y) of each point of the two-dimensional image data is subjected to discrete Fourier transform (DFT), discrete cosine transform (DCT), or FFT (fast Fourier transform) algorithm for calculating them at high speed by software processing, etc. Thus, F (u, v) converted to the frequency axis is obtained, and the image quality blur is determined from the frequency characteristics of the image, such as the amplitude value and conversion coefficient for each frequency, and the ratio of the high-frequency component and low-frequency component in the whole. The degree, sharpness (sharpness), resolution, etc. can be evaluated.

Since recent digital cameras have a built-in DSP for DCT conversion and software for image compression encoding such as JPEG, it can be mounted relatively easily by diverting that part. The discrete Fourier transform (DFT) is
F [u, v] = (1 / MN) Σx _{= 0} ^M−1 Σy _{= 0} ^N−1 f [x, y] W ₁ ^ux W ₂ ^vy
(10)
However, each conversion coefficient W ₁ = exp (−j2π / M), W2 = exp (−j2π / N))

Next, in discrete cosine transform,
F [u, v] = (4 / √MN) C (u) C (v)
_{· Σ x Σ y f [x} , y] · cos {(2x + 1) uπ / 2M}
Cos {(2y + 1) vπ / 2N} (11)

  However, each conversion coefficient C (u), C (v) = 1 / √2 (u, v = 0), C (u), C (v) = 1 (u, v ≠ 0)) can be calculated.

  First, in step S876, the CPU 53g represents the luminance of the point (x, y) on the image as f [x, y]. Next, in step S878, the CPU 53g converts to a one-dimensional signal by sequential scanning. Next, in step S880, the CPU 53g converts the frequency axis by Fourier transform, DFT, or the like.

  Further, the frequency component F (u, v) obtained by converting the two-dimensional image f (x, y) into the frequency space is also distributed in the u, v space, but may be determined from the frequency characteristics in the two-dimensional space.

  As shown in FIG. 18C, the image is sequentially scanned and rearranged into a one-dimensional signal, and then evaluated by performing DFT conversion or the like, or the amplitude value or DCT coefficient converted to the frequency axis such as DCT is also obtained. The ratio of high frequency components may be produced or evaluated after rearranging in one dimension by zigzag scanning or the like. Similarly to the evaluation of the histogram distribution, a representative value or a statistic of the frequency characteristic distribution may be obtained and evaluated based on it.

First, in step S885, the CPU 53g represents the luminance of the point (x, y) as f [x, y]. Next, in step S890, the CPU 53g performs discrete orthogonal transform such as DFT or DCT. Next, in step S895, the CPU 53g makes the F [u, v] amplitude value one-dimensional such as a zigzag operation. Next, in step S900, the CPU 53g sets F [i] (the amplitude of F [u, v] or the DCT coefficient). Next, in step S910, the CPU 53g performs the following.
Image quality evaluation value = high frequency ratio
= (Total high-frequency component amplitude value) / (Total amplitude value of all components) (12)
Or
Bokeh evaluation value = Low frequency ratio
= (Total of all components-high frequency components) / (total of all components) (13)

Next, in step S920, the CPU 53g sets the frequency distribution _mode ( _mode ) to f _mode (frequency having the largest amplitude) and the frequency distribution median value (Median) to f _med (N / 2 most frequently occurring frequency). The average value (Mean) of the frequency distribution is f _M , the variance (Variance, σ2) of the frequency distribution is σ2, the standard deviation (SD, Standard Deviation, σ) of the frequency distribution is σ, and f _M , σ2 , Σ are set as follows.
f _M = ΣiF [i] / N (14)
σ2 = deviation sum of squares / (N−1)
= Σ _i (F [i] −f _M ) ² / (N−1) (15)
σ = SQRT (dispersion)
= √ {Σ _i (F [i] −f _M ) ² / (N−1)} (16)

  As described above, in the image quality evaluation method 2, the captured image data is converted into the frequency space by the discrete Fourier transform DFT, the discrete cosine transform DCT, or the like, the conversion coefficient of the data converted into the frequency space, or the frequency distribution characteristic, Evaluation value of image quality by evaluating predetermined image quality characteristics such as sharpness, resolution, degree of blur, etc. based on any one of amplitude value for each frequency, ratio of high frequency components, and statistics of frequency characteristic distribution The image selected according to the size of the image is displayed as a recording candidate image, or the image with the best image quality selected automatically, or only the desired image selected by the user from the displayed images can be easily displayed on a memory card, etc. Can be saved and recorded.

  [Image Quality Evaluation Method 3] FIGS. 19A and 19B use a PSF (point spread function, point spread function) method or the like used for image conversion or restoration as the image quality evaluation method 3 in the image evaluation processing unit 75m. 5 is a flowchart showing a method for discriminating and evaluating blurring and blurring.

In FIG. 19A, in step S1010, the image evaluation processing unit 75m uses the PSF method to restore the captured image g (x, y) to the original image i (x, y) without blur or blur. And a deteriorated image g (x, y) deteriorated by a component p (x, y) that causes blurring,
g (x, y) = p (x, y) * i (x, y) (17)
(* Is convolution, convolution integral operation)
In addition, P (x, y) is converted into p (x, which is a degradation factor, as a PSF function (Point Spread Function, point spread function), an LSF function (Line Spread Function, line image distribution function), or the like. , Y) and p (x, y) can be estimated, the original image i (x, y) can be used for image restoration by deconvolution (deconvolution integration).

  Next, in step S1020, the image evaluation processing unit 75m converts the degraded image g (x, y) into the frequency axis by Fourier transform (FFT), discrete Fourier transform (DFT), or the like, and G (u, v). Ask.

  Since G (u, v) = P (u, v) · I (u, v) (convolution is multiplication of Fourier transforms on the frequency axis), P (u, v) is If P (u, v) can be estimated in the frequency domain, 1 / P (u, v) is obtained as an inverse filter, and the original image i (x, y) is obtained using 1 / P (u, v). Is the principle that can be restored.

That is, I (u, v) = G (u, v) / P (u, v) (division between Fourier transforms) is obtained, and it is inverse Fourier transformed.
i (x, y) = inverse Fourier transform {I (u, v)}
= Σ _{x = 0} ^M−1 Σ _{y = 0} ^N−1 I [u, v] W ₁ ^ux W ₂ ^vy (18)
(W ₁ = exp (−j2π / M), W ₂ = exp (−j2π / N))

  Here, PSF (Point Spread Function) and P (u, v) estimation methods in this PSF method are aligned with “exposure setting failure” in a photographed image of a general amateur or an unskilled person. Many tend to be. This method is used to discriminate and evaluate “focal blur” images and “straight line blurring” images, so that images with poor image quality and image quality are detected so that they can be deleted preferentially (or not stored or recorded).

  Next, in step S1030, the CPU 53g can obtain a Fourier transform image of the deteriorated image. (G (u, v) = P (u, v) · i (u, v) is assumed)

  In general, the distribution of amplitude values of F (u, v) obtained by performing Fourier transform on an image that has undergone linear blurring is a general image with less blurring and blurring as shown in FIG. 19A (a). A linear blur pattern as shown in FIG. 19A (b) is formed, and a high-frequency component near the center appears as a pattern of several elongated streaks or a slanted elliptical shape that is distorted or distorted according to the blur angle. Further, F (u, v) of the defocused image becomes a defocused image pattern as shown in FIG. 19A (d), and a high-frequency component in the center portion is a concentric circle pattern or a distorted pattern. Further, when both straight blurring and out-of-focus blur occur, a pattern having both characteristics as shown in FIG. 19A (c) is obtained.

  Next, in step S1040, the image evaluation processing unit 75m estimates P (u, v) or PSF by the PSF method, zero cross method, Hough transform method, inverse filter method, or the like.

  Next, in step S1050, the image evaluation processing unit 75m outputs, for example, an evaluation value of linear blur that zero-crosses in the θ direction with a period 1 / L with respect to the blur direction angle (θ) and the blur distance (L). .

Next, in step S1060, the image evaluation processing unit 75m sets a straight blur correction filter.
P (u, v) = sin (πfL) / πfL (19)
(F = ucos θ + vsin θ)

  On the other hand, in step S1070, the image evaluation processing unit 75m estimates P (u, v) or PSF by the PSF method, the zero cross method, the Hough transform method, the inverse filter method, or the like.

  Next, in step S1080, the image evaluation processing unit 75m outputs, for example, an evaluation value of a focal blur that crosses zero concentrically with a period of 1.01π / r with respect to a focal spread radius (r).

Next, in step S1090, the image evaluation processing unit 75m sets a defocus correction filter.
P (u, v) = 2 · J1 (r · R) / r · R (20)
J1 = first order Bessel function of first order

  Next, in step S1100, the image evaluation processing unit 75m outputs the degree of linear blurring and defocusing. Alternatively, an image in which straight line blurring and defocusing are corrected by a setting filter is output.

  Next, in step S1100, the image evaluation processing unit 75m outputs the degree of linear blurring and defocusing. Alternatively, the image evaluation processing unit 75m outputs an image in which linear blurring and defocusing are corrected by the setting filter.

  In the present embodiment, in the case of straight line blurring by the zero point crossing method or the Hough transformation (Hough transformation, Hugh transformation) method, the amplitude value of F (u, v) of Fourier transformation is zero crossing with a period of 1 / L. In the case of blur direction angle (θ), blur distance or the number of pixels (L), and out-of-focus, the amplitude value of F (u, v) is zero with a period of 1.01π / r. Since the intersecting concentric circles and the radius of the spread of the focal point or the number of pixels (r) thereof can be estimated and calculated, the straight blurring image and the out-of-focus image can be evaluated using the value from the image evaluation processing unit 75m as the evaluation value.

  FIG. 20 is a flowchart illustrating an example of a method for calculating (estimating) a linear blur direction, a blur distance, and a focal blur radius by the PSF method.

  In the PSF method, the blur direction (θ) is G (u) as an estimation method of the blur direction (θ) and blur distance (L) detected by the angular velocity sensor 66 and the detection circuit 67, and the defocus radius (r). , V) is calculated from the vertical / horizontal relative ratio (R), and the blur distance (L) or the focal spread radius (r) is obtained by sequentially calculating the restored images iL and iL + 1, and the correlation value C (L). Or the calculation is repeated until the correlation value C (L) is saturated to a correlation degree equal to or greater than a predetermined value. Further, as a method of shortening the calculation time, there is a method of obtaining by multi-gradation Hough conversion.

In FIG. 20, in step S1210, the image evaluation processing unit 75m calculates the blur direction (θ) from the vertical / horizontal relative ratio R of G {u, v} by the blur direction (θ) estimation method. The relative ratio R is
R = ∫ | G {rcos (θ + π / 2), rcos (θ + π / 2)} | dr
÷ ∫ | G {rcosθ, rcosθ} | dr (21)
However, r = √ {u ² + v ² }
G {u, v}: Fourier spectrum of the degraded image

Next, in step S1220, the image evaluation processing unit 75m calculates the blurring distance (L) from the correlation value C (L) between the restored images iL and iL by the estimation method of the blurring distance (L) and the focal spread radius (r). Or, r) is calculated backward.
C (L) = Σx _{, y} i _L (x, y) i _{L + ΔL} (x, y)
÷ √ [Σ _{x, y} {i _L (x, y)} ²
[Sigma] _{x, y} { _{iL + [Delta} ] _L (x, y)} ² ] (22)

However, i _L (x, y): a restored image when the parameter is L, i _{L + ΔL} (x, y): a restored image when the parameter is L + ΔL.
Next, in step S1230, the image evaluation processing unit 75m calculates straight blur P (u, v). (Zero crossing with period T = 1 / L in θ direction)
P (u, v) = sin (πfL) / πfL (23)
(F = ucos θ + vsin θ)

Next, in step S1240, the image evaluation processing unit 75m calculates P (u, v) of defocus. (Concentric zero crossing with period T = 1.01π / r)
P (u, v) = 2 · J1 (r · R) / r · R (24)
(J1 = 1-order first-order Bessel function)

  As described above, in the image quality evaluation method 3, the captured image data is converted into the frequency space by the fast Fourier transform FFT or the discrete Fourier transform DFT, and from the data converted into the frequency space, the point spread function PSF method or Evaluation values such as blur distance and direction angle or focal spread radius are estimated from the Fourier transform amplitude value pattern by the zero point crossing method, Hough transform method, etc., and the degree of straight blurring or focal blurring is estimated. By evaluating the predetermined image quality characteristics such as the degree of image quality, the image selected according to the magnitude of the image quality evaluation value is displayed as a recording candidate image, or the image with the best image quality automatically selected or displayed. Only a desired image selected by the user can be easily stored and recorded on a memory card or the like.

  [Image quality evaluation method 4] In addition, it is determined whether or not the image quality itself is similar to that of another image with good image quality already recorded or another image that has been image quality evaluated. You may evaluate the superiority or inferiority.

  That is, each of the image f (x, y) and the recorded reference image t (x, y) in the two-dimensional distribution pattern of luminance values, the luminance distribution histogram, or the image converted into the frequency space. The degree of similarity and the correlation coefficient may be obtained so that an image having characteristics similar to the recorded reference image, characteristics of exposure characteristics, sharpness, etc. can be preferentially selected or deleted.

As an example of the correlation coefficient, the Pearson product moment correlation coefficient R can be calculated by the following equation.
R = (covariance of image f and image t) / (standard deviation of image ff) · (standard deviation of image t)
= {ΣyΣx (f [x, y] −fav) (t [x, y] −tav)}
/ √ {ΣyΣx (f [x, y] −fav) ² }
√ {ΣyΣx (t [x, y] −tav) ² } (25)
Here, fav is an average value of density values of the input image f, and tAV is an average value of density values of the reference image t.

  [Effects of Fourth Embodiment] As described above, a means or program for evaluating the image quality of an image is provided, and a plurality of images continuously shot while changing shooting conditions by combining a plurality of shooting conditions. Images automatically selected according to the magnitude of the image quality evaluation value, such as “Best 3”, “Best 10”, “Best 3 by shooting condition and image quality item”, are automatically displayed as recording candidate images. Only the selected image having the best image quality or the desired image selected by the user from among the displayed images can be easily stored and recorded on a memory card or the like. As a result, an image close to a desired condition can be efficiently shot without performing many unnecessary shots even during continuous shooting.

  Therefore, as in the present invention, even when a large number of images are shot by operating the release button once, a large number of images are not consumed at the same time. There is no need to delete unnecessary images and many images with poor image quality and image quality.

  [Modification] Also, in the above example, depending on the user's operation, the image quality evaluation method, the priority image quality characteristics item, the number of images with good image quality, how many images are automatically saved and recorded, etc. are arbitrary. A custom setting function related to image quality evaluation may be provided.

  In addition, image correction means and image restoration that automatically corrects images that are estimated to have poor image quality or poor image quality, or images with noticeable blurring or blurring. Means can be additionally provided.

1 is a system configuration diagram illustrating an overview when an imaging control apparatus according to an embodiment of the present invention is applied to an electronic camera. 1 is a block diagram illustrating an overall configuration of a high-speed camera according to a first embodiment of the present invention. It is a block diagram which shows the structure of the image pick-up element of the high speed camera which concerns on the 1st Embodiment of this invention. 1 is a circuit diagram illustrating a detailed configuration of an image sensor of a high-speed camera according to a first embodiment of the present invention. 3 is a timing chart for explaining operations of a CDS circuit and an A / D conversion circuit. It is a flowchart for demonstrating schematic operation | movement in case the high speed camera which concerns on embodiment of this invention performs multi-condition continuous shooting which continuously shoots, changing the combination of several imaging conditions little by little. FIG. 6B is a screen example (a) to (e) for explaining an operation corresponding to each step shown in FIG. 6A. As a first embodiment of the present invention, an example of shooting condition setting data stored in advance for each shooting scene when a combination of a plurality of shooting conditions for multi-condition continuous shooting is set according to a selected scene. FIG. It is a figure which shows the example of the distribution setting data of the exposure correction condition classified by scene. It is a figure which shows the example of the distribution setting data of the white balance conditions for every imaging | photography scene. FIGS. 9A to 9D are diagrams illustrating examples in which the number of shots for each combination of shooting conditions is allocated according to a selected scene. FIGS. 9A and 9B are diagrams illustrating an example in which the number of shots for each combination of shooting conditions is allocated according to a selected scene. FIG. 6 is a flowchart (part 1) for explaining the control of the number of shots for each combination of shooting conditions according to the shooting scene as an example of shooting control of the electronic camera of the first embodiment of the present invention. FIG. 6 is a flowchart (part 2) for explaining the control of the number of shots for each combination of shooting conditions according to the shooting scene as an example of shooting control of the electronic camera of the first embodiment of the present invention. It is a figure which shows the example (b) which allocated strobe light emission intensity | strength conditions to the surrounding conditions of setting strobe intensity | strength according to the setting (a) of strobe intensity according to average brightness | luminance and a brightness | luminance difference, and dispersion degree. It is a figure which shows the example of the imaging | photography number for every strobe intensity | strength set automatically. It is a flowchart (the 1) regarding imaging | photography control of the camera of 2nd Example of this invention. It is a flowchart (the 2) regarding imaging | photography control of the camera of 2nd Example of this invention. It is a figure (a)-(c) which shows the example of the frequency data of the luminosity and distance of a subject in a certain focal distance. It is a figure which shows the example (b) of the example (b) which allocated the continuous shooting number and imaging | photography condition according to frequency data and dispersion | distribution, and the imaging | photography number for every imaging | photography condition set automatically. It is a flowchart (the 1) regarding imaging | photography control of the camera of 3rd Example of this invention. It is a flowchart (the 2) regarding imaging | photography control of the camera of 3rd Example of this invention. It is a flowchart (the 1) regarding imaging | photography control of the camera of 4th Example of this invention. It is a flowchart (the 2) regarding imaging | photography control of the camera of 4th Example of this invention. It is a flowchart which shows evaluating image quality from the statistic of luminance histogram distribution of each color of RGB as an image evaluation method (1). It is a figure which shows the low frequency / high frequency component by discrete Fourier transform, discrete cosine transform, and each transformation. As the image quality evaluation method (2), a method of evaluating image quality from a spatial frequency distribution or high-frequency component by DFT of image data is shown. As the image quality evaluation method (2), a method of evaluating image quality from a spatial frequency distribution and high frequency components by DFT, DCT, etc. of image data is shown. FIG. 5 is a flowchart (part 1) showing a method for discriminating and evaluating blurring and blurring by using a PSF method or the like used for image conversion or restoration as the image quality evaluation method 3. FIG. 12 is a flowchart (part 2) showing a method for discriminating and evaluating blurring and blurring using the PSF method or the like used for image conversion or restoration as the image quality evaluation method 3. It is a flowchart which shows an example of the calculation (estimation) method of a linear blur direction, a blur distance, and a focus blur radius by PSF method.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 ... Operation input part, 13 ... Control part, 13a ... Shooting mode / shooting scene selection part, 13b ... Shooting program classified by scene, 13c1 ... Shooting condition, 13cn ... Shooting condition n, 13d ... Combination of multiple shooting conditions / continuous shooting Number setting section, 13e ... Shooting condition combination setting data, 13f ... Shooting condition frequency statistical data, 13g ... Shooting condition, 13h ... Shooting control section, 13h1 ... Normal shooting control section, 13h2 ... High-speed continuous shooting control section , 13h3... Continuous shooting under multiple conditions, 13i... Image evaluation control unit, 13j... Image recording / input / output control unit, 15... Zoom lens / focus lens drive unit, 16. , 18 ... Strobe, 19 ... Angular velocity sensor / acceleration sensor, 20 ... Camera shake / vibration detector, 21 ... Light receiving sensor / AF sensor, 22 ... Photometry / Distance / AF detection unit, 23 ... optical system, 25 ... image sensor, 29 ... buffer memory unit, 31 ... image encoding / decoding unit, 33 ... image recording / input / output unit, 35 ... image memory medium, 37 ... Display unit 39 ... Display control unit 51 ... Operation input unit 53 ... Control circuit 53a ... I / O port 53b ... I / O port 53c ... HDD / IF 53d ... Interface 53e ... Input circuit 53f ... Memory Card IF, 53g ... CPU, 55 ... shutter drive unit, 56 ... diaphragm drive unit, 57 ... zoom lens drive unit, 58 ... focus lens drive unit, 59 ... shooting optical system, 60 ... strobe drive circuit, 61 ... strobe, 62 ... Photometry / ranging sensor, 63 ... Detection circuit, 64 ... Angular velocity sensor, 65 ... Detection circuit, 66 ... Angular velocity sensor, 67 ... Detection circuit, 68 ... HDD storage device, 69 ... Professional RAM memory, 70 ... data memory, 71 ... image memory medium, 73 ... imaging device, 75 ... DSP section, 75a ... controller, 75b ... S / P conversion circuit, 75c ... buffer memory (A), 75d ... WB correction Circuit, 75e ... Pixel interpolation / resizing circuit, 75f ... Color interpolation circuit, 75g ... Contour correction circuit, 75h ... Gamma correction circuit, 75i ... Matrix circuit, 75j ... Image feature processing unit, 75k ... Image recognition processing unit, 75m ... Image Evaluation processing unit 77 ... Buffer memory (B), 79 ... Image CODEC 79, 81 ... Moving image CODEC, 83 ... Display drive circuit, 85 ... Image display unit

Claims (13)

An imaging means for imaging a subject image formed by an optical system and outputting an imaging signal;
Shooting condition setting means for setting a plurality of combinations of shooting conditions according to predetermined conditions;
Continuous imaging control means for controlling the imaging means so as to repeatedly execute an imaging operation based on a combination of a plurality of imaging conditions set by the imaging condition setting means;
An imaging control apparatus comprising: The photographing condition setting means includes
2. The photographing control apparatus according to claim 1, wherein the number of combinations of photographing conditions is changed according to a predetermined condition. A shooting mode selection means for selecting a desired shooting mode from a plurality of shooting modes;
The photographing condition setting means includes
2. A plurality of combinations of shooting conditions are set according to setting data for setting a combination of shooting conditions for each of a plurality of shooting scenes according to the shooting mode selected by the shooting mode selection means. The imaging control device described. Photometric means for measuring the brightness or illuminance of external light or subject light,
The photographing condition setting means includes
2. The photographing control apparatus according to claim 1, wherein a plurality of combinations of photographing conditions are set in accordance with photographing condition setting data corresponding to a measurement signal from the photometry means. Equipped with a distance measuring means to measure the distance to the subject,
The photographing condition setting means includes
2. The photographing control apparatus according to claim 1, wherein a plurality of combinations of photographing conditions are set according to setting data corresponding to a measurement signal from the distance measuring means. The photographing condition setting means includes
2. The photographing control apparatus according to claim 1, wherein the number of shots for each combination of the photographing conditions is distributed and set according to setting data of a distribution ratio for each of the photographing conditions to be combined. Based on the operation information from the operation input unit, comprising continuous shooting number setting means for setting the total number of continuous shooting,
The photographing condition setting means includes
7. The photographing control apparatus according to claim 1, wherein a plurality of combinations of the photographing conditions are set according to a total number of continuous photographing set by the continuous photographing number setting means. Based on the operation information from the operation input unit, continuous shooting number setting means for setting the total number of continuous shooting,
Dispersity setting means for setting the dispersity of the shooting conditions according to the set total number of continuous shootings,
The photographing condition setting means includes
Depending on the degree of dispersion set by the degree-of-dispersion setting means, the dispersion range of shooting conditions is increased or decreased, and a plurality of combinations of shooting conditions are set within the increased or decreased dispersion range, and the number of shots for each combination is automatically set. The photographing control apparatus according to claim 1, wherein distribution setting is performed for each of the two. Image display means;
A plurality of images continuously photographed by the imaging means or reduced images of the images are arranged on the image display means by arranging a combination of a plurality of photographing conditions at the time of photographing the image or by predetermined photographing conditions. Display control means for controlling reproduction and display;
Recording control means for controlling to encode image data of an image selected from the images displayed on the image display means based on operation information from an operation input unit and to store and encode the image data in a memory medium. The imaging control apparatus according to claim 1. The photographing condition setting means includes
A plurality of combinations of shooting conditions are set according to shooting condition setting data based on setting data for setting a combination of shooting conditions based on frequency data or statistical data of shooting conditions stored in advance. The imaging control apparatus according to 1. The photographing condition setting means includes
4. A plurality of combinations of photographing conditions among exposure correction conditions, white balance setting conditions, strobe lighting conditions, automatic focusing conditions, and depth of field conditions are set according to the setting data. Or the imaging | photography control apparatus of 4 or 10. A shooting condition setting step for setting a plurality of combinations of shooting conditions according to a predetermined condition;
Based on a combination of a plurality of shooting conditions set in the shooting condition setting step, an image sensor that picks up a subject image formed by an optical system and outputs an image pickup signal is controlled so as to repeatedly execute a shooting operation. Continuous shooting control step,
An imaging control method comprising: A shooting condition setting step for setting a plurality of combinations of shooting conditions according to a predetermined condition;
Based on a combination of a plurality of shooting conditions set in the shooting condition setting step, an image sensor that picks up a subject image formed by an optical system and outputs an image pickup signal is controlled so as to repeatedly execute a shooting operation. Continuous shooting control step,
A program that causes a computer to execute.

Images