JP2009065566A - Imaging apparatus and control method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve a multiple photographing function capable of performing multiple photographing suitable for a state of a photographing object. <P>SOLUTION: An imaging apparatus includes an image sensor for obtaining image data by performing photoelectric conversion on a subject image and has a multiple photographing mode during which image data are produced by synthesizing a plurality of image data items obtained by a plurality of times of photographing. The apparatus includes: a first arithmetic means for operating a histogram of pixel values of image data; a recording means for recording the histogram of the image data operated by the first arithmetic means in every photographing; and a second arithmetic means for operating a synthesized histogram by synthesizing the histogram of the image data recorded in the recording means and a histogram of non-photographed image data captured by the image sensor. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an imaging technique having a multiple imaging function.

  Some recent digital cameras have multiple shooting functions. This multiple shooting function displays a recorded image or an image synthesized by multiple shooting so far as a base image on a liquid crystal display mounted on the camera, etc., and combines the image of the subject to be shot with this base image. It is a function to display. Then, the photographer can take a picture while confirming the positioning of the subject when performing the multiple photography.

Furthermore, as a method of superimposing a plurality of images, there are a method of superimposing a plurality of images after predetermined weighting (Patent Literature 1), a method of simply superposing a plurality of images (Patent Literature 2), and the like. In particular, according to Patent Document 1, multiple shooting suitable for the state of the shooting target can be performed by switching the mode according to each method according to the state of the shooting target (for example, the characteristics of the background portion).
JP 2003-298925 A JP 2003-125266 A

  An object of the present invention is to realize a multiple shooting function that can perform multiple shooting suitable for the state of the shooting target, and in particular, can perform multiple shootings for the second and subsequent times with exposure control intended by the photographer.

  In order to achieve the above object, an image pickup apparatus of the present invention includes an image pickup element that obtains image data by photoelectrically converting a subject image, and generates image data obtained by combining a plurality of image data obtained by a plurality of times of photographing. An imaging apparatus having a multiple shooting mode, wherein a first calculation means for calculating a histogram of pixel values of image data, and a recording means for recording a histogram of image data calculated by the first calculation means for each shooting And second calculation means for calculating a combined histogram obtained by combining the histogram of the image data recorded in the recording means and the histogram of the pre-photographing image data captured by the image sensor.

  The image pickup apparatus of the present invention includes an image pickup element that obtains image data by photoelectrically converting a subject image, and has a multiple shooting mode that generates image data obtained by combining a plurality of image data obtained by a plurality of shootings. An image pickup apparatus that generates image data obtained by synthesizing image data for each shooting, calculates a histogram of pixel values of the combined image data, and calculates the first calculation unit for each shooting Recording means for recording a histogram of the synthesized image data, a second histogram for calculating a synthesized histogram obtained by synthesizing the histogram recorded in the recording means and the histogram of pre-photographing image data captured by the image sensor. And an arithmetic means.

  The imaging apparatus control method according to the present invention includes an imaging device that obtains image data by photoelectrically converting a subject image, and generates multiple image data obtained by combining a plurality of image data obtained by multiple imaging. A method for controlling an imaging apparatus having a mode, wherein a first calculation step of calculating a histogram of pixel values of image data, a recording step of recording a histogram of the calculated image data for each shooting in a recording unit, A second calculation step of calculating a combined histogram obtained by combining the histogram of the recorded image data and the histogram of the pre-photographing image data captured by the image sensor.

  The imaging apparatus control method according to the present invention includes an imaging device that obtains image data by photoelectrically converting a subject image, and generates multiple image data obtained by combining a plurality of image data obtained by multiple imaging. A method of controlling an imaging apparatus having a mode, wherein a first calculation step of generating image data obtained by combining image data for each shooting and calculating a histogram of pixel values of the combined image data, and the calculation for each shooting A recording step of recording the histogram of the combined image data recorded in the recording unit, and a second calculation for calculating a combined histogram obtained by combining the recorded histogram and the histogram of the pre-photographing image data captured by the image sensor Steps.

  According to the present invention, a composite histogram obtained by combining a histogram of a captured image or a composite image obtained by combining these and a histogram of a live view image is calculated, so that multiple shooting can be performed while checking the composite histogram. Therefore, multiple shooting can be performed while checking the exposure of the subject without relying on the photographer's intuition as in the past.

  The best mode for carrying out the present invention will be described below in detail with reference to the accompanying drawings.

  The embodiment described below is an example as means for realizing the present invention, and should be appropriately modified or changed according to the configuration and various conditions of the apparatus to which the present invention is applied. It is not limited to the embodiment.

[Description of FIG. 2 (Block Diagram)]
FIG. 2 is a block diagram showing an internal configuration of the camera according to the present embodiment.

  In FIG. 2, reference numeral 1 denotes a photographing lens provided in the lens barrel 22, and reference numeral 2 denotes a shutter having a light shielding blade capable of moving back and forth in the photographing optical path.

  Reference numeral 3 denotes an image pickup element composed of a CCD or the like, which is an element that receives a subject image incident from the photographing lens 1 and converts it into an electric signal by photoelectric conversion.

  A process circuit 4 performs known signal processing such as gamma correction on the signal output from the image sensor 3.

  An A / D converter 5 converts the analog output of the process circuit 4 into a digital signal.

  Reference numeral 13 denotes a buffer memory such as a DRAM, which temporarily records the digital signal A / D converted by the A / D converter 5. Reference numeral 7 denotes an image processing unit (color processing unit, image processing means), which performs auto white balance, activation, color signal generation, and other color processing on the pixel signal read from the buffer memory 13.

  The color image signal (processed image data) generated by the image processing unit 7 is stored in the buffer memory 13 again.

  Reference numeral 14 denotes a display processing unit, which performs processing for displaying a color image signal stored again in the buffer memory 13 as a color image on the rear display unit 10 to be described later after image processing is performed by the image processing unit 7. Do.

  Reference numeral 10 denotes a rear display unit composed of a color liquid crystal display or the like, which receives a color image signal processed by the display processing unit 14 and displays a color image.

  A compression / decompression processing unit 6 compresses the color image signal stored in the buffer memory 13 after the image processing is performed by the image processing unit 7 or the compressed color image signal as described later. Stretch.

  Reference numeral 15 denotes a recording / playback processing unit (recording unit) that records the color image signal compressed by the compression / decompression processing unit 6. Reference numeral 18 denotes a connector provided on the camera body 21, which electrically connects the recording medium 16 such as a memory card and the camera body 21.

  The recording medium 16 is generally a memory card composed of a semiconductor memory such as a card-type flash memory, but is not limited to a memory card. For example, a recording medium of a computer connected to a hard disk or an imaging apparatus main body, etc. Various forms can be used.

  When the image recorded on the recording medium 16 is reproduced, the recording / reproduction processing unit 15 performs reproduction processing of the image data via the connector 18, and the compression / decompression processing unit 6 performs the expansion processing, and then the buffer memory 13 stores the image data. Record temporarily. Then, the image data recorded in the buffer memory 13 is processed by the display processing unit 14 and the image is displayed (reproduced) by the rear display unit 10 in the same manner as when photographing.

  A system control circuit 39 receives an input from the switch group 38 and performs an operation according to the input, and the type of the recording medium 16 mounted on the camera body 21 and the state of the recording medium 16 (remaining recording capacity). Etc.). In addition, the system control circuit 39 controls the operation of the camera according to the input of the detection device (the focus detection circuit 30, the photometry circuit 31, etc.) of the camera body 21, as will be described later.

  A shutter drive circuit 28 drives the shutter 2 in response to an instruction from the system control circuit 39. By driving the shutter 2, the light shielding blade moves back and forth in the photographing optical path to control the exposure.

  Reference numeral 29 denotes a lens driving circuit which drives the focusing lens in the photographing lens 1 upon receiving an instruction from the system control circuit 39. Focus adjustment is performed by driving the focusing lens.

  A focus detection circuit 30 receives an instruction from the system control circuit 39 and detects the focus adjustment state of the photographing optical system, and outputs the detection result to the system control circuit 39. The system control circuit 39 controls the driving of the focusing lens according to the focus adjustment state of the photographing optical system.

  Reference numeral 31 denotes a photometry circuit, which receives an instruction from the system control circuit 39 to measure the brightness of the subject (photometry) and outputs the photometry result to the system control circuit 39. The system control circuit 39 determines the exposure value based on the photometric result.

  Reference numeral 32 denotes a strobe that irradiates the subject with illumination light in response to an instruction from the system control circuit 39.

  Reference numeral 34 denotes a power supply control circuit that detects and controls the state of a power supply unit 35 described later.

  A power supply unit 35 includes a battery, a DC-DC converter, a switch for switching a block to be energized, and the like, and is controlled by the power supply control circuit 34.

  The power supply control circuit 34 detects the presence / absence of a battery, the type of battery, and the remaining battery level, and controls the power supply unit 35 based on the detection result and an instruction from the system control circuit 39.

  A display device 36 receives an instruction from the system control circuit 39 and displays an operation state of the camera.

  Reference numeral 37 denotes a control memory for recording constants and variables for photographing operation of the system control circuit 39.

  Reference numeral 38 denotes a switch group for giving various operation instructions to the system control circuit 39. The switch group 38 includes switches described below (see FIG. 4).

  The ON / OFF state is switched according to the operation of the main switch 51, and the camera is activated in the ON state. The switch SW1 is turned on when the release button is pressed halfway, and gives an instruction to start the focus detection operation by the focus detection circuit 30 and the photometry operation by the photometry circuit 31.

  The switch SW2 is turned on when the release button is fully pressed, and gives an instruction to drive the shutter 2 to start the exposure operation. The menu switch gives an instruction to display the camera setting menu on the rear display unit 10 when the menu switch is turned on.

  The cross key button 8 (consisting of left, right, up and down buttons 8r, 8l, 8u, 8d) indicates a menu switching direction according to the switch that is turned on.

  The setting button 98 is in various setting states when turned on, and various settings of the camera are performed by operating the cross key button 8 or the electronic dial 11.

[Explanation of FIG. 4 (appearance on the back)]
FIG. 4A is an external view of the imaging apparatus according to the embodiment of the present invention as viewed from the back.

  A digital camera as an imaging apparatus according to the present embodiment constitutes a camera system including a camera body 21 and a lens barrel 22 (see FIG. 2) that can be attached to and detached from the camera body 21.

  The camera body 21 is provided with a finder 111 for optically looking into the subject. The camera body 21 is provided with a release button 24, an electronic dial 11, a shooting mode dial 26, a menu button 25, an information button 17, a playback button 9, and an erase button 27 as operation members. Further, the camera body 21 is provided with a cross key button 8 (up: 8u, down: 8d, left: 8l, right: 8r), a SET button 12, a main switch 51, a setting button 98, and other buttons 99. Yes.

  In addition, a rear display unit 10 that displays captured images, shooting information, and the like is provided on the back of the camera body 21, and a display device 36 that displays shooting information and the like is provided below the display unit 10. A storage chamber for storing the recording medium 16 is provided on the side surface of the camera body 21.

  FIG. 4B illustrates an image displayed on the rear display unit 10. In addition to the image, the rear display unit 10 displays a histogram 19 of image data, shooting information 20, and the like. These display types can be changed by the information button 17.

  When performing normal shooting, first, the main switch 51 is operated (ON state), and then a desired shooting mode is set by operating the shooting mode dial 26. Here, when the Tv priority AE mode is set and the shutter speed or the like needs to be set, the Tv value can be set by operating the electronic dial 11 while observing the value displayed on the display device 36. .

  The release button 24 can be pressed in two stages, and includes a SW1 switch that is turned ON by a half-press operation and a SW2 switch that is turned ON by a full-press operation.

  When the half-press operation is performed, a shooting preparation operation (photometry operation, focus adjustment operation, etc.) is started. When the photographing operation ends, the image data read from the image sensor is written in the recording medium 16 after being subjected to a predetermined process.

  When the play button 9 is pressed, the photographed image is displayed on the rear display unit 10. In this state, when the left and right buttons (81, 8r) of the cross key button 8 are pressed, another image can be displayed. When the erase button 27 is pressed while an image is displayed on the rear display unit 10, the displayed image can be erased.

  The camera is set by pressing a setting button (part of the button 99) to enter the setting mode and operating the electronic dial 11 while viewing the display on the display device 36. In addition, there is an operation of setting the menu by pressing the menu button 25 and selecting the menu by operating the cross key button 8 while watching the menu display displayed on the rear display unit 10 and operating the SET button 12.

[Description of FIG. 3 (Operation Flow after Power ON)]
Next, with reference to FIG. 3, the operation after the power is turned on by the imaging apparatus of the present embodiment will be described.

  FIG. 3 is a flowchart illustrating an operation after the power is turned on by the imaging apparatus according to the first embodiment.

  In FIG. 3, when the power is turned on in S201, initial values for photographing are set in S202. As the initial value, the value set at the previous power-on time is stored in the memory 37 (see FIG. 2), and is set to that value.

  In S203, it is determined whether the mode is the shooting mode or the playback mode. If the mode is the playback mode, the process proceeds to S204 and the playback process is performed. If it is in the shooting mode, the process proceeds to S205.

  In S205, it is determined whether the setting mode or the shooting mode, and if it is the setting mode, the process proceeds to S206, and if not, the process proceeds to S207.

  In S206, settings relating to shooting are performed. As described above, the setting of the camera is performed by operating the setting button, the display device 36, the electronic dial 11, or the menu button 25, the rear display unit 10, the cross key button 8, and the SET button 12.

  Settings for multiple shooting are performed by pressing the menu button 25 and displaying the menu on the rear display unit 10. When the cross key button 8 is operated to select the “multiple shooting” item and the SET button 12 is pressed, a “multiple shooting setting screen” is displayed on the rear display unit 10. On this screen, ON / OFF of the multiplex mode, the number of multiplex times, and the gain correction method (manual setting / automatic correction) are set.

  Returning to FIG. 3, in S207, it is determined whether the mode is the multiple shooting mode or the normal shooting mode. In the case of the normal shooting mode, the process proceeds to S208, and shooting is performed. In the next S210, it is determined whether the power is off. If the power is not turned off, the process returns to S203.

  On the other hand, if it is the multiple shooting mode in S207, the process proceeds to S209, shooting is performed a plurality of times, it is determined whether the power is OFF in the next S210, and the same processing is performed.

[Description of FIG. 1 (Multiple Shooting Operation Flow)]
Next, with reference to FIG. 1, the multiple shooting operation by the imaging apparatus of the present embodiment will be described.

  FIG. 1 is a flowchart illustrating a multiple shooting operation performed by the imaging apparatus according to the first embodiment.

  The program transitions from S209 in FIG. 3 to S1000, and the live view image data (image data before photographing) is captured in S1010 which is the first multiple photographing. Here, when the release button 24 is pressed halfway, the subject luminous flux incident from the photographing lens 1 is guided to the image sensor 3 by opening the shutter 2. Further, known signal processing such as gamma correction is performed on the signal output from the image sensor 3 by the process circuit 4, and an analog signal is converted into a digital signal by the A / D converter 5. The digital signal A / D converted by the A / D converter 5 is temporarily recorded in the buffer memory 13.

  In step S1020, the image processing unit 7 performs auto white balance, luminance, color signal generation, and other color processing (development processing) on the signal read from the buffer memory 13. The color image signal (processed image data) generated by the image processing unit 7 is stored in the buffer memory 13 again.

  In S1030, a histogram of pixel values of the image data is calculated from the color image signal stored in the buffer memory 13. Here, for example, the histogram of the entire image is calculated using, for example, at least one of luminance, R component, G component, and B component as the pixel value of the image data. The histogram is temporarily recorded in the buffer memory 13. This histogram is constantly updated throughout the live view.

Here, the image size of the still image and the live view and the number of pixels used for the calculation of the histogram will be described with reference to FIG. 7 [Explanation of FIG. 7]
FIG. 7 illustrates an image sensor having an image size of about 12.44 million pixels. An imaging device equipped with this imaging device can shoot and record a 4320 × 2880 still image (large size in FIG. 7A).
Also, a still image of middle size (3054 × 2036 = about 6.22 million pixels) or small size (2160 × 1440 = 31.1 million pixels) can be recorded by setting the recording size (middle size in FIG. 7B). 7 (c) small size).

  When performing live view display, if all the pixels of the image sensor are read out and processed, the time lag until display becomes longer or the update of the display becomes slower. For this reason, the processing speed is increased by thinning the number of pixels to 1/2 in the horizontal direction and 1/3 in the vertical direction. Specifically, processing is performed with 2160 pixels in the horizontal direction, 960 pixels in the vertical direction, and a total of about 2.70 million pixels (live view in FIG. 7D).

  When an image is displayed on the rear display unit 10, the number of pixels is further converted to 720 × 480 (= 340,000 pixels) (rear display in FIG. 7E).

  Since the live view image is about 2.70 million pixels as described above, the histogram is also calculated with this number of pixels. In cases other than multiple shooting, the histogram of the live view image is not necessary since it is not required after shooting, but in multiple shooting, the histogram during the composition process is also calculated using this number of pixels, so the live view image Also record the histogram. When displaying a histogram at the time of normal shooting and at the time of playback of multiple shot images after the end of shooting, all the playback images are used and recalculated. That is, the histogram is calculated using approximately 12.44 million pixels for large, approximately 6.22 million pixels for middle, and approximately 3.1110,000 pixels for small.

  Returning to the flow of FIG. 1, the program proceeds to S1040 and calculates the histogram of the images that have been captured so far and the combined histogram of the live view images (second calculation). Here, since it is still before the exposure of the first multiple shooting, a histogram of only the live view is sufficient, and no new calculation is required.

  In step S1050, the live view image and the histogram are displayed on the rear display unit 10. The content displayed here can be changed by operating the information button 17.

  The types of images displayed on the rear display unit 10 include a current live view image or a composite image of live view images and images that have been subjected to multiple shooting so far, individual multiple shot images that have been shot so far, and the like. Furthermore, the histogram includes the presence / absence of display and the histogram of only the current live view image, the histogram of the composite image of the live view image and the image that has been subjected to multiple shooting so far, the histogram of individual multiple shot images that have been shot so far, etc. is there. A number of display modes are possible by combining image types and histogram types (required display modes can be selected by the setting state before shooting and the operation of information buttons).

  The photographer can set the exposure control value and take a picture while viewing the image and the histogram information.

  In S1060, it is determined whether the release button 24 is fully pressed. If the release button 24 is not fully pressed, steps S1010 to S1050 are repeatedly executed to update the live view image and the histogram display.

  If the release button 24 is fully pressed, the process advances to S1070 to perform shooting. Here, the subject image incident from the photographing lens 1 is received by the image sensor 3 and subjected to photoelectric conversion to obtain an electrical signal. In the process circuit 4, known signal processing such as gamma correction is performed on the analog electric signal output from the image sensor 3 and converted into a digital signal by the A / D converter 5. The A / D converted digital signal is temporarily recorded in the buffer memory 13. In this imaging, data (4320 × 2880) of all pixels of the image sensor 3 is read.

  In step S1080, the image processing unit 7 performs auto white balance, luminance, color signal generation, and other color processing on the signal read from the buffer memory 13, and the developed image data is again stored in the buffer memory 13. Record. FIG. 5A illustrates an image taken here (first single image).

  In S1090, a histogram of the image data captured this time is calculated (first calculation). The calculation of the histogram is performed by thinning the number of pixels to the same number as that of the live view image, that is, the horizontal is 1/2 and the vertical is 1/3. FIG. 5B illustrates the histogram created here.

  In step S1095, the histogram calculated in step S1090 is recorded in the buffer memory 13 (recording unit or recording unit). Here, the histogram is calculated and recorded for each captured image.

  In S1100, an image composition process is performed. Nothing is done during the first shooting. The synthesized image is stored in the buffer memory 13. An example of the synthesized image is shown in FIG. 6 (a) (this is the first time, and is not particularly different from FIG. 5 (a)).

  In S1110, a histogram of the composite image data synthesized in S1100 is calculated. FIG. 6B illustrates an example of the histogram of the composite image calculated here (since it is the first time, there is no particular difference from FIG. 5B).

  In step S1120, the composite image and the histogram of the composite image are displayed as a quick review.

  In step S1130, the end of multiple shooting is determined. If the set number of times of multiple shooting remains, the process returns to S1010 to perform the next shooting.

[Second and subsequent shooting operations]
When the release button 24 is pressed halfway in S1010, the live view image is captured.

  In step S <b> 1020, live view development processing is performed, and the developed image data is stored in the buffer memory 13.

  In S1030, the histogram of the image is calculated from the image data stored in the buffer memory 13 (as described above, the number of pixels of the live view image is 2160 × 960, so the histogram is also calculated with this number of pixels).

  In S1040, a histogram of the images that have been shot so far and a combined histogram of the live view images are calculated (second calculation). Here, the calculation is performed using the individual histogram data recorded in the buffer memory 13 in S1095 and the live view histogram calculated in S1030. Since all the histograms photographed so far are processed with the number of pixels of the live view image, it is not necessary to convert or normalize the number of images and can be calculated.

  In step S1050, a live view image and a histogram are displayed on the rear display unit 10. The content displayed here can be changed by operating the information button 17. In other words, it is possible to switch between live view histogram display calculated in S1030 or composite histogram display calculated in S1040.

  In step S1060, it is determined whether the release button 24 is fully pressed. If not, the process returns to step S1010. If the release button 24 is fully pressed, a shooting operation is performed in step S1070, and development processing is performed in step S1080. Here, a single image taken for the second time is illustrated in FIG.

  Thereafter, the histogram calculation is performed in S1090, and the histogram is recorded in the buffer memory 13 in S1095, as in the first shooting. Record separately for each number of multiple shots. Here, a histogram of a single image taken for the second time is illustrated in FIG.

  In S1100, an image composition process is performed. The image data captured so far recorded in the buffer memory 13 and the image data captured this time are combined, and the composite image data is recorded in the buffer memory 13 again. FIG. 6C illustrates an image obtained by combining the first and second captured images.

  In S1110, a histogram of the composite image synthesized in S1100 is calculated. That is, the histogram of the synthesized image is calculated by synthesizing the histogram data corresponding to each image recorded in S1090.

  Although it is possible to newly calculate a histogram from the composite image created in S1100, in this case, it is necessary to calculate the histogram after converting it to the same number of pixels as that of the live view image. The histogram of the composite image calculated here is illustrated in FIG.

  In step S1120, the synthesized image and the histogram of the synthesized image are displayed as a quick review.

  In S1130, the end of multiple shooting is determined. For example, when the number of times of multiple shooting is set to three, the image shown in FIG. 5 (e) is shot a third time and shown in FIG. 5 (f). Calculate the histogram. Then, after shooting, the image shown in FIG. 6 (e) is synthesized, and the histogram shown in FIG. 6 (f) is calculated.

  When the multiple shooting is finished in S1130, the process proceeds to S1140, in which the image data recorded in the buffer memory 13 is compressed by the compression / decompression processing unit 6, and is electrically connected to the camera body 21 by the recording / playback processing unit 15. Recorded on the recording medium 16. Thereafter, the process proceeds to S1150 and the program is terminated.

[Second Embodiment (FIGS. 2, 4, 3, 7)]
The internal configuration of the camera (FIG. 2), appearance (FIG. 4), operation flow after power-on (FIG. 3), and description of the number of pixels (FIG. 7) are the same as those in the first embodiment. Omitted or simplified.

[Description of FIG. 8 (Multiple Shooting Operation Flow)]
Next, with reference to FIG. 8, a multiple shooting operation by the imaging apparatus of the second embodiment will be described.

  FIG. 8 is a flowchart illustrating a multiple shooting operation performed by the imaging apparatus according to the second embodiment.

  The program transitions from S209 to S3000 in FIG. 3, and a live view image is captured in S3010. In the live view, data of 2160 × 960 pixels obtained by thinning out all the pixel data to ½ in width and ３ in length is taken in.

  In step S3020, the captured image is developed and recorded in the buffer memory 13.

  In S3030, an image histogram is calculated from the image signal stored in the buffer memory 13. The histogram is recorded in the buffer memory 13.

  In S3040, a composite histogram of the image of the multiple photographed image and the live view image is calculated (the histogram of the multiple photographed image is calculated in S3110 described later and recorded in the buffer memory 13 in S3115).

  In step S3050, the rear display unit 10 displays a live view image and a histogram.

  In S3060, it is determined whether or not the release button 24 is fully pressed. If not, the processes from S3010 to S3050 are repeated to update the live view image and the histogram display. If the release button 24 is fully pressed, the process goes to S3070. move on.

  In S3070, shooting is performed. For shooting, data (4320 × 2880) of all pixels of the image sensor 3 is read.

  In step S3080, all pixel data of the image sensor 3 is developed and recorded in the buffer memory 13 again.

  In S3100, image composition processing is performed. The synthesized image is recorded in the buffer memory 13.

  In S3110, the histogram of the composite image created in S3100 is calculated. The calculation of the histogram is performed by thinning the number of pixels to the same number as that of the live view image, that is, the horizontal is 1/2 and the vertical is 1/3.

  In step S3115, the histogram calculated in step S3110 is recorded in the buffer memory 13 (recording unit) (recording unit). Here, only the histogram of the synthesized image is recorded, not the histogram for each captured image.

  In S3120, the synthesized image and the histogram of the synthesized image are displayed in a quick review.

  In S3130, the end of multiple shooting is determined. If the number of times of multiple shooting remains, the process returns to S3010 to perform the next shooting.

  If the multiple shooting is to be terminated, the process proceeds to S3140, where the image data recorded in the buffer memory 13 is recorded in the recording medium 16, the process proceeds to S3150, and this program is terminated.

[Other Embodiments]
The object of the present invention can also be achieved by the following method. That is, a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded is supplied to the system or apparatus. Then, the computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but the present invention includes the following cases. That is, an operating system (OS) running on a computer performs part or all of actual processing based on an instruction of a program code, and the functions of the above-described embodiments are realized by the processing.

  Furthermore, the following cases are also included in the present invention. That is, the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion card or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing. When the present invention is applied to the above-mentioned storage medium, the storage medium stores program codes corresponding to the procedure described above.

It is a flowchart which shows the multiple imaging operation | movement of the 1st this embodiment which concerns on this invention. It is a block diagram which shows the internal structure of the imaging device of this embodiment. It is a flowchart which shows the operation | movement after power ON by the imaging device of this embodiment. It is an external view of the back surface of this embodiment. It is a figure which illustrates the image and histogram of the 1st multiple photography. It is a figure which illustrates the histogram of a composite image and composite image for every multiple imaging | photography count. It is a figure explaining each pixel number of the image displayed on the picked-up image by the imaging device of this embodiment, a live view image, and a back surface display part. It is a flowchart which shows the multiple imaging operation | movement of 2nd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Shooting lens 2 Shutter 3 Image pick-up element 4 Process circuit 5 A / D converter 6 Compression / decompression processing part 7 Image processing part 8 Cross key button 8 (Up: 8u, Down: 8d, Left: 8l, Right: 8r)
9 Playback button 10 Rear display unit 11 Electronic dial 12 SET button 13 Buffer memory 14 Display processing unit 15 Recording / playback processing unit 16 Recording medium 17 Information button 18 Connector 19 Histogram display 20 Camera information display 21 Camera body 22 Lens barrel 24 Release button 25 Menu button 26 Shooting mode dial 27 Erase button 28 Shutter drive circuit 29 Lens drive circuit 30 Focus detection circuit 31 Metering circuit 32 Strobe 34 Power supply control circuit 35 Power supply unit 36 Display device 37 Memory for control 38 Switch group 39 System control circuit 51 main Switch 98 Setting button 99 Other buttons

Claims (6)

An imaging apparatus having an imaging device that includes an imaging device that obtains image data by photoelectrically converting a subject image and that generates image data obtained by combining a plurality of image data obtained by a plurality of imaging operations,
First computing means for computing a histogram of pixel values of image data;
Recording means for recording a histogram of the image data calculated by the first calculation means for each photographing;
And a second computing unit for computing a combined histogram obtained by synthesizing the histogram of the image data recorded in the recording unit and the histogram of the pre-photographing image data captured by the imaging device. apparatus. An imaging apparatus having an imaging device that includes an imaging device that obtains image data by photoelectrically converting a subject image and that generates image data obtained by combining a plurality of image data obtained by a plurality of imaging operations,
First calculation means for generating image data obtained by combining image data for each shooting, and calculating a histogram of pixel values of the combined image data;
A recording unit that records a histogram of the composite image data calculated by the first calculation unit for each shooting;
An image pickup apparatus comprising: a second calculation unit that calculates a combined histogram obtained by combining a histogram recorded in the recording unit and a histogram of pre-photographing image data captured by the image pickup device.   The image processing apparatus further includes display means for displaying pre-photographing image data captured by the imaging device, image data obtained by combining the plurality of image data, and a histogram calculated by the second calculation means. The imaging device according to claim 1 or 2.   3. The imaging apparatus according to claim 1, wherein the first and second computing units compute a histogram using a pixel value having a smaller number of pixels than image data captured by the imaging device. A control method for an imaging apparatus including an imaging device that includes an imaging device that obtains image data by photoelectrically converting a subject image and that generates image data obtained by combining a plurality of image data obtained by a plurality of imaging operations.
A first calculation step of calculating a histogram of pixel values of image data;
A recording step of recording a histogram of the calculated image data for each shooting in a recording unit;
A control method comprising: a second calculation step of calculating a composite histogram obtained by combining the histogram of the recorded image data and the histogram of pre-photographing image data captured by the image sensor. A control method for an imaging apparatus including an imaging device that includes an imaging device that obtains image data by photoelectrically converting a subject image and that generates image data obtained by combining a plurality of image data obtained by a plurality of imaging operations.
A first calculation step of generating image data obtained by combining image data for each shooting, and calculating a histogram of pixel values of the combined image data;
A recording step of recording in the recording unit a histogram of the calculated composite image data for each shooting;
A control method comprising: a second calculation step of calculating a combined histogram obtained by combining the recorded histogram and a histogram of pre-photographing image data captured by the image sensor.

Images