JP2002077713A - Image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup device capable of preparing the desired composite picture, and preventing the capacity over of a picture storing part or the arithmetic time increase in picture compositing. SOLUTION: This image pickup device is provided with an imaging device 3 for plural photographing whose photographic conditions are different, an RAM 42 for temporarily storing plural pictures photographed by the imaging device 3, a picture processing mode setting key 102 as the number of picture designating means for designating the number of pictures to be used for the preparation of a composite picture among plural pictures stored in the RAM 42, and a picture compositing part 50 for preparing one composite picture by compositing the designated number of pictures.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image pickup apparatus such as a digital camera having a multiple image photographing function.

[0002]

2. Description of the Related Art Conventionally, as disclosed in Japanese Patent Application Laid-Open No. H11-18707, multiple image processing for creating one super-resolution image, all-in-focus image, etc. by synthesizing a plurality of images having different photographing conditions. An imaging device such as a digital camera having the above function is known.

[0003] In this image pickup apparatus, the number of images used for image synthesis is set in advance or automatically set.

[0004]

However, if the number of images to be used for image composition is set in advance or automatically set in this way, it is possible to create a composite image desired by the user. There was a problem that it was difficult.

[0005] In some cases, the capacity of an image storage unit such as a RAM for temporarily storing a plurality of shot images before combining them becomes excessive, or the number of images used for image combining is set to be large. As a result, there is a problem that the calculation time required for image synthesis increases.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problem, and can create a composite image desired by a user, and can reduce the capacity of an image storage unit and increase the operation time of image synthesis. It is an object to provide an imaging device capable of preventing such a situation.

[0007]

An object of the present invention is to provide an image capturing means for performing a plurality of image capturing with different image capturing conditions, an image storing means for temporarily storing a plurality of images captured by the image capturing means, and the image storing means. Means for designating the number of images to be used for creating a composite image among a plurality of images stored in the means, and one composite image by composing the number of images designated by the image number designation means And an image synthesizing means for creating the image data.

According to this imaging apparatus, the number of images used to create a composite image is specified, so that a composite image that the user likes can be created.

[0009] The above object is also achieved by an imaging means for performing a plurality of imagings with different imaging conditions, an imaging number control means for variably setting the number of images captured by the imaging means,
An image synthesizing unit, wherein the imaging unit synthesizes a plurality of images photographed by the number set by the photographing number control unit to create one composite image. Is also resolved by

According to this imaging apparatus, since the number of images taken by the imaging means is set to be variable, it is possible to prevent the capacity of the image storage unit from being excessive and the calculation time for image synthesis from increasing.

[0011]

[First Embodiment] An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is an external perspective view showing a digital camera as an image pickup apparatus according to an embodiment of the present invention.
FIG. 2 is a rear view of the digital camera.

1 and 2, a digital camera 1 is provided with an imaging lens 2 on a front surface of a camera body 1A, and a finder window 5 and a distance measuring window 101 on an upper portion of the front surface. In addition, an image sensor 3 that receives an optical image from the image pickup lens 2 and performs photoelectric conversion is provided inside the camera body 1A. The image pickup means includes the image pickup device 3.

A release button (shutter button) 4, a shooting mode setting key 8, a liquid crystal panel 9, and the like are provided on the upper surface of the camera body 1A. An insertion opening 7 into which the storage medium 6 is removably inserted is formed on a side surface of the camera body 1A.

The photographing mode setting key 8 is used to set exposure conditions such as aperture priority and shutter speed priority, switch macro photography, and further set zoom while observing the display contents of the liquid crystal panel 9.

Further, a liquid crystal monitor 103 for live view display, an image processing mode setting key 102, and the like are provided on the back of the camera body 1A. The image processing mode setting key 102 is used to select a multiplex image processing mode or a normal mode, an image quality priority mode, a standard mode, a speed priority mode, an image designation mode, or the like while viewing the display contents on the liquid crystal monitor 103. Is what you do.

The digital camera 1 can record an image captured by the image pickup device 2 on the recording medium 6 in the same manner as a normal camera. It has a processing function. Of course, the configuration may be such that the multiplex image processing function is automatically executed without setting the multiplex image processing mode.

The multiplex image processing refers to a process of creating one combined image by combining a plurality of images captured by the image sensor 2. The multiple image processing includes super-resolution image creation and omnifocal image creation. In this embodiment, super-resolution image creation is used. This super-resolution image creation is a technique for creating an image in which the resolution is increased from a plurality of images of the same scene slightly displaced from each other, and the principle thereof is disclosed in JP-A-7-322121. Therefore, the description is omitted.

Each of the above modes is displayed on the display monitor 103 when the multiple image processing mode is set by the image processing mode setting key 102, as shown in FIG. 4A, and the user sets one of the modes. It has been done.

In the image quality priority mode, as shown in Table 1, in order to obtain an image having the highest image quality, the maximum number of images that can be shot is taken ignoring the processing time, and all the images are used. To perform multiplex image processing. In the standard mode, half the maximum number of images that can be photographed are photographed so that the processing time can be shortened while improving the image quality, and multiplex image processing is performed using all the images. In the speed priority mode, two images are photographed so as to minimize the processing time without considering the image quality, and multiplex image processing is performed using the two images. In the image designation mode, after the maximum number of images that can be photographed are photographed, two or more images to be used for multiplex image processing are designated from all of the images, and multiplex image processing is performed using the designated images.

[0021]

[Table 1]

FIG. 3 is a block diagram showing the electrical configuration of the digital camera 1, wherein thin arrows indicate the flow of control data.
Thick arrows indicate the flow of image data.

The digital camera 1 has a CPU 40 for controlling the entire camera, a photographing number control unit 104 for controlling the number of images photographed by the image element 3, and an A for converting an analog image signal from the image sensor 3 into a digital image signal. /
D converter 41, RAM 4 as image storage means for temporarily storing a plurality of images converted into digital image signals
2. An image combining unit 50 that performs multiplex image processing for creating one combined image by combining a plurality of images, an image designating unit 43 that designates an image to be used for multiplex image processing by the image combining unit 50, and the like. In addition to the above, the photographing lens driving unit 46 for driving the photographing lens,
8 is provided with an aperture driving unit 47 for driving the shutter 8.

The number-of-photographs control unit 104 sets the number of images to the maximum number of images that can be taken in the image quality priority mode, half the number of images that can be taken in the standard mode, two in the speed priority mode, In the image designation mode, the maximum number of images that can be taken is set and controlled. Note that the maximum number of images that can be shot refers to the number of images that can be stored in the RAM 42, and is determined by the image size and the memory capacity.

The image specifying section 43 specifies an image to be used for multiplex image processing by the image synthesizing section 50 as described above. That is, when the image designating mode is selected from the above modes, the maximum number of images that can be photographed is photographed by the image pickup device 3, and all of the images are stored in the RAM 42. Then, as shown in FIG. R on monitor 103
All images stored in the AM 42 are displayed in a thumbnail format. Here, if the user selects two or more images to be used for multiplex image processing using the image processing mode setting key 102 or the like, those images are specified by the image specifying unit 43, and the image synthesizing unit 50 Multiple image processing is performed using the designated image.

When images in the thumbnail format are displayed on the display monitor 103, a word "designate the number of images" is displayed separately from those images. Then, if this number designation mode is selected without selecting each image displayed in the thumbnail format, as shown in FIG.
The number of images stored in M42 is displayed on the liquid crystal monitor 103. Then, when the user inputs the number of images desired to be used for the multiplex image processing by using the image processing mode setting key 102, the image specifying unit 43 automatically switches the plurality of images stored in the RAM 42 to the number of images. Is specified. The input of the number of images may be performed by a key other than the image processing mode setting key 102.

The method of specifying the image at this time is as follows.
There is a method of measuring the amount of noise of all the images stored in the RAM 42 and specifying an image with less noise, a method of measuring the amount of blur of all the images stored in the RAM 42 and specifying an image of small blur, etc. . According to this, an image can be easily specified even when it is not known which of the images stored in the RAM 42 is to be specified.

Next, the operation of the digital camera 1 having the above configuration will be described with reference to the flowcharts of FIGS. Here, the basic control of the digital camera, such as lens drive, aperture drive, LCD drive, and flash drive, is well known, and a description thereof will be omitted. In the following description and drawings, “step” is abbreviated as “S”.

First, in S1, the CPU 40 determines whether or not the release button 4 has been pressed. If the release button 4 has not been pressed (NO in S1), the process returns. If the release button 4 has been pressed (S1). YES), the process proceeds to S2, and the CPU 4
0 reads and stores the photographing mode and image processing mode at that time.

Then, in S3, the object distance is measured by the distance measuring unit 44, and then, in S4, based on the result of the side distance, photographing is performed by the photographing lens driving unit 46 so as to focus on the object. The lens 2 is driven, and in step S5, the diaphragm drive unit 47 sets the diaphragm 48 to an appropriate value, and the flow advances to step S6.

In S6, it is determined whether or not the capacity of the recording medium 6 for recording an image is sufficient. If the capacity of the recording medium 6 is not sufficient (NO in S6), the process returns to S1. On the other hand, if the capacity of the recording medium 6 is sufficient (YES in S6), the process proceeds to S7, where it is determined whether the multiplex image processing mode is set in the image processing mode, and the multiplex image processing mode is set. If not (NO in S7), the process proceeds to S8.

In S8, exposure integration of the image sensor 23 is performed, and then in S9, image data is read out, and the flow advances to S10. In S10, the read image data is converted into digital data by the A / D converter 41 in a pipeline manner and temporarily stored in the RAM 42, and then in S11,
After reading out the image data of 42 and recording it on the recording medium 6, the process returns to S1 in order to proceed to the next shooting.

On the other hand, if the multiplex image processing mode is set in S7 (YES in S7), the flow advances to S12 to determine whether or not the image designation mode is set.
If the image designation mode is set (YE in S12)
S), the process proceeds to S13, the number of shootable images is calculated based on the size of the image and the capacity of the RAM 42, and the process proceeds to S14.

In S14, exposure integration of the image sensor 3 is performed, and in S15, after image data is read out,
At S16, the read image data is digitally converted by the A / D converter 41 by a pipeline method and
2 and temporarily proceed to S17.

In S17, it is determined whether or not the number of photographable images has reached the number of photographable images calculated in S13. If the number of photographable images has not reached the number of photographable images (NO in S17), the process returns to S14, while the number of photographable images If the number has reached (YES in S17), all the images stored in the RAM 42 are displayed on the liquid crystal monitor 103 in the thumbnail format, and the user is prompted to select an image to be used for multiplex image processing or to input the number of images. Proceed to S19.

In S19, the image designation section 43 designates the image selected by the user with the image processing mode setting key 102 or the like, and the flow advances to S20. At this time, if the user inputs the number of images without selecting an image, the image specifying unit 43 automatically specifies the number of images to be used for the multiple image processing by the number set by the user.

In S20, the designated image data is read out and multiplexed image processing is performed by the image synthesizing unit 50. Subsequently, in S21, one synthesized image subjected to multiplexed image processing is recorded on the recording medium 6. Then, the process returns to S1 to move to the next shooting.

If the image designation designation mode has not been designated in the processing of S12 (NO in S12), the process proceeds to S12.
The process proceeds to step S22, where it is determined whether the mode is the image quality priority mode, the standard mode, or the speed priority mode. In step S23, the number of shootable images corresponding to each mode is calculated, and the process proceeds to step S24. For example, in the image quality priority mode, the maximum number of images that can be photographed, in the standard mode, half of the maximum number of images that can be photographed, and in the case of the speed wired mode, the number of images that can be photographed is two.

In step S24, the image sensor 3 is integrated. Subsequently, in step S25, image data is read out. In step S26, the read out image data is converted into an A /
After the digital conversion by the D converter 41, the data is temporarily stored in the RAM 42, and the process proceeds to S27.

In S27, it is determined whether or not the number of photographable images has reached the number of photographable images calculated in S23. If the number of photographable images has not reached the number of photographable images (NO in S27), the flow returns to S24, while the number of photographable images If it has reached (YES in S27), the process proceeds to S28.

In S28, all the image data stored in the RAM 42 is read out, and the multiplexed image processing is performed by the image synthesizing section 50. In S29, one synthesized image that has been subjected to the multiplexed image processing is stored in a recording medium. 6 and return to S1 to move to the next shooting.

According to this imaging apparatus, the number of images to be used for creating a composite image is designated, so that a composite image desired by the user can be created.

Although the image quality priority mode, the standard mode, and the speed priority mode are provided in addition to the image designation mode, other modes may be provided.

The number of shots in the image quality priority mode, the standard mode, and the speed priority mode may be set to a value different from the above-described number of shots.

The repetition of photographing is performed by the digital camera 1
May be performed automatically or manually by a user. Embodiment 2 Hereinafter, another embodiment of the present invention will be described with reference to the drawings.

FIG. 8 is an external perspective view showing a digital camera as an image pickup apparatus according to another embodiment of the present invention, and FIG. 9 is a rear view of the digital camera.

8 and 9, the digital camera 2 is provided with an imaging lens 22 on the front surface of the camera main body 2A and a finder window 25 and a distance measuring window 201 on the upper front surface. And camera body 2A
An image sensor 23 that receives the optical image from the image pickup lens 22 and performs photoelectric conversion is disposed inside the image sensor 22. Then, an image pickup means is configured to include the image pickup device 23.

A release button 24, a photographing mode setting key 28, a liquid crystal panel 29 and the like are provided on the upper surface of the camera body 2A. An insertion slot 2 into which the storage medium 26 is removably inserted is provided on a side surface of the camera body 2A.
7, which have the same functions as the digital camera 1 shown in FIG.

A liquid crystal monitor 203 for live view display, an image processing mode setting key 202, a shooting pixel number setting key 209, and the like are provided on the back of the camera body 2A. The image processing mode setting key 202 is used to select the multiplex image processing mode, the continuous shooting mode, the normal mode, or the like while viewing the display contents on the liquid crystal monitor 203. The continuous shooting mode refers to a mode in which images are continuously shot while the release button 24 is pressed.

A photographing pixel number setting key 209 is used to set the number of pixels of an image desired by the user while watching the display contents of the liquid crystal monitor 203. The number of shootable images is calculated based on the number. Then, a photographing number control unit 2 described later
04 controls the number of images captured by the image sensor 23 according to the number of images that can be captured calculated by the CPU.

FIG. 10 is a block diagram showing the electrical configuration of the digital camera 2, wherein thin arrows indicate the flow of control data, and thick arrows indicate the flow of image data.

The digital camera 1 includes a CPU 240 for controlling the entire camera, a photographing number controller 204 for controlling the number of images photographed by the image element 3, and an image pickup element 23.
A / D converter 241 for converting an analog image signal into a digital image signal according to the above, a RAM 242 for temporarily storing a plurality of images converted to digital image signals, and creating one combined image by combining a plurality of images A photographing lens driving unit 246 for driving the photographing lens 22;
An aperture driving unit 247 for driving the aperture 248 according to a command from the CPU is provided.

Next, the operation of the digital camera 2 having the above configuration will be described with reference to the flowcharts of FIGS. Here, the basic control of the digital camera, such as lens driving, aperture driving, LCD driving, and flash driving, is well known, and a description thereof will be omitted. In the following description and drawings, “step” is abbreviated as “S”.

First, in S51, it is determined whether or not the release button 24 has been pressed. If the release button 24 has not been pressed (NO in S51), the process returns. YES), proceeding to S52, CPU2
40 reads and stores the photographing mode, image processing mode, and photographing pixel number setting at that time.

In step S53, the object distance is measured by the distance measuring unit 244. Subsequently, in step S54, the photographing is performed by the photographing lens driving unit 246 such that the object is focused on the basis of the side distance result. The lens 22 is driven, and in step S55, the diaphragm drive 247 sets the diaphragm 248 to an appropriate value, and the flow advances to step S56.

In S56, it is determined whether or not the capacity of the recording medium 26 for recording all images after photographing is sufficient. If the capacity of the recording medium 26 is not sufficient (NO in S56), It returns to S51. On the other hand, if the capacity of the recording medium 26 is sufficient (YE at S56).
S), the process proceeds to S57, and determines whether or not the continuous shooting mode is set in the image processing mode. If the continuous shooting mode is not set (NO in S57), S58 is performed.
Proceed to.

In S58, it is determined whether or not the multiplex image processing mode is set in the image processing mode. If the multiplex image processing mode is not set (N in S58)
O), the flow proceeds to S59, and after performing exposure integration of the image sensor 23, the image data is read out in S60, and the flow proceeds to S61.

In step S61, the read image data is converted into digital data by the A / D converter 241 in a pipeline manner, temporarily stored in the RAM 242, and then in step S6.
At 2, the CPU 240 reads out the image data from the RAM 242 and records it on the recording medium 26, and then returns to S51 to move to the next shooting.

On the other hand, when the continuous shooting mode is set in S57 (YES in S57), in S63,
The number of pixels set by the shooting pixel number setting key 229 and the RAM
The number of recordable images is calculated based on the capacity of 242,
Proceed to S64.

In S64, exposure integration of the image sensor 23 is performed, and in S65, image data is read out.
In step S66, the read image data is converted into a digital signal by an A / D converter by a pipeline method.
And the process proceeds to S67.

In S67, it is determined whether or not the number of photographable images has reached the number of recordable images calculated in S63. If the number of photographable images has reached the number of recordable images (YES in S67), the flow proceeds to S69. On the other hand, if the number of recordable images has not been reached (S6
(NO in 7), proceeding to S68, determining whether the release button is pressed or not. If the release button is pressed (YES in S68), the process returns to S64 while the release button is not pressed. Is (NO in S68), S6
Go to 9.

In step S69, the image data in the RAM 242 is read and recorded on the recording medium 26, and then the process returns to step S51 to move to the next photographing.

On the other hand, if the multiplex image processing mode has been set in S58 (YES in S58), the flow advances to S70, in which the number of pixels set by the shooting pixel number setting key 229, R
The number of images that can be photographed is calculated based on the capacity of the AM 242 and the capacity of the recording medium 26. Subsequently, in S71, the number of images required for multiplex image processing is calculated, and the process proceeds to S72.

In step S72, the image sensor 23 is integrated. Subsequently, in step S73, the image data is read. In step S74, the read image data is converted into an A /
It is digitally converted by the D converter and temporarily stored in the RAM 242.

Then, in S75, it is determined whether or not the number of photographed images has reached the required number calculated in S71. If the required number has not been reached (NO in S75), the flow returns to S72, while the required number of images has been reached. Is reached (YE in S75).
S), the process proceeds to S76, the image data in the RAM 242 is read, and the multiplex image processing is performed by the image synthesizing unit 25.
Go to 77.

In S77, the composite image subjected to the multiplex image processing is recorded on the recording medium 26, and the process returns to S51 to move to the next photographing.

According to this digital camera, the number of images taken by the image pickup means is set variably.
It is possible to prevent the capacity of the image storage unit from being excessive and the calculation time for image synthesis from increasing.

In this embodiment, the number-of-photographs control section 204 controls the number of photographed images in the image sensor 23 in accordance with the number of photographable images calculated based on the number of pixels and the capacity of the RAM 242. However, the number of shots in the image sensor 23 may be controlled in accordance with the number of shots calculated based on any one element or another element.

The number-of-shots control section 204 may control the number of shots in the image sensor 23 in accordance with the number of shots set by the user.

[0070]

According to the first aspect of the present invention, the number of images to be used for creating a composite image is specified, so that the user can create a desired composite image.

According to the second aspect of the present invention, the number of images taken by the image pickup means is set to be variable.
It is possible to prevent the capacity of the image storage unit from being excessive and the calculation time for image synthesis from increasing.

[Brief description of the drawings]

FIG. 1 is an external perspective view showing a digital camera according to an embodiment of the present invention.

FIG. 2 is a rear view showing the digital camera shown in FIG. 1;

FIG. 3 is a block diagram illustrating an electrical configuration of the digital camera in FIG. 1;

FIG. 4 is a diagram showing a screen displayed on the liquid crystal monitor of FIG. 2;

FIG. 5 is a first flowchart illustrating the operation of the digital camera in FIG. 1;

FIG. 6 is a second flowchart illustrating the operation of the digital camera in FIG. 1;

FIG. 7 is a third flowchart illustrating the operation of the digital camera in FIG. 1;

FIG. 8 is an external perspective view showing a digital camera according to another embodiment of the present invention.

FIG. 9 is a rear view showing the digital camera of FIG. 8;

FIG. 10 is a block diagram showing an electrical configuration of the digital camera shown in FIG.

FIG. 11 is a first flowchart illustrating the operation of the digital camera in FIG. 8;

FIG. 12 is a second flowchart illustrating the operation of the digital camera in FIG. 8;

FIG. 13 is a third flowchart illustrating the operation of the digital camera in FIG. 8;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 3 ... Image sensor 41 ... A / D converter 42 ... RAM 50 ... Image synthesis part 6 ... Recording media

Claims (2)

[Claims] 1. An image capturing means for performing a plurality of image capturing with different capturing conditions, an image storing means for temporarily storing a plurality of images captured by the image capturing means, and a plurality of images stored in the image storing means An image number designating means for designating the number of images used for creating a composite image; an image combining means for creating one composite image by combining the number of images designated by the image number designating means; An imaging apparatus comprising: 2. An image capturing means for performing a plurality of image capturing with different image capturing conditions; an image capturing number control means for variably setting the number of images captured by the image capturing means; and the image capturing number control means by the image capturing means. An image capturing apparatus, comprising: image combining means for creating one combined image by combining a plurality of images photographed by the number set in the step (c).