JP2003051979A - Electronic camera provided with image processing function and a computer-readable recording medium recording program enabling the electronic camera to realize the image processing function - Google Patents

Abstract

PROBLEM TO BE SOLVED: To give no effect of image processing on a substantial function of the camera to the utmost in an electronic camera, capable of applying prescribed image processing to a photographed image. SOLUTION: A total control section 108 has the function of consecutively photographing two images by revising a photographing condition in a special photographing mode and the function of compositing the two photographed images. A memory card MC records the two images consecutively photographed in the special photographing mode. The total control section 108 reduces power supplied from a power supply 111 to be shifted to a standby mode (power-save mode), when the state of no operation of an operation section 107 continues for a prescribed time. In the case of transition to the standby mode, an image synthesis processing section 1108h reads the two images recorded in the memory card MC to composite both the images and records the synthetic image to the memory card MC. Image processing is conducted in the standby mode to avoid the image processing from giving effect on the substantial photographing processing of the camera, or the like.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention performs focusing by performing a predetermined image process (for example, a process of combining two taken images) on a taken image recorded on a recording medium, which is different from the process at the time of shooting. The present invention relates to an electronic camera capable of obtaining a captured image with improved image quality such as gradation and the like, and a recording medium recording a program capable of imparting such an image processing function to the electronic camera.

[0002]

2. Description of the Related Art A digital still for photoelectrically converting an optical image of a subject into an electric signal corresponding to the light intensity, A / D converting the electric signal to create an image composed of digital data, and recording the image on a recording medium. In electronic cameras such as cameras,
Since various photographed images can be obtained by image processing, it has been proposed to perform various image processing on the camera side.

For example, in Japanese Patent Laid-Open No. 11-168683, a digital still camera with a printer capable of setting a photographing mode such as a landscape mode, a soft focus mode and a portrait mode is set to a photographed image after A / D conversion. An image for recording (hereinafter, referred to as a recorded image) is created by performing a predetermined image processing according to the selected shooting mode.

Further, for example, a digital still camera has been commercialized, which is capable of obtaining a high-resolution shot image by synthesizing the shot images by performing two consecutive shots by slightly displacing the image pickup device. (GC-X1 “PIXSTER” digital still camera manufactured by Victor Company). With this digital still camera, two types of exposure control values are set according to the bright and dark areas of the subject, and two consecutive shots are taken with these exposure control values, and both shot images are processed by image processing. It is possible to obtain a photographed image having an appropriate density from a dark portion to a bright portion by combining them.

[0005]

Although it is preferable that the image quality of a captured image can be improved or a special video effect can be provided by image processing, in recent years, high pixel counts of image pickup devices applied to electronic cameras have been developed. As a result, the number of data of captured images becomes enormous, and if the camera side is provided with such an image processing function, a problem occurs that the image processing load adversely affects the original shooting / playback function of the camera.

That is, when the image processing according to the photographing mode such as the landscape mode is performed in a series of release processing from the exposure of the image pickup device to the formation of the recorded image and the recording on the recording medium, The processing time of this image processing becomes long, and there is a problem that the next shooting operation and the playback operation of a shot image cannot be immediately started. It is also possible to prevent the original functions of the camera from being damaged by processing the images, such as combining the two shot images, in parallel with the original shooting and playback functions of the camera using the multitasking function after shooting. However, even in that case, the repetitive arithmetic processing for repeating the same kind of arithmetic operation on a huge amount of data causes a heavy processing load on the computer that integrally controls the operation of the camera, and the photographing processing and the reproduction processing. Response will be reduced and operability will be deteriorated.

Since the electronic camera has a main function of originally taking a picture or reproducing a taken image, the operability for the functions relating to the taking operation such as the taking operation and the reproducing operation for confirming the taken image is two. It is not preferable that the image quality is lowered due to the influence of the image processing function which is the next additional function.

The present invention has been made in view of the above problems, and an electronic camera capable of performing various kinds of image processing such as image quality improvement and special effects on a photographed image without affecting the photographing function. And a recording medium in which a program capable of imparting such an image processing function to an electronic camera is recorded.

[0009]

The invention according to claim 1 is
When an operation means for inputting various kinds of information and a release instruction is given by the operation means, the subject light image is photoelectrically converted into an image composed of an electric signal, and a predetermined process is performed on this image to record an image. An image pickup means for creating an image, a recording means for recording the image created by the image pickup means on a recording medium, and a predetermined image processing different from the above-described processing at the time of shooting on the image recorded on the recording medium. An electronic camera comprising an image processing means, wherein the detecting means detects that the non-operating state of the operating means has continued for a predetermined time or more, and the non-operating state of the operating means is predetermined by the detecting means. When it is detected that the above time has continued, the above predetermined image processing is started.

According to the above construction, when the release is instructed by the operation means, the image of the subject is captured by the image pickup means,
After a predetermined image processing is performed by the recording means, the image is recorded on the recording medium. When the unoperated state of the operating means continues for a predetermined time or longer, the state is detected by the detecting means, and a predetermined image processing different from the processing at the time of shooting is performed on the captured image recorded on the recording medium by the image processing means. Is performed. For example, a process of combining two captured images to improve the image quality or creating one image having a special video effect is performed. Such image processing is usually a heavy processing that requires a long time for processing, including repeated calculation processing in which the same type of calculation is repeated for each pixel data forming an image. Since it is performed when it is estimated that the operation of shooting or reproduction will not be performed while the state where the operation means is not operated continues, the processing efficiency can be improved.

According to a second aspect of the present invention, in the electronic camera according to the first aspect, the image pickup means, the recording means, and the image processing means are provided with power supply means for supplying predetermined power, respectively, and the power supply means is provided. When the detection means detects that the operation means has not been operated for a predetermined time or longer, the power supplied to the imaging means is reduced.

According to the above construction, when the detecting means detects that the operation interval of the operating means exceeds the predetermined time, the power supplied to the image pickup means is reduced, and in this state, the image processing means. The predetermined image processing different from the processing at the time of photographing is performed on the photographed image recorded on the recording medium. When performing predetermined image processing with the image processing means,
Since the electric power supplied to the image pickup means irrelevant to this processing is reduced, it is possible to prevent the power shortage to the image processing means due to the power consumption in the image pickup means, and to surely perform the image processing. You can

In the electronic camera according to the second aspect, when the power supply means is capable of supplying power from an AC adapter or a battery, a power supply determination means for determining the type of power supply source to the power supply means. And the image processing means detects that the detecting means has continued the non-operation state of the operating means for a predetermined time or more, and
When the power supply discriminating means discriminates that the main power supply is the AC adapter, it is preferable to start predetermined image processing on the image recorded on the recording medium (claim 3).

According to this structure, since the power is supplied from the AC adapter having a stable power supply capability to the image processing means through the power supply means, the processing may be interrupted due to insufficient power during image processing. Therefore, image processing can be performed without fail.

Further, in the electronic camera according to the present invention, when the power supply means is capable of supplying power from an AC adapter or a battery, a power supply discrimination means for discriminating the kind of power supply source to the power supply means. And a battery capacity determination means for determining whether or not the battery can be supplied with power, and the image processing means is such that the detection means continues the non-operation state of the operation means for a predetermined time or more. If the battery is detected as the power supply source to the power supply means and the battery capacity determination means determines that the battery can be supplied with power, the image recorded in the recording medium is detected. It is preferable to start a predetermined image processing for (Claim 4).

Also in this configuration, when the battery has a power supply capability, power is supplied from the battery to the image processing means through the power supply means, so that the processing is interrupted due to insufficient power during image processing. Can be prevented.

Further, in the electronic camera according to any one of claims 2 to 4, the power supply means may reduce power supply to the image processing means when the image processing means completes image processing. (Claim 5). By doing so, power consumption can be reduced as much as possible.

According to a sixth aspect of the present invention, in the electronic camera according to any one of the first to fifth aspects, the information input from the operating means is information for instructing image processing of a recorded image by the image processing means. The image processing means performs predetermined image processing on the image recorded on the recording medium when the image processing is instructed by the operating means.

According to this structure, the image processing means is
When the image processing is instructed by the operating means, a predetermined image processing is performed on the image recorded on the recording medium, so that the operator can perform the image processing only on a desired captured image. it can. As a result, it is possible to reduce the adverse effect of unnecessary image processing on the photographing processing and reduce the power consumption.

According to a ninth aspect of the present invention, an operating means for inputting various kinds of information, and when a release is instructed by the operating means, the light image of the subject is photoelectrically converted into an image consisting of an electric signal, and this image is obtained. Image pickup means for performing a predetermined process to create an image for recording, a recording means for recording the image created by the image pickup means on a recording medium, and a non-operation state of the operation means for a predetermined time or more. When the detection means detects that the operation means has not been operated for a predetermined time or longer, the image processing means detects the fact that the image recorded on the recording medium is detected. An electronic camera having an image processing means for performing a predetermined image processing different from the above-mentioned processing at the time of photographing, wherein a specific operation is performed by the operation means when the image processing means is performing the predetermined image processing. When carried out, interrupting the image processing, in which the image in the middle of processing with an image processing control means for recording on the recording medium.

According to the above construction, when the release is instructed by the operation means, the image of the subject is taken in by the image pickup means,
After a predetermined image processing is performed by the recording means, the image is recorded on the recording medium. When the unoperated state of the operating means continues for a predetermined time or longer, the state is detected by the detecting means, and a predetermined image processing different from the processing at the time of shooting is performed on the captured image recorded on the recording medium by the image processing means. Is performed. When a specific operation (for example, an instruction to switch the mode of release and shooting and reproduction) is performed by the operation means during the image processing, the image processing is interrupted, and the image being processed is recorded on the recording medium. To be done.

If there is a specific operation related to the photographing function such as a release during the image processing with a heavy processing load, the image processing is interrupted and the processing of the operation is prioritized. Does not decrease.

It is to be noted that, in the electronic camera according to claim 9, the image processing control means is configured to execute the image processing recorded on the recording medium in the image processing means after the processing corresponding to the specific operation is completed. It is preferable to perform the interrupted predetermined image processing on the unfinished image (claim 1).
0). Specifically, the image processing control means, after the processing corresponding to the specific operation is completed, when the detecting means detects that the non-operating state of the operating means has continued for a predetermined time or more, the recording is performed. It is preferable that the image which has not been subjected to the image processing recorded on the medium is read out and the image processing means starts a predetermined image processing which is interrupted for the image (claim 11).

According to this structure, after the processing for the specific operation in which the image processing is interrupted is completed, the interrupted image processing is automatically restarted, so that the image processing can be completed reliably.

According to a sixteenth aspect of the present invention, a detecting means is provided for detecting that a computer for integrally controlling the operation of the electronic camera controls the operation means for inputting various kinds of information for a predetermined time or more. When the non-operated state of the operating means continues for a predetermined time or longer, the image processing means functions as an image processing means for performing a predetermined image processing different from the processing at the time of shooting on the shot image recorded on the recording medium. It is a computer-readable recording medium in which a program is recorded.

According to this configuration, the electronic camera according to the first aspect can be realized by causing the computer of the electronic camera to read the program recorded in the recording medium.

[0027]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An electronic camera according to the present invention will be described by taking a digital still camera as an example. FIG. 1 is a front view of a camera body of the digital still camera, FIG. 2 is a top view showing the arrangement of main members incorporated in the digital still camera, and FIG. 3 is an arrangement of main members incorporated in the digital still camera. A right side view and FIG. 4 are rear views of the digital still camera.

In the digital still camera 1, in addition to a shooting mode for taking a normal picture (hereinafter referred to as a normal shooting mode), two shot images are obtained by successively exposing twice with one shutter operation. A shooting mode (hereinafter referred to as a special shooting mode) in which the captured images are combined by an image combining process to obtain an image in which focus, gradation, resolution, etc. are improved as compared with a normal captured image. I have it.

The special photographing mode includes a blur adjustment mode,
A gradation adjustment mode and a super-resolution mode are included. The bokeh adjustment mode is one in which the focus position is changed by one shutter operation and two consecutive exposures are performed to match the photographic image focused on the distant view (background) and the near view (main subject such as a person). This is a shooting mode in which an image having a desired degree of blur is obtained by obtaining a focused shot image and synthesizing these shot images by image synthesis processing.

In the gradation adjustment mode, the exposure condition is changed by one shutter operation and the exposure is continuously performed twice, and the captured image in which the main subject is exposed and the captured image in which the background is exposed. , And combine these captured images in the image composition process to create an image with a proper density distribution on the entire screen or an image with strong originality in which the contrast between the main subject and the background is intentionally increased. It is a shooting mode to obtain.

In the super-resolution mode, the photographing operation is continuously performed twice without changing the focus and the exposure condition by one shutter operation, and slightly different between the first photographing and the second photographing. Two captured images in which the position of the main subject on the screen changes slightly due to the difference in camera angle are acquired, and these captured images are combined by image combining processing to obtain an image with a higher resolution than the original captured image. It is a shooting mode to obtain.

The digital still camera uses an LC
Playback on the D display has an advantage over a film camera that the captured image can be confirmed immediately after shooting. Considering that this advantage is not impaired, in the blur adjustment mode, gradation adjustment mode, and super-resolution mode, after two captured images for combining are acquired, these combining processes are performed continuously. It is desirable to obtain a desired image.

However, the image synthesizing process in these special photographing modes includes a process of aligning both images for synthesizing two photographed images and an iterative calculation process for obtaining a target blur condition and gradation. Therefore, the processing load is large, and a certain processing time is required until the processing is completed. For this reason,
In the special photographing mode, if two photographed images for combination are obtained and then these combining processes are performed, there is a possibility that an adverse effect such as deterioration in response to the next photographing process or reproduction process may occur. .

Therefore, in the digital still camera 1 according to the present embodiment, as will be described later, the timing of the image synthesizing process for the photographed image photographed in the special photographing mode is set as follows.
The user may either continue the operation after acquiring the two captured images for composition, or perform the operation when there is no user operation and the power consumption is suppressed to save power (hereinafter referred to as standby). So that you can choose
With such a configuration, the problem described above in the special photographing mode such as the blurring adjustment mode accompanied by the image synthesizing process is solved.

The present invention is characterized by the processing timing of the image synthesis processing which has a heavy processing load, and the processing timing is not related to the content itself of the image synthesis processing in the special photographing mode such as the blur adjustment mode. Absent. The image combination processing in the blur adjustment mode, the gradation adjustment mode, and the super-resolution mode is merely an example of the image combination processing that has a heavy processing load. Japanese Patent Application No. 2000-30
It is almost the same as that described in No. 1293.

Therefore, in the following description, the processing timing of the image synthesis processing according to the present invention will be described by taking the image synthesis processing in the blur adjustment mode as an example, and the processing of the image synthesis processing in the gradation adjustment mode and the super-resolution mode will be described. The description of the timing is omitted.

In FIG. 1, a digital still camera 1
Is an interchangeable lens 3 including a camera body 2 and a zoom lens detachably attached to the camera body 2 substantially in the center of the front surface thereof.
It is composed of a single-lens reflex camera consisting of.
The camera body 2 is provided with a mount portion 201 on which the interchangeable lens 3 is mounted, and a grip portion 202 at the left end portion of the front surface, in the approximate center of the front surface.

As shown in FIG. 2, a battery storage chamber 203 and a card storage chamber 204 are provided inside the grip portion 202, and the battery storage chamber 203 has four AA dry batteries E1 to E1.
E4 (camera power supply battery) is stored, card storage room 2
In 04, a memory card MC for recording image data of a photographed image is detachably housed.

A plurality of contact points ST for making an electrical connection with the interchangeable lens 3 mounted on the lower part of the mount 201 and a plurality of couplers CP for making a mechanical connection.
And are provided. The electrical contact ST receives specific information (information such as the open F value and focal length) related to the lens from the lens ROM 301 (see FIG. 3) built in the interchangeable lens 3 in the overall control unit 108 (in the camera body 2). (See FIG. 6) and outputs information on the position of the zoom lens and the position of the focusing lens in the interchangeable lens 3 to the overall control unit 108. The coupler CP transmits the driving force of the zoom lens driving motor ZM (see FIG. 3) and the driving force of the focus lens driving motor FM (see FIG. 3) provided in the camera body 2 to the interchangeable lens 3 side. It is for doing.

A color image pickup element 205 is arranged at a proper position in the camera body 2 on the optical axis L of the interchangeable lens 3 when the mount part 201 is mounted.
Color image sensor 205 (hereinafter referred to as CCD 205)
Is a CCD (Charge-Coupled Devic
On the surface of each pixel of the area sensor 205A consisting of e),
R (red), G (green), B (blue) color filters 205
B is composed of a single-plate color area sensor, which is a so-called Bayer system, which is attached in a checkered pattern, and has, for example, 1600 × 1200 = 1920,000 pixels.

As shown in FIG. 5, the area sensor i
The pixel position of the row j-th column is (i, j) (i = 1, 2, ... N,
j = 1,2, ... m), R, G, and B color filters are R; (2h + 1,2k + 1) G; (2h + 2,2k + 1), (2h + 1,2k + 2) B; (2h + 2,2k + 2) However, h = 0,1,2, ... n / 2, k = 0,1,2, ...
It is arranged at a pixel position of m / 2.

A shutter button 206 is provided on the upper surface of the grip portion 202 of the camera body 2. Half-pressing operation and full-pressing operation of the shutter button 206 are detected by switches S1 and S2 described later. When the switch S1 is turned on (when the shutter button 206 is half-pressed), a preparatory operation (a preparatory operation such as setting an exposure control value and focus adjustment) for taking a still image of a subject is performed, and the switch S2 is turned on. When turned on (shutter button 20
6 is fully pressed), a photographing operation (a series of operations of exposing the CCD 205, performing predetermined image processing on the image signal obtained by the exposure, and recording the image signal in the memory card MC)
Is performed.

An electronic view finder 4 (EVF; Electronic View Finder) and a pop-up type flash 5 are provided in the approximate center of the upper surface of the camera body 2. The electronic viewfinder 4 is a monitor image of the subject photographed by the CCD 205 (the CCD 2 in the photographing standby state).
Display unit 401 (hereinafter, L) including a color liquid crystal display device that displays a subject image captured as a moving image by S.05.
It is called the CD display unit 401. ) And an eyepiece 402 for guiding the monitor image displayed on the color liquid crystal display device to the outside of the finder window 403.

In the standby state for shooting, the electronic viewfinder 4
Since a monitor image (moving image) of the subject is displayed on, the photographer can visually recognize the subject by looking through the finder window 403.

A display unit 207 (hereinafter, referred to as LCD display unit 207) formed of a color liquid crystal display device is provided in the rear surface of the camera body 2 substantially in the center. The LCD display unit 207 displays a menu screen for setting a shooting mode, shooting conditions, etc. in the recording mode, and reproduces and displays a shot image recorded in the memory card MC in the reproduction mode.

The photographing mode includes a mode related to exposure control and a mode related to image composition processing. The mode relating to the exposure control is a mode relating to a method of determining the exposure control value (aperture value of the diaphragm and the exposure time) at the time of release. The modes relating to the image composition processing are the blur adjustment mode, gradation adjustment mode, and super-resolution mode described above.

The modes relating to exposure control include at least a program mode, a shutter priority mode, and an aperture priority mode. The exposure control value is set by using one of a plurality of preset program charts. In the program mode, the exposure control value is set by using a standard program chart, and the shutter is set. In the priority mode, the exposure control value is set using the program diagram that gives priority to the shutter speed (exposure time) over the aperture value, and in the aperture priority mode, the program diagram that gives priority to the aperture value over the shutter speed is used. The exposure control value is set.

At the upper left position of the LCD display section 207,
A power switch 211 is provided, and a mode setting switch 208 for switching and setting a recording mode (a mode that performs a function of taking a picture) and a reproduction mode (a mode for reproducing a recorded image on the LCD display unit 207) is provided below the power switch 211. .
The power switch 211 is composed of a push switch, and switches ON and OFF alternately each time it is pressed. The mode setting switch 208 is a two-point slide switch. When the contact is set to the upper "REC" position, the recording mode is set, and when the contact is set to the lower "PLAY" position, the reproduction mode is set.

At the upper right position of the LCD display section 207, 4
A serial switch 209 is provided. 4 switches 20
Reference numeral 9 has a circular operation button, and pressing operations in four directions of up, down, left and right on the operation button are detected respectively. The quadruple switch 209 is multi-functional, and functions as an operation switch for changing an item selected on the menu screen displayed on the LCD display unit 207 or changing a frame to be reproduced selected on the index screen, for example. At the same time, the left and right switches also function as switches for changing the zoom ratio of the interchangeable lens 3.

A switch group 210 is provided below the quadruple switches 209 to perform operations relating to the display and display contents of the LCD display unit 207. The switch group 210 includes a cancel switch 210a and a confirmation switch 21.
0b, a menu display switch 210c, and a display switch 210d. Further, a connection terminal 21 for connecting an AC adapter (not shown) below the switch group 210.
Two are provided. When the AC adapter is connected to the connection terminal 212, the main power source of the camera is switched from the battery power source to the AC adapter, and the power source is supplied from the AC adapter.

The cancel switch 210a is a switch for canceling the contents selected on the menu screen. The confirmation switch 210b is a switch for confirming the content selected on the menu screen. Menu display switch 21
0c is a switch for displaying a menu screen on the LCD display unit 207. Menu display switch 210c
Each time is pressed, the display and non-display of the menu screen are switched alternately. The display switch 210d is the LCD display unit 20.
It is a switch that causes the display at 7 and turns off the display. In order to save power of the power supply batteries E1 to E4,
The display on the LCD display unit 207 is not displayed when the camera is activated. Each time the display switch 210d is pressed, the display and non-display of the LCD display unit 207 are switched alternately.

On the menu screen, for example, a plurality of items are arranged and displayed, and the currently selected item is displayed to show the selected state (for example, a cursor or reverse display). For example, in the case of selecting a mode relating to image combining processing in the shooting mode, a menu screen as shown in FIG. 6 is displayed on the LCD display unit 207. The item of "normal shooting" on this menu screen is a normal shooting mode in which shooting is performed in the same manner as the shooting operation of the silver halide camera.

In the menu screen of FIG. 6, when the up switch of the quad switch 209 is pressed, the display position of the cursor K indicated by the black triangle (that is, the item indicated by the cursor K) cyclically moves upward. 4 switches 2
When the downward switch of 09 is pressed, the item display position indicated by the cursor K cyclically moves downward. Then, when the confirmation switch 210b of the switch group 210 is pressed, the item (bokeh adjustment mode in FIG. 6) designated by the cursor K at that time is set as the shooting mode.

Therefore, the photographer operates the quadruple switch 209 in the vertical direction on the menu screen for selecting the photographing mode to select the desired photographing mode, and the confirm switch 210.
The shooting mode can be set by operating d.

A black triangle mark J on the upper right side of the screen on the right side indicates that there is a next selection menu. When the right switch of the quad switch 209 is pressed, the selection menu shown in FIG. 7 is displayed. . FIG. 7 is a selection menu for setting the timing of performing image synthesis processing such as blur adjustment, gradation adjustment, and super-resolution. Timing of executing image synthesis processing after shooting (hereinafter referred to as “image after shooting”). "Execute processing") and the timing of executing the image combining processing during standby can be selected.

The selection method is the same as in the shooting mode, and 4
After pressing the up / down switch of the serial switch 209 to determine the display position of the cursor K indicated by the black triangle, the confirmation switch 210b of the switch group 210 is pressed, and the item designated by the cursor K at that time (in FIG. "Run on standby") is set.

When the leftward switch of the quad switch 209 is pressed on the menu screen of the execution timing of the image synthesizing process, the menu screen shown in FIG. 6 is returned. Also, regarding the mode relating to the exposure control, a desired shooting mode can be set by the same method.

On the index screen, the memory card MC
Nine thumbnail images of all the images recorded in are displayed in an array, and the display selected for the currently selected frame (for example, blinking display or frame display) is performed. When one of the up, down, left and right direction switches of the quad switch 209 is pressed, the display showing the selection state of the menu screen or index screen moves to the item or frame in that direction. For example, when the upward switch is pressed, the display showing the selection state of the menu screen or index screen moves to the upward item or frame.

In the zoom operation of the interchangeable lens 3, when the right switch of the quad switch 209 is pressed, the interchange lens 3 continuously moves to the wide side, and when the left switch of the quad switch 209 is pressed, the interchange lens is pressed. The zoom lens 3 moves continuously to the telephoto side.

FIG. 8 is a block diagram showing the internal structure of the digital still camera 1.

The digital still camera 1 is composed of an image pickup block A, a display block B, a recording block C, a control block D, and a power supply block E. Imaging block A
Is a block for performing a photographing function, and the lens 10
1, image pickup unit 102, signal processing unit 103, light emission control unit 10
4, members such as the lens control unit 105 and the flash 5 are included. The display block B is a block for performing display functions such as monitor display of a subject, reproduction display of captured images, and menu display for setting shooting conditions, and includes members of the display unit 106. The recording block C is a block for performing a function of recording a captured image in the memory card MC, and includes the card I / F 109 and members of the memory card MC. The control block D is a block that controls the operation of the members in each block to exert various functions of the camera, and includes an operation unit 107, an overall control unit 108, and an RTC (Real Time Cloc).
k) Includes members such as 110. The power supply block E is a block for performing a function of supplying a predetermined power supply to each of the blocks A to D, and includes members such as a power supply unit 111, a battery 112, and an AC adapter 113. The batteries 112 are stored in the battery storage chamber 203 and directly connected to the power supply batteries E1 to E
4 and the AC adapter 113 corresponds to the AC adapter connected to the connection terminal 212.

The lens 101 in the image pickup block A corresponds to the interchangeable lens 3. The lens 101 includes a focusing lens 101a and a zoom lens 101b, and a diaphragm 101c for adjusting the amount of transmitted light is provided inside.

The image pickup section 102 photoelectrically converts a subject light image incident through the lens 101 into an image signal (electrical image) and takes it in. The image pickup unit 102 includes a CCD 102a corresponding to the CCD 205, a timing generator 102b that controls the image pickup operation of the CCD 102a, and a timing control circuit 102c that controls the driving of the timing generator 102b.

The CCD 102a has a drive control signal (integration start signal / integral start signal / input from the timing generator 102b).
The subject light image is received for a predetermined time (exposure time) based on the integration end signal) and converted into an image signal (charge accumulation signal), and the image signal is read out from the timing generator 102b (horizontal synchronization signal). Signal, vertical synchronization signal, transfer signal, etc.) to the signal processing unit 103. At this time, the image signal is separated into R, G, and B color components and output to the signal processing unit 103. That is, the image signal of the R color component is output by sequentially reading the image signal received by each pixel at the pixel position (2h + 1, 2k + 1), and the pixel position (2h + 2, 2k + 1), (2h + 1,
The image signal of the G color component is output by sequentially reading the image signal received by each pixel of 2k + 2), and the image signal received by each pixel of the pixel position (2h + 2, 2k + 2) is sequentially read by The image signal of the color component is output.

The timing generator 102b generates a drive control signal based on the control signal input from the timing control circuit 102c and a read control signal based on the reference clock, and outputs the read control signal to the CCD 102a. The timing control circuit 102c controls the photographing operation of the image pickup unit 102. Timing control circuit 102
c generates a shooting control signal based on the control signal input from the overall control unit 108. The shooting control signal is a shooting control signal for displaying a moving image of a subject (hereinafter, referred to as a live view image) on the electronic viewfinder 4 in a monitor mode in the recording mode, and the shutter button 6 is operated to operate the subject. Signal, reference clock, CC for shooting still images (hereinafter referred to as recorded images)
The image signal output from D102a is processed by the signal processing unit 103.
Timing signal (synchronous clock) for signal processing by
Etc. are included. This timing signal is sent to the signal processor 10
Signal processing circuit 103a and A / D conversion circuit 103 in 3
Input to b.

The signal processing section 103 performs predetermined analog signal processing and digital signal processing on the image signal output from the CCD 102a. The signal processing of the image signal is performed for each light receiving signal of each pixel forming the image data. Hereinafter, for convenience of explanation, in order to distinguish the light receiving signal of each pixel from the image signal forming the captured image by these sets, the light receiving signal of each pixel is converted into a pixel signal (analog signal) or pixel data (digital signal) as necessary. Signal).

The signal processing unit 103 includes an analog signal processing circuit 103a, an A / D conversion circuit 103b, a black level correction circuit 103c, a WB circuit 103d, a γ correction circuit 103e and an image memory 103f. The black level correction circuit 103c, the WB circuit 103d, and the γ correction circuit 103
e constitutes a circuit for performing digital signal processing.

The analog signal processing circuit 103a is mainly a CD
The CCD 102a includes an S circuit (correlated double sampling) circuit and an AGC (auto gain control) circuit.
The sampling noise of the pixel signal output from the device is reduced and the signal level is adjusted. The A / D conversion circuit 102b converts each pixel signal output from the analog signal processing circuit 103a into digital image data. A /
The D conversion circuit 102b converts the pixel signal received by each pixel into
For example, it is converted into 10-bit pixel data.

The black level correction circuit 103c corrects the black level of each A / D converted pixel data to a reference black level. The WB circuit 103d adjusts the white balance of the captured image. The WB circuit 103d adjusts the white balance of the captured image by converting the levels of the pixel data of the R, G, and B color components using the level conversion table input from the overall control unit 108. γ
The correction circuit 103e corrects the γ characteristic of pixel data. The γ correction circuit 103e corrects the level of each pixel data using a preset correction table.

The image memory 103f is a memory for temporarily storing the image data for which signal processing has been completed. Image memory 1
03f has a capacity capable of storing at least two frames of image data. This is because exposure is performed twice in succession in shooting in the blur adjustment mode and the like, and image data for two frames is captured, so that these can be stored respectively.

The light emission control section 104 controls the light emission of the flash 5 based on the light emission control signal input from the overall control section 108. The light emission control signal includes a light emission preparation instruction, a light emission timing, and a light emission amount. When the light emission control unit 104 receives a light emission preparation instruction from the overall control unit 108, it charges the main capacitor (not shown) to enable light emission, and discharges the accumulated charge in the main capacitor in synchronization with the light emission timing signal. The flash 5 is fired. Then, the discharge of the accumulated charge of the main capacitor is stopped based on the light emission stop signal input from the overall control unit 108. This causes the flash 5 to emit a required amount of light.

The lens controller 105 controls the driving of each member of the focusing lens 101a, the zoom lens 101b and the diaphragm 101c in the lens 101.
The lens control unit 105 includes an aperture control circuit 105a that controls the aperture value of the aperture 101c, a focus control circuit 105b that controls the drive of the focus motor FM, and a zoom control circuit 105c that controls the drive of the zoom motor ZM.

The aperture control circuit 105a is the overall control unit 108.
The aperture 101c is driven on the basis of the aperture value input from, and the aperture amount is set to the aperture value. The focus control circuit 105b is an AF input from the overall control unit 108.
The drive amount of the focus motor FM is controlled based on a control signal (for example, a control value such as the number of drive pulses), and the focus lens is set at the focus position. Zoom control circuit 105c
Is a zoom control signal (4
The zoom motor ZM is driven based on (operation information of the serial switch 209) to move the zoom lens 101b in the direction designated by the quad switch 209. That is, the zoom control circuit 105c drives the zoom motor ZM in the positive direction to move the zoom lens 101b to the wide side when the right operation information of the quad switch 209 is input from the overall control unit 108. When the left operation information of the serial switch 209 is input, the zoom motor ZM is driven in the reverse direction to move the zoom lens 101b to the tele side.

The display section 106 performs display on the LCD display section 207 and display on the electronic viewfinder 4. The display unit 106 includes a display 106a and a VRAM 106b corresponding to the LCD display unit 207, and a display 106c and a VRAM 106d corresponding to the LCD display unit 401 in the electronic viewfinder 4.
The display 106a has, for example, 640 × 480 = 30.
The display 106c has a pixel count of 7200, and has a pixel count of 400 × 300 = 120,000, for example. Therefore, the VRAM 106b is the display 106a.
The VRAM 106d is capable of storing approximately 307,000 pixel data corresponding to the number of pixels of the display 106.
Corresponding to the number of pixels of c, approximately 120,000 pixel data can be stored.

During standby for shooting, the data of each frame image of the moving image, which is shot by the CCD 102a and stored in the image memory 103f after the predetermined signal processing, is sequentially read out to the overall control unit 108, and the data size is set to the display 10.
The display size is adjusted to 6c (that is, the image data of 1.92 million pixels is adjusted to the image data of approximately 120,000 pixels) and transferred to the VRAM 106d. As a result, the preview image of the subject is displayed on the display 106c (display surface of the LCD display unit 401) on the monitor. When the display switch 210d is instructed to display on the LCD display unit 207, the data of each frame image read on the overall display unit 108 is adjusted to the display size of the display 106a (that is, 1.92 million pixels). Image data is adjusted to approximately 307,000 pixel image data) VRA
The preview image of the subject is displayed on the monitor on the display 106a (display surface of the LCD display unit 207).

Further, when the menu display is instructed by operating the menu switch 210c, the image data of the menu screen stored in the ROM 108a in the overall control unit 108 is read out to the VRAM 106b, whereby the display content of the display 106a is changed to the menu. Switch to the screen.

In the reproduction mode, the thumbnail image of the photographed image is read from the image file of each frame recorded in the memory card MC by the overall control unit 108, arranged in a predetermined format, and image data for index display is created. , The image data is read to the VRAM 106b. As a result, a list of photographed images recorded in the memory card MC is displayed on the display 106a. When a frame to be reproduced is specified by operating the quad switch 209, the image data of the captured image recorded in the image file corresponding to the frame recorded in the memory card MC is read out and displayed on the display 106a. The display size is adjusted and transferred to the VRAM 106b.
As a result, the captured image is reproduced and displayed on the display 106a (display surface of the LCD display unit 207).

The operation unit 107 provides operation information of operation members provided on the camera body 2 for shooting and reproduction, to the overall control unit 1.
08 is input. The operation information input from the operation unit 107 includes a shutter button 206, a mode setting switch 208, a quad switch 209, a switch group 210,
The operation information of each operation member such as the power switch 211 is included.

The overall control unit 108 centrally controls the photographing function, the reproducing function and the image synthesizing processing function of the digital still camera 1. A memory card MC is connected to the overall control unit 108 via a card I / F 109. Further, an RTC 110 that measures the current time is connected to the overall control unit 108.

The overall control unit 108 is composed of a micro computer, and has a processing program for performing various concrete processes in the photographing function, the reproducing function, and the image synthesizing function, the above-mentioned image pickup unit 102, the signal processing unit 103, and the light emission. ROM storing a control program for controlling driving of the control unit 104, the lens control unit 105, the display unit 106, and the like.
108a and a RAM 108b for performing various arithmetic operations according to a processing program and a control program.

The specific processing performed by the overall control unit 108 includes exposure control values (exposure time Tv [AP of the CCD 102 a [AP
EX value] and aperture value Av of aperture 101c [APEX value])
(Exposure control value calculation process) from the CCD 102a to the image memory 1 in the recording mode
A process (image display process) of displaying a live view image captured in 03f on the electronic viewfinder 4 and displaying a captured image read from the memory card MC to the image memory 103f in the playback mode on the LCD display unit 207 (image display process) Image memory 1 from CCD 102a in mode
Processing for recording captured images captured in 03f in card memory MC (recording processing) Processing for reading captured images to be reproduced from memory card MC into image memory 103f in reproduction mode (reproduction processing) Continuous exposure in special photographing mode Processing to perform operations (special exposure control processing) Processing to combine two images taken in the special shooting mode to create an image with adjusted bokeh or an image with adjusted gradation (image combination processing), etc. Is included.

Exposure calculation unit 108c, display control unit 108
The d, the recording control unit 108e, the reproduction control unit 108f, the special exposure control unit 108g, and the image compositing processing unit 108e are functional blocks that represent the above-described processes in the overall control unit 108.

The exposure calculation unit 108c performs an exposure value calculation process. The exposure calculation unit 108c determines the brightness of the subject using the image data of the G color component of the live view image, and calculates the exposure control value based on the determination result. .

The display control unit 108d performs image display processing, and the display operation of the display unit 106, that is,
After the image data temporarily stored in the image memory 103f is read and the image size is adjusted to the image size of the display destination as necessary, the VRAM 106c or VRAM 10 is read.
The operation of transferring to 6d is performed.

The recording control unit 108e performs recording processing. When shooting is instructed by the shutter button 206 in the normal shooting mode, the recording control unit 108e reads out the image data (image data of a still image) temporarily stored in the image memory 103f to the RAM 108b after the shooting instruction, and for example, two-dimensionally. Image data for recording is created by performing a predetermined compression process by the JPEG system such as DCT conversion and Huffman coding. In addition, the pixel data is stored in the RAM from the image memory 103f every 8 pixels in both vertical and horizontal directions.
By reading out to 108b, a thumbnail image of 200 × 150 pixels is created. Further, tag information regarding a captured image recorded along with these recording image data is created. This tag information includes the lens name, frame number,
It includes a focal length at the time of shooting, an F number at the time of shooting, a focus position, a subject brightness, a white balance adjustment value, a shooting mode, a compression rate, a shooting date, whether or not a flash is emitted.

Then, the recording control unit 108e attaches tag information to the image data of the compressed photographed image and thumbnail image, and EXIF (Exchangeable Image File Format).
An image file of a format is created and this image file is recorded in the memory card MC.

Even in the blurring adjustment mode, gradation adjustment mode and super-resolution mode, the two captured images are
After D / D conversion, image files are created and recorded in the memory card MC.

In these photographing modes, since two photographed images A1 and A2 are generated by one shutter operation, uncompressed TIFF (Tag Image Fi) for each photographed image A1 and A2.
le format) format image files are created and recorded in the memory card MC. In addition, the captured image A1,
Since A2 is used to generate an image excellent in blurring, gradation, resolution, etc., the tag information of both image files includes information that can be recognized as a captured image for image combination. Further, since the photographed images A1 and A2 are for improving the image quality by image synthesis, all the pixel data are recorded as they are without performing the compression process which causes the deterioration of the image quality.

FIG. 9 shows an example of the structure of an image file recorded in the memory card MC.

In the figure, "P000001.TI
“F”, “P000002.TIF” and the like indicate image file names. In this embodiment, the image file name is "P
X. "PX.Y" is a 6-digit number indicating the order in which the image files were created.
“Y” is a symbol indicating the format of image data. The symbol "TIF" in "Y" indicates that the image file is in the TIFF format, and the symbol "JPG" indicates that the image file is in the JPEG format.

In the blur adjustment mode, gradation adjustment mode and super-resolution mode, two photographed images are continuously captured,
Since an image file is created for each of these image data and an image file is created for the image data that is combined in the image combining process, in the present embodiment, these image files are collected in one holder and stored in the memory card. It is designed to be recorded on the MC. Therefore,
“1b” and “2b”, “1t”, “2h”, etc. indicate the holder names of image files that have been captured and combined in the blur adjustment mode, gradation adjustment mode, and super-resolution mode, respectively.

In this embodiment, the holder name is "Ni".
, “I” of “Ni” is a symbol (b, t, h) indicating the type of special shooting mode, and “N” is a number indicating the shooting order in each shooting mode. For example, "1
"b" indicates that the holder stores the image data of the image first captured in the bokeh adjustment mode. "2b"
Indicates that the holder stores the image data of the second image captured in the blur adjustment mode.

Therefore, in FIG. 9, two holders 1b and 2b photographed and created in the blur adjustment mode and holders 1t and 1h photographed and created in the gradation adjustment mode and the super-resolution mode, respectively. This shows that the two image files 1n and 2n that have been shot and created in the normal shooting mode are collected in the holder P and stored in the memory card MC.

Further, for example, the image files "P000001.TIF" and "P0000" included in the holder 1b are included.
02. “TIF” indicates an image file of the first captured image and the second captured image captured in the blur adjustment mode, respectively, and the image file “P000003.
“JPG” indicates that the image file is a composite image. Similarly, the image file “P000009.JPG” included in the holder 1t also indicates an image file of a composite image of two captured images captured in the gradation adjustment mode,
The image file "P00001" included in the holder 1h
2. "JPG" also indicates an image file of a composite image of two shot images shot in the gradation adjustment mode.

FIG. 10 is a diagram showing a method of recording an image file in the memory card MC.

An index area for storing holder information and information of image files belonging to each holder is provided in the top storage area of the memory card MC, and each image file is stored in the subsequent area in the order of file number X. There is.
The recording area of each image file consists of three areas, and tag information data, photographed image data, and thumbnail image data are stored in each area from the top.

Note that FIG. 10 shows an example of the tag information of the first photographed image photographed in the blur adjustment mode. In the case of a composite image, the tag information includes lens name, photographing focal length, and focus. Information such as position, subject brightness, and white balance is not included, but information that the image is a blur-adjusted image (composite image), composition completion, or composition in progress is included.
As will be described later, when the image synthesizing process is performed in the standby mode, when the release instruction is input during the synthesizing process, the synthesizing completion / during synthesizing information is interrupted and the image in the synthesizing process is displayed. Since the data of the composite image may be temporarily stored in the memory card MC, it is recorded so that it can be identified whether the data of the composite image is the composition completion data or the data in the middle of composition.

Returning to FIG. 8, the reproduction control unit 108f controls the LCD display unit 207 of the photographed image recorded in the memory card MC.
The reproduction processing is performed on the. Reproduction control unit 108f
When the reproduction mode is set by the mode setting switch 208, the thumbnail image is read from each image file recorded in the memory card MC and sequentially stored in the VRAM 106b according to a predetermined index format. For example, 9 thumbnail images are 3 per page.
The data is stored in the VRAM 106b so as to be secondarily arranged in × 3. Therefore, this makes it possible to display nine 2
The three-dimensionally arranged thumbnail images are displayed as an index.

Regarding the paired image files whose shooting modes are the blur adjustment mode, gradation adjustment mode, and super-resolution mode, the same thumbnail image is stored in both image files, so one image Thumbnail images are read from only files.

When the thumbnail image of the frame to be reproduced with respect to the thumbnail image displayed in the index is designated by the quad switch 209 and the switch group 210, the reproduction processing unit 108f causes the captured image from the image file corresponding to the frame. When the frame is in the normal shooting mode, the data is compressed, so the data is compressed and stored in the image memory 103f after the predetermined expansion processing.
If the frame is not in the normal shooting mode, the data is not compressed and is stored in the image memory 103f as it is. The data read out to the image memory 103f is adjusted in data size by the display control unit 108d as described above and transferred to the VRAM 106b, whereby it is reproduced and displayed on the LCD display unit 207.

When the frame to be reproduced is a frame photographed in the blur adjustment mode, if a combined image file exists, data is read from the image file and the combined image file is read. If there is no image data, the image data is read from the image file of the in-focus image (the image captured in the second time as described later in this embodiment).

The special exposure control unit 108g is a CCD when the shutter button 6 is fully pressed in the state where the blur adjustment mode, gradation adjustment mode and super-resolution mode are set.
The exposure operation of 102a is controlled. The special exposure control unit 108g basically captures images for image composition when the S2 switch is turned on, and therefore the continuous exposure of the CCD
The exposure operation of 102a is repeated twice.

The image synthesizing processor 108e is the ROM 108.
By executing the image synthesizing processing program stored in a, two photographed images photographed in the special photographing mode are synthesized to create one image. The image composition processing program includes a blur adjustment program, a gradation adjustment program, and a super-resolution program.
By executing the bokeh adjusting program, two shot images taken in the bokeh adjusting mode are combined to create an image having a desired blur condition. Similarly, in gradation adjustment, a gradation adjustment program is executed to combine two captured images taken in the gradation adjustment mode to create an image having a desired gradation. In super-resolution adjustment, super-resolution is used. By executing the image program, the two captured images captured in the super-resolution mode are combined to create a high-resolution image.

As described above, the processing timing of these image synthesizing processes can be selected by the operator, and if "execute after photographing" is set, for example, in the case of the blur adjustment process, the blur adjustment mode is set to 2 When one shot image is recorded in the memory card MC, these shot images are continuously read out from the memory card MC, and an image having a desired blur condition is created by executing the blur adjusting program.
The image is recorded on the memory card MC. On the other hand, if "Execute during standby" is set, for example, in the case of blur adjustment processing, when the camera is in the standby state described later after the shooting processing in the blur adjustment mode ends, the memory card Two shot images taken in the blur adjustment mode are read from the MC, the blur adjustment program is executed to create an image having a desired blur condition, and the images are recorded in the memory card MC. The same applies to gradation adjustment processing and super-resolution processing.

FIG. 11 is a diagram for explaining the relationship between the state transition of the camera and the image synthesizing process. It should be noted that this figure shows the case where execution of image combining processing is set in standby.

In the figure, the arrows indicate the direction in which the state transitions, and the items described above each arrow are the conditions under which the transition of the arrow occurs. If the operation information of the switches is not input from the operation unit 107 for 5 minutes or more in the state where the “recording mode” is set, the operation mode is changed to the standby mode (transition), and the operation information of the switches is operated from the operation unit 107 in the standby mode. When is input, a transition is made to the recording mode (transition). The standby mode is a mode in which the power supply from the power supply unit 111 to the imaging block A to the control block D is stopped or reduced to a necessary minimum to suppress the power consumption, and is a state of the camera at the standby time. Therefore, in the recording mode, if no operation is performed for 5 minutes or more, the state of the camera shifts to the standby mode to save power, and the photographing operation is not performed in this state, which imposes a processing load on the overall control unit 108. The large image composition process is started. Therefore, even in the standby mode, the power supply unit 11 supplies the control block D with power for image synthesis processing.

If the power switch 211 is operated while the image compositing process is being executed in the standby mode and an instruction to turn off the power is input from the operation unit 107, the operation of the power switch 211 becomes invalid (transition), After the image composition processing is completed, the power is turned off (transition). This is because if the power-off process is executed immediately according to the power-off instruction, the image composition process is interrupted, which is not preferable.

On the other hand, when the mode setting switch 208 is operated while the image synthesizing process is being executed in the standby mode and an instruction to change to the reproduction mode is input from the operation unit 107, it is referred to as the change to the reproduction mode. In order to realize a good response to the operation of the operator, the image synthesizing process is immediately interrupted, and the RA including the image data being processed is RA.
The data in the area 4 (FIG. 13) of M108b is recorded in the memory card MC as a temporary file, and transitions to the reproduction mode (transition).

In the photographing mode, if a power-off instruction is input from the operation unit 107 before the lapse of 5 minutes, the power is immediately turned off, and the power is turned off from the operation unit 107 in the power-off state. When the instruction is input, if the mode setting switch 208 is set to the shooting mode, the camera is activated and the mode is changed to the shooting mode (transition).

The transition relations between the "playback mode" and the "standby mode" and "power OFF state" are the same as those of the "shooting mode", "standby mode" and "power OF" described above.
It is the same as the transition relation between the “F state”. The transitions '~' related to the playback mode correspond to the transitions ~ related to the shooting mode, respectively, and the transition condition of each transition '~' is the same as the transition condition of the corresponding transition ~. Therefore, the description of the transition relation among the “reproduction mode”, the “standby mode”, and the “power OFF state” is omitted.

Next, the processing procedure related to the timing of the image synthesizing processing according to the present invention will be described with reference to the flowcharts of FIGS. 12 and 14 to 16. In this flowchart, the case where the blur adjustment mode is set will be described as an example.

First, the processing in the recording mode will be described. When shifting to the recording mode, first, the RAM 108
An area required for processing in the recording mode is set in the storage area of b (# 1).

FIG. 13 shows areas allocated to the RAM 108b according to the recording mode, the photographing mode, and the standby mode. In the figure,
Area 1 is a common area that is required in any processing such as shooting, reproduction, and image composition. Area 2 is an area required for performing a shooting process in the recording mode, and area 3 is an LCD of a shot image in the playback mode.
This is an area required for performing a reproduction process on the display unit 207 or the LCD display unit 401. Area 4 is an area required for performing image combining processing in the standby mode.

Therefore, when shifting to the recording mode, first,
Areas 1 and 2 of the RAM 108b are allocated as areas for processing in the recording mode (# 1). Then, it is determined whether or not the image capturing block A and the display block B are supplied with power from the power supply unit 111 (# 3, # 7), and the blocks that are not supplied with power are supplied with power from the power supply unit 111. A and the display block B are activated (# 5, # 9). The imaging block A and the display block B are activated because the shooting process and the display process of the live view image on the LCD display unit 207 or the LCD display unit 401 are performed in the recording mode.

Subsequently, the live view image is displayed on the LCD display unit 207 or the LCD display unit 401 (finder display process) (# 11). In this process,
An image of the subject is captured by the CCD 102a every 1/30 seconds, and predetermined image processing is performed by the signal processing unit 103, and then displayed on the LCD display unit 207 or the LCD display unit 401. Then, when the state where no operation is performed continues for 5 minutes or more after starting the display of the live view image (NO in # 13, YES in # 29), the storage area of the RAM 108b allocated in step # 1 is released. Done (#
31), shift to standby mode.

On the other hand, the shutter button 206 is operated 5 minutes before the display of the live view image is started,
When the switch S1 is turned on (YES in # 13),
According to the flowchart shown in FIG. 4, the shooting process in the blurring adjustment mode is performed (# 15).

First, preparations are made for photographing a still image in the blur adjustment mode. That is, the aperture 101c
The aperture value is set to an open aperture value (for example, F = 2.8) (# 15-1), and the focus of the lens 101 is adjusted to the ∞ position (# 15-2). Further, the exposure time of the CCD 102a is set, and white balance adjustment is performed (# 1
5-3).

Subsequently, it is judged whether or not the shutter button 206 is fully pressed (# 15-4), and if the shutter button 206 is not fully pressed (NO in # 15-4), the routine returns. When the shutter button 206 is fully pressed (YES in # 15-4), the CCD 102a is stepped #
A still image of the subject is captured by performing exposure for the exposure time set in 15-3 (# 15-4). After exposure, CC
The image signal output from D102a is the signal processing unit 103.
Then, predetermined analog signal processing, A / D conversion, and predetermined digital signal processing are performed and stored in the image memory 103f. In this captured image, the focus of the lens 101 is adjusted to the infinity position, so the background of the screen is in focus and the main subject such as a person in the screen is out of focus.

Next, the recording control unit 1 of the overall control unit 108
08e creates tag information data,
Image data of the thumbnail image is created using the image data stored in the image memory 103f, an image file is created from these data and the image data stored in the image memory 103f, and stored in the memory card MC ( # 15-6). It should be noted that in the shooting mode of the tag information for this shot image, there is information indicating that it is the first shot in the bokeh adjustment mode, such as "bokeh adjustment mode 1/2" (see FIG. 9). Granted.

The information on the photographing mode is included in the tag information in order to distinguish it from the photographed image in the normal photographing mode. The same applies to the second captured image captured in the blur adjustment mode.

Then, the focus of the lens 101 is, for example, 3
It is adjusted to the position of m ahead (# 15-7), and further CCD10
The exposure time of 2a is set and the white balance is adjusted (# 15-8).

Then, the CCD 102a is moved to step # 15.
A still image of the subject is captured by exposing for the exposure time set in -8 (# 15-9). After exposure, CCD1
The image signal output from 02a is subjected to predetermined analog signal processing, A / D conversion, and predetermined digital signal processing in the signal processing unit 103 and stored in the image memory 103f. In this photographed image, the focus of the lens 101 is adjusted to 3 m ahead, so that the main subject in the screen is almost in focus.

Subsequently, the display controller 1 of the overall controller 108
Image data is read from the image memory 103f to the RAM 108b by 08d, the data size is adjusted, and then transferred to the VRAM 106b to be displayed on the LCD display unit 207.
Is displayed on the screen (# 15-10). This display process is to enable you to monitor the captured image immediately after shooting.
After a lapse of a predetermined time (for example, 2 seconds), the live view image is switched to.

The recording controller 10 of the overall controller 108
The tag information data is created by 8e, and the image data of the thumbnail image is created using the image data stored in the image memory 103f. The tag information shooting mode for this shot image is provided with information indicating that the image was taken a second time in the bokeh adjustment mode, such as “bokeh adjustment mode 2/2”. Then, an image file is created from these data and the image data stored in the image memory 103f and stored in the memory card MC (# 15-11).

In this embodiment, the distant view side is first focused on, and then the near view side is focused on the second time. However, the order of changing the focus position may be reversed. Good. Further, when shooting is performed in the bokeh adjustment mode after the camera is activated, the focusing lens 10 is activated when the camera is activated.
Since 1a is initially set to the infinity position, it is more rational to focus on the distant view side in the first shooting without waste of focus control.

In the second shooting, the in-focus position is fixed at a position 3 m from the camera. However, this is because a blurred image adjusting process creates a combined image in an arbitrary focus state, so that the shooting before combining is performed. This is because it is not necessary to accurately determine the in-focus position of the image and that the focus control processing time should be as short as possible so that continuous shooting can be performed quickly. The distance from the camera may be fixed to another distance, or the distance to the main subject may be accurately determined by AF processing.

Returning to FIG. 12, when the photographing processing in the blurring adjustment mode is completed, it is judged whether or not the photographed image is captured in this photographing processing (# 17), and if the photographed image is not captured (in # 17). NO), and returns to step # 11. Therefore, if the shutter button 206 is half pressed, step # 11 → step # 13 → step # 15-1.
The loop process of # 15-4 → step # 17 → step # 11 is continued, and the release standby state is entered.

In step # 15, if the photographed image is captured by the photographing processing in the blurring adjustment mode (YES in # 17).
S), it is determined whether or not the timing of the image combining process is set to “execute in standby” (# 19),
If it is set to "Execute after shooting" (N in # 19
O), the memory for recording processing is released (# 20), and after the image composition processing (bokeh adjustment processing) in the blur adjustment mode described later is executed (# 21), the memory for recording processing is reopened. It is assigned (# 22), and the process proceeds to step # 23. On the other hand, if the timing of the image compositing process is set to "execute during standby" (YES in # 19), the process proceeds to step # 23 without performing the image compositing process.

When the process proceeds to step # 23, it is determined whether or not the recording mode is maintained. If the recording mode is maintained (NO in # 23), the process returns to step # 11 to wait for the next photographing. Becomes If the mode has been changed to the reproduction mode (YES in # 23), the storage area allocated to the RAM 108b is released (# 25), and the mode shifts to the reproduction mode described later.

Next, the processing in the standby mode will be described. When shifting to the flowchart of the standby mode shown in FIG. 15, it is determined whether or not the image pickup block A and the display block B are supplied with power from the power supply unit 111 (# 41, # 45). The power supply to is stopped (# 43, # 47). The power supply to the imaging block A and the display block B is stopped because the standby mode is a mode in which the power supply is reduced to the necessary minimum and the power consumption is suppressed. In this embodiment, the standby mode is a state in which the image capturing block A and the display block B are not supplied with power for 5 minutes or more, but the present invention is not limited to this, and the standby mode is a power saving state. If so, the standby mode may be used.

Subsequently, it is judged whether or not the timing of the image synthesizing process is set to "execute in standby"(# 49), and if it is not set to "execute in standby" (NO in # 49), step The process proceeds to # 65 (FIG. 16). If it is set to "Execute during standby" (YES in # 49), there is an image file in the memory card MC for which the bokeh adjustment processing has not been performed or a temporary file for which the bokeh adjustment processing has been interrupted and which has not been processed. Whether or not to do so is determined (# 51), and if neither file exists (NO in # 53), there is no need for image combining processing, and the process moves to step # 65 (FIG. 16).

If there is an image file for which the blur adjustment processing has not been performed or a temporary file in the middle of blur adjustment is present in the memory card MC (YES in # 53),
First, the power supply state of the power supply unit 111 is confirmed in order to perform the image combining process on the file (# 55).
That is, the main power source of the power source unit 111 is the AC adapter 113.
Is determined (# 57), the AC adapter 11
When the power is supplied from 3 (YES in # 57), the power supply capacity is sufficient, so the process proceeds to step # 63,
Image synthesis processing in the blur adjustment mode described below is performed. On the other hand, when the main power source of the power source unit 111 is the battery 112 (NO in # 57), the voltage value of the battery 112 is confirmed (# 59), and it is determined from the voltage value that there is sufficient power supply capability. Then (YES in # 61), the process proceeds to step # 63, and the image synthesizing process in the blur adjustment mode is performed. If it is determined from the voltage value of the battery 112 that there is not sufficient power supply capability (NO in # 61), step # 63 is skipped and step # 6 is performed without performing image combining processing.
5 (FIG. 15).

The image synthesizing process is not performed when the power supply capacity is not sufficient. It is possible to prevent the process from being interrupted due to insufficient power during the image synthesizing process. This is to prevent the reliability of the bokeh adjustment processing) from decreasing.

When the process proceeds to step # 65, it is determined whether or not the non-operation state continues for 3 minutes (# 65, #
(Loop of 67), when 3 minutes have passed without any operation (YES in # 65), the power supply to the blocks A to C is stopped, and only the control block D is supplied with the minimum necessary power supply to enter the standby state. (# 69). On the other hand, if the switch operation is performed before the lapse of 3 minutes (YES in # 67), it is determined whether or not the operation is the operation related to the recording mode (# 71), and if the operation is related to the recording mode (# 71).
If YES in step # 71, the recording mode is entered, and if the operation is related to the playback mode (NO in # 71), the mode is entered.

Next, step # 21 or step #
The image composition process (bokeh adjustment image creation process) executed in 63 will be described.

First, the method of creating the blurring adjustment image used in this embodiment will be briefly described. Using two images with different focus states (for example, as shown in FIG. 17, the near view is focused, the distant view is the out-of-focus focused image Ir and the distant view is focused, and the near view is the out-of-focus image If) Various methods are known as a method for creating an image I in an arbitrary focused state, but basically, alignment between two images Ir and If (registration processing) and predetermined arithmetic processing are performed. This is composed of two steps of creating a blurring adjustment image (image synthesizing process).

The registration process aligns the positions of both images to be combined in order to accurately combine the same symbols on the screen in the image combining process. The registration process is performed in two stages: registration of the entire image (coarse registration) and subsequent local registration (fine registration).

In the registration of the entire image, for example, the far-field focused image If is enlarged / reduced, translated, rotated, or the like while the near-field focused image Ir is used as a reference, and both images Ir,
If is collated, the enlargement ratio, the translation amount, the rotation angle, etc. of the distant view focused image If in which both images Ir and If match is calculated. The degree of matching of the distant view focused image If to the near view focused image Ir is evaluated by calculating the root mean square value ΔV of the level differences of corresponding pixels between the images and using the sum ΣΔV of these as an index. Values such as an enlargement ratio, a parallel movement amount, and a rotation angle that minimize the total sum ΣΔV are calculated as image alignment information.

The local registration processing is to correct the positional deviation for each pixel between the in-focus image Ir of the near view and the in-focus image If of the far image in which the entire image is registered. This correction is performed for both images within r × r pixels centered on the pixel position (x, y) of the near-field focused image If and the pixel position (x + m, y + n) of the distant-view focused image If that is the entire image registered. 2 of the level difference of the corresponding pixel
This is performed by calculating the multiplicative mean value and further calculating the parameter (m, n) that minimizes the r × r total sum.
When the parameter (m, n) is calculated for all pixels and the distant view focused image If is corrected using this parameter (m, n), finally the near focus image Ir is aligned. The distant view image image If is obtained.

The registration process is not necessarily required if the near-field focused image Ir and the distant-view focused image If are exactly the same. However, in the case of images photographed at different times, such as photographed images, they are continuously processed. Even if a subject is photographed, it is usual that the subject is slightly displaced in the screen, so that the registration process is always performed in this embodiment.

As the image synthesizing process, various methods such as a segment method, an iterative method and an inverse filter method are known. In the present embodiment, the iterative method is adopted.

As shown in FIG. 17, the function g1 (x, y) representing the in-focus image Ir of the foreground is f1 (x, y) representing the in-focus region of the in-focus position, and the in-focus distant view. Let f2 (x,
y), h is a function that represents the degree of blurring of the distant view area that is out of focus
If 2 (x, y), then g1 (x, y) = f1 (x, y) + h2 (x, y) .f2 (x, y) ... (1)

Similarly, a function g2 representing the distant view focused image Ir
Let (x, y) be h2 (x, y) = f2 (x, y) + h1 (x, y). It is represented by f1 (x, y) ... (2).

On the other hand, the bokeh adjustment image I is the close-focused image I.
If it is created by synthesizing an image in which the near view region of r is blurred with the blur function ha (x, y) and an image in which the distant view region of the distant view focused image If is blurred with the blur function hb (x, y) are created, The function f (x, y) representing the bokeh adjustment image I is f (x, y) = ha (x, y) .f1 (x, y) + hb (x, y) .f2 (x, y) ... (3)

As for the blurring functions h1 and h2, the function h representing the degree of blurring is represented by h (x, y) = (1 / πR ² ) · exp (-(x ² + y ² ) / R ² ) ... ( 4) R: Assuming that it is represented by a two-dimensional Gaussian function of the blur amount (blur radius), it can be estimated from the near view region image of the distant view focused image If or the distant view region image of the near focused image Ir. In the case of a shot image, the amount of blur can be calculated from the in-focus position of the shooting lens.
In the present embodiment, the setting is performed by referring to a table that is set in advance based on the type of photographing lens included in the tag information of the image file and the focal length information at the time of photographing. Further, default values are set in advance for the blur functions ha and hb.

From equations (1) to (3), f1 (x, y) and f2 (x, y)
When is deleted, the relational expression among the function g1 (x, y) of the near-field focused image Ir, the function g2 (x, y) of the distant-view focused image If, and the function f (x, y) of the bokeh adjusted image I. (Ha-hb ・ h1) ・ g1 + (hb-ha ・ h2) ・ g2 ＝ (δ-h1 ・ h2) ・ f… (5) is obtained. In the equation (5), δ is a Dirac delta function. Further, in the expression (5), the variable (x, y) portion of the function notation is omitted for convenience. Variable (x, y)
The part of is omitted and each function is described.

Therefore, by solving the equation (5), it is possible to obtain the function f indicating the blurring adjusted image I. In the iterative method, the left side of equation (5) is g = (ha-hb · h1) · g1 + (hb
-ha · h2) · g2, the initial value f ^{(0) of the} function f representing the bokeh adjustment image (for example, the functions g1, g2, (g1 + g2) / 2 etc.)
Is set appropriately and g + h1 · h2 · f ^(K) = f ^{(K + 1)} (k =
0,1,2, ...) is repeated, k → ∞ f
^{Since (} ∞ ⁾ converges to f that satisfies the equation (5), this is a method of obtaining the solution of the equation (5) by repeating this iterative calculation. Therefore, the bokeh adjustment image I having a desired degree of blur is calculated by repeating the iterative calculation of g + h1 · h2 · f ^(K) .

Next, the image synthesizing process for blurring adjustment will be specifically described with reference to the flowcharts of FIGS.

When moving to the image synthesizing process, first, the RAM
Area 4 of 108b is allocated as a storage area for image composition processing (# 81). Then, it is determined whether or not there is a temporary file in the process of adjusting the bokeh (#
83), if there is a temporary file (Y in # 81)
ES), the data of the temporary file is read into the area 4 of the RAM 108b to restart the image combining processing for the image data in the process included in the file (# 85), and the blurring is caused according to the flowcharts of FIGS. Adjustment processing is performed (# 87).

The image composition processing in step # 21 is as follows.
Since the image composition processing is performed after shooting,
The two image files P (X + 1). T
IF, PX. The TIF exists, and the image data of the R, G, and B color components of the photographed images (the distant view focused image A1 and the near view focused image A2) are stored in the RAM 10 from these image files.
The data is read out to the area 4 of 8b (# 85), and is read in FIGS.
The blur adjustment processing is performed according to the flowchart of (# 87).

On the other hand, if there is no image file for which the blur adjustment processing has not been performed and no temporary file in the middle of the blur adjustment is present in the memory card MC (N in # 83).
O), since there is no data for image composition processing,
Skip steps # 85 and # 87 and skip step # 91
Move to.

Flow chart of the blur adjustment processing shown in FIG.
First, it is a new bokeh adjustment process
It is determined whether or not (# 101). This judgment is RAM1
The image data file expanded to 08b is a temporary file.
It is determined by whether it is a file. New bokeh adjustment center
If it makes sense (YES in # 101), two captured images
There is a shortage of image data for the G color components of A1 and A2.
The image data of the pixel position to be interpolated is interpolated (# 105, # 1
07). That is, in this embodiment, single-plate color imaging is performed.
Blurring adjustment processing for a captured image captured by the element 205
As shown in FIG. 21A, the color component of G
Image data of (2h + 2, 2k + 1) and (2h + 1,
2k + 2) (h = 0,1,2 ... n / 2, k = 0,1,
2, ... m / 2), it exists only at pixel positions,
As shown in (b), the pixel positions (2h + 1, 2k + 1),
The image data G'is interpolated into (2h + 2,2k + 2).
It The interpolation processing of this image data G'is, for example,
Image of adjacent pixel position as image data of pixel position
This is performed by calculating the average value of the data G. An example
For example, the image data G at the pixel position (2, 2)_2,2Is the pixel position
Image of (2,1), (1,3), (3,2), (2,3)
Image data G_2,1, G_1,3, G_3,2, G_2,3Using G _2,2=
(G_2,1+ G_1,3+ G_3,2+ G_2,3) / 4 calculated
It

Subsequently, initial values (δx0, δy0) of the shift amount in the registration process between the photographed image A1 and the photographed image A2 are set (# 109). This initial value (δx0, δy0) is set to an appropriate value in advance. Subsequently, a registration process is performed between the photographed image A1 and the photographed image A2 using the image of the G color component (# 111), and the photographed image A2 with respect to the photographed image A1.
The shift amount (δx, δy) is determined (# 113).

Then, the images of the R, G, and B color components of the photographed image A2 are moved by the amount of displacement (δx ', δy') as a whole to align the photographed image A1 and the photographed image A2. (# 115), the image files P (X + 1). T
IF, PX. The ROM 1 is preliminarily based on the type of the photographing lens and the focal length information at the time of photographing included in the TIF tag information
08a, the blur amount r1 of the photographed image A1 and the blur amount (blurring radius) of the photographed image A2 are referred to.
r2 and r2 are set (# 117).

Subsequently, with respect to the image data of the R and B color components of the two photographed images A1 and A2, the image data at the pixel positions where the image data does not exist is thinned out to create the image data for the repetitive calculation processing (# 119- # 125). For example R
In the case of the color component of (2h +
Since there is image data only in the pixel positions of (1, 2k + 1), the image data in the pixel positions other than this are thinned out and reduced to the image size of n / 4 × m / 4 as shown in FIG. Image data for iterative calculation processing is created. Similarly, for the B color component, since image data exists only at pixel positions (2h + 2, 2k + 2), image data at pixel positions other than this is thinned out and reduced to an image size of n / 4 × m / 4. Image data for iterative calculation processing is created.

As described above, image data is interpolated for all pixel positions for the G color component and the pixel positions having no image data are thinned out for the R and B color components before the iterative calculation for blurring adjustment is performed. This is because the G color component has a significant effect on the resolution, whereas the R and B color components have a small effect on the resolution and a large effect on the tint. Is taken into consideration.

Generally, in digital image processing, the higher the resolution, the more accurate the processing result can be obtained, but the number of data to be processed becomes huge and the processing time becomes long. Therefore, it is necessary to reduce the number of data to be processed and shorten the processing time as much as possible in relation to the acceptable quality of the processing result, and also from the viewpoint of operability and power saving. .

In the bokeh adjustment processing by the iterative method,
Since it is required in terms of quality that the degree of bokeh adjustment can be recognized as accurately as possible, the image data of the G color component, which has a large effect on it, is interpolated to produce image data at all pixel positions. However, the processing time can be increased by excluding the image data at the pixel position where the image data originally does not exist from the calculation target for the image data of R and B, which has little influence on the degree of blur adjustment. I try to keep it as short as possible.

As a result, the blurring adjustment processing is performed by interpolating the image data at all pixel positions for the R and B color components as well as the G color component without affecting the quality of the blurred state after the processing. The blurring adjustment processing can be performed at a higher speed than that.

Subsequently, the bokeh adjustment image Ac is obtained by the iterative method.
The count value n of the counter that counts the number of iterative calculations when calculating is reset to "0"(# 127), and in steps # 129 to # 145, the iterative method is used for each image of the R, G, and B color components. Blurring adjustment processing is performed.

On the other hand, when it is not a new blur adjustment process (that is, the process is interrupted by the previous blur adjustment process) (NO in # 101), the process is continued and the number of repetitive calculations is increased. The count value n of the counter that counts is set to the number of times (n + 1) obtained by incrementing the iterative calculation count n executed in the previous processing by 1 and the process proceeds to step # 129 (# 103).
In step # 145, the blur adjustment processing is performed by the iterative method for each image of the R, G, and B color components.

When the process proceeds to step # 129, the blur amounts are set to r1 and r2, and f ⁽¹⁾ representing the first blur adjustment image Ac for each color component of G is f ⁽¹⁾ = g + h1 · h
It is calculated by 2 · f ⁽⁰⁾ (# 131). Also, the blur amount is set to r1 / 2 and r2 / 2 (# 133), and R and B are set.
For each color component, f ⁽¹⁾ representing the first-time blurring adjustment image C is calculated by f ⁽¹⁾ = g + h1 · h2 · f ⁽⁰⁾ (# 135, # 137). If it is not a new process, the blur amounts (r1, r2), (r1 / 2, r2 / 2) for the R, G, and B images have been set in the previous process, so steps # 129, # are performed. In 133, the set value is set as the blur amount.

Here, the function f ⁽⁰⁾ is an initial value of the function f representing the blurring adjustment image Ac, and is, for example, the average value (g1 + g of the function g1 representing the photographed image A1 and the function g2 representing the photographed image A2.
2) / 2. Further, the blurring functions h1 and h2 are calculated by adding the blurring amount R in the above equation (4) to the steps # 129 and # 1 respectively.
This is a blur function obtained by substituting the blur amounts r1, r2 or r1 / 2, r2 / 2 set at 33. Further, the function g includes blur functions ha and hb obtained by substituting the default values ra and rb of the preset blur amounts into the blur amount R of the above equation (4), the blur functions h1 and h2, and the image function, respectively. g1, g2
And g = (ha-hb · h1) · g1 + (hb-ha · h2) · g2.

The blur amount for the image of the R and B color components is ½ of the blur amount for the image of the G color component because the data size of the image of the G color component is full size. On the other hand, the image of R and B color components is processed in step # 1.
19 to # 125, 1 for the full size
This is because the size is reduced to / 2 x 1/2. When the R and B color component data sizes are reduced to 1 / s × 1 / s with respect to the full size, the blur amounts for the R and B color component images are r1 / s and r2 / s. .

Subsequently, it is sequentially determined whether or not the iterative operation result has converged during the iterative operation, and whether or not the iterative operation number n has reached the set predetermined number N (# 139, #
141), the iterative calculation result has converged (Y in # 139).
ES), or if the number of times n of repetitive calculations exceeds the set number of times N (YES in # 141), the blurring adjustment processing is ended, and the process proceeds to step # 147.

When the blurring adjustment processing is completed (# 139,
(YES in # 141), and then interpolation processing is performed on the image data of the R and B color components of the blurring adjustment image Ac (# 147 and # 149). This interpolation process is performed by R, B
Since the data size of the bokeh adjustment image Ac of the color component is reduced by the thinning process, it is restored to full-size image data. For example, the bokeh adjustment image Ac of the R color component corresponds to the pixel position of each pixel data R (2h + 1, 2k + 1) as shown in FIGS.
After returning to the pixel position of, the image data R'is used to interpolate the image data R'of the pixel position where the data is insufficient as shown in FIG. The interpolation of the image data R ′ is performed in the same manner as the above-described interpolation method of the image data of the G color component. Interpolation processing is performed on the bokeh adjustment image Ac of the B color component in the same manner.

Then, the blur adjustment images Ac of the R, G, and B color components are combined (# 151), and the blur is adjusted by a predetermined compression method (JPEG method or the like) at a predetermined compression rate set in advance. The image data of the adjusted image Ac is compressed (# 15
3) Then, it is saved in the memory card MC with the set file name (# 155), the image synthesizing process in the blurring adjustment mode is ended, and the process returns.

On the other hand, if the number of repeated calculations n has not reached the predetermined number N (NO in # 141), it is determined whether or not a switch operation has been performed (# 143). This determination of the switch operation is performed in the case where the image combining process is performed after the shooting, and when the next release operation or the like related to the shooting is performed during the image combining process, the image combining process is interrupted. This is to prioritize the processing according to the operation and prevent the deterioration of the responsiveness of the original photographing function of the camera. The same applies when performing image composition processing during standby, and if any switch operation is performed, the mode changes from standby mode to shooting mode or playback mode, and priority is given to the processing according to the transitioned mode, and the original shooting function and playback of the camera are performed. This is to prevent a decrease in responsiveness of the function.

If there is no switch operation (# 143: N
O), the count value n of the counter is incremented by 1 (# 145), the process returns to step # 129, and the next blurring adjustment calculation is performed. That is, in the case of the second time,
Using f ⁽¹⁾ representing the first bokeh adjustment image Ac, f ⁽²⁾
= G + h1 · h2 · f ⁽¹⁾ is calculated (# 129 to # 1)
37).

If there is a switch operation (Y in # 143
S): In order to prioritize the processing according to the switch operation over the image composition processing, the iterative calculation processing is interrupted and the processing returns.

Returning to FIG. 18, when the image synthesizing process in the blurring adjustment mode is completed, it is judged whether or not the image synthesizing process is completed (# 89), and if the image synthesizing process is completed (# 89). If YES in 89), the storage area allocated to the RAM 108b for the image combining process is released (# 9).
1) Return.

On the other hand, if the image synthesizing process is interrupted (NO in # 89), a temporary file is created for the image data being processed which is stored in the RAM 108b, and the file is stored in the memory card MC. At the same time (# 93), the storage area allocated to the RAM 108b for the image composition processing is released (# 95).

Subsequently, it is determined whether or not the switch operation that interrupted the image synthesizing process (the switch operation determined in step # 143) is related to the recording mode (# 9).
7) If it is related to the recording mode (YE in # 97)
S), shift to the recording mode, and if it relates to the playback mode (NO in # 97), shifts to the playback mode.

Next, the processing of the reproduction mode will be concretely described with reference to the flowchart of FIG.

When the playback mode is entered, the RAM 1 is first
An area required for processing in the reproduction mode is set in the storage area of 08b (# 151). That is, area 1 and area 3 of the RAM 108b are allocated as storage areas for processing in the reproduction mode. Subsequently, it is determined whether or not the image pickup block A and the display block B are supplied with power from the power supply unit 111 (# 153, # 157), and if the image pickup block A is supplied with power (YES in # 153), the power supply is performed. Is stopped (# 155), and if the display block B is not powered (NO in # 157), the display block B is powered and activated.

The power supply to the image pickup block A is stopped by
This is because the photographing operation is not performed in the reproduction mode, so that the power supply to the imaging block A is stopped to prevent unnecessary power consumption. Power is supplied to the display block B in order to reproduce the captured image on the LCD display 207 or the like in the display block B.

When display block B is activated, reproduction processing is subsequently performed (# 161). In this playback process, L
The CD display unit 207 displays the index of the photographed frames recorded in the memory card MC (an array of thumbnail images of the photographed frames is displayed). The operator operates the quad switch 209 and the confirm switch 210b to display the reproduced frames. When the selection is made, the image data from the image file corresponding to the frame in the memory card MC is transferred to the RAM 10
8b, the image data is expanded and the image size is adjusted, and then transferred to the VRAM 106b to reproduce the reproduced frame on the LCD display unit 207. Regarding the image captured in the bokeh adjustment mode, the bokeh adjustment image Ac is L when the image combining process is performed.
The image is reproduced on the CD display unit 207, but if the image combination processing is not performed, the close-range in-focus image A2 (image focused on the main subject such as a person) is reproduced on the LCD display unit 207.

Subsequently, it is determined whether or not the mode setting switch 208 has been operated (whether the recording mode has been changed) (# 165). If the mode setting switch 208 has not been operated (NO in # 163). Then, it is determined whether or not 5 minutes have passed without any switch operation (# 16
7) If there is a switch operation related to the playback mode before 5 minutes have passed (NO in # 167), the process returns to step # 161,
Reproduction processing is performed according to the switch operation.

In the reproduction mode, when the mode setting switch 208 performs a change operation to the recording mode (# 163), the storage area allocated to the RAM 108b for the reproduction process is released (# 165), and the above-mentioned operation is performed. Switch to recording mode. Also, in playback mode,
After 5 minutes without switch operation (# 167
YES), the storage area assigned to the RAM 108b for the reproduction process is released (# 169), and the above-described standby mode is entered. When there is no switch operation for 5 minutes or more, the standby mode is automatically entered to save power consumption.

As described above, the digital still camera 1 according to the present embodiment is designed to perform the image synthesizing process of the photographed images photographed in the special photographing mode in the standby mode. Even if an operation is performed, it is not affected by the image synthesizing process, and its operability is not deteriorated.

Further, since it is possible to select whether to execute the image compositing process in the standby mode or in the photographing mode after the photographing process, the user can operate the switch operation in the photographing mode. When,
The above timing can be appropriately selected depending on which of the convenience of making it possible to immediately check the composite image of the images shot in the special shooting mode can be selected, and the usability is not reduced.

In the image synthesizing process in the standby mode, the power supply to the image pickup block A and the like not related to the image synthesizing process is stopped or reduced, so that the power consumption is reduced when the main power source is the battery 112. It is suppressed as much as possible, and there is no inconvenience that the battery 112 runs short of power during the combining process and the combining process is interrupted. In the standby mode, the state of the power supply unit 111 (particularly the power feeding capability) is confirmed, and the image synthesizing process is performed when the power feeding capability is sufficient. Therefore, the image synthesizing process can be executed reliably. it can.

If a switch operation is performed during the image combining process, the image combining process is interrupted and the process corresponding to the switch operation is executed, so that the processing response to the switch operation is not deteriorated. . When the processing corresponding to the switch operation ends and the standby mode is entered again, the interrupted image compositing process is automatically restarted, so that the image compositing process can be surely completed.

In the above-described embodiment, as an example of the image synthesizing process, the synthesizing process of two photographed images photographed in the special photographing shadow mode has been described, but the image processing according to the present invention is the photographing process obtained by the photographing process. The image processing is not limited to this as long as the image processing is newly added to the image. The gist of the present invention is to prevent the image processing, which has a heavy processing load, from affecting the processing for the original functions of the camera in the shooting mode and the playback mode (processing executed according to an irregular switch operation). Since the image processing is executed in the standby mode in which no special processing is performed, the purpose of the image processing is to combine a plurality of images, improve the image quality, and add a special video effect. It is not limited to one.

Generally, a process including a repetitive calculation process in which the same kind of calculation is repeated by changing the condition for each pixel data forming an image, like the above-mentioned registration process and blurring adjustment process, is processed. It takes a long time, and the processing load is large. Therefore, it is extremely effective to apply the present invention to such image processing.

In the above embodiment, the digital still camera having the function of executing the image processing in the standby mode according to the present invention (including the case of restarting the interrupted image processing) has been described as an example. , The image processing is executed in the standby mode (including the case where the interrupted image processing is restarted) is recorded in a computer-readable recording medium, and the image processing is executed in the standby mode. The function may be provided by causing a digital camera that does not have such a function as standard to read the processing program from the recording medium.

[0187]

As described above, according to the present invention,
An electronic camera having image processing means for performing predetermined image processing on an image recorded on a recording medium, which is different from processing at the time of photographing, wherein the detecting means is in a non-operated state for a predetermined time or more. When the continuation is detected, the predetermined image processing is started, so that the image processing will be performed when it is estimated that the shooting or reproducing operation will not be performed. Can be increased.

Further, when the detection means detects that the operation means has not been operated for a predetermined time or longer, the power supply to the image pickup means is reduced, so that the image based on the power consumption in the image pickup means is reduced. It is possible to prevent a power shortage from occurring in the processing means, and it is possible to reliably perform image processing.

When the power supply means is capable of supplying power from the AC adapter or the battery, when the power is supplied from the AC adapter, or when the power is supplied from the battery, the power supply capability of the battery is sufficient. Since the image processing is started, it is possible to reliably perform the image processing without being interrupted due to a power shortage during the image processing.

Further, when the predetermined image processing is completed, the power supplied to the image processing means is reduced, so that the power is not unnecessarily consumed and the power can be saved as much as possible. it can.

Further, since the predetermined image processing is carried out only when instructed by the operating means, it is possible for the operator to carry out the image processing only for a desired photographed image. As a result, it is possible to reduce the adverse effect of unnecessary image processing on the photographing processing and reduce the power consumption.

Further, when a specific operation related to a photographing function such as a release is performed by the operating means during image processing, the image processing is interrupted and the image in the process is recorded on the recording medium. Therefore, the operability for the operation related to the shooting function does not deteriorate.

When the predetermined image processing is interrupted,
After the processing corresponding to the specific operation is completed, the interrupted image processing is performed on the image for which the image processing is not completed, so that the image processing is surely completed even for the image for which the image processing is interrupted. be able to.

[Brief description of drawings]

FIG. 1 is a front view of a camera body of a digital still camera according to the present invention.

FIG. 2 is a diagram showing an arrangement of main members of the digital still camera.

FIG. 3 is a right side view showing an arrangement of main members built in the digital still camera.

FIG. 4 is a rear view of the digital still camera.

FIG. 5 is a diagram showing a configuration of an image pickup surface of a color image pickup element.

FIG. 6 is a diagram showing a menu screen for selecting a shooting mode.

FIG. 7 is a diagram showing a menu screen for selecting image processing timing.

FIG. 8 is a block diagram showing an internal configuration of a digital still camera.

FIG. 9 is a diagram showing a configuration example of an image file recorded in a memory card.

FIG. 10 is a diagram showing a method of recording an image file on a memory card.

FIG. 11 is a diagram for explaining the relationship between camera state transitions and image composition processing.

FIG. 12 is a flowchart showing a processing procedure in a recording mode.

FIG. 13 is a diagram showing a storage area of a RAM set according to a mode.

FIG. 14 is a flowchart illustrating a processing procedure of shooting in a blur adjusting mode.

FIG. 15 is a flowchart showing a processing procedure in a standby mode.

FIG. 16 is a flowchart showing a processing procedure in a standby mode.

17A and 17B are views showing two images with different focus states used for the blur adjustment processing, FIG. 17A is a view showing a close view focused image, and FIG. 17B is a view showing a distant view focused image. Is.

FIG. 18 is a flowchart showing a processing procedure of image combination.

FIG. 19 is a flowchart showing the procedure of an image combining process for adjusting the blur effect.

FIG. 20 is a flowchart showing the procedure of an image combining process for adjusting the blur.

21A and 21B are diagrams for explaining interpolation processing of image data for the G color component, FIG. 21A is a diagram showing image data before interpolation, and FIG. 21B is a diagram showing image data after interpolation.

FIG. 22 is a diagram showing a method of thinning out image data of R color component to create image data for iterative calculation processing,
(A) is a figure which shows the image data before thinning, (b) is a figure which shows the image data after thinning.

FIG. 23 is a diagram for explaining a method of interpolating image data for an R color component to create a bokeh adjustment image,
(A) is a figure which shows the image data before interpolation, (b) is a figure which shows the state which restored the image data to the original pixel position, (c) is a figure which shows the image data after interpolation.

FIG. 24 is a flowchart showing a processing procedure in a reproduction mode.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Digital still camera (electronic camera) 101 Lens 102 Imaging section (imaging means) 103 Signal processing section 104 Light emission control section 105 Lens control section 106 Display section 107 Operating section (operating section) 108 Overall control section (Image processing control section, detection) 108a ROM 108b RAM 108c exposure calculation unit 108d display control unit 108e recording control unit (recording unit) 108f reproduction control unit 108g special exposure control unit 108h image synthesis processing unit (image processing unit) 108i power supply control unit (power supply determination unit, Power supply capacity determination means) 109 Card I / F 110 RTC 111 Power supply section (power supply means) 112 Battery 113 AC adapter 2 Camera body 205 Color image sensor 206 Shutter button (operation means) 207 Display section 208 Mode setting switch (operation means) 209 4 stations Switch (operation means) 210 switch group (operation means) 211 power switch (operation means) 212 AC adapter connection terminal 3 interchangeable lens 4 electronic viewfinder 5 flash A imaging block (imaging means) B display block C recording block (recording means) D power block E control block MC memory card (recording medium)

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 5/91 H04N 101: 00 5C053 // H04N 101: 00 5/91 J (72) Inventor Hironori Sumitomo 2-13-13 Azuchi-cho, Chuo-ku, Osaka Osaka International Building Minolta Co., Ltd. (72) Inventor Katsutoshi Shinkawa 2-3-3 Azuchi-cho, Chuo-ku, Osaka City Osaka International Building F-term inside Minolta Co., Ltd. (reference) 2H054 AA01 2H100 CC07 DD01 DD02 DD11 DD15 DD16 2H105 EE26 5C022 AA13 AB67 AC03 AC42 CA00 5C052 AA17 AB09 DD02 GA02 GA03 GA09 GB01 GE06 GE08 5C053 FA08 KA01 KA24 LA02

Claims (16)

[Claims] 1. An operation means for inputting various kinds of information, and when a release is instructed by the operation means, the subject light image is photoelectrically converted into an image composed of an electric signal, and a predetermined process is performed on this image. Image pickup means for creating an image for recording by using a recording means, a recording means for recording the image created by the image pickup means on a recording medium, and a predetermined process different from the above-described processing at the time of photographing the image recorded on the recording medium. And an image processing means for performing the image processing, the detecting means for detecting that the non-operating state of the operating means has continued for a predetermined time or more, and the image processing means is the detecting means. The electronic camera starts the predetermined image processing when detects that the non-operation state of the operation means has continued for a predetermined time or longer. 2. The electronic camera according to claim 1, further comprising a power supply means for supplying a predetermined power source to each of the image pickup means, the recording means and the image processing means, and the power supply means includes the detection means. An electronic camera characterized in that, when it is detected that the non-operation state of the operation means has continued for a predetermined time or longer, the power supplied to the image pickup means is reduced. 3. The electronic camera according to claim 2, wherein the power supply means is capable of supplying power from an AC adapter or a battery, and further comprises power supply determination means for determining the type of power supply source to the power supply means. The image processing means detects that the detecting means has maintained the non-operation state of the operating means for a predetermined time or more, and the main power source is determined to be an AC adapter by the power source determining means. An electronic camera, which starts predetermined image processing on an image recorded on the recording medium. 4. The electronic camera according to claim 2, wherein the power supply means is capable of supplying power from an AC adapter or a battery, and the power supply determination means determines the type of the power supply source to the power supply means, Further comprising battery capacity determination means for determining whether or not the battery can be supplied with power,
The image processing means detects that the detecting means has continued the non-operation state of the operating means for a predetermined time or more, and the power supply source to the power supply means is a battery, the battery capacity is An electronic camera, which starts predetermined image processing for an image recorded on the recording medium when the determining unit determines that the battery can be supplied with power. 5. The electronic camera according to claim 2, wherein the power supply means reduces power supply to the image processing means when the image processing means completes image processing. A characteristic electronic camera. 6. The electronic camera according to claim 1, wherein the information input from the operation means includes information instructing image processing of a recorded image by the image processing means. The electronic camera, wherein the processing means performs predetermined image processing on the image recorded on the recording medium when the image processing is instructed by the operating means. 7. The electronic camera according to claim 1, wherein the predetermined image processing is processing for combining one image using a plurality of images. 8. The electronic camera according to any one of claims 1 to 6, wherein the predetermined image processing includes repetitive calculation processing for repeating the same kind of calculation for each pixel data forming an image. An electronic camera that is characterized by being an object. 9. An operating means for inputting various kinds of information, and when a release is instructed by the operating means, the subject light image is photoelectrically converted into an image composed of an electric signal, and a predetermined process is performed on this image. And an image pickup means for making an image for recording, a recording means for recording the image made by the image pickup means on a recording medium, and a detection for detecting that the non-operated state of the operating means has continued for a predetermined time or more. Means and the image processing means, when the detecting means detects that the non-operation state of the operating means has continued for a predetermined time or more, the processing at the time of photographing the image recorded on the recording medium, Is an electronic camera provided with image processing means for performing different predetermined image processing, and when a specific operation is performed by the operating means while the image processing means is performing the predetermined image processing, An electronic camera comprising image processing control means for interrupting image processing and recording an image being processed on the recording medium. 10. The electronic camera according to claim 9, wherein:
The image processing control means, after the processing corresponding to the specific operation is completed, the predetermined image processing in which the image processing recorded in the recording medium in the image processing means is interrupted for an uncompleted image. An electronic camera characterized by performing the following. 11. The electronic camera according to claim 10, wherein the image processing control unit records the image on the recording medium when the detecting unit detects that the operation unit has not been operated for a predetermined time or longer. An electronic camera which reads out an image which has not been subjected to the image processing performed and causes the image processing means to start a predetermined image processing which is interrupted for the image. 12. The electronic camera according to claim 9, wherein the specific operation is an operation for instructing a release. 13. The electronic camera according to claim 9, wherein the specific operation is an operation for instructing switching of shooting and reproduction modes. 14. The electronic camera according to claim 9, wherein the predetermined image processing is processing of combining one image using a plurality of images. 15. The electronic camera according to any one of claims 9 to 13, wherein the predetermined image processing is a repetitive arithmetic processing for repeating the same kind of arithmetic operation on each pixel data forming an image. An electronic camera characterized by being included. 16. A detection means for detecting that a computer, which controls the operation of the electronic camera, controls the operation means for inputting various kinds of information for a predetermined time or more, and a detection means for the operation means. When a non-operation state continues for a predetermined time or more, a computer-readable program recording a program for causing the captured image recorded on the recording medium to perform a predetermined image processing different from the processing at the time of shooting Possible recording medium.