JP2007142639A - Imaging apparatus and program therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus in which a faded photography can be restored well easily, and to provide a program therefor. <P>SOLUTION: Based on image data obtained by still image photography processing, a quadrilateral profile, i. e. the profile of photograph, is detected (S8). Image data in the detected quadrilateral profile is extracted (S9) and small image data is generated from the extracted image data (S10). The small image data is subjected to trapezoidal/barrel distortion correction processing and fading correction processing (S11, S12) and the corrected small image data is displayed at an image display section 15. Based on a trimming range specified by a user, trimming image data is generated from image data in the extracted quadrilateral profile and subjected to trapezoidal/barrel distortion correction processing and fading correction processing before being recorded in a flash memory 13. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image pickup apparatus and a program thereof, and more particularly, to an image pickup apparatus having a function of restoring a faded photograph and a program thereof.

With the passage of time, photos fade, and technology to restore the faded photos to their original vivid photos has appeared.
For example, image data of a photo faded by a personal computer or a printer is captured by a scanner, and the faded image is restored by applying a color fading correction process to the captured image data based on the color fading factor data input by the user. (Patent Document 1).
There is also a method of taking a photo fading with a digital camera instead of a scanner, taking the obtained image data into a personal computer or the like, and performing a fading correction process.

JP Patent Publication No. 2005-123790

However, according to the technique described in Patent Document 1, there is a problem in that the following steps must be performed for each sheet, which is troublesome, takes time, and takes too much time.
(Process according to Patent Document 1)
First, the album color film is peeled off to take out a photo to be subjected to fading correction, and the taken photo is read by a scanner to obtain photo image data. Then, an effective area of the photograph is cut out, a fading correction process is performed based on the image data in the cut out area, and the image data after the fading correction process is recorded.

In addition, even when a photograph fading with a camera is taken, there is a problem that the following steps must be performed for each sheet, which is cumbersome, time-consuming, and takes too much time.
(Process when using a camera)
First, take a photo that has faded with the camera. At that time, in order to suppress light reflection on the surface of the photograph, it is necessary to take it from an angle, and the photographed image becomes a trapezoidal photograph. Then, the photographed image data is taken into a personal computer or the like, and then the range of the photographic area (the range is a trapezoid) is designated, and the image data in the range is cut out. Then, the extracted trapezoidal image is converted into a rectangular image by performing a trapezoidal correction process, the color fading correction process is performed on the converted image data, and the image data after the fading correction process is recorded.

  Also, in any of the above-described scanners and cameras, if fading correction is performed before trimming the photographic area, the color spectrum of the background image outside the photographic area will cause an erroneous determination of fading correction, and good fading correction. There was also a problem that it was not possible to carry out.

  Therefore, the present invention has been made in view of such conventional problems, and an object thereof is to provide an imaging apparatus capable of easily and satisfactorily restoring a fading photo and a program thereof.

In order to achieve the above object, an imaging apparatus according to a first aspect of the present invention is an imaging apparatus having a function of taking a photograph and restoring the image of the photograph using image data of the photographed photograph. ,
Acquisition means for acquiring image data;
First determination means for determining a color degree based on a color spectrum of the image data acquired by the acquisition means;
First fading correction processing means for applying a fading correction process to the image data acquired by the acquisition means in accordance with the color degree determined by the first determination means;
A recording control means for recording the image data subjected to the fading correction processing by the first fading correction processing means on the recording means;
It is provided with.

In addition, for example, as described in claim 2, a photograph portion is detected by detecting a contour of a photograph based on the image data acquired by the acquisition unit and extracting image data in the detected contour. An extraction means for extracting the image data of
The first determination means includes
Determining the degree of color based on the color spectrum of the image data extracted by the extraction means;
The first fading correction processing means may perform a fading correction process on the image data extracted by the extraction means in accordance with the color degree determined by the first determination means.

Further, for example, as described in claim 3, the image processing apparatus includes a first trapezoid correction processing unit that performs a keystone correction process on the image data extracted by the extraction unit,
The recording control means includes
Image data that has been subjected to fading correction processing by the first fading correction processing means and has been subjected to trapezoid correction processing by the first trapezoid correction processing means may be recorded in the recording means.

Further, for example, as described in claim 4, the image processing apparatus includes first barrel distortion correction processing means for performing barrel distortion correction processing on the image data extracted by the extraction means,
The recording control means includes
Image data that has been subjected to fading correction processing by the first fading correction processing means and that has been subjected to barrel distortion correction processing by the first barrel distortion correction processing means is recorded in the recording means. Also good.

Further, for example, as described in claim 5, the image forming apparatus includes a generation unit that generates trimming image data from image data,
The generating means includes
Generating trimmed image data from the image data extracted by the extracting means;
The first determination means includes
Determining the color degree based on the color spectrum of the trimmed image data generated by the generating means;
The first fading correction processing unit may perform a fading correction process on the trimmed image data generated by the generation unit according to the color degree determined by the first determination unit.

Further, for example, as described in claim 6, small image generation means for generating small image data having a small image size from the image data extracted by the extraction means;
Second determination means for determining a color degree based on a color spectrum of the small image data generated by the small image generation means;
Second fading correction processing means for performing fading correction processing on the small image data generated by the small image generation means according to the color degree determined by the second determination means;
You may make it provide.

  Further, for example, as described in claim 7, a second trapezoid correction processing unit that performs trapezoid correction processing on the small image data generated by the small image generation unit may be provided.

  Further, for example, as described in claim 8, a second barrel distortion correction processing unit that performs barrel distortion correction processing on the small image data generated by the small image generation unit may be provided. Good.

  Further, for example, as described in claim 9, display control means for displaying small image data subjected to fading correction processing by the second fading correction processing means on the display means may be provided. .

For example, as described in claim 10, the recording control unit includes:
Image data that has been subjected to fading correction processing by the first fading correction processing means may be recorded in the recording means, and information indicating that the fading correction processing has been performed may be attached to the image data. .

Further, for example, as described in claim 11, an imaging unit that images a subject is provided,
The acquisition means includes
You may make it acquire the image data obtained by the said imaging means.

Further, for example, as described in claim 12, a determination unit that determines whether or not information indicating that the color fading correction process has been applied to the image data acquired by the previous acquisition unit ,
When it is determined that the information indicating that the color fading correction processing has been performed by the determination means, the color fading correction processing by the first color fading correction processing means for the image data acquired by the acquisition means. Prohibiting means for prohibiting execution may be provided.

For example, as described in claim 13, the acquisition unit includes:
You may make it acquire the image data currently recorded on the said recording means.

For example, as described in claim 14, the recording control unit includes:
The image processing apparatus may include a unit that records the image data acquired by the acquisition unit that has not been subjected to the color fading correction process by the first color fading correction processing unit.

In order to achieve the above object, a program according to a fifteenth aspect of the present invention is to execute an imaging apparatus having a function of taking a photograph and using the image data of the photographed photograph to restore the photograph image. The program of
Acquisition processing to acquire image data;
A determination process for determining a color degree based on a color spectrum of the image data acquired by the acquisition process;
Fading correction processing for performing fading correction on the image data acquired by the acquisition processing according to the color degree determined by the determination processing;
A recording process for recording the image data subjected to the fading correction by the fading correction process on a recording medium;
It is characterized by including.

  According to the first aspect of the present invention, there is provided an imaging apparatus having a function of taking a photograph and using the image data of the photographed photograph to restore the photograph image, and acquiring the image data Means, a first determination unit that determines a color degree based on a color spectrum of the image data acquired by the acquisition unit, and a fading correction process according to the color degree determined by the first determination unit. First fading correction processing means applied to the image data obtained by the obtaining means; and recording control means for recording the image data subjected to fading correction processing by the first fading correction processing means on the recording means. Since it is provided, it is possible to obtain image data obtained by restoring a fading photo easily.

  According to the invention described in claim 2, based on the image data acquired by the acquisition means, the contour of the photograph is detected, and the image data within the detected contour is extracted, thereby extracting the image data of the photograph portion. Extracting means for determining the color degree based on the color spectrum of the image data extracted by the extracting means, and the first fading correction processing means for determining the first color. Since the color fading correction process is performed on the image data extracted by the extracting means according to the color degree determined by the means, it is possible to obtain image data obtained by restoring a photo fading.

  According to a third aspect of the invention, there is provided first trapezoid correction processing means for performing trapezoid correction processing on the image data extracted by the extraction means, and the recording control means is controlled by the first fading correction processing means. Since the image data subjected to the fading correction process and the keystone correction process by the first trapezoid correction process unit is recorded in the recording unit, the image data is obliquely applied to suppress the light reflection on the photographic surface. Even in the case of shooting, it is possible to obtain an image (straight image) as if a photograph was taken from the front. In addition, since it is not necessary to reflect the light reflection on the surface of the photograph, a good restored image can be obtained.

  According to a fourth aspect of the present invention, the image processing apparatus includes a first barrel distortion correction processing unit that performs barrel distortion correction processing on the image data extracted by the extraction unit, and the recording control unit includes the first color fading. Since the image data subjected to the fading correction processing by the correction processing means and the barrel distortion correction processing by the first barrel distortion correction processing means is recorded in the recording means, the barrel by the lens is used. A good restored image without mold distortion can be obtained.

  According to a fifth aspect of the present invention, the image forming apparatus includes a generation unit that generates trimming image data from image data, the generation unit generates trimming image data from the image data extracted by the extraction unit, and the first data The determining means determines the color degree based on the color spectrum of the trimmed image data generated by the generating means, and the first fading correction processing means is in accordance with the color degree determined by the first determining means. Since the fading correction processing is performed on the trimmed image data generated by the generating means, it is necessary to perform correction processing such as fading correction processing on unnecessary image data among the extracted image data. The burden of processing can be reduced.

According to the sixth aspect of the present invention, a small image generating unit that generates small image data having a small image size from the image data extracted by the extracting unit, and a color of the small image data generated by the small image generating unit. Second determination means for determining the color degree based on the spectrum, and fading correction processing according to the color degree determined by the second determination means are performed on the small image data generated by the small image generation means. Since the second fading correction processing means is provided, it is possible to obtain image data obtained by restoring a fading photograph with a small processing load and with ease and speed.
Also,

  According to the seventh aspect of the invention, since the second trapezoid correction processing means for performing the trapezoid correction processing on the small image data generated by the small image generation means is provided, the light reflection of the photographic surface can be promptly reflected. No straight restored image can be obtained.

  According to the eighth aspect of the present invention, since the second barrel distortion correction processing unit that performs barrel distortion correction processing on the small image data generated by the small image generation unit is provided, the lens can be quickly used. A good restored image without barrel distortion can be obtained.

  According to the ninth aspect of the invention, since the display control means for displaying the small image data subjected to the fading correction process by the second fading correction processing means on the display means is provided, the fading correction process is performed. The user can recognize the image of the small image data.

  According to a tenth aspect of the present invention, the recording control unit records the image data subjected to the fading correction process by the first fading correction processing unit on the recording unit, and the color fading correction process on the image data. Since the information indicating that the process has been performed is added, it is possible to recognize whether or not the recorded image data has been subjected to the fading correction process.

  According to the eleventh aspect of the present invention, the image pickup device for picking up an image of the subject is provided, and the acquisition device acquires the image data obtained by the image pickup device. The image data can be recorded after being subjected to a fading correction process, and image data obtained by easily restoring a fading photo can be obtained.

  According to a twelfth aspect of the present invention, a determination unit that determines whether or not information indicating that the color fading correction process has been performed is attached to the image data acquired by the acquisition unit; and the color fading by the determination unit Prohibition of prohibiting execution of fading correction processing by the first fading correction processing means on the image data acquired by the acquisition means when it is determined that information indicating that correction processing has been performed is attached The fading correction process can be performed only on the image data that has not been subjected to the fading correction process. Further, since the fading correction processing is not performed on the image data that has been subjected to the fading correction processing, unnecessary processing is not required.

  According to a thirteenth aspect of the present invention, since the acquisition unit acquires the image data recorded in the recording unit, the image data recorded in the recording unit is subjected to a fading correction process. Image data obtained by restoring a fading photo can be obtained.

  According to a fourteenth aspect of the present invention, the recording control means records on the recording means the image data obtained by the obtaining means and not subjected to the fading correction processing by the first fading correction processing means. The original image data that has not been subjected to the fading process can be recorded.

  According to the fifteenth aspect of the present invention, the image pickup apparatus of the present invention can be realized by being read by a digital camera, a personal computer or the like.

Hereinafter, the present embodiment will be described in detail with reference to the drawings as an example in which the imaging apparatus of the present invention is applied to a digital camera.
[First embodiment]
A. Configuration of Digital Camera FIG. 1 is a block diagram showing a schematic electrical configuration of a digital camera 1 that implements the imaging apparatus of the present invention.
The digital camera 1 includes a focus lens 2, a zoom lens 3, a lens driving circuit 4, a CCD 5, a vertical driver 6, a TG (timing generator) 7, a unit circuit 8, a signal processing unit 9, a CPU 10, a DRAM 11, a memory 12, and a flash memory 13. A key input unit 14, an image display unit 15, a trapezoid / barrel distortion correction unit 16, and a fading correction unit 17.

The focus lens 2 and the zoom lens 3 are composed of a plurality of lens groups (not shown), and a lens driving circuit 4 is connected to the focus lens 2 and the zoom lens 3.
The lens driving circuit 4 includes a motor (not shown) that moves the focus lens 2 and the zoom lens 3 in the optical axis direction, and a motor driver that drives the focus motor and the zoom motor in accordance with a control signal sent from the CPU 10, respectively. (Not shown).

  The CCD 5 is scanned and driven by the vertical driver 6, photoelectrically converts the intensity of light of each color of the RGB value of the subject image at a constant period, and outputs it to the unit circuit 8 as an imaging signal. The operation timings of the vertical driver 6 and unit circuit 8 are controlled by the CPU 10 via the TG 7.

  A TG 7 is connected to the unit circuit 8, a CDS (Correlated Double Sampling) circuit that holds the imaging signal output from the CCD 5 by correlated double sampling, and an AGC (Automatic Gain Adjustment of the imaging signal after the sampling) Automatic gain control) circuit, and an A / D converter that converts the analog image pickup signal after the automatic gain adjustment into a digital signal. The image pickup signal of the CCD 5 passes through the unit circuit 8 as a digital signal and is a signal processing unit. Sent to 9.

  The signal processing unit 9 performs processing such as γ correction processing and white balance processing on the image data sent from the unit circuit 8, generates a luminance color difference signal (YUV data), and generates the generated luminance color difference. The image data of the signal is sent to the CPU 10.

The CPU 10 is a one-chip microcomputer that controls functions of the digital camera 1 as well as functions such as through image display processing, still image shooting processing, and image data compression / expansion processing.
In particular, in the present embodiment, the CPU 10 has a function of performing quadrilateral contour detection processing, processing for generating small image data, and trimming processing.
The memory 12 stores a control program and necessary data necessary for controlling each part of the CPU 10, and the CPU 10 operates according to the program.

The DRAM 11 is used as a buffer memory for temporarily storing image data sent to the CPU 10 after being imaged by the CCD 5 and also as a working memory for the CPU 10.
The flash memory 13 is a recording medium that stores image data captured by the CCD 5.

The key input unit 14 includes a plurality of operation keys such as a shutter button, a mode switching key, a cross key, a SET key zoom key (“W” key, “T” key), and an operation signal corresponding to a user's key operation. It outputs to CPU10.
The image display unit 15 includes a color LCD and its drive circuit, and displays the subject imaged by the CCD 5 as a through image when in a shooting standby state, and is read out from the flash memory 13 and decompressed when a recorded image is reproduced. The recorded image is displayed.

The trapezoidal / barrel distortion correction unit 16 has a function of performing trapezoidal correction processing / barrel distortion correction on image data.
The trapezoid correction process is to correct an image distorted into a trapezoid into a rectangular image (straight image).
For example, when a photograph is taken from an oblique direction, the photographed picture is distorted into a trapezoid. Therefore, by performing this trapezoidal correction process, it is possible to obtain a straight (rectangular) image without distortion as if the photograph was taken from the front.
In addition, barrel distortion correction processing is performed so that the image of the image data shot by a photographing lens such as a zoom lens is distorted (causes barrel distortion), so that the image does not have barrel distortion. To do.

The fading correction unit 17 has a function of performing a fading correction process on image data.
Although this fading correction technique is already well known and will not be described in detail here, here, the fading degree is determined by using the color spectrum determined based on the image data to be subjected to the fading correction processing. The color fading correction process is performed according to the degree of color fading.
The trapezoid / barrel distortion correction unit 16 and the fading correction unit 17 may be implemented as hardware circuits, respectively, and the trapezoid / barrel distortion correction program and the fading correction program are stored in the memory 12. The CPU 10 may execute trapezoid / barrel distortion correction and fading correction.

B. Operation of Digital Camera 1 The operation of the digital camera 1 according to the embodiment will be described with reference to the flowcharts of FIGS.

  When the best shot mode is set by operating the mode switching key of the user key input unit 14, the CPU 10 selects the best shot scene designated by the user (step S1). When the best shot mode is set, a list (or switching) of best shot scenes is displayed on the image display unit 15, and the best shot scene most suitable for the shooting scene that the user wants to shoot is selected from the list. It can be selected by operating a key. Examples of the best shot scene include a “fading correction scene” and a “fireworks scene”.

When the best shot scene is selected, the CPU 10 determines whether or not the selected best shot scene is a fading correction scene (step S2). This fading correction scene refers to taking an old faded photo and restoring it to a colorful photo.
If it is determined in step S2 that the selected best shot scene is not a fading correction scene, another process is performed. If it is determined in step S2 that the selected best shot scene is a fading correction scene, the CPU 10 uses the CCD 5 A through image in which imaging of a subject is started, the image data of the luminance color difference signal generated by the signal processing unit 9 is stored in the buffer memory (DRAM 11), and the stored image data of the subject is displayed on the image display unit 15. Display is started (step S3).

Next, the CPU 10 determines whether or not a zoom operation has been performed by the user (step S4). This determination is made based on whether or not an operation signal corresponding to the operation of the zoom key has been sent from the key input unit 14.
If it is determined in step S4 that the zoom operation has been performed, the CPU 10 sends a control signal to the lens drive circuit 4 in accordance with the user's zoom operation (in accordance with an operation signal sent from the key input unit 14), thereby zooming in the zoom lens 3. (Step S5), the process proceeds to step S6. If it is determined in step S4 that the zoom operation is not performed, the process proceeds to step S6.

In step S6, the CPU 10 determines whether or not the shutter button has been pressed. This determination is made based on whether or not an operation signal corresponding to pressing of the shutter button is sent from the key input unit 14.
If it is determined in step S6 that the shutter button has not been pressed, the process returns to step S4. If it is determined in step S6 that the shutter button has been pressed, the CPU 10 performs still image shooting processing (step S7).
At this time, the user presses the shutter button after setting the camera at a position where the photograph to be restored can be taken. Here, if the photograph is taken from the front, the reflected light reflected on the surface of the photograph may be taken together, so it is preferable to take the photograph from an oblique direction. Here, it is assumed that the user has taken a photograph from an oblique direction.

When the still image shooting process is performed, the CPU 10 performs a quadrilateral contour detection process based on the shot image data (luminance color difference signal) obtained by the shooting process (step S8). This quadrilateral contour detection process refers to automatically detecting a contour line of a photograph based on photographed image data, that is, automatically detecting a boundary line between a photograph part and a non-photo part.
FIG. 4A is a diagram showing a quadrilateral outline detected by the quadrilateral outline detection process based on the image data obtained by the photographing process, and is a quadrilateral outline in which the line 21 is detected. Referring to FIG. 4, it can be seen that the photograph part (shadow part) and the other part are partitioned by a quadrilateral outline.

Next, the CPU 10 performs a process of extracting image data in the detected quadrilateral contour 21 (step S9). As a result, the image data of the image portion corresponding to the photograph is extracted from the captured image data. The extracted image data is stored in the buffer memory.
FIG. 4B shows the state of the extracted image data, and it can be seen that the image data within the detected quadrilateral contour 21 is extracted from the photographed image data.
Next, the CPU 10 generates small image data having a small image size based on the extracted image data in the quadrilateral outline 21, that is, image data corresponding to the photograph portion (step S10). Here, the image size of the generated small image data is QVGA (320 × 240 dots (pixels)).

Next, the CPU 10 causes the trapezoid / barrel distortion correction unit 16 to perform a process of performing trapezoid / barrel distortion correction on the generated small image data (step S11).
The trapezoid correction process is a process for correcting an image distorted into a trapezoid into a rectangle.
In order to prevent the user from taking the light reflected on the photograph, the photograph is taken from an oblique direction, so that the photographed picture is distorted into a trapezoid. Therefore, by performing this trapezoidal correction process, it is possible to obtain a straight (rectangular) image without distortion as if the photograph was taken from the front.
In addition, barrel distortion correction processing is performed so that the image of the image data shot by a photographing lens such as a zoom lens is distorted (causes barrel distortion), so that the image does not have barrel distortion. To do. Since this barrel distortion also changes the distortion rate according to the zoom magnification (the position of the zoom lens), the CPU 10 performs barrel distortion correction processing according to the lens position of the zoom lens 3 when the captured image is obtained. I do.

FIG. 5 is a diagram for explaining barrel distortion correction processing.
As shown in FIG. 5, an image without barrel distortion can be obtained by performing reverse distortion correction processing according to the zoom lens position on an image distorted into a barrel shape of the photographing lens.
The trapezoid correction process and the barrel distortion correction process may be performed separately or may be combined and performed collectively.

Next, the CPU 10 causes the fading correction unit 17 to execute processing for performing fading correction on the small image data on which the trapezoid / barrel distortion correction processing has been performed (step S12).
Although this fading correction technique is already well known and will not be described in detail here, here, the fading degree is determined by using the color spectrum determined based on the image data to be subjected to the fading correction processing. The color fading correction process is performed according to the degree of fading.

Next, the CPU 10 displays the corrected small image data on the image display unit 15 (step S13).
Next, the CPU 10 determines whether or not a trimming operation has been performed by the user (step S14). This determination is made based on whether or not an operation signal corresponding to the cross key is sent from the key input unit 14.

If it is determined in step S14 that the trimming operation has been performed, the CPU 10 changes the trimming position and trimming size in accordance with the operation (step S15), proceeds to step S16, and determines that the trimming operation has not been performed in step S14. The process proceeds to step S16 as it is.
The changed trimming position and trimming size are stored in the trimming information storage area of the memory 12.

In step S16, it is determined whether or not the user has operated the SET key. This determination is made based on whether or not an operation signal corresponding to the operation of the SET key is sent from the key input unit 14.
If the SET key is not operated in step S16, the process returns to step S14. If the SET key is operated in step S16, the process proceeds to step S17.

  Proceeding to step S17, based on the trimming information (trimming position, trimming size) stored in the trimming information storage area, the image data in the quadrilateral contour stored in the buffer memory, that is, in step S9. Trimming image data is generated using the image data extracted from the captured image data (step S17). At this time, since the trimmed image data extracted in step S9 is image data before the trapezoidal / barrel distortion correction processing, the trimming position and trimming size stored in the trimming information storage area cannot be used as they are. When the extracted image data is subjected to trapezoidal / barrel distortion correction processing, a trimming position and a trimming size at which an image in a range specified by the user is trimmed are calculated to generate trimmed image data.

Next, the CPU 10 causes the trapezoid / barrel distortion correction unit 16 to execute a process of performing trapezoid / barrel distortion correction on the generated trimmed image data (step S18). This trapezoid / barrel distortion correction processing is executed by the same processing as that described in step S11.
Next, the CPU 10 causes the fading correction unit 17 to perform processing for performing fading correction on the trimmed image data after the trapezoid / barrel distortion correction processing (step S19).
Note that the trimmed image generation process in step S17 may be performed after the trapezoid / barrel distortion correction process in step S18 and the fading correction process in step S19.
Then, the CPU 10 performs an interpolation process so that the image size of the image data after the color fading correction becomes the captured image size (step S20). That is, the image size of the image data after the color fading correction is enlarged or reduced.

Next, the CPU 10 compresses the image data subjected to the interpolation processing (for example, JPEG compression), and generates a still image file (for example, the Exif format) (step S21). At this time, information indicating that the photograph was taken in the fading correction scene, information indicating that the fading correction processing was performed, and the like are recorded in the header of the still image file.
In addition, information indicating that the color fading correction has been performed may not be recorded in the header of the image file, but information indicating that the color fading correction processing has been performed in association with the image file may be recorded. In short, any information may be used as long as information indicating that the color fading correction processing has been performed on the image file.
Next, the CPU 10 records the generated still image file in the flash memory 13 (step S22), and displays the recorded image data as a preview (step S23).

C. As described above, in the first embodiment, based on the captured image data obtained by the still image capturing process, the quadrilateral contour is detected, the image data in the quadrilateral contour is extracted, and the extracted The image data (trimmed image data cut out from the extracted image data when the trimming range is designated by the user) is subjected to trapezoidal / barrel distortion correction processing and fading correction processing, and the processed image Since the data is recorded as a still image file, it is possible to obtain image data obtained by restoring a fading photo easily and satisfactorily.

Also, based on the image data in the extracted quadrilateral outline, small image data with a small image size that does not burden the processing is generated, and trapezoidal / barrel distortion correction processing and fading correction are performed on the generated small image data. By performing processing and displaying the image of the small image data after processing on the image display unit 15, the image after performing the trapezoid / barrel distortion correction processing and the fading correction processing is quickly displayed on the image display unit 15. be able to.
In addition, the user designates a trimming range in a state where the image after the trapezoid / barrel distortion correction processing and the fading correction processing are displayed on the image display unit 15, and based on the designated trimming range, Since the image data in the quadrilateral outline is trimmed before the barrel distortion correction process and the fading correction process, the trapezoid / barrel distortion correction process is performed on unnecessary image data in the quadrilateral outline. Therefore, it is not necessary to perform a fading correction process, and the processing load can be reduced.
In addition, when recording an image file of image data that has undergone fading correction processing, information indicating that fact is recorded in the header of the image file, so whether or not the image file has been subjected to fading correction processing. Can be judged.

[Second Embodiment]
Next, a second embodiment will be described.
In the first embodiment, fading correction is performed during still image shooting. In the second embodiment, fading correction is performed during reproduction.
Note that only one of the first and second embodiments may be implemented, or the first and second embodiments may be implemented together.

D. Operation of Digital Camera 1 In the second embodiment, the imaging apparatus of the present invention is realized by using the digital camera 1 having the same configuration as that shown in FIG.
The operation of the digital camera 1 according to the second embodiment will be described below with reference to the flowchart of FIG.

  When the playback mode is set by the user operating the mode switching key of the key input unit 14, the CPU 10 displays a list (or switching) of image files recorded in the flash memory 13 (step S51). As a list display method, still image data images (thumbnail images, etc.) recorded in an image file are displayed. The file names of image files recorded in the flash memory 13 may be displayed as a list.

Next, the CPU 10 determines whether an image has been designated by the user. This determination is made based on whether or not an operation signal for designating an image has been sent by operating the cross key and the SET key of the key input unit 14 (step S52).
At this time, the user can designate the images displayed as a list on the image display unit 15 by operating the cross key and the SET key.
If it is determined in step S52 that the user has not designated an image, the process remains in step S52 until the image is designated. If it is determined in step S52 that the user has designated an image, the CPU 10 The image file corresponding to the image specified by is selected (step S53), and the still image data of the selected image file is reproduced (step S54). That is, it is displayed on the image display unit 15.

Next, the CPU 10 determines whether or not an instruction to perform menu display is given by the user (step S55). This determination is made based on whether or not an operation signal corresponding to an operation for displaying a menu is sent from the key input unit 14.
If it is determined in step S55 that an instruction to perform menu display has not been issued, the CPU 10 proceeds to another process. If it is determined in step S55 that an instruction to perform menu display has been performed, the CPU 10 A list of menus is displayed on the image display unit 15 so as to be superimposed on the displayed still image data. Listed menus include “fading correction mode” and “trimming mode”.

When displaying the menu list, the CPU 10 determines whether or not the fading correction mode has been selected by the user (step S57).
If it is determined in step S57 that the fading correction mode is not selected, the CPU 10 proceeds to another process. If it is determined in step S57 that the fading correction mode is selected, the CPU 10 determines still image data of the selected image file. Determines whether the color fading correction has been completed (step S58). This determination is made based on whether or not information indicating that the photograph was taken in the fading correction scene or information indicating that the fading correction processing has been performed is recorded in the header of the selected still image file.

If it is determined in step S58 that the fading correction has not been completed, a fading correction process or the like is performed on the selected still image data (step S59). The execution of the fading correction process and the like will be specifically described. The same processes as those in steps S8 to S23 in FIGS. 2 and 3 described above are performed.
However, in the processing of FIG. 2 and FIG. 3, the fading correction processing or the like is performed using the photographed image data. However, in the second embodiment, still image data (luminance color difference signal) of the expanded image file. Will be used.
On the other hand, if it is determined in step S58 that the color fading correction has been completed, the image display unit 15 is informed that the color fading correction has been performed on the image display unit 15 without executing the processing in step S59 (prohibiting the execution of the processing). It is displayed (step S60). This is because it is not necessary to perform the fading correction process again because it has been corrected.

E. As described above, in the second embodiment, since the trapezoid / barrel distortion correction and the fading correction can be performed at the time of reproducing the still image data, the still image data captured in the normal shooting mode is used. However, it is possible to obtain image data obtained by restoring a fading photo easily and satisfactorily.
Further, it is possible to restore a fading image easily and satisfactorily with respect to image data taken with another digital camera or image data downloaded over the Internet.

In each of the above embodiments, the trapezoidal / barrel distortion correction process is performed and then the fading correction process is performed. However, the trapezoidal / barrel distortion correction process is performed after the fading correction process is performed. You may do it.
In each of the above embodiments, trapezoidal correction processing and barrel distortion correction processing are performed, but they may not be performed. When the keystone correction process is not performed, the user needs to take a picture from the front instead of taking a picture from an oblique direction.

  In each of the above embodiments, small image data is generated. However, trapezoidal / barrel distortion correction processing is not performed on the extracted image data in the quadrilateral contour without generating small image data. The fading correction process may be performed. In this case, after performing the trapezoid / barrel distortion correction process and the fading correction process, the image data may be displayed, and the user may designate a range to be trimmed.

  Further, in each of the above embodiments, when there are a plurality of quadrilateral contours detected based on the image data, the user can specify an optimal quadrilateral contour among the detected quadrilateral contours, You may make it extract the image data in this designated quadrilateral outline. Further, the user may arbitrarily specify the quadrilateral contour.

  The digital camera 1 in the above embodiment is not limited to the above embodiment, and may be a mobile phone with a camera, a PDA with a camera, a personal computer with a camera, an IC recorder with a camera, a digital video camera, or the like. In short, any device capable of photographing a subject may be used.

1 is a block diagram of a digital camera according to an embodiment of the present invention. It is a flowchart which shows operation | movement of the digital camera of 1st Embodiment. It is a flowchart which shows operation | movement of the digital camera of 1st Embodiment. The state of the quadrilateral outline detected by the quadrilateral outline detection process and the state of the image in the extracted quadrilateral outline are shown. It is a figure for demonstrating barrel type distortion correction processing. It is a flowchart which shows operation | movement of the digital camera of 2nd Embodiment.

Explanation of symbols

1 Digital Camera 2 Focus Lens 3 Zoom Lens 4 Lens Drive Circuit 5 CCD
6 Vertical driver 7 TG
8 Unit circuit 9 Signal processor 10 CPU
11 DRAM
12 memory 13 flash memory 14 key input unit 15 image display unit 16 trapezoidal / barrel distortion correction unit 17 fading correction unit

Claims (15)

An imaging device having a function of taking a photograph and using the image data of the photographed photograph to restore the photograph image,
Acquisition means for acquiring image data;
First determination means for determining a color degree based on a color spectrum of the image data acquired by the acquisition means;
First fading correction processing means for applying a fading correction process to the image data acquired by the acquisition means in accordance with the color degree determined by the first determination means;
A recording control means for recording the image data subjected to the fading correction processing by the first fading correction processing means on the recording means;
An imaging apparatus comprising: Based on the image data acquired by the acquisition means, comprising an extraction means for detecting the outline of a photograph and extracting the image data of the photograph part by extracting the image data in the detected outline,
The first determination means includes
Determining the degree of color based on the color spectrum of the image data extracted by the extraction means;
2. The first fading correction processing means performs fading correction processing on the image data extracted by the extraction means according to the color degree determined by the first determination means. Imaging device. First trapezoid correction processing means for performing trapezoid correction processing on the image data extracted by the extraction means;
The recording control means includes
The image data that has been subjected to fading correction processing by the first fading correction processing means and that has been subjected to trapezoid correction processing by the first trapezoid correction processing means is recorded in the recording means. 2. The imaging device according to 2. First barrel distortion correction processing means for performing barrel distortion correction processing on the image data extracted by the extraction means;
The recording control means includes
Image data that has been subjected to fading correction processing by the first fading correction processing means and has been subjected to barrel distortion correction processing by the first barrel distortion correction processing means is recorded in the recording means. The imaging apparatus according to claim 2 or 3. A generating means for generating trimmed image data from the image data;
The generating means includes
Generating trimmed image data from the image data extracted by the extracting means;
The first determination means includes
Determining the color degree based on the color spectrum of the trimmed image data generated by the generating means;
The first fading correction processing means performs a fading correction process on the trimmed image data generated by the generation means according to the color degree determined by the first determination means. 5. The imaging device according to any one of 4 to 4. Small image generation means for generating small image data having a small image size from the image data extracted by the extraction means;
Second determination means for determining a color degree based on a color spectrum of the small image data generated by the small image generation means;
Second fading correction processing means for performing fading correction processing on the small image data generated by the small image generation means according to the color degree determined by the second determination means;
The imaging apparatus according to claim 2, further comprising: The imaging apparatus according to claim 6, further comprising second trapezoid correction processing means for performing trapezoid correction processing on the small image data generated by the small image generation means. 8. The imaging apparatus according to claim 6, further comprising second barrel distortion correction processing means for performing barrel distortion correction processing on the small image data generated by the small image generation means. 9. The image pickup apparatus according to claim 6, further comprising display control means for causing the display means to display small image data that has been subjected to color fading correction processing by the second color fading correction processing means. The recording control means includes
The image data subjected to the color fading correction process by the first color fading correction processing unit is recorded in the recording unit, and information indicating that the color fading correction processing has been performed is attached to the image data. The imaging device according to claim 1. Comprising imaging means for imaging a subject;
The acquisition means includes
The image pickup apparatus according to claim 1, wherein the image data obtained by the image pickup unit is acquired. Determining means for determining whether or not the image data acquired by the acquiring means is attached with information indicating that the fading correction processing has been performed;
When it is determined that the information indicating that the color fading correction processing has been performed by the determination means, the color fading correction processing by the first color fading correction processing means for the image data acquired by the acquisition means. The imaging apparatus according to claim 1, further comprising a prohibiting unit that prohibits execution. The acquisition means includes
The image pickup apparatus according to claim 1, wherein the image data recorded in the recording unit is acquired. The recording control means includes
14. The image processing apparatus according to claim 1, further comprising a recording unit that records image data acquired by the acquiring unit and not subjected to the fading correction process by the first fading correction processing unit. The imaging device described. A program for executing an imaging device having a function of taking a photograph and using the image data of the photographed photograph to restore the photograph image,
Acquisition processing to acquire image data;
A determination process for determining a color degree based on a color spectrum of the image data acquired by the acquisition process;
Fading correction processing for performing fading correction on the image data acquired by the acquisition processing according to the color degree determined by the determination processing;
A recording process for recording the image data subjected to the fading correction by the fading correction process on a recording medium;
The program characterized by including.

Images