JP2007124387A - Image processing device and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing device and an image processing program capable of identifying a process procedure of image data without analyzing format and content of procedure data. <P>SOLUTION: Selecting means 28 is designed to select an image group which is imaged continuously using date and time data indicating imaged date and time from a plurality of images acquired by imaging a subject image. Processing means 28 is designed to perform any one of an average process for averaging image data configuring each image and an adding process for adding image data configuring each image in response to brightness of each image configuring the image group. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and an image processing program that perform image processing on a plurality of captured images.

Conventionally, an imaging mode of a digital camera includes, for example, a camera shake suppression mode in which a subject image is continuously captured with a short exposure time that does not cause camera shake or the like by an imaging element such as a CCD (Charge Coupled Device), or a subject image. There is a noise reduction mode in which the imaging sensitivity of the image sensor is increased and the subject image is continuously captured when the image is dark.
In the camera shake suppression mode, a composite image with proper exposure is generated by adding a plurality of captured image data (addition process). In the noise reduction mode, a composite image is generated by averaging a plurality of image data in order to reduce noise components included in the plurality of captured image data (average processing).

By the way, when the above-described addition processing and average processing are executed by, for example, a personal computer, a large amount of image data may be transferred from the digital camera to the personal computer. In this case, it is difficult for the personal computer to grasp the procedure of image processing (addition processing and average processing) suitable for each of a large amount of image data.
As a technique for avoiding this, a technique is disclosed in which image data is created by adding procedure data indicating the procedure of image processing to each image data, and the created image file is transferred from a digital camera to a personal computer. (For example, Patent Document 1). In this method, procedure data is analyzed by dedicated software installed in a personal computer as a transfer destination, and an image processing procedure is identified for each image data. As a result, image processing suitable for each image data is performed, and the above-described composite image is generated.
Japanese Patent Laid-Open No. 2002-112008

However, with the method of Patent Document 1, special processing for analyzing the format and contents of procedure data is possible only with dedicated software. Therefore, software other than dedicated software cannot analyze the format and contents of the procedure data and cannot identify the image processing procedure for each image data. For this reason, there has been a problem that a composite image cannot be generated.
An object of the present invention is to provide an image processing apparatus and an image processing program capable of generating a composite image without analyzing the format and contents of procedure data.

  In the image processing apparatus according to the first aspect, the selection unit selects a group of images that are continuously captured from a plurality of images obtained by capturing the subject image using date / time data indicating the date / time of imaging. The processing means performs any one of an averaging process for averaging the image data constituting each image and an addition process for adding the image data constituting each image according to the brightness of each image constituting the image group.

In the image processing apparatus according to claim 2 and the image processing program according to claim 8, the processing means performs an average process when the brightness of all the images constituting the image group exceeds a reference value, and the brightness of all the images. When is below the reference value, addition processing is performed.
In the image processing device according to claim 3 and the image processing program according to claim 9, the processing means, when the reference value is less than or equal to a predetermined upper limit and greater than or equal to a predetermined lower limit, An average process is performed when the brightness is less than or equal to the upper limit value and exceeds the reference value, and an addition process is performed when the brightness of all images is less than or equal to the reference value and greater than or equal to the lower limit value.

In the image processing device according to claim 4 and the image processing program according to claim 10, the processing means determines that the difference value between the maximum value and the minimum value of the brightness of each image constituting the image group is smaller than a predetermined threshold value. Sometimes, either the averaging process or the addition process is allowed to be performed.
In the image processing apparatus according to the fifth aspect and the image processing program according to the eleventh aspect, the processing means performs either the averaging process or the addition process only when the focus used for capturing all the images is the same.

In the image processing apparatus of the sixth aspect, the screen displays an image group. The display control means distinguishes and displays the image group used for the averaging process and the image group used for the addition process on the screen.
In the image processing program according to claim 7, the computer selects a group of continuously captured images from the plurality of images obtained by capturing the subject image, using date / time data indicating the date / time of imaging, and According to the brightness of each image constituting the group, it is made to function as a processing means for performing either an averaging process for averaging the image data constituting each image or an addition process for adding the image data constituting each image.

  In an image processing program according to a twelfth aspect of the invention, the computer is further caused to function as display control means for distinguishing and displaying the image group used for the averaging process and the image group used for the addition process on the screen displaying the image group.

  Without analyzing the format and content of the procedure data, the processing procedure of the image data can be identified, and a composite image can be generated.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a first embodiment of an image processing apparatus and an image processing program of the present invention. The personal computer 10 (image processing apparatus) includes a display 12 for displaying an image, a keyboard 14 and a mouse 16 for inputting commands and numerical values, a control device 18, a CD-ROM 20, and a card reader 22. Yes.

  The control device 18 includes a CPU 24 (processing means and selection means) that controls each device in the personal computer 10, a hard disk 26, a memory 28, and a drive device 30. The CD-ROM 20 is detachably attached to the drive device 30. After the CD-ROM 20 is mounted on the drive device 30, the program stored in the CD-ROM 20 is downloaded to the hard disk 26 in response to a command input via the keyboard 14 or the mouse 16.

The card reader 22 is detachably attached to the control device 18 using a USB code or the like. The memory card MC is composed of a flash memory or the like, and is detachably attached to the card reader 22. The memory card MC stores image data obtained by the imaging operation of the digital camera 32 and incidental data related to the image data described in FIG.
FIG. 2 shows the internal configuration of the digital camera 32. The digital camera 32 has a lens system 34, an aperture 36, a shutter 38, a CCD 40, an A / D conversion circuit 42, a CPU 44, and a slot 46 in which a memory card MC is detachably mounted.

  The lens system 34 includes a plurality of lenses including a focus lens that focuses on the subject and a zoom lens that optically enlarges and shoots the subject. The position of the focus lens and zoom lens in the optical axis direction is adjusted by a lens driving driver (not shown). The diaphragm 36 is disposed between the lens system 34 and the shutter 38. The diaphragm 36 is driven by a diaphragm driver (not shown). The aperture value of the aperture 36 is adjusted to reduce the amount of light that has passed through the lens system 34.

The shutter 38 has a shutter film (not shown) disposed at a position that blocks the optical path from the lens system 34 to the CCD 40. The shutter 38 is driven by a shutter driver (not shown) and adjusts the exposure time during which the CCD 40 is exposed by the light that has passed through the lens system 34. The shutter film is opened to secure an optical path from the lens system 34 to the CCD 40.
The CCD 40 is disposed at a position facing the lens system 34 via the shutter 38. The CCD 40 is driven by a CCD driver (not shown) and can continuously capture subject images formed by the lens system 34. The continuous shooting of the subject image by the CCD 40 is performed in any one of modes (1) to (4) described below (hereinafter referred to as a continuous shooting mode).

(1) In the camera shake suppression mode, subject images are continuously captured with a short exposure time (eg, 10 milliseconds) that does not cause camera shake.
(2) In the noise reduction mode, when the subject image is dark, the imaging sensitivity of the CCD 40 is increased and the subject image is continuously captured.
(3) In the bracket shooting mode, in order to obtain a plurality of images with different exposure conditions, the subject image is continuously captured while changing the aperture value.

(4) In the blur addition mode, subject images are continuously captured with the foreground and the background in focus.
The A / D conversion circuit 42 performs A / D conversion on an image captured by the CCD 40 under the control of the CPU 44 to generate image data. The CPU 44 controls the operation of each device in the digital camera 32. The CPU 44 stores the image data of the subject image obtained by the CCD 40 and the accompanying data attached to the image data in the memory card MC via the slot 46.

  For example, the image data and the incidental data are collectively stored in an image file conforming to Exif (Exchangeable Image File Format). The accompanying data includes date and time data indicating the date and time when the image file was created (date and time when the image was taken), imaging conditions (exposure time, aperture value, and focus lens that focuses on the subject) used to capture the subject image. In-focus position, etc.), and procedure data indicating the processing procedure of image data that can be uniquely defined by each camera manufacturer.

FIG. 3 shows an image processing operation in the first embodiment of the image processing apparatus and the image processing program. The operation shown in FIG. 3 is realized by the CPU 24 (selecting means and processing means) executing a program (image processing program) stored in the hard disk 30.
First, in step S <b> 100, the CPU 24 sequentially reads out image data and incidental data stored in the memory card MC via the card reader 22 and writes them in the memory 28. Thereafter, the process proceeds to step S102.

  In step S <b> 102, the CPU 24 selects an image data group (hereinafter, processed image data group) in which the date / time data continues at a time interval (for example, 1 second) equal to or less than a predetermined value from the image data compliant with the above-described Exif. Note that the time interval equal to or less than the predetermined value is sufficiently shorter than the time required for starting the digital camera 32 and determining the composition in the normal shooting mode (for example, ten to several minutes). For this reason, it is possible to estimate the processed image data group as the image data group captured in the above-described continuous shooting mode using only the date / time data that is normally included in the accompanying data. Thereafter, the process proceeds to step S104.

  In step S104, the CPU 24 integrates the pixel values of the processed image data for each processed image constituting the processed image data group, thereby brightening the image represented by the processed image data (hereinafter, processed image) within the screen. I ask for it. For the integration of pixel values, for example, an integration value of pixel values of discrete pixels in a screen area, a partial area, or a screen in a processed image is obtained. Thereafter, the process proceeds to step S106.

In step S106, the CPU 24 detects whether or not the brightness of all processed images exceeds a predetermined reference value. When the reference value is exceeded, the process proceeds to step S108. On the other hand, when the brightness of all processed images does not exceed the reference value, the process proceeds to step S110.
In step S108, the CPU 24 identifies the processed image data group as an image data group captured in the above-described noise reduction mode, and superimposes the positions of the processed images based on the motion vectors calculated between the processed images. At the same time, the processed image data is multiplied by a coefficient (for example, “1” or less) for each pixel, and a process of adding and averaging all the processed image data (hereinafter referred to as an average process) is performed to generate composite image data. By this averaging process, noise components included in the plurality of processed images are reduced. In this way, the average processing can be performed on the processed image data without using the procedure data included in the accompanying data. Then, the image processing operation in the first embodiment of the image processing apparatus and the image processing program ends.

In step S110, the CPU 24 detects whether or not the brightness of all processed images is equal to or less than a reference value. When it is below the reference value, the process proceeds to step S112. On the other hand, when the brightness of all processed images is not less than the reference value, the process proceeds to step S114.
In step S112, the CPU 24 identifies the processed image data group as an image data group captured in the above-described camera shake suppression mode. With this identification, the CPU 24 superimposes the positions of the processed images using the motion vectors between the processed images that are arranged in the order of the date and time data, and multiplies the processed image data by a coefficient (for example, “1”) for each pixel. Then, composite image data is generated by performing a process of adding all the processed image data (hereinafter referred to as an addition process). By this addition processing, a composite image with proper exposure is generated. In this manner, the addition process can be performed on the processed image data without using the procedure data included in the accompanying data. Then, the image processing operation in the first embodiment of the image processing apparatus and the image processing program ends.

In step S <b> 114, the CPU 24 identifies the processed image data group as an image data group captured in the bracket shooting mode described above, and performs a process of driving the display 12 and displaying the processed image group (hereinafter, a bracket process). By this bracket processing, the user can search for a favorite image from the processed image group.
In this way, the CPU 24 can identify each processing procedure (average processing, addition processing, and bracket processing) of the processed image data simply by comparing the brightness of all processed images with the reference value. For this reason, the identification procedure of the process performed on the processed image can be simplified. Then, the image processing operation in the first embodiment of the image processing apparatus and the image processing program ends.

In the first embodiment, an upper limit value larger than the reference value and a lower limit value smaller than the reference value are set in advance, and the brightness of all processed images is between the set upper limit value and lower limit value. It may be configured to perform the processing of step S106 to step S114 when the size is.
In this case, the step of determining whether or not the brightness of all processed images is between the upper limit value and the lower limit value is executed between step S104 and step S106. In this determination step, when it is determined that the brightness of all processed images is between the upper limit value and the lower limit value, the processes after step S106 are executed.

On the other hand, if it is not determined in this determination step that the brightness of all processed images is between the upper limit value and the lower limit value, gradation correction processing is performed. The gradation correction process is a correction process for adding an image obtained by photographing a same subject brightly and an image photographed darkly to obtain an image having a large dynamic range.
The above upper limit value and lower limit value are determined by the brightness of two-frame images (bright and dark images) on which gradation correction processing is performed. That is, the upper limit value is smaller than the brightness of the bright image at the time of gradation correction and larger than the brightness of the image obtained in other shooting modes, and the lower limit value is a dark image at the time of gradation correction. The brightness is set to be larger than the brightness of the image and smaller than the brightness of the image obtained in the other shooting modes.

  Further, the maximum brightness value and the minimum brightness value may be obtained between each image in the series of image groups, and the difference value may be compared with a threshold value to identify the image group to be subjected to the gradation correction process. . That is, when the difference value is larger than the threshold value, it is determined that the image group is to be subjected to gradation correction. When the difference value is equal to or less than the threshold value, the processes after step S106 are executed. However, this threshold value is set to be larger than the difference value between the maximum value and the minimum value of the brightness between the images in the image group obtained in the bracket shooting. Such a determination step between the difference value and the threshold value is also executed between step S104 and step S106. With such a configuration, it is possible to identify an image group to be subjected to gradation correction processing from the brightness of the image.

  As described above, in the first embodiment, it is possible to identify the processing procedure of image data even when the incidental data of the image file includes only date / time data. Therefore, the process for analyzing the procedure data can be eliminated. For this reason, it is possible to identify the processing procedure even for old image data in which the processing procedure is not stored in the maker note. As a result, either the averaging process or the addition process can be performed on a wide range of image data, and an image processing apparatus that is convenient for the user can be provided.

  FIG. 4 shows an image processing operation in the second embodiment of the image processing apparatus and the image processing program. In this embodiment, the program stored in the hard disk 30 to be executed by the CPU 24 is different from the first embodiment of the image processing apparatus and the image processing program. FIG. 4 is the same as FIG. 3 except that step S200 is executed after step S102 of the first embodiment (FIG. 3) is executed, and one of steps S202 and S104 is executed. .

Detailed description of the same processing as in FIG. 3 described above will be omitted. 4 is realized by the CPU 24 (selecting means and processing means) executing a program (image processing program) stored in the hard disk 30.
First, after steps S100 and S102 are executed and a processed image data group is selected, in step S300, the CPU 24 determines whether the focus lens included in the auxiliary data is included in all the processed image data constituting the processed image data group. It is detected whether or not the focal position is the same. When it is detected that the in-focus position is the same, steps S104 to S114 are executed, and the image processing operation in the third embodiment of the image processing apparatus and the image processing program ends. On the other hand, if it is detected that all the processed image data have different in-focus positions, the process proceeds to step S302.

  In step S302, the CPU 24 identifies the processed image data group as an image data group captured in the above-described blur addition mode, and adds blur using a plurality of processed image data constituting the processed image data group (hereinafter, referred to as “processed image data group”). , Blur addition processing) to generate composite image data. By this blur addition processing, a composite image in which the blur state is changed can be obtained from the image focused on the near view and the image focused on the distant view. As described above, the CPU 24 can identify each processing procedure (average processing, addition processing, bracket processing, and blur addition processing) of the processed image data without using the procedure data included in the accompanying data. Then, the image processing operation in the second embodiment of the image processing apparatus and the image processing program ends.

As described above, in the second embodiment, the same effect as that of the first embodiment can be obtained. Furthermore, each processing procedure (average processing, addition processing, bracket processing, and blur addition processing) of the processed image data can be identified without using procedure data, and each processing can be performed.
In the first and second embodiments described above, the example in which the CPU 24 selects the processed image data group with reference to the date / time data has been described. The present invention is not limited to such an embodiment. For example, as shown in FIG. 5, the CPU 24 (display control means) uses the image data and the auxiliary data written in the memory card MC to process the image group PA used for the average process and the process image used for the addition process. The group PB is displayed on the display 12 (screen) as a reduced image for list display.

  This display allows the user to grasp the series of processed image groups PA and PB at a glance, so whether to add images to the processed image groups PA and PB or delete images from the processed image groups PA and PB, respectively. Etc. can be judged. In addition, images that are excluded from the averaging process and the addition process due to erroneous rewriting of date / time data and file names can be excluded from the processed image groups PA and PB, respectively.

  As shown in FIG. 5, character strings (“average process” and “addition process”) indicating the processing contents are enclosed in the process image groups PA and PB, or surrounded by different line type frame lines. By displaying them in association with each other, the user can easily determine a process and a processing target suitable for obtaining a composite image intended by the user. As shown in FIG. 6, character strings (“average processing” and “addition processing”) indicating the processing contents may be displayed in association with the combined images SPA and SPB after processing.

  In the first and second embodiments described above, the example in which the brightness of the processed image group is used to determine the processing procedure has been described. The present invention is not limited to such an embodiment. The CPU 24 may determine either the averaging process or the addition process by comparing the exposure value (exposure time and aperture value) included in the incidental data with a reference value determined in advance for each processed image data.

  As mentioned above, although this invention was demonstrated in detail, said embodiment and its modification are only examples of this invention, and this invention is not limited to this. Obviously, modifications can be made without departing from the scope of the present invention.

  The present invention is applied to an image processing apparatus and an image processing program that perform image processing on a plurality of captured images.

1 is a block diagram illustrating a first embodiment of an image processing apparatus and an image processing program of the present invention. It is a block diagram which shows the internal structure of a digital camera. It is a flowchart which shows the image processing operation in 1st Embodiment of an image processing apparatus and an image processing program. It is a flowchart which shows the image processing operation in 2nd Embodiment of an image processing apparatus and an image processing program. It is explanatory drawing which shows the reduced image displayed on the display. It is explanatory drawing which shows the reduced image displayed on the display.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Personal computer, 12 ... Display, 14 ... Keyboard, 16 ... Mouse, 18 ... Control device, 20 ... CD-ROM, 22 ... Card reader, 24, 44 ... CPU, 26 ... Hard disk, 28 ... Memory, 30 ... Drive Device 32 ... Digital camera 34 ... Lens system 36 ... Aperture 38 ... Shutter 40 ... CCD 42 ... A / D conversion circuit 46 ... Slot MC ... Memory card

Claims (12)

A selection means for selecting a group of images captured continuously using date and time data indicating the imaging date and time from a plurality of images obtained by imaging a subject image;
Processing means for performing either an averaging process for averaging the image data constituting each image or an addition process for adding the image data constituting each image according to the brightness of each image constituting the image group An image processing apparatus comprising: The image processing apparatus according to claim 1.
The processing means performs the averaging process when the brightness of all the images constituting the image group exceeds a reference value, and performs the addition process when the brightness of all the images is equal to or less than the reference value. An image processing apparatus. The image processing apparatus according to claim 2.
The processing means includes
When the reference value is equal to or lower than a predetermined upper limit value and equal to or higher than a predetermined lower limit value, the brightness of all the images is equal to or lower than the upper limit value and exceeds the reference value. An image processing apparatus that performs an averaging process and performs the addition process when the brightness of all the images is equal to or lower than a reference value and equal to or higher than the lower limit value. The image processing apparatus according to claim 2.
The processing means includes
Allowing either the averaging process or the adding process to be performed when it is determined that the difference between the maximum value and the minimum value of the brightness of each image constituting the image group is smaller than a predetermined threshold value An image processing apparatus. The image processing apparatus according to claim 2.
The image processing apparatus characterized in that the processing means performs either the averaging process or the adding process only when the focus used for capturing all the images is the same. The image processing apparatus according to claim 1.
A screen for displaying the image group;
An image processing apparatus comprising: a display control unit configured to distinguish and display an image group used for the averaging process and an image group used for the addition process on the screen. Computer
From a plurality of images obtained by capturing a subject image, a group of images captured continuously is selected using date / time data indicating the imaging date and time, and the brightness of each image constituting the image group is selected. An image processing program for functioning as a processing means for performing either an averaging process for averaging image data constituting each image or an addition process for adding image data constituting each image. The image processing program according to claim 7,
The processing means performs the averaging process when the brightness of all the images constituting the image group exceeds a reference value, and performs the addition process when the brightness of all the images is equal to or less than the reference value. An image processing program characterized by that. The image processing program according to claim 8.
The processing means includes
When the reference value is equal to or lower than a predetermined upper limit value and equal to or higher than a predetermined lower limit value, the brightness of all the images is equal to or lower than the upper limit value and exceeds the reference value. An image processing program that performs an averaging process and performs the addition process when the brightness of all the images is equal to or lower than a reference value and equal to or higher than the lower limit value. The image processing program according to claim 8.
The processing means includes
Allowing either the averaging process or the adding process to be performed when it is determined that the difference between the maximum value and the minimum value of the brightness of each image constituting the image group is smaller than a predetermined threshold value An image processing program. The image processing program according to claim 8.
The image processing program characterized in that the processing means performs either the averaging process or the adding process only when the focus used for capturing all the images is the same. The image processing program according to claim 7,
The computer,
An image processing program for further functioning as display control means for distinguishing and displaying an image group used for the averaging process and an image group used for the addition process on a screen for displaying the image group.

Images