JP2007020071A - Imaging apparatus, imaging method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus, an imaging method, and a program capable of outputting an image desired by user, by properly correcting pixel data, at compression of a composite image. <P>SOLUTION: The imaging apparatus 1 includes: imaging means 11 to 15; a positional change extracting means 20; an image composite means 20; and an image compression means 20. The image compression means 20 includes a luminance calculation means 20 for calculating the luminance of each pixel of a composite image; a luminance correction means 20 for correcting the luminance of a target pixel, on the basis of the luminance of peripheral pixels of a prescribed target pixel of the composite image; and a pixel data determining means 20 that pixel data of a concerned pixel have a value between a value equivalent to the luminance corrected by the luminance correction means 20 and a value equivalent to the luminance at a preset proper exposure, when the luminance of the pixel in the composite image is within a preset proper luminance range or that the pixel data of the pixel have a value equivalent to the luminance corrected by the luminance correction means 20, when the luminance of the pixel in the composite image is not within the proper luminance range. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program.

2. Description of the Related Art Conventionally, there is a digital camera as an imaging device that can capture a plurality of images with different exposures and create a combined image with an expanded dynamic range by combining the images.
In such a digital camera, when the gradation of the composite image is compressed, a straight line determined based on the ratio between the number of gradations of the composite image and the number of gradations of the output image, and a histogram indicating the luminance distribution of the composite image, There is a method in which a gradation conversion table is created based on a combined curve obtained by combining the above and the gradation is compressed with reference to the gradation conversion table (for example, see Patent Document 1).
In addition, Retinex processing is well known as a method for correcting a composite image, which is digital data, when compressing the gradation of a composite image. Various modifications are considered for the Retinex processing, and it is widely used as an image correction method (see, for example, Patent Document 2).
JP 2003-46859 A JP 2004-164121 A

By the way, in the above-mentioned Patent Document 1, it is assumed that the ratio of the area of an important subject in a composite image with a wide dynamic range is large, and the luminance values near the peak of the histogram are distributed to as many gradations as possible. By determining the gradation conversion table, a decrease in contrast of an important subject is suppressed.
However, there are cases where there are multiple important subjects in the composite image in the composite image, and there are cases where there is a relatively wide area with uniform brightness in the background. In such cases, the same gradation conversion table is used. When used, there is a problem that some compressed images cannot be output as a compressed image desired by the user.

  Accordingly, the present invention has been made to solve the above-described problem, and an imaging apparatus and an imaging apparatus that can appropriately correct pixel data when a composite image is compressed and can output a compressed image desired by a user. An object is to provide a method and a program.

According to the first aspect of the present invention, there are provided an imaging unit that captures a plurality of images with different exposures, a position change extraction unit that extracts a change in position in an image of a subject from the images captured by the imaging unit, and each image Image combining means for creating a composite image by combining the image, and image compression means for compressing the composite image combined by the image composition means in accordance with the output, wherein the image compression means Luminance calculation means for calculating the brightness of each pixel, brightness correction means for correcting the brightness of the target pixel based on the brightness of surrounding pixels of the target pixel, using the predetermined pixel of the composite image as the target pixel, and the composite image When the luminance of the pixel in the pixel is within the preset appropriate luminance range, the pixel data of the pixel is preset with a value corresponding to the luminance corrected by the luminance correction means When the luminance of the pixel in the composite image is not within the appropriate luminance range, the pixel data of the pixel is corrected by the luminance correction unit. Pixel data determining means for setting a value corresponding to luminance.
Here, the appropriate luminance range refers to a range of luminance values that are allowed in a pixel that is considered to have an appropriate exposure when imaged.

  According to a second aspect of the present invention, in the imaging apparatus according to the first aspect, the pixel data determining unit is configured to detect the pixel when the luminance of the pixel in the composite image is within a preset appropriate luminance range. The pixel data is determined to be a value calculated by a weighted average of a value corresponding to the luminance corrected by the luminance correction means and a value corresponding to the luminance at a preset appropriate exposure.

  According to a third aspect of the present invention, in the imaging method, an imaging step of capturing a plurality of images with different exposures, and a position change extraction step of extracting a change in position in the image of the subject from the images captured by the imaging step And an image composition step for composing each image to create a composite image, and an image compression step for compressing the composite image synthesized by the image composition step according to an output, the image compression step comprising: A luminance calculating step of calculating the luminance of each pixel of the synthesized image, and a luminance correcting step of correcting the luminance of the pixel of interest based on the luminance of the surrounding pixels of the pixel of interest, with the predetermined pixel of the synthesized image as the pixel of interest. When the luminance of the pixel in the composite image is within a preset appropriate luminance range, the pixel data of the pixel corresponds to the luminance corrected by the luminance correction step. And the value corresponding to the luminance at the appropriate exposure set in advance, and the pixel data of the pixel is not the luminance correction when the luminance of the pixel in the composite image is not within the appropriate luminance range. And a pixel data determining step that sets a value corresponding to the luminance corrected by the step.

  According to a fourth aspect of the present invention, in a program, a position change for extracting a change in position in an image of a subject from an image picked up by the image pickup means in a computer comprising image pickup means for picking up a plurality of images with different exposures An extraction function, an image composition function for compositing each image to create a composite image, a brightness calculation function for calculating the brightness of each pixel of the composite image, and a target pixel as a predetermined pixel of the composite image, the target pixel When the luminance correction function for correcting the luminance of the pixel of interest based on the luminance of the peripheral pixel of the pixel and the luminance of the pixel in the composite image are within a preset appropriate luminance range, the pixel data of the pixel is A pixel between the value corresponding to the luminance corrected by the luminance correction function and the value corresponding to the luminance at a preset appropriate exposure, and the pixel in the composite image When the luminance is not within the appropriate luminance range, the pixel data of the pixel is realized with a pixel data determination function that sets a value corresponding to the luminance corrected by the luminance correction function. .

According to the first aspect of the present invention, a plurality of images with different exposures are picked up by the image pickup means, and a change in position in the subject image is extracted from the image picked up by the position change extraction means. Then, a plurality of captured images are synthesized by the image synthesizing unit to create a synthesized image. At this time, based on the change in position extracted by the position change extraction means, the composition is performed in a state where the positions of the respective pixels are matched.
The created composite image is compressed in accordance with the output by the image compression means. In the compression process, the brightness calculation means calculates the brightness of each pixel of the composite image, and the brightness correction means is a predetermined one of the composite images. The pixel at the position is set as the pixel of interest, and the luminance of the pixel of interest is corrected based on the luminance of surrounding pixels existing around the pixel of interest.
Then, when the pixel data determining unit has the luminance of the pixel in the composite image within the preset appropriate luminance range, the pixel data of the pixel is preliminarily set to a value corresponding to the luminance corrected by the luminance correcting unit. If the luminance of the pixel in the composite image is not within the appropriate luminance range, the pixel data of the pixel is corrected by the luminance correction unit. The value corresponds to the luminance.

Thereby, when compressing the composite image, the brightness of the target pixel to be corrected is corrected based on the brightness of the surrounding pixels, so that the brightness of the target pixel in the composite image is the same as in the past. When the peripheral pixels have different luminances, both pixels of interest are not corrected to the same luminance, and each pixel can be corrected appropriately. Therefore, accuracy degradation due to image compression can be reduced.
In addition, when the pixel data is within an appropriate luminance range set in advance, the pixel data after compression is determined in consideration of the pixel data captured with the appropriate luminance. Since the correction is performed so as to approach the appropriate exposure while leaving the natural characteristics of the time as much as possible, a compressed image desired by the user can be output.

  According to the second aspect of the present invention, the pixel data determination unit corrects the pixel data of the pixel by the luminance correction unit when the luminance of the pixel in the composite image is within a preset appropriate luminance range. Therefore, it is determined to be a value calculated by weighted average of the value corresponding to the brightness and the value corresponding to the brightness at the preset appropriate exposure. Can be adjusted.

According to the third aspect of the present invention, a plurality of images with different exposures are captured in the imaging step, and a change in position in the image of the subject is extracted from the image captured in the position change extraction step. Then, a plurality of captured images are combined in an image combining step to create a combined image. At this time, based on the change in the position extracted in the position change extraction step, the composition is performed in a state where the positions of the respective pixels are matched.
The created composite image is compressed according to the output in the image compression process. In the compression process, the brightness calculation process calculates the luminance of each pixel of the composite image, and the brightness correction process calculates a predetermined value from the composite image. The pixel at the position is set as the pixel of interest, and the luminance of the pixel of interest is corrected based on the luminance of surrounding pixels existing around the pixel of interest.
Then, in the pixel data determination step, when the luminance of the pixel in the composite image is within the preset appropriate luminance range, the pixel data of the pixel is preliminarily set to a value corresponding to the luminance corrected in the luminance correction step. When the brightness of the pixel in the composite image is not within the proper brightness range, the pixel data of the pixel is corrected in the brightness correction step. The value corresponds to the luminance.

Thereby, when compressing the composite image, the brightness of the target pixel to be corrected is corrected based on the brightness of the surrounding pixels, so that the brightness of the target pixel in the composite image is the same as in the past. When the peripheral pixels have different luminances, both pixels of interest are not corrected to the same luminance, and each pixel can be corrected appropriately. Therefore, accuracy degradation due to image compression can be reduced.
In addition, when the pixel data is within an appropriate luminance range set in advance, the pixel data after compression is determined in consideration of the pixel data captured with the appropriate luminance. Since the correction is performed so as to approach the appropriate exposure while leaving the natural characteristics of the time as much as possible, a compressed image desired by the user can be output.

According to the fourth aspect of the present invention, a plurality of images with different exposures are picked up by the image pickup means, and a change in position in the image of the subject is extracted from the image picked up by the position change extraction function. Then, a plurality of captured images are synthesized by the image synthesis function to create a synthesized image. At this time, based on the change in position extracted by the position change extraction function, composition is performed in a state where the positions of the respective pixels are matched.
The created composite image is compressed according to the output by the image compression function. In the compression process, the brightness calculation function calculates the luminance of each pixel of the composite image, and the brightness correction function calculates a predetermined value from the composite image. The pixel at the position is set as the pixel of interest, and the luminance of the pixel of interest is corrected based on the luminance of surrounding pixels existing around the pixel of interest.
When the pixel data determination function causes the luminance of the pixel in the composite image to be within a preset appropriate luminance range, the pixel data of the pixel is preliminarily set to a value corresponding to the luminance corrected by the luminance correction function. When the brightness of the pixel in the composite image is not within the proper brightness range, the pixel data of the pixel is corrected by the brightness correction function. The value corresponds to the luminance.

Thereby, when compressing the composite image, the brightness of the target pixel to be corrected is corrected based on the brightness of the surrounding pixels, so that the brightness of the target pixel in the composite image is the same as in the past. When the peripheral pixels have different luminances, both pixels of interest are not corrected to the same luminance, and each pixel can be corrected appropriately. Therefore, accuracy degradation due to image compression can be reduced.
In addition, when the pixel data is within an appropriate luminance range set in advance, the pixel data after compression is determined in consideration of the pixel data captured with the appropriate luminance. Since the correction is performed so as to approach the appropriate exposure while leaving the natural characteristics of the time as much as possible, a compressed image desired by the user can be output.

The best mode of an imaging apparatus, an imaging method, and a program according to the present invention will be described below in detail with reference to the drawings.
<Configuration of imaging device>
FIG. 1 is a block diagram illustrating a configuration of the imaging apparatus 1.
The imaging apparatus 1 includes an optical system 11 for condensing and forming an image of a subject, a photoelectric conversion unit 12 for digitizing to capture an image formed by the optical system 11, and strobe light emission for strobe light emission. Unit 13, zoom drive unit 14 that performs zoom adjustment, focus drive unit 15 that adjusts the focus, display unit 16 that displays an image formed by optical system 11, and operation input unit 17 that performs operation input. , And a control unit 20 that controls the operation of each unit.
The optical system 11, the photoelectric conversion unit 12, the strobe light emitting unit 13, the zoom driving unit 14, the focus driving unit 15 and the like constitute an imaging unit.

The control unit 20 includes a CPU 21 that executes each process in accordance with a process program related to operation control of each unit, and a memory 22 that stores a process program, image data, and the like for executing each process.
In the memory 22, a processing program is developed, a work area 23 for performing processing based on the program, a program area 24 in which processing programs relating to operation control of each unit are stored, and an image formed by the optical system 11, and a photoelectric conversion unit A data area 25 is formed for storing the image data of the image digitized by No. 12 and the luminance range of the pixels that are recognized as an appropriate exposure range for imaging the subject.
The control unit 20 is connected to an external external memory 26 so that image data can be stored.

FIG. 2 is a configuration block diagram showing the program area 24.
The program area 24 stores a position change extraction program 24a that compares two image data captured at different exposures, for example, and extracts a change in position in the subject image. That is, when the CPU 21 executes the position change extraction program 24a, the control unit 20 functions as a position change extraction unit.
In the program area 24, an image synthesis program 24b for synthesizing the captured images to create one synthesized image is stored. That is, when the CPU 21 executes the image composition program 24b, the control unit 20 functions as an image composition unit.
The program area 24 stores an image compression program 24c that compresses the composite image synthesized by the image synthesis program 24b in accordance with the output. That is, when the CPU 21 executes the image compression program 24c, the control unit 20 functions as an image compression unit.
The program area 24 stores an image processing program 24d for performing image processing on the compressed image compressed by the image compression program 24c.

Here, the above-described image compression program 24c has a luminance calculation program 24f for calculating the luminance of each pixel of the composite image, as shown in FIG. That is, when the CPU 21 executes the luminance calculation program 24f, the control unit 20 functions as a luminance calculation unit.
The image compression program 24c includes a luminance correction program 24g that corrects the luminance of the pixel of interest based on the luminance of pixels around the pixel of interest using a predetermined pixel of the synthesized image as the pixel of interest. That is, when the CPU 21 executes the brightness correction program 24g, the control unit 20 functions as a brightness correction unit.
In addition, when the luminance of the pixel in the composite image is within the appropriate luminance range stored in the data area 25, the image compression program 24c sets the pixel data of the pixel to the luminance corrected by the luminance correction program 24g and appropriate. If the luminance of the pixel in the composite image is not within the appropriate luminance range stored in the data area 25, the pixel data of the pixel is A pixel data determination program 24h having a value corresponding to the luminance corrected by the luminance correction program 24g is included. That is, when the CPU 21 executes the pixel data determination program 24h, the control unit 20 functions as a pixel data determination unit.

<Imaging process>
An imaging process by the imaging apparatus 1 will be described.
As shown in FIGS. 1 and 4, when the user presses an image capturing button that constitutes the operation input unit 17, the scene captured by the optical system 11 is condensed on the photoelectric conversion unit 12, and the photoelectric conversion unit 12 is a digital image. Create At this time, two images are picked up by changing the exposure time using the electronic shutter of the photoelectric conversion unit 12 and the mechanical shutter of the optical system 11 (step S1: imaging step).
Next, the CPU 21 executes the position change extraction program 24a to extract a position change in the subject image from two images with different exposures (step S2: position change extraction step). In order to extract a change in the position of the subject, feature points of the captured image are extracted. When extracting the feature points, a finite number of eigenvalues of the image are extracted by a method such as the KLT method to obtain feature points. Then, in order to know where the extracted feature point has moved in the next image, a point closest to the feature point is searched. This is performed with a plurality of feature points, and the transformation coordinates of the images are obtained by associating the position coordinates of the feature points between the two images.

  Next, the CPU 21 executes the image composition program 24b to synthesize the two captured images to create one composite image (step S3: image composition step). In the synthesis of the captured image, as shown in FIG. 5, the image data of the short-exposure captured image is corrected with the exposure ratio in accordance with the image data of the long-exposure captured image out of the two image data. . Specifically, assuming that the image data of a captured image with a long exposure is Pl, the image data of a captured image with a short exposure is Ps, and the exposure amount ratio is k, the CPU 21 converts the conversion matrix calculated by the position change extraction program 24a. If the value obtained by combining the position coordinates of both images and multiplying the image data Ps of the captured image with a short exposure by the exposure amount ratio k is larger than a predetermined luminance threshold, the image data Ps of the captured image with a short exposure When the value obtained by multiplying the image data Ps of the captured image with a short exposure by the exposure ratio k is equal to or less than a predetermined luminance threshold, the image obtained by multiplying the exposure amount ratio k by the exposure amount ratio k is used. The image data Pl of the image is used.

Next, the CPU 21 executes the image compression program 24c to compress the combined image formed by the image combining program 24b in accordance with the output range of the display unit 16 (step S4: image compression process).
Here, the compression processing of the composite image will be described with reference to FIGS. 6 and 7. When the CPU 21 executes the luminance calculation program 24 f, the control unit 20 functions as the luminance calculation unit 101, and each pixel of the composite image Is calculated (step S41: luminance calculation step). Next, when the CPU 21 executes the luminance correction program 24g, the control unit 20 functions as the luminance correction unit 102, and performs luminance correction using peripheral pixels around the target pixel with the predetermined pixel of the synthesized pixel as the target pixel. (Step S42: luminance correction step). As a luminance correction method, for example, a single-scale retinal method of Retinex processing, which is a known method, is used. Retinex processing is a pixel data correction method that models vision and adds peripheral pixel information to the pixel of interest, and gain adjustment is performed in each part of the image according to the brightness and darkness of the image, that is, the difference in luminance. Therefore, it is possible to effectively compress a composite image with an expanded dynamic range. The luminance correction by the Retinex process is expressed by the following equation (1) when the luminance component Y (x, y) and the peripheral visual field function F (x, y) of the target pixel are used.
Yr = logY (x, y) -log {Fn (x, y) * Y (x, y)} (1)
Here, the peripheral visual field function F (x, y) is expressed by the following equation (2), where r is the distance between the target pixel and the peripheral pixels, and c is a scale variable.
F (x, y) = Ke− ^{r2 / c2} (2)
K is determined so that the sum of the peripheral visual field functions is 1.
The result of equation (1) is normalized by equation (3) and output. Here, u is a gain, and v is an offset, which is determined by the number of bits of the output luminance signal.
Yout = uYr + v (3)

Next, when the CPU 21 executes the pixel data determination program 24h, the control unit 20 functions as the output luminance calculation unit 103 and the output image creation unit 104, and determines the pixel data of the compressed image after compression.
Specifically, the CPU 21 determines whether or not the luminance of the target pixel is within the appropriate luminance range of the pixel data captured with appropriate exposure (step S43). This is to create a natural output image close to an image captured with appropriate exposure.
Here, the pixel data having the appropriate luminance is Pa in FIG. 5, and it can be inferred which part of the composite image corresponds to the proper exposure condition without knowing the actual exposure. .
In step S43, when the CPU 21 determines that the luminance of the target pixel is within the range of the appropriate luminance (step S43: YES), the CPU 21 calculates the average of the luminance corrected by the Retinex process and the luminance of the pixel with the appropriate exposure. The average value is calculated as pixel data (step S44: pixel data determination step). In calculating the average value, the average may be simply calculated, or the average is calculated by weighting the corrected luminance or the luminance of the pixel with appropriate exposure using a weighting factor set in advance by the user. May be. Specifically, the weighting is averaged so as to weight the corrected luminance so as to approach the corrected luminance when the degree of processing of the pixel data is to be increased, and conversely, When it is desired to reduce the degree of processing, averaging is performed so that the appropriate exposure brightness is weighted so as to approach the proper exposure brightness.

On the other hand, when the CPU 21 determines in step S43 that the luminance of the target pixel is not within the appropriate luminance range (step S43: NO), the CPU 21 determines the pixel data so that the luminance is corrected by the Retinex process. .
Next, the CPU 21 calculates a luminance ratio between the luminance of the synthesized image and the luminance of the compressed image compressed according to the output range of the display unit 16 (step S45), and then the CPU 21 calculates the calculated luminance ratio. The pixel data of the composite image is multiplied (step S46), and the image compression process is terminated.

Here, the advantages compared with the conventional method from the correction of the pixel data to the determination of the pixel data will be described.
For example, it is assumed that there are two target pixels P1 and P2 having the same luminance in the composite image. In this case, when the pixel data is corrected by looking at only the luminance of the target pixel, the corrected pixel data of the target pixels P1 and P2 are both pixel data having the same value. However, when the pixel data is corrected in consideration of the peripheral pixels, the corrected pixel data varies depending on the luminance difference of the peripheral pixels as shown in FIG. Thereby, it is possible to reduce the accuracy deterioration of the corrected image.
Further, when the luminance of the target pixels P1 and P2 is within the luminance range of the pixel data captured with appropriate exposure, the pixel data of the target pixels P1 and P2 is corrected by the average or the weighted average. It is determined to be a value corresponding to the brightness between the brightness and the brightness of the pixel data captured with appropriate exposure. As a result, the pixel data is corrected in a direction approaching the appropriate luminance, so that the created compressed image can be brought close to an image in a natural state.

Then, after compressing the composite image by the above-described method, the CPU 21 executes an image processing program 24d as shown in FIG. 4 to perform image processing such as gamma correction and color correction on the compressed image, thereby displaying the display unit. An output image to be displayed on the screen 16 is created (step S5).
Next, the CPU 21 displays the output image after the image processing on the display unit 16 (step S6), and ends this processing. Note that the output image displayed on the display unit 16 may be stored in the data area 25 or the external memory 26 at the discretion of the user, or may be forcibly stored in the data area 25 or the external memory 26 when the output image is created. May be memorized.

<Effects of Embodiment>
According to the embodiment, a plurality of images with different exposures are captured, and a change in position in the image of the subject is extracted from the captured images by executing the position change extraction program 24a by the CPU 21. Then, by executing the image synthesis program 24b by the CPU 21, the two captured images are synthesized to create one synthesized image. At this time, based on the change in position extracted by the position change extraction program 24a, the composition is performed in a state where the positions of the respective pixels are matched.
The created composite image is compressed in accordance with the output range of the display unit 16 by execution of the image compression program 24c by the CPU 21, but in the compression processing, each pixel of the composite image is executed by execution of the luminance calculation program 24f by the CPU 21. And the luminance correction program 24g is executed by the CPU 21, and the pixel at a predetermined position in the synthesized image is set as the pixel of interest, and the luminance of the pixel of interest is calculated based on the luminance of peripheral pixels existing around the pixel of interest. to correct.
When the pixel data determination program 24h is executed by the CPU 21 and the luminance of the pixel in the composite image is within a preset appropriate luminance range, the pixel data of the pixel is corrected by the luminance correction program 24g. If the luminance of the pixel in the composite image is not within the appropriate luminance range, the pixel data of the pixel is the luminance The value is equivalent to the luminance corrected by the correction program 24g.

As a result, when the synthesized image is compressed, the luminance of the target pixel to be corrected is corrected based on the luminance of the surrounding pixels. Therefore, the luminance of the target pixel in the synthesized image is the same and the luminance of the peripheral pixels is corrected. Even if they are different, both pixels of interest are not corrected to the same luminance, and each pixel can be corrected appropriately.
In addition, when the pixel data is within the proper luminance range stored in the data area 25, the pixel data after compression is determined in consideration of the pixel data within the proper luminance range. Since the correction is made so as to approach the appropriate exposure while leaving as much as possible the feature at the time of being performed, the compressed image desired by the user can be output.

  Further, when determining the pixel data, when the pixel data determination program 24h executes the pixel brightness in the composite image within the appropriate brightness range set in advance, the pixel data of the pixel is corrected by the brightness correction program 24g. The value calculated by the weighted average of the value corresponding to the luminance and the value corresponding to the luminance at the appropriate exposure set in advance is determined so that the luminance adjustment of the image is requested by changing the weight setting. It will be possible to adjust to match.

<Others>
The present invention is not limited to the above embodiment. In the above-described embodiment, two images are captured and combined with different exposures, but three or more images may be combined. In this case, as the exposure correction value, the exposure correction value of another image may be calculated using the image with the longest exposure as a reference.
Further, the image data of the composite image is not limited to being compressed by the imaging apparatus, and the image data of the composite image may be transmitted to the personal computer and the compression processing may be performed by the personal computer.
In addition, the design can be freely changed within the scope of the invention.

It is a block diagram which shows the structure of an imaging device. It is a block diagram which shows the structure of the program area in FIG. It is a block diagram which shows the structure of the image compression program in FIG. It is a flowchart which shows the flow of a process of a captured image. It is a graph which shows the luminance range recognized as the range of appropriate exposure while showing the comparison of two image data from which exposure differs. It is a block diagram which shows the function of the compression process of a synthesized image. It is a flowchart which shows the flow of the compression process of a synthesized image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 11 Optical system (imaging means)
12 Photoelectric conversion unit (imaging means)
13 Strobe light emitting unit (imaging means)
14 Zoom drive (imaging means)
15 Focus drive unit (imaging means)
17 Operation input unit 20 Control unit (position change extraction unit, image synthesis unit, image compression unit, luminance calculation unit, luminance correction unit, pixel data determination unit)
101 Luminance calculation unit (luminance calculation means)
102 Luminance correction unit (luminance correction means)
103 Output luminance calculation unit (pixel data determining means)

Claims (4)

Imaging means for imaging a plurality of images with different exposures;
Position change extracting means for extracting a change in position in the image of the subject from the image picked up by the image pickup means;
Image composition means for composing each image to create a composite image;
Image compression means for compressing the synthesized image synthesized by the image synthesis means in accordance with output;
With
The image compression means includes
Luminance calculation means for calculating the luminance of each pixel of the composite image;
Luminance correction means for correcting the luminance of the target pixel based on the luminance of the surrounding pixels of the target pixel, with the predetermined pixel of the composite image as the target pixel;
When the luminance of the pixel in the composite image is within a preset appropriate luminance range, the pixel data of the pixel is a value corresponding to the luminance corrected by the luminance correction unit and a preset appropriate exposure. Between the values corresponding to the brightness at
When the luminance of the pixel in the composite image is not within the appropriate luminance range, the pixel data determination unit sets the pixel data of the pixel to a value corresponding to the luminance corrected by the luminance correction unit;
An imaging apparatus comprising: The pixel data determining means includes
When the luminance of a pixel in the composite image is within a preset appropriate luminance range, the pixel data of the pixel is set to a value corresponding to the luminance corrected by the luminance correction unit and a preset appropriate exposure. The imaging apparatus according to claim 1, wherein the imaging device is determined to be a value calculated by weighted averaging with a value corresponding to luminance. An imaging step of imaging a plurality of images with different exposures;
A position change extraction step of extracting a change in position in the image of the subject from the image picked up by the image pickup step;
An image composition step of composing each image to create a composite image;
An image compression step of compressing the combined image combined by the image combining step according to an output;
With
The image compression step includes
A luminance calculation step of calculating the luminance of each pixel of the composite image;
A luminance correction step of correcting the luminance of the target pixel based on the luminance of the peripheral pixels of the target pixel, with the predetermined pixel of the composite image as the target pixel,
When the luminance of the pixel in the composite image is within a preset appropriate luminance range, the pixel data of the pixel is a value corresponding to the luminance corrected by the luminance correction step and a preset appropriate exposure. Between the values corresponding to the brightness at
When the luminance of the pixel in the composite image is not within the appropriate luminance range, the pixel data determination step in which the pixel data of the pixel is a value corresponding to the luminance corrected by the luminance correction step;
An imaging method comprising: In a computer comprising an imaging means for imaging a plurality of images with different exposures,
A position change extraction function for extracting a change in position in the image of the subject from the image picked up by the image pickup means;
An image composition function for composing each image to create a composite image;
A luminance calculation function for calculating the luminance of each pixel of the composite image;
A luminance correction function that corrects the luminance of the target pixel based on the luminance of the peripheral pixels of the target pixel, with the predetermined pixel of the composite image as the target pixel;
When the luminance of the pixel in the composite image is within a preset appropriate luminance range, the pixel data of the pixel is a value corresponding to the luminance corrected by the luminance correction function and a preset appropriate exposure. Between the values corresponding to the brightness at
When the luminance of the pixel in the composite image is not within the appropriate luminance range, the pixel data determination function that sets the pixel data of the pixel to a value corresponding to the luminance corrected by the luminance correction function;
A program to realize

Images