JP6157274B2 - Imaging apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an information processing method, and a program.

A night view or a starry sky is one of the subjects of a user who takes a picture. Although there has been a strong demand for users to shoot beautiful starry sky, it is difficult to shoot beautiful starry sky with imaging devices such as digital cameras, and advanced knowledge about specialized equipment and shooting settings is required. It had been. Therefore, in recent years, a digital camera equipped with a function that allows a user to easily photograph a beautiful starry sky has been proposed.
In particular, exposure setting is a problem when shooting a night view or a starry sky. When shooting a dark subject such as a starry sky, it is necessary to increase the sensitivity or increase the exposure time to incorporate more light into the imaging device. However, if the sensitivity is increased too much, noise will increase and the image quality will deteriorate, and if the exposure time is extended, there will be problems such as image blurring. Moreover, in order to set an appropriate exposure condition that allows the night view and the starry sky to be seen clearly, advanced shooting knowledge by experience was necessary.
In Patent Document 1, as a method for allowing a user to easily set appropriate exposure conditions, there is a technique that allows a user to change exposure settings while viewing the brightness of an image displayed on an LCD (Liquid Crystal Display). It is disclosed.

JP 2013-70298 A

However, in the technique disclosed in Patent Document 1, when a dark starry sky region and a bright ground region exist in the shooting region, even if the user sets the exposure condition while checking the image, the starry sky region, It was difficult to set the brightness of both the ground area properly.
An object of this invention is to provide the technique which image | photographs a to-be-photographed object with appropriate brightness.

  Therefore, the imaging apparatus according to the present invention includes a plurality of images generated by the image generation unit from the image generation unit that generates a plurality of images having different luminances and the luminance of the first image generated by the image generation unit. Synthesis condition generation means for generating a synthesis condition related to the synthesis of the image, and synthesis means for synthesizing the plurality of images based on the synthesis condition generated by the synthesis condition generation means. The separation means for separating a subject image having an area smaller than a predetermined threshold among subject images included in the first image from the first image according to the size of the subject image. The first image is reduced until it is separated, and the synthesis condition is generated using the reduced first image.

  According to the present invention, it is possible to provide a technique for photographing a subject with appropriate brightness.

It is a figure which shows an example of an imaging | photography scene. It is a figure which shows an example of the hardware constitutions of an imaging device. 5 is a flowchart (part 1) illustrating an example of processing according to the first exemplary embodiment. It is a figure which shows an example of a histogram and exposure setting. 5 is a flowchart (part 2) illustrating an example of processing in the first embodiment. It is a figure which shows an example of the concept of a synthetic | combination map production | generation process. It is a figure which shows an example of the table regarding the variable magnification S. 10 is a flowchart illustrating an example of processing in the second embodiment. It is a figure which shows an example of the synthetic | combination map at the time of correct | amending deviation.

The best mode for carrying out the present invention will be described below with reference to the drawings.
<Embodiment 1>
FIG. 1 is a diagram illustrating an example of a shooting scene as a target in the present embodiment.
In the photographic scene of FIG. 1, as areas having different brightness (luminance), a starry sky area that is darker than a predetermined threshold (hereinafter simply referred to as dark) and a brighter area than a predetermined threshold. And a ground area which is a high brightness area (hereinafter simply referred to as bright). In such a case, it has been difficult for the user to photograph both the starry sky region and the ground region with a desired brightness setting using an imaging device such as a digital camera. In the present embodiment, a method for solving such a problem will be described. The shooting scene is not limited to the scene including the starry sky as shown in FIG. 1, and any scene may be used as long as it has a luminance difference. In addition, the imaging apparatus according to the present embodiment, which will be described later with reference to FIG. The same applies to threshold values and the like described below.

FIG. 2 is a diagram illustrating an example of a hardware configuration of the imaging apparatus 100 according to the present embodiment.
The optical system 1 includes a plurality of lens groups and a diaphragm mechanism. The optical system 1 includes a distance measuring lens (FocusLens) 14, a zoom lens (ZoomLens) 15, and a diaphragm mechanism 13.
The image pickup device 2 includes a charge coupled device (CCD), a complementary metal-oxide semiconductor (CMOS), an A / D (Analog / Digital) converter that converts an analog signal into a digital signal, and the like. Further, the image pickup element 2 is covered with an RGB color filter having a Bayer arrangement, for example, so that color imaging can be performed. When the subject image is formed, the image sensor 2 generates image data (image signal) and stores it in the memory 3.
The memory 3 stores various data including image signals converted by the image sensor 2, data relating to threshold values necessary for processing of the imaging device 100, data relating to setting values, and programs for realizing the functions of the imaging device 100. I remember it.
The image processing circuit 4 performs color conversion processing including predetermined pixel interpolation processing for the image signal held in the memory 3, correction processing for distortion caused by the apparatus, shading, aberration, pixel defects, and the like, and color space conversion processing. And an image processing circuit for performing development processing. Further, the image processing circuit 4 performs a predetermined calculation process using the captured image data, determines a shooting condition based on the obtained calculation result, and notifies the system control unit 5 of the determined shooting condition. . Further, the image processing circuit 4 has functions such as image analysis, filter processing, and composition processing, and can generate an image composition map or synthesize an image according to an algorithm described later. Note that the composite map here is an image generated to synthesize images with different brightness. The composite map is an example of a composite condition for combining a plurality of images having different brightness. Details of the composite map will be described later with reference to FIG.

The system control unit 5 controls the entire photographing system. The system control unit 5 controls the shutter speed, the aperture mechanism 13, the distance measuring lens 14, and the zoom lens 15 in order to perform shooting under the shooting conditions determined by the image processing circuit 4, and the exposure amount control unit 6, An instruction is given to the focus lens control unit 7 and the focal length control unit 8.
The exposure amount controller 6 controls the exposure amount by adjusting the aperture mechanism 13 of the optical system 1 and the exposure time and imaging sensitivity of the image sensor 2.
The focus lens control unit 7 controls the distance measuring lens 14 of the optical system 1.
The focal length control unit 8 controls the zoom lens 15 of the optical system 1. More specifically, the focal length control unit 8 changes the focal length in accordance with an instruction from the system control unit 5.
The compression circuit 9 compresses the image into JPEG or the like and records it on the recording medium 10.
The display unit 11 is a display device such as an LCD or an external monitor on the imaging device 100 and displays a captured image generated by the image processing circuit 4.
The operation unit 12 is an input device that receives user input, and includes buttons, a touch panel, and the like. The system control unit determines or changes the operation of the imaging apparatus 100 in accordance with a user operation (instruction) received via the operation unit 12. For example, the system control unit switches the operation mode to a “starry sky shooting mode” for shooting a night scene (starry sky) in accordance with a user operation received via the operation unit 12.
Note that the imaging device 100 related to the imaging device 2, the image processing circuit 4, the system control unit 5, the exposure amount control unit 6, the focus lens control unit 7, the focal length control unit 8, the compression circuit 9, the display unit 11, and the operation unit 12. The function may be realized by software. In this case, the CPU constituting the system control unit executes a program stored in the memory 3 or the like, thereby realizing the functions of the imaging device 100 described above and processing (information processing) related to a flowchart described later.

Next, the operation flow in the starry sky shooting mode in this embodiment will be described.
FIG. 3 is a flowchart showing an example of processing in the starry sky shooting mode in the present embodiment.
In S100, the image processing circuit 4 determines the exposure setting for shooting and advances the process to S101.
FIG. 4A is a diagram illustrating an example of a histogram relating to the luminance of an image. In the histogram of FIG. 4A, the vertical axis represents frequency, and the horizontal axis represents a value based on an image signal.
As an exposure determination algorithm, a histogram of the brightness in the screen as shown in FIG. 4A is generated, taking into consideration that the high luminance area is not saturated and the low luminance area is not blacked out. Generally, the exposure setting is determined so as to balance the whole. However, in the case of a scene in which a dark starry sky region and a bright ground region are mixed as shown in FIG. 1, the shape of the histogram often has a clear contrast with little halftone. Therefore, when the user tries to adjust the entire brightness to the desired brightness using the imaging device, the starry sky region may be too dark and the star may not be noticeable, or the brightness of the ground region may be saturated. . Therefore, in the present embodiment, when shooting a starry sky scene with a contrast difference as shown in FIG. 1, the image processing circuit 4 includes a dark region (region A) indicating a starry sky region in FIG. A predetermined calculation is performed for each of the bright areas (area B) indicating the exposure setting. Then, the image processing circuit 4 stores information on the difference between the obtained setting values of the exposure setting (hereinafter referred to as exposure difference) in the memory 3 and uses the information for developing the captured image described later. Note that, since the image processing circuit 4 determines the exposure setting based on the histogram, which is a known technique, a detailed description thereof is omitted. For example, the luminance value corresponding to the peak of the histogram is an appropriate value. A process for setting the exposure can be considered.

Here, FIG. 4B is a diagram illustrating an example of exposure setting.
For example, if the image processing circuit 4 obtains the exposure setting as shown in FIG. 4B by the above-described method, there is a three-stage exposure difference between the exposure setting A and the exposure setting B. Become. The stage of exposure difference here is based on 1 / (the factorial of 2) of the exposure time. For example, when the exposure time of exposure setting B is (1/2) s with respect to the exposure time 1 s of exposure setting A, the exposure difference is one level, and when (¼) s, the exposure difference is 2. If the exposure time is (1/8) s, the exposure difference is 3 steps. Therefore, the image processing circuit 4 generates an image having a three-stage exposure difference in order to generate an image with brightness desired by the user in both the starry sky region of the region A and the ground region of the region B. do it. Then, the image processing circuit 4 may synthesize the starry sky region and the ground region for each region.

Returning to the description of FIG.
In S101, the system control unit 5 captures a shooting scene according to the exposure setting determined in S100. Here, the image processing circuit 4 will be described later with reference to FIG. 5 and the like on the data of the ground area that has been saturated when the system control unit 5 has taken images under the condition of the exposure setting A in FIG. It cannot be restored by image processing. Therefore, the system control unit 5 captures images under the condition of exposure setting B. Then, the image processing circuit 4 generates an image having a brightness corresponding to the exposure setting A by performing a gain increase of the above-described three exposure differences during image processing to be described later. Here, gain-up refers to a process for increasing luminance. In this example, the system controller 5 captures images under the condition of exposure setting B, and the image processing circuit 4 corrects the exposure difference by increasing the gain by digital signal processing. However, when gain increase is performed by digital signal processing. Noise also increases and the image quality in the starry sky region deteriorates. For this reason, the system control unit 5 captures an under image within a predetermined exposure difference (N steps) range in which the dark side exposure setting A is set as a reference (± 0) and gain increase is allowed. It may be. Note that the imaging apparatus 100 can change the exposure difference (N steps) set in advance according to a user instruction received via the operation unit 12 or the like. The under image referred to here is an image taken with an exposure setting with an exposure difference of −N with respect to the exposure setting reference (± 0). N is a natural number. Thus, the image processing circuit 4 can generate both a bright image and a dark image within a predetermined exposure difference (N stages). That is, the user can obtain an image in which the image quality of the starry sky region is not deteriorated.

Returning to the description of FIG.
In S <b> 102, the image processing circuit 4 performs various image processing described later with reference to FIG. 5 and the like. More specifically, the image processing circuit 4 generates two types of images with different brightnesses based on the image data captured in S101, and combines the generated two types of images according to a combination map described later. .
Hereinafter, the details of the processing characteristic of the present embodiment including the synthesis processing in the processing of S102 will be described with reference to FIG.
FIG. 5 is a flowchart illustrating an example of image processing in S102.
In S200, the image processing circuit 4 holds RAW data that is raw image data captured in S101 of FIG.
In step S <b> 201, the image processing circuit 4 performs image processing 1 for generating an image 1 (first image) such as a YUV image from RAW data. In S202, the image processing circuit 4 performs image processing 2 for generating an image 2 (second image) such as a YUV image from the RAW data. Note that the processing in S201 and S202 is an example of image generation processing. Since the process in which the image processing circuit 4 generates image data such as a YUV image from the RAW data is a known technique, detailed description thereof is omitted. Further, the difference in brightness between the image 1 generated by the image processing circuit 4 and the image 2 is an exposure difference indicated by the information on the exposure difference obtained in S100 and stored in the memory 3. As described above, the image processing circuit 4 can change the luminance by gain-up or gamma conversion in digital signal processing.
In S203, the image processing circuit 4 obtains an image 1 as a result of the processing in S201. In S204, the image processing circuit 4 obtains an image 2 as a result of the processing in S202.

In the processing from S205 to S207, the image processing circuit 4 generates a composite map for combining two images 1 and 2 having different brightness. Here, the image processing circuit 4 generates a composite map as to which of the image 1 and the image 2 should be mainly used based on the image 1 of the under image based on the brightness of each region. . At this time, the composite map is generated so that the bright image of the image 2 is mainly used for the starry sky region, and the dark image (under image) of the image 1 is mainly used for the subject region other than the starry sky such as a building. . Note that the processing from S205 to S207 is an example of the synthesis condition generation processing.
In S205, the image processing circuit 4 reduces the image 1 to a predetermined size. At this time, the image processing circuit 4 uses a predetermined scaling factor S, which will be described later with reference to FIG. 7 and the like, to a size that can reduce the influence of stars in the captured starry sky to some extent in the composite map generation. Reduce 1 Note that the imaging apparatus 100 can change the preset scaling factor S in accordance with a user instruction received via the operation unit 12 or the like. Details of the processing in S205 will be described later with reference to FIG.
In S206, the image processing circuit 4 binarizes the image 1 reduced in S205. Hereinafter, the binarization process in the present embodiment will be described.
The image processing circuit 4 performs a binarization operation according to the following formulas (1) and (2).
M (x, y) = 1, Y (x, y) ≧ Y _TH ... Formula (1)
M (x, y) = 0, Y (x, y) <Y _TH ... (2)
Here, M (x, y) is an output of the binarization process. Y (x, y) is the luminance at the coordinates (x, y). Y (x, y) is an example of luminance information. Y _TH is a predetermined luminance threshold value at coordinates (x, y). Note that the imaging apparatus 100 can change the threshold value of the brightness according to a user instruction received via the operation unit 12 or the like. Further, the imaging apparatus 100 may set an average value of the luminance of the entire screen as a luminance threshold value.
In S207, the image processing circuit 4 enlarges the image 1 binarized in S205 to the original size.

Hereinafter, an example of processing from S205 to S207 will be described with reference to FIG.
FIG. 6 is a diagram illustrating an example of the concept of the composite map generation process.
For example, when the image processing circuit 4 converts an image as shown in FIG. 6A into a composite map by binarization of luminance, a bright ground area, a dark starry area as shown in FIG. Can be separated. However, in this case, the image processing circuit 4 classifies the star, which is a bright luminescent spot, into the same label as the ground area. On the other hand, it is assumed that the image processing circuit 4 reduces the image at a scaling factor S after applying an LPF (Low Pass Filter) to the image as shown in FIG. The LPF is an example of a separation unit that separates subject images that are smaller than a predetermined threshold. In this case, a bright subject having a larger area than a predetermined area remains like a building in the ground area, but a bright subject having a smaller area than the predetermined area such as a star disappears. Therefore, when the binarized image obtained by binarizing the reduced image in FIG. 6C is enlarged to the original size, the image processing circuit 4 acquires a composite map as illustrated in FIG. Will be able to.
Here, the scaling factor S will be described with reference to FIG.
FIG. 7 is a diagram illustrating an example of a table relating to the scaling factor S.
The image processing circuit 4 can predetermine the scaling factor S from the size of the star area in the assumed shooting scene. The size of the star region in the image varies depending on the focal length of the imaging apparatus 100 and the image size (number of pixels). Therefore, the image processing circuit 4 can determine the scaling factor S by determining the assumed star area based on the matrix of the image size and the focal length as shown in the example of FIG. In the case of the example in FIG. 7, when the number of pixels is 12 million pixels or more and the focal length is 28 mm or more, the image processing circuit 4 determines the scaling factor S to be a magnification greater than 0 and equal to or less than 1/16. Note that the imaging apparatus 100 can create a table as shown in FIG. 7 according to a user instruction received via the operation unit 12 or the like and store the table in the memory 3 or the like.

Returning to the description of FIG.
In S208, as described with reference to FIG. 6, the image processing circuit 4 combines the image 1 and the image 2 using the combination map generated by the processing from S205 to S207.
In S209, the image processing circuit 4 obtains an image 3 obtained by combining the image 1 and the image 2 as a result of the processing in S208. That is, the user can obtain an image in which both the starry sky region and the ground region are adjusted to a desired brightness. Further, as described above, the image processing circuit 4 performs binarization after reducing the image in the processing from S205 to S206. As a result, the image processing circuit 4 can reduce the processing time required for the binarization operation as compared to the case where the binarization operation is performed without reducing the image.
As described above, according to the present embodiment, the imaging apparatus 100 can generate an image having a brightness desired by the user even in a shooting scene including a night view or a starry sky with a large exposure level difference.

<Embodiment 2>
In the first embodiment, the imaging apparatus 100 generates two images with different brightness from one photographed image, and combines them according to the combination map. However, as the difference in the setting value of the exposure setting determined in S100 of FIG. 3 increases, the image quality of the output image deteriorates due to noise amplification when the imaging apparatus 100 gains up the under image by digital signal processing. There is a case.
Therefore, in the present embodiment, the image capturing apparatus 100 captures two images with different exposure settings during the capturing process of S101, and combines them according to the composite map. Details of the image processing in S102 in that case will be described with reference to FIG. In the present embodiment, a case where there are two captured images will be described as an example. However, even when there are three or more captured images, the processing described below can be similarly applied.
FIG. 8 is a flowchart illustrating an example of image processing in S102.
More specifically, in the flowchart of FIG. 8, similar to the processing of the flowchart of FIG. 5 described above, the imaging apparatus 100 combines two images with different brightness, and the exposure of the entire screen is desired by the user. It is a flowchart regarding the process which produces | generates the image which becomes exposure.

In S300, the image processing circuit 4 holds RAW data (RAW1) that is captured raw image data. Similarly, in S301, the image processing circuit 4 holds RAW data (RAW2) that is captured raw image data. Here, RAW1 and RAW2 are two captured images with different exposure settings. More specifically, RAW1 is an image taken under an exposure condition set for a brightness area corresponding to the ground area (high luminance area) in FIG. On the other hand, RAW2 is an image taken under an exposure condition set for a brightness area corresponding to the starry sky area (low luminance area) in FIG.
In S302, the image processing circuit 4 performs image processing 1 for generating an image 1 (first image) such as a YUV image from the RAW1. In S303, the image processing circuit 4 performs image processing 2 for generating an image 2 (second image) such as a YUV image from the RAW2. Note that the processing in S302 and S303 is an example of image generation processing.
In S304, the image processing circuit 4 obtains an image 1 as a result of the processing in S302. In S305, the image processing circuit 4 obtains an image 2 as a result of the processing in S303.
The processing from S306 to S308 is the same as the processing from S205 to S207 of FIG. Note that the processing from S306 to S308 is an example of a synthesis condition generation process.

In step S309, the image processing circuit 4 acquires image registration information. When a user captures two images with different exposures using the imaging device 100, particularly when handheld shooting is performed, a difference between the images, that is, a difference in shooting position occurs due to the difference in shooting timing between the two. . Therefore, the image processing circuit 4 needs to estimate the amount of positional deviation between the images from the alignment information acquired in S309, and correct the deviation to synthesize both images as shown in FIG. FIG. 9 is a diagram illustrating an example of a composite map when the deviation is corrected. As an alignment method, there is a method of performing alignment so that the total sum of differences between target images is minimized while gradually shifting. In addition, there is a method of measuring the amount of movement of the imaging apparatus 100 when taking an image using an acceleration sensor or the like of the imaging apparatus 100 and performing reverse correction thereof.
In S310, the image processing circuit 4 synthesizes the image 1 and the image 2 according to the synthesis map while considering the alignment as shown in FIG.
In step S311, the image processing circuit 4 outputs an image 3 that is an image obtained by cutting out an image corresponding to the hatched area in FIG. At this time, the image processing circuit 4 also synthesizes the synthesis map obtained by the processing from S306 to S308 using an area corresponding to the hatched area in FIG.
As described above, according to the present embodiment, the imaging apparatus 100 generates an image having a brightness desired by the user even in a shooting scene including a night view or a starry sky with a large exposure step without causing deterioration in image quality due to gain increase. be able to.

<Other embodiments>
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

  As described above, according to each embodiment described above, it is possible to provide a technique for photographing a subject with appropriate brightness.

  The preferred embodiment of the present invention has been described in detail above, but the present embodiment is not limited to the specific embodiment, and various modifications can be made within the scope of the gist of the present invention described in the claims.・ Change is possible.

Claims (15)

Image generating means for generating a plurality of images having different luminances;
Synthesis condition generation means for generating a synthesis condition relating to the synthesis of a plurality of images generated by the image generation means from the luminance of the first image generated by the image generation means;
A combining unit that combines the plurality of images based on the combining condition generated by the combining condition generating unit;
Have
The synthesizing condition generation unit generates a subject image having an area smaller than a predetermined threshold among subject images included in the first image from the first image according to the size of the subject image. An imaging apparatus that reduces the first image until it is separated by a separating unit that separates, and generates the synthesis condition using the reduced first image.   The image generation means includes a setting value for an exposure setting in a high-luminance area having a luminance higher than a predetermined threshold included in the photographic scene, and a setting for an exposure setting in a low-luminance area having a luminance lower than the predetermined threshold. The imaging apparatus according to claim 1, wherein the plurality of images are generated based on a difference from the value.   The image generation means is configured to cause the difference in luminance based on the difference to be a difference between the luminance of the first image and the luminance of a second image having a higher luminance than the first image. The imaging apparatus according to claim 2, wherein the image and the second image are generated.   When the difference in luminance based on the difference becomes larger than a predetermined threshold, the threshold is a difference between the luminance of the first image and the luminance of the second image. The imaging device according to claim 3, wherein the first image and the second image are generated as described above.   The image generation means generates the first image from an image shot with an exposure setting relating to a high-luminance region having a luminance higher than a predetermined threshold, and has a low luminance with a luminance lower than the predetermined threshold The imaging apparatus according to claim 1, wherein a second image is generated from an image captured with an exposure setting relating to a region.   The imaging apparatus according to claim 3, wherein the synthesis condition generation unit generates, as the synthesis condition, an image obtained by separating a subject image included in the first image according to an area and binarizing the image. . The synthesis condition generation means includes
Binarization means for binarizing the reduced image based on the luminance information of the reduced image.
Enlarging means for enlarging the binarized image binarized by the binarizing means to the original size;
Have
The imaging apparatus according to claim 1, wherein an image enlarged by the enlargement unit is generated as a synthesis condition. An imaging device for generating an image,
Image generating means for generating a plurality of images having different luminances;
Synthesis condition generation means for generating a synthesis condition relating to the synthesis of a plurality of images generated by the image generation means from the luminance of the first image generated by the image generation means;
A combining unit that combines the plurality of images based on the combining condition generated by the combining condition generating unit;
Have
The synthesis condition generation unit reduces the first image at a magnification set in advance with respect to a combination of the number of pixels of the imaging device and a focal length, and uses the reduced first image. An imaging device that generates a synthesis condition.   When the number of pixels of the imaging device is 12 million pixels or more and the focal length is 28 mm or more, the reduced image is reduced from the first image at a magnification greater than 0 and 1/16. The imaging device according to claim 8, wherein the imaging device is an image.   In the case where the image generating unit generates a plurality of images having different luminances from a plurality of captured images, the combining unit includes a registration included in the captured image when combining the plurality of images based on the combining condition. The imaging device according to any one of claims 1 to 9, wherein a region where the plurality of images overlap is synthesized based on information.   The imaging device according to any one of claims 1 to 10, wherein the image generation unit generates a plurality of images having different luminances in a shooting mode for shooting a night scene. An information processing method executed by an imaging apparatus,
An image generation step for generating a plurality of images having different luminances;
A synthesis condition generation step for generating a synthesis condition relating to the synthesis of the plurality of images generated by the image generation step from the luminance of the first image generated by the image generation step;
A synthesis step for synthesizing the plurality of images based on the synthesis condition generated by the synthesis condition generation step;
Including
In the synthesis condition generation step, a subject image having an area smaller than a predetermined threshold among subject images included in the first image is extracted from the first image according to the size of the subject image. An information processing method for reducing the first image to a size separated by a separating means for separating, and generating the synthesis condition using the reduced first image. An information processing method executed by an imaging apparatus,
An image generation step for generating a plurality of images having different luminances;
A synthesis condition generation step for generating a synthesis condition relating to the synthesis of the plurality of images generated by the image generation step from the luminance of the first image generated by the image generation step;
A synthesis step for synthesizing the plurality of images based on the synthesis condition generated by the synthesis condition generation step;
Including
In the synthesis condition generation step, the first image is reduced at a magnification set in advance with respect to a combination of the number of pixels of the imaging device and a focal length, and the reduced first image is used to reduce the first image. An information processing method for generating a synthesis condition. On the computer,
An image generation step for generating a plurality of images having different luminances;
A synthesis condition generation step for generating a synthesis condition relating to the synthesis of the plurality of images generated by the image generation step from the luminance of the first image generated by the image generation step;
A synthesis step for synthesizing the plurality of images based on the synthesis condition generated by the synthesis condition generation step;
And execute
In the synthesis condition generation step, a subject image having an area smaller than a predetermined threshold among subject images included in the first image is extracted from the first image according to the size of the subject image. A program for reducing the first image to a size separated by a separating means for separating, and generating the synthesis condition using the reduced first image. On the computer,
An image generation step for generating a plurality of images having different luminances;
A synthesis condition generation step for generating a synthesis condition relating to the synthesis of the plurality of images generated by the image generation step from the luminance of the first image generated by the image generation step;
A synthesis step for synthesizing the plurality of images based on the synthesis condition generated by the synthesis condition generation step;
And execute
In the synthesis condition generation step, the first image is reduced at a magnification set in advance with respect to a combination of the number of pixels of the computer and a focal length, and the synthesis is performed using the reduced first image. A program that generates conditions.

Images