JP6485204B2 - Imaging device, image file generation device, image file processing device, and program - Google Patents

Description

The present invention, imaging apparatus, an image file generation device, an image file processing equipment and programs.

  Japanese Patent Application Laid-Open No. 2004-151561 discloses an image composition device that aims to reduce image quality deterioration due to variations in a plurality of imaging devices and to synthesize a high-resolution image at high speed.

  The image composition device generates composite image data by combining a plurality of image data, selects one of the plurality of image data as reference image data, and each of the composite image data and the reference image data Compare the image quality of the divided areas, select the composite processing range that includes the divided areas where the image quality of the composite image data is improved, and select the reference image outside the composite processing range for the composite image data in the composite processing range A high resolution image is generated by combining the data.

JP 2010-34964 A

  However, it is essential for the image synthesizing apparatus disclosed in Patent Document 1 to repeat selection of the reference image data and selection of the synthesis processing range each time image synthesis is performed. For this reason, there is a problem in that duplication of image synthesis processing occurs, processing time becomes long, and CPU resources are wasted.

  In recent years, as the functions of cameras have become higher and more multifunctional, there have been a wide variety of shooting preferences for photographers. For example, there is a photographing preference of a photographer who wants to obtain an original composite image in which various parameters such as a plurality of image data, reference image data, and a composition processing range are slightly modified. In this regard, since the image composition apparatus of Patent Document 1 performs image composition in a uniform and mechanical processing flow, it cannot flexibly cope with such photographing preferences of photographers.

The present invention, these problems are those conscious was made based on a simple configuration, the photographing apparatus which can flexibly respond to shooting preference of the photographer, an image file generation device, image file processing equipment and flop The purpose is to obtain a program.

  An imaging apparatus according to the present invention includes an image acquisition unit that acquires a plurality of images, a reference image determination unit that determines a reference image from the plurality of images, and at least a part of a composite image obtained by combining the plurality of images. A replacement region calculation unit that calculates a replacement region for replacement with the reference image; and an image file generation unit that generates an image file including information indicating the plurality of images and the reference image and the replacement region. It is characterized by.

  The imaging apparatus of the present invention may further include a composite replacement image generation unit that generates a composite replacement image obtained by replacing the composite image with the reference image in accordance with information indicating the replacement region.

  The photographing apparatus of the present invention may further include an output setting unit that sets whether to output each of the image file and the composite replacement image.

  The plurality of images may be taken continuously while changing the shooting conditions for the same subject.

  The plurality of images are images taken by an image sensor that converts an object image formed by a photographing optical system into an electrical pixel signal, and the optical element that forms at least a part of the photographing optical system and the image Using at least one of the sensors as a moving member and moving the moving member in a direction different from the optical axis of the photographing optical system, the subject light flux after each movement is incident on a plurality of pixels having different detection colors of the image sensor. It can be taken.

  An image file generation device according to the present invention includes at least one of an image input unit that inputs a plurality of images, a reference image determination unit that determines a reference image from the plurality of images, and a composite image obtained by combining the plurality of images. A replacement region calculation unit that calculates a replacement region for replacing a part with the reference image, and an image file generation unit that generates an image file including information indicating the plurality of images and the reference image and the replacement region. It is characterized by having.

  The image file processing apparatus of the present invention replaces at least a part of a plurality of images, information indicating a reference image determined from the plurality of images, and a composite image obtained by combining the plurality of images with the reference image. An image file input unit for inputting an image file having information for indicating a replacement area, and at least a part of the plurality of images in the image file and the information indicating the reference image and the replacement area A parameter modifying unit that can modify the image, an image combining unit that receives a presence or absence of modification by the parameter modifying unit, synthesizes a plurality of images by the parameter modifying unit, and obtains a composite image; and the parameter modifying unit In response to the presence / absence of modification by the parameter modification unit, at least a part of the composite image is changed according to the replacement region by the parameter modification unit. It is characterized by having an image replacing unit for replacing the reference image with the.

  The program of the present invention calculates a reference image determining step for determining a reference image from among a plurality of images, and a replacement area for replacing at least a part of a composite image obtained by combining the plurality of images with the reference image. A replacement area calculation step and an image file generation step for generating an image file including information indicating the plurality of images, the reference image, and the replacement area are executed by a computer.

According to the present invention, with a simple configuration, the photographing apparatus which can flexibly respond to shooting preference of the photographer, an image file generation device, image file processing equipment and programs can be obtained.

It is a block diagram which shows the principal part structure of the digital camera (imaging device) of this embodiment. 2 is a block diagram illustrating a main configuration of an image shake correction apparatus. FIG. It is a side view which shows the structure of an image shake correction apparatus. FIG. 4A to FIG. 4D are conceptual diagrams illustrating an example of the “RRS imaging mode” of the present embodiment. It is a functional block diagram which shows the internal structure of DSP (image file generation apparatus). It is a figure which shows an example of the reference | standard image replacement area | region and non-replacement area | region of the composite image data which the replacement area | region calculation part calculated. It is a figure which shows the data structure of the special image file which the image file generation part produced | generated. It is a flowchart which shows the imaging | photography process by the digital camera of this embodiment. FIG. 2 is a functional block diagram illustrating an image file processing apparatus as an external application that performs image processing on a special image file output by the digital camera of the present embodiment.

  The imaging system (image processing system) according to the present embodiment will be described with reference to FIGS.

  FIG. 1 is a block diagram showing a main configuration of a digital camera (photographing apparatus) 10. The digital camera 10 includes a body main body 20 and a photographic lens 30 that can be attached to and detached from the body main body 20 (lens exchangeable). The photographic lens 30 includes, in order from the subject side (left side in FIG. 1) to the image plane side (right side in FIG. 1), a photographic lens group (photographic optical system, moving member, shake correction member) 31, and aperture ( Photographing optical system) 32. The body body 20 includes a shutter (photographing optical system) 21 and an image sensor (image acquisition unit, moving member, shake) in order from the subject side (left side in FIG. 1) to the image plane side (right side in FIG. 1). Correction member) 22. The body body 20 also includes a diaphragm / shutter drive circuit 23 that controls driving of the diaphragm 32 and the shutter 21 in a state where the body body 20 is attached to the photographing lens 30. A subject image is formed on the light receiving surface of the image sensor 22 by the subject light flux that enters from the photographing lens group 31 and passes through the aperture 32 and the shutter 21. The subject image formed on the light receiving surface of the image sensor 22 is converted into an electrical pixel signal by a large number of pixels having different detection colors arranged in a matrix, and image data (a plurality of RAW image data described later). Is output to a DSP (image file generation device) 40. The DSP 40 performs predetermined image processing on the image data input from the image sensor 22, displays it on the LCD 24, and stores it in the image memory 25. In FIG. 1, the photographic lens group 31 is depicted as a single lens. However, the actual photographic lens group 31 may be, for example, a fixed lens, a variable magnification lens that moves during zooming, or a focusing lens that moves during focusing. And a plurality of lenses.

  Although not shown, the image sensor 22 includes a plurality of packages, a solid-state image sensor chip housed in the package, and a lid member fixed to the package so as to hermetically protect the solid-state image sensor chip. It consists of the following components. In this specification, “driving the image sensor 22” means “driving at least a part of the plurality of components of the image sensor 22 through which the subject luminous flux passes”.

  The photographic lens 30 includes a communication memory 33 that stores various information such as resolving power (MTF) information of the photographic lens group 31 and aperture diameter (aperture value) information of the diaphragm 32. In a state where the photographic lens 30 is attached to the body main body 20, various information stored in the communication memory 33 is read into the DSP 40.

  The body main body 20 is connected to the DSP 40 and includes a photographing operation switch 26. The photographing operation switch 26 includes various switches such as a power switch and a release switch.

  The body body 20 includes a gyro sensor (a shake detection unit) 27 connected to the DSP 40. The gyro sensor 27 detects a shake detection signal indicating a shake in the plane orthogonal to the optical axis of the body body 20 by detecting a moving angular velocity (around the X axis and the Y axis) applied to the body body 20.

  As shown in FIGS. 1 to 3, the image sensor 22 is mounted on the image blur correction device 50 so as to be movable in the X-axis direction and the Y-axis direction (two orthogonal directions) orthogonal to the optical axis Z of the photographing optical system. Yes. The image shake correction apparatus 50 includes a fixed support substrate 51 fixed to a structure such as a chassis of the body main body 20, a movable stage 52 that fixes the image sensor 22 and is slidable with respect to the fixed support substrate 51, and fixed support. Magnets M1, M2, M3 fixed on the surface of the substrate 51 facing the movable stage 52, and each magnet M1, fixed on the fixed support substrate 51 with the movable stage 52 sandwiched between the magnets M1, M2, M3, For driving to generate a driving force by receiving a current in a magnetic field of the magnetic circuit fixed to the movable stage 52 and the yokes Y1, Y2, Y3 made of a magnetic material constituting the magnetic circuit between M2 and M3 Coils C1, C2, and C3 are provided. By flowing (applying) an AC drive signal (AC voltage) to the drive coils C1, C2, and C3, the movable stage 52 (image sensor 22) is driven in a plane orthogonal to the optical axis with respect to the fixed support substrate 51. It has become. The AC drive signal that flows through the drive coils C1, C2, and C3 is generated by the image sensor drive circuit 60 under the control of the DSP 40.

  In the present embodiment, the image sensor 22 includes a magnetic driving unit including the magnet M1, the yoke Y1, and the driving coil C1, and a magnetic driving unit (two sets of magnetic driving units) including the magnet M2, the yoke Y2, and the driving coil C2. Are arranged at predetermined intervals in the longitudinal direction (horizontal direction, X-axis direction), and magnetic drive means (a set of magnetic drive means) including the magnet M3, the yoke Y3, and the drive coil C3 are orthogonal to the longitudinal direction of the image sensor 22. Are arranged in the short direction (vertical (vertical) direction, Y-axis direction).

  Further, the fixed support substrate 51 detects the magnetic force of the magnets M1, M2, and M3 in the vicinity (central space) of each of the driving coils C1, C2, and C3, and is orthogonal to the optical axis of the movable stage 52 (image sensor 22). Hall sensors (position detection units) H1, H2, and H3 for outputting (detecting) a hall output signal (position detection signal) indicating a position in the plane are arranged. The position and tilt (rotation) of the movable stage 52 (image sensor 22) are detected by the hall sensors H1 and H2, and the position of the movable stage 52 (image sensor 22) is detected by the hall sensor H3. The DSP 40 detects, via the image sensor drive circuit 60, a shake detection signal indicating a shake in the plane orthogonal to the optical axis of the body main body 20 detected by the gyro sensor 27, and the image sensor 22 output by the hall sensors H1, H2, and H3. The image blur correction device 50 drives the image sensor 22 in the optical axis orthogonal plane based on the Hall output signal indicating the position in the optical axis orthogonal plane. Thereby, the image formation position of the subject image on the image sensor 22 can be displaced, and the image shake due to the camera shake can be corrected.

  The digital camera 10 according to the present embodiment uses the image blur correction device 50 to shoot a plurality of times while finely moving the image sensor 22 (image sensor unit) in a plane perpendicular to the optical axis Z of the imaging optical system. And combining the images into a single image (compositing by performing special operations by image processing on the data rather than simply adding the images), generating an ultra-high definition (high image quality, high accuracy) image Equipped with a shooting mode. Hereinafter, this photographing mode is referred to as “RRS (Real Resolution System) photographing mode”. In the “RRS shooting mode”, unlike the conventional Bayer method in which only one color information is acquired per pixel, information on each color of RGB is obtained for each pixel, so that the details and color reproduction in detail are excellent. A fine image can be drawn. Further, moire and false colors are not generated, and an effect of reducing high-sensitivity noise can be obtained.

  FIG. 4A to FIG. 4D are conceptual diagrams illustrating an example of the “RRS imaging mode” of the present embodiment. In the figure, an image sensor 22 includes a large number of pixels arranged at a predetermined pixel pitch in a matrix on the light receiving surface, and a Bayer array of color filters R, G (Gr, Gb), B on the front surface of each pixel. Either one is arranged. Each pixel detects the color of the subject light ray that has passed through the front color filters R, G (Gr, Gb), B, that is, photoelectrically converts the light of the color component (color band), and the intensity ( Accumulate charges according to (luminance). More specifically, one image is taken at the reference position shown in FIG. 4A, and one image is taken at the position shown in FIG. 4B where the image sensor 22 is moved downward by one pixel pitch. A single image was taken at the position shown in FIG. 4C where the image sensor 22 was moved to the right by one pixel pitch from there, and the image sensor 22 was moved upward by one pixel pitch therefrom. One image is taken at the position of FIG. 4D, and finally returns to the reference position of FIG. In this way, four images taken while driving the image sensor 22 so as to draw a square of one pixel pitch in the plane orthogonal to the optical axis are input to the DSP (image file generation device) 40 as RAW image data. The

  FIG. 5 is a functional block diagram showing an internal configuration of the DSP (image file generation device) 40. The DSP 40 performs various processes on four (a plurality of) RAW image data shot (acquired) by the image sensor 22 in the “RRS shooting mode”.

  The DSP (image file generation device) 40 includes an image input unit 40A, an image composition unit 40B, a reference image determination unit 40C, a replacement region calculation unit (reference image replacement region calculation unit) 40D, and a reference image replacement unit 40E. A combined replacement image generation unit (composited image file generation unit) 40F, a pre-combination multi-frame image integration unit 40G, an additional information generation unit 40H, and an image file generation unit (pre-combination multi-frame image file generation unit) 40I. And an image file storage unit 40J.

  The image input unit 40A receives four (a plurality of) RAW image data from the image sensor 22.

  The image composition unit 40B combines the four pieces of RAW image data input to the image input unit 40A and performs image processing to obtain composite image data.

  The reference image determination unit 40C selects one of the four RAW image data input to the image input unit 40A and determines this as reference image data. For example, the reference image determination unit 40C determines the RAW image data captured by the image sensor 22 first (first image) or last (fourth image) as reference image data.

  The replacement region calculation unit 40D calculates a replacement region for replacing at least part of the composite image data by the image composition unit 40B with the reference image data determined by the reference image determination unit 40C. The replacement area calculation unit 40D determines whether or not the quality of the combined image data by the image combining unit 40B satisfies a predetermined level, that is, whether or not it is adversely affected by camera shake, subject movement, or flickering of a fluorescent lamp. Based on the above, a replacement area is calculated.

  More specifically, the replacement area calculation unit 40D calculates a replacement area by comparing the reference image data and other pre-combination frame image data for each pixel. Alternatively, the replacement region calculation unit 40D calculates a replacement region by blocking each pre-combination frame image data and comparing the reference image data and other pre-combination frame image data for each block. Alternatively, the replacement area calculation unit 40D obtains difference information from luminance data and color difference data, and calculates a replacement area based on the difference information. Alternatively, the replacement region calculation unit 40D calculates a replacement region by detecting a high-frequency component and determining whether the high-frequency component exceeds a threshold value. As described above, the manner in which the replacement region calculation unit 40D calculates the replacement region has a degree of freedom, and various design changes are possible.

  FIG. 6 is a diagram illustrating an example of the reference image replacement region and the non-replacement region of the composite image data calculated by the replacement region calculation unit 40D. The reference image replacement area of the composite image data is an area in which replacement with the reference image data is specified because the quality of the composite image data does not satisfy a predetermined level, and the non-replacement area is a corresponding portion of the composite image data. This is an area to be applied (used) as it is.

  The reference image replacement unit 40E replaces the composite image data obtained by the image composition unit 40B with the reference image data determined by the reference image determination unit 40C according to the replacement region calculated by the replacement region calculation unit 40D (FIG. 6).

  The composite replacement image generation unit 40F generates the composite replacement image data replaced by the reference image replacement unit 40E in a predetermined file format (for example, JPEG format).

  The pre-combination multi-frame image integration unit 40G integrates the four RAW image data input to the image input unit 40A as a pre-combination multi-frame image.

  The additional information generation unit 40H adds the reference image data determined by the reference image determination unit 40C and the replacement region calculated by the replacement region calculation unit 40D to basic additional information (for example, including image processing parameters for RAW image data such as Exif). Generate integrated additional information. The image processing parameters for RAW image data in the basic additional information include AF area and lens information as supplements related to the replacement area such as color information provided in normal RAW data, and the replacement area also uses the information. Multiple levels can be stored.

  The image file generation unit 40I generates a special image file in which the pre-combination multi-frame images (four raw image data) from the pre-combination multi-frame image integration unit 40G and the additional information from the additional information generation unit 40 are integrated.

  FIG. 7 is a diagram illustrating a data structure of a special image file generated by the image file generation unit 40I. The special image file includes, in order from the top to the bottom in the figure, basic additional information (for example, Exif), reference image frame designation information (information indicating the reference image data determined by the reference image determination unit 40C), reference image The replacement area information (information indicating the replacement area calculated by the replacement area calculation unit 40D) and the pre-combination multiple frame images (raw image data of 4 frames (n (n is a positive integer))) are layered and integrated. Has a data structure. The hierarchical structure of the special image file is not limited to that shown in FIG. 7, and various design changes can be made.

  The image file storage unit 40J corresponds to the combined replacement image data generated by the combined replacement image generation unit 40F in a predetermined file format (for example, JPEG format) and the special image file (FIG. 7) generated by the image file generation unit 40I. Add and save.

The presence / absence of each output of the composite replacement image data and the special image file stored in the image file storage unit 40J is set to one of the following four output modes 1 to 4. The digital camera 10 includes an RRS shooting mode setting unit (output setting unit) 28 (FIG. 1) that selectively sets any one of these four output modes 1 to 4.
Output mode 1: Output both the composite replacement image data and the special image file.
Output mode 2: Neither composite replacement image data nor special image file is output.
Output mode 3: Outputs composite replacement image data and does not output a special image file.
Output mode 4: A special image file is output and composite replacement image data is not output.

  With reference to the flowchart of FIG. 8, the RRS imaging process by the digital camera 10 of the present embodiment will be described. This photographing process is realized by causing a computer of a DSP (image file generation device) 40 to execute a predetermined program.

  In step S1, the image sensor 22 acquires four (a plurality of) RAW image data and inputs them to the image input unit 40A.

  In step S2, the image composition unit 40B combines the four pieces of RAW image data input to the image input unit 40A to obtain composite image data.

  In step S3, the reference image determination unit 40C selects one of the four pieces of RAW image data input to the image input unit 40A and determines this as reference image data.

  In step S4, the replacement region calculation unit 40D calculates a replacement region for replacing at least part of the composite image data by the image composition unit 40B with the reference image data determined by the reference image determination unit 40C.

  In step S5, the reference image replacement unit 40E replaces the composite image data by the image composition unit 40B with the reference image data determined by the reference image determination unit 40C in accordance with the replacement region calculated by the replacement region calculation unit 40D. Further, the composite replacement image generation unit 40F generates composite replacement image data replaced by the reference image replacement unit 40E in a predetermined file format (for example, JPEG format).

  In step S6, the image file storage unit 40J stores the composite replacement image data generated by the composite replacement image generation unit 40F in a predetermined file format (for example, JPEG format).

  In step S7, whether the DSP 40 is set to save the special image file, that is, whether the output mode by the RRS shooting mode setting unit (output setting unit) 28 is set to the output mode 1 or the output mode 4 described above. Determine whether or not. The DSP 40 ends the process when the special image file storage setting is not set (step S7: NO), and proceeds to step S8 when the special image file storage setting is set (step S7: YES). .

  In step S8, the additional information generating unit 40H integrates the basic additional information (for example, Exif) and the additional information (reference data) obtained by integrating the reference image data determined by the reference image determination unit 40C and the replacement area calculated by the replacement area calculation unit 40D. Image replacement additional information) is generated.

  In step S9, the pre-combination multi-frame image integration unit 40G integrates the four raw image data input to the image input unit 40A as a pre-combination multi-frame image.

  In step S10, the image file generation unit 40I integrates the pre-combination multi-frame images (four raw image data) from the pre-combination multi-frame image integration unit 40G and the additional information from the additional information generation unit 40. (FIG. 7) is generated.

  In step S11, the image file storage unit 40J stores the special image file generated by the image file generation unit 40I.

  FIG. 9 is a functional block diagram showing an image file processing apparatus 70 as an external application that performs image processing on the special image file (FIG. 7) output from the digital camera 10 of the present embodiment.

  The image file processing device 70 includes a special image file input unit 71, a parameter modification unit 72, an image composition unit 73, and an image replacement unit 74.

  The special image file input unit 71 receives a special image file (FIG. 7) output from the digital camera 10. For example, the image file input to the image file processing apparatus 70 is discriminated whether it is a normal image file or a special image file based on its header information, and only the special image file is input / output to / from the special image file input unit 71. The The special image file input to the special image file input unit 71 is decomposed into individual file components.

  The parameter modification unit 72 includes basic additional information (including image processing parameters for RAW image data), reference image frame designation information (reference image determination unit) in the special image file (FIG. 7) input to the special image file input unit 71. Information indicating the reference image data determined by 40C), reference image replacement area information (information indicating the replacement area calculated by the replacement area calculation unit 40D), and a plurality of pre-composite frame images (n frames (n is a positive value) It is possible to select at least a part of the RAW image data) and to modify it.

  The image composition unit 73 receives the presence / absence of modification by the parameter modification unit 72, composes a plurality of image data by the parameter modification unit 72, performs image processing using the image processing parameters for RAW image data by the parameter modification unit 72, Obtain composite image data.

  The image replacement unit 74 receives the presence / absence of modification by the parameter modification unit 72, and uses at least part of the composite image data by the image composition unit 73 as reference image data by the parameter modification unit 72 according to the replacement region by the parameter modification unit 72. Replace.

  As described above, according to the imaging system (image processing system) of the present embodiment, the image file generation unit 40I generates a special image file (FIG. 7) including information indicating a plurality of images, a reference image, and a replacement area. Therefore, there is no need to perform overlapping calculations in subsequent image composition processing (the calculations can be omitted). Therefore, the processing time can be shortened, waste of CPU resources can be reduced, and the configuration of the apparatus can be simplified.

  In addition, the image file processing apparatus 70, which is an external application, can flexibly cope with the photographing preference of the photographer by modifying at least part of the information indicating the plurality of images and the reference image and the replacement area in the image file. An original composite image can be obtained. Since processing that can be executed by the CPU in the digital camera 10 is naturally limited, it is not realistic to modify various parameters in the digital camera 10. In this respect, the present embodiment that can output a special image file (FIG. 7) including information indicating a plurality of images, a reference image, and a replacement area in a form that can be modified by an external application is extremely useful.

  In the above embodiment, in the RRS imaging mode, a case where four images captured while driving the image sensor 22 so as to draw a square of one pixel pitch in the plane orthogonal to the optical axis is set as “a plurality of images” is illustrated. Explained. However, the drive trajectory and drive pitch of the image sensor 22 and the number of “plural images” have a degree of freedom, and various design changes are possible. The direction in which the image sensor 22 is driven is not limited to a plane orthogonal to the optical axis of the photographic optical system, and may be any direction different from the optical axis of the photographic optical system. Further, the “plurality of images” are not limited to those captured (acquired) in the RRS imaging mode, and may be any images continuously captured while changing the imaging conditions for the same subject (for example, HDR imaging).

  In the above embodiment, the image sensor 22 is assumed to be the “moving member” and the image sensor 22 is driven in the plane orthogonal to the optical axis. However, the present invention is not limited to this. For example, an optical element that forms at least a part of the photographing lens group (photographing optical system) 31 is a “moving member”, and this optical element is driven in a plane orthogonal to the optical axis by a voice coil motor provided in the photographing lens 30. Is also possible. Alternatively, it is also possible to adopt a mode in which both the image sensor 22 and the optical elements constituting at least a part of the photographing lens group (photographic optical system) 31 are “moving members” and are driven in a plane orthogonal to the optical axis.

  In the above embodiment, the DSP 40 and the image sensor drive circuit 60 are drawn as separate components (blocks), but an aspect in which these are realized as a single component (block) is also possible.

  In the above embodiment, the image shake correction apparatus 50 is configured such that the magnets M1, M2, and M3 and the yokes Y1, Y2, and Y3 are fixed to the fixed support substrate 51, and the driving coils C1, C2, and C3 are connected to the movable stage 52. The case of fixing is described by way of example, but it is also possible to reverse the positional relationship, fix the magnet and the yoke to the movable stage, and fix the driving coil to the fixed support substrate.

  In the above embodiment, the mode in which the body main body 20 and the photographic lens 30 are detachable (lens exchangeable) has been described as an example, but the mode in which the body main body 20 and the photographic lens 30 are detachable (lens exchangeable) is not possible. Is also possible.

10 Digital camera (photographing device)
20 Body body 21 Shutter (shooting optical system)
22 Image sensor (image acquisition unit, moving member, shake correction member)
RG (Gr, Gb) B Color filter 23 Aperture / shutter drive circuit 24 LCD
25 Image memory 26 Shooting operation switch 27 Gyro sensor (shake detection unit)
28 RRS shooting mode setting section (output setting section)
30 Shooting lens 31 Shooting lens group (shooting optical system, moving member, shake correction member)
32 Aperture (Optical system)
33 Communication Memory 40 DSP (Image File Generation Device)
40A Image input unit 40B Image composition unit 40C Reference image determination unit 40D Replacement region calculation unit (reference image replacement region calculation unit)
40E Reference image replacement unit 40F Composite replacement image generation unit (composited image file generation unit)
40G pre-combination multiple frame image integration unit 40H additional information generation unit 40I image file generation unit (pre-combination multi-frame image file generation unit)
40J Image file storage unit 50 Image shake correction device 51 Fixed support substrate 52 Movable stage M1 M2 M3 Magnet Y1 Y2 Y3 Yoke C1 C2 C3 Driving coil H1 H2 H3 Hall sensor (position detection unit)
60 Image sensor driving circuit 70 Image file processing apparatus (external application)
71 Special image file input unit 72 Parameter modification unit 73 Image composition unit 74 Image replacement unit

Claims (8)

An image acquisition unit for acquiring a plurality of images;
A reference image determination unit for determining a reference image from the plurality of images;
A replacement area calculation unit for calculating a replacement area for replacing at least a part of a combined image obtained by combining the plurality of images with the reference image;
An image file generation unit for generating an image file including information indicating the plurality of images and the reference image and the replacement area;
A photographing apparatus comprising: The imaging device according to claim 1,
An imaging apparatus further comprising a combined replacement image generation unit configured to generate a combined replacement image in which the combined image is replaced with the reference image in accordance with information indicating the replacement area. The imaging device according to claim 2,
An imaging apparatus further comprising an output setting unit configured to set whether to output each of the image file and the composite replacement image. In the imaging device according to any one of claims 1 to 3,
The plurality of images is a photographing device in which the same subject is continuously photographed while changing photographing conditions. The photographing apparatus according to any one of claims 1 to 4,
The plurality of images are images taken by an image sensor that converts an object image formed by a photographing optical system into an electrical pixel signal, and the optical element that forms at least a part of the photographing optical system and the image Using at least one of the sensors as a moving member and moving the moving member in a direction different from the optical axis of the photographing optical system, the subject light flux after each movement is incident on a plurality of pixels having different detection colors of the image sensor. A photographic device that was taken. An image input unit for inputting a plurality of images;
A reference image determination unit for determining a reference image from the plurality of images;
A replacement area calculation unit for calculating a replacement area for replacing at least a part of a combined image obtained by combining the plurality of images with the reference image;
An image file generation unit for generating an image file including information indicating the plurality of images and the reference image and the replacement area;
An image file generation device characterized by comprising: A plurality of images, information indicating a reference image determined from the plurality of images, information indicating a replacement area for replacing at least a part of a combined image obtained by combining the plurality of images with the reference image, An image file input unit for inputting an image file having
A parameter modifying unit capable of selecting and modifying at least part of information indicating the plurality of images and the reference image and the replacement area in the image file;
In response to the presence or absence of modification by the parameter modification unit, an image composition unit that combines a plurality of images by the parameter modification unit to obtain a composite image;
In response to the presence or absence of modification by the parameter modification unit, an image replacement unit that replaces at least a part of the composite image with a reference image by the parameter modification unit according to a replacement region by the parameter modification unit;
An image file processing apparatus comprising: A reference image determining step for determining a reference image from a plurality of images;
A replacement area calculating step of calculating a replacement area for replacing at least a part of a combined image obtained by combining the plurality of images with the reference image;
An image file generating step for generating an image file including information indicating the plurality of images and the reference image and the replacement area;
A program that causes a computer to execute.

Images