JP2009164768A - Image file creation device, image file creation method, image file restoration device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image file creation device etc. which create an image file so that sub-image data in a multi-image file may be restored as much as possible. <P>SOLUTION: The image file creation device 1 is provided with: an image data discrimination part 3 which discriminates whether or not one or more pieces of sub-image data can be generated from RAW data which is a source for generating main image data based on a sub-image generation condition which is the condition under which the pieces of sub-image data are generated; and an image file creation part 2 which creates one multi-image file including the one or more pieces of sub-image data and the main image data and creates a RAW file including the RAW data by being associated with the multi-image file when it is discriminated that the one or more pieces of sub-image data can be generated by the image data discrimination part 3. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image file creation device capable of creating a multi-image file including main image data and sub-image data, an image file creation method, and an image file repair device for repairing a multi-image file.

  Current devices such as digital cameras and application software for image editing of still images normally handle files of a file format in which only one still image data is included in one file. Many files do not consider the existence of multiple image data in one file. Even in the Exif standard, which is one of image file formats widely used in digital cameras and the like, a single file includes only one image data except for a list display reduced image (thumbnail image). ing.

  On the other hand, image data (main image data) of a main image (main image) and image data (sub-image data) of a sub-image related to the main image are combined into one image file (hereinafter referred to as multi-image as appropriate). A technique for creating an image file and recording it on a recording medium has been proposed.

  For example, in Japanese Patent Laid-Open No. 2005-252754, a plurality of JPEG images are combined into one multi-image file to prevent an increase in the number of files, and a main image (a plurality of images combined into a file is added at the top of the multi-image file. In this technique, a main (representative image) is stored in a format compliant with the Exif standard, and the extension of the file itself is “JPG”.

  As an image file for storing a plurality of JPEG data, by adopting a configuration having the same structure as the existing JPEG format from the beginning of the file to the end of the main image, the extension is “JPG”. Compatibility with existing image processing apparatuses and applications that handle JPG files can be maintained. Then, it becomes possible to record a plurality of image groups obtained by photographing the same scene at several different exposure levels including appropriate exposure, for example, as a single multi-image file. In addition, there are advantages that the number of files can be reduced, file management is facilitated, and the convenience of the user can be increased when browsing, copying, transferring, storing, etc. of image groups.

  By the way, an imaging device such as a digital camera that is currently commercialized uses a JPG file that includes JPEG data and conforms to the Exif standard as a still image recording format as described above. Furthermore, in addition to this JPG file, a RAW image obtained by converting an image obtained by imaging with an image sensor into a digital signal can be stored as a RAW file in various imaged imaging devices. Some are configured to do so. In this type of imaging apparatus, a recording mode for storing only a JPG file, a recording mode for storing only a RAW file, a recording mode for storing both a JPG file and a RAW file, and the like can be selected as desired. There are many cases.

  Here, object formation of a plurality of files when the recording mode for saving both the JPG file and the RAW file is selected will be described with reference to FIGS.

  First, FIG. 12 is a diagram showing a relationship between a file and an object created when three images are captured by the exposure bracket.

  In the example shown in FIG. 12, exposure bracket photography is performed, and an image with appropriate exposure based on a photometric value, an image with an exposure value different by -1 EV from the appropriate exposure, and exposure by +1 EV from the appropriate exposure. Assume that three images, which are images having different values, are captured.

  First, when an image with proper exposure is captured, as shown in FIG. 12A, one RAW file including RAW data with proper exposure is saved, and then created based on this RAW data. One JPG file containing JPEG data is stored. The RAW file and JPG file created at this time have the same file name portion excluding the extension.

  Next, when an image having an exposure value different from that of the appropriate exposure by -1 EV is captured, as shown in FIG. 12B, one RAW file including -1 EV RAW data is saved, and then One JPG file including JPEG data created based on the RAW data is stored. The RAW file and the JPG file created at this time have the same file name portion excluding the extension.

  Subsequently, when an image having an exposure value different from that of the appropriate exposure by +1 EV is captured, as shown in FIG. 12C, one RAW file including +1 EV RAW data is stored. One JPG file including JPEG data created based on the RAW data is stored. The RAW file and the JPG file created at this time have the same file name portion excluding the extension.

  Therefore, at this time, a total of six files are created, but there are three types of file names excluding the extension. In many devices and software that handle current JPEG images, file groups having the same file name excluding the extension are often handled as the same object. From this viewpoint, the RAW file and the JPG file shown in FIG. 12A constitute the first object, and similarly, the RAW file and the JPG file shown in FIG. 12B constitute the second object. The RAW file and JPG file shown in FIG. 12C constitute a third object.

  Next, FIG. 13 is a diagram showing a relationship between a file and an object created when three pieces of JPEG data are generated by the white balance (WB) bracket. The objectification as described with reference to FIG. 12 is similarly performed in white balance bracket photography. However, while the exposure bracket is performed by capturing a plurality of images while changing the shutter speed and the aperture value, this white balance bracket is based on one RAW data obtained by capturing, A plurality of image data is obtained by performing digital image processing with different parameters.

  In the example shown in FIG. 13, by white balance bracket shooting, JPEG data with an appropriate white balance, JPEG data that has been color-corrected to the blue side of the appropriate white balance, and color correction to the amber side of the appropriate white balance. Assume that three pieces of JPEG data, JPEG data, are created.

  At this time, as shown in FIG. 13A, one RAW file including RAW data is stored as the first object, and then JPEG data with appropriate white balance created based on this RAW data is stored. One containing JPG file is saved. The RAW file and the JPG file created at this time have the same file name portion excluding the extension, as described above.

  Next, as shown in FIG. 13B, the same RAW file as shown on the left side of FIG. 13A is saved as the file name included in the second object. Also, one JPG file including JPEG data whose color is corrected on the blue side is saved with the same file name as the RAW file except for the extension.

  Subsequently, as shown in FIG. 13 (C), the same RAW file as shown on the left side of FIG. 13 (A) is stored as the file name included in the third object. Also, one JPG file including JPEG data whose color is corrected on the amber side is saved with the same file name as the RAW file except for the extension.

In this way, in the case shown in FIG. 13, although there is only one RAW data obtained by imaging, the same RAW data is included in each object one by one because of the necessity of objectification. As a result, the recording capacity is wasted.
JP 2005-252754 A

  A multi-image file storing a plurality of images as described in the above Japanese Patent Application Laid-Open No. 2005-252754 is compatible with an existing JPG file because the top main image is compatible with the existing JPG file. It can be displayed on an image processing apparatus or an application, edited, or saved. However, when a multi-image file as described in the publication is edited and saved by an existing image processing apparatus or application based on the current Exif standard as described above, the main image is saved, but the main image is saved. Other sub-images may be erased or damaged.

  Therefore, even if the sub-image data is damaged by processing the file with an existing image processing apparatus or application, the damaged sub-image data is restored (that is, the multi-image file is restored). It is desirable that there is a technology that can be restored.

  The present invention has been made in view of the above circumstances, and an image file that can create an image file so that it can be restored if it can be restored even if the sub-image data in the multi-image file is damaged. It is an object to provide a creation device and an image file creation method.

  It is another object of the present invention to provide an image file repairing apparatus capable of repairing a multi-image file created by the image file creating apparatus and the image file creating method.

  In order to achieve the above object, an image file creation device according to the present invention includes main image data generated based on one RAW data and one or more sub-image data related to the main image data. An image file creation device capable of creating a multi-image file, wherein whether or not the one or more sub-image data can be generated from the RAW data is a sub-image generation condition that is a condition for generating the sub-image data If the image data discriminating unit discriminates based on the image data discriminating unit and the image data discriminating unit determines that the data can be generated, one multi-image file including the one or more sub-image data and the main image data is created. And an image file creation unit that creates a RAW file including the RAW data in association with the one multi-image file. That.

  The image file creation method according to the present invention creates a multi-image file including main image data generated based on one RAW data and one or more sub-image data related to the main image data. And determining whether or not the one or more sub-image data can be generated from the RAW data based on a sub-image generation condition that is a condition for generating the sub-image data, When it is determined that it can be generated, one multi-image file including the one or more sub-image data and the main image data is created, and a RAW file including the RAW data is associated with the one multi-image file. Is a way to create.

  Furthermore, the image file restoration apparatus according to the present invention can create an image file that can create a multi-image file including main image data generated based on one RAW data and one or more sub-image data related to the main image data. An image data determination unit that is a creation device and determines whether or not the one or more sub-image data can be generated from the RAW data based on a sub-image generation condition that is a condition for generating the sub-image data And generating one multi-image file including the one or more sub-image data and the main image data, when the image data determining unit determines that the image data can be generated. A RAW file including the RAW data is created in association with the RAW data, and at this time, the one or more sub-image data is restored from the RAW data. A multi-image file created by an image file creation device comprising an image file creation unit that creates the multi-image file so as to include information necessary for the image file creation, and the image file creation device associates the multi-image file with the multi-image file. An image data repair device for repairing based on a RAW file created in the above, a repair discriminating unit for discriminating whether or not at least part of the sub-image data included in the multi-image file is damaged; Included in the RAW file associated with the multi-image file based on information necessary to restore the sub-image data when it is determined by the repair determining unit that at least a part of the sub-image data is damaged Image data restoration for generating the damaged sub-image data from the RAW data When, those provided with the, image file creation unit for creating the multiple image file again using the sub image data generated by the image data restoration unit.

  According to the image file creation device and the image file creation method of the present invention, an image file can be created so that it can be restored if it can be restored even if the sub-image data in the multi-image file is damaged. .

  In addition, according to the image file repair device of the present invention, it is possible to repair a multi-image file created by the image file creation device and the image file creation method.

  Embodiments of the present invention will be described below with reference to the drawings.

[Embodiment 1]
1 to 11 show Embodiment 1 of the present invention, and FIG. 1 is a block diagram conceptually showing the configuration of an image file creation apparatus.

  As shown in FIG. 1, the image file creation device 1 includes an image file creation unit 2, an image data discrimination unit 3, a repair discrimination unit 4, and an image data restoration unit 5.

  A recording medium 6 is connected to the image file creation device 1. More specifically, the image file creation unit 2 is connected to be able to write to the recording medium 6, and the repair determination unit 4 is connected to be able to read from the recording medium 6.

  Now, there is one main image data created based on one RAW image and one or more (N (N is an integer of 1 or more)) sub-image data in the example shown in FIG. Shall.

  At this time, the image data determination unit 3 determines whether or not one or more sub-image data can be created based on the raw data from which the main image data is created. The image data discriminating unit 3 determines later when sub-image generation conditions such as a shooting mode to be described later are conditions for generating one or more sub-image data from RAW data by changing only parameters in predetermined image processing. As specifically described, it is determined that one or more sub-image data can be generated from the RAW data.

  When it is determined that the image file determination unit 3 can generate the image file, the image file generation unit 2 records the RAW data as a RAW file on the recording medium 6 and also converts the main image data and the sub image data into the RAW data. When it is recorded on the recording medium 6 as one file (referred to as a multi-image file as appropriate as described above) so as to be the same object, on the other hand, when it is determined by the image data determination unit 3 that it cannot be created The main image data and one or more sub-image data are recorded on the recording medium 6 as individual files (each as a different object).

  The repair discriminating unit 4 reads the multi-image file recorded on the recording medium 6 and determines whether or not the sub-image data included in the file is damaged. This is to determine whether there is damage. When it is determined that there is damage, the repair determination unit 4 also reads a RAW file that is the same object as the multi-image file that is determined to be further damaged. Then, the repair determination unit 4 transfers the determination result, the read multi-image file, and the read RAW file to the image data repair unit 5.

  When the repair discriminating unit 4 determines that there is damage, the image data restoration unit 5 restores the damaged image data based on the transferred RAW file, and sends the restored image data to the image file creation unit 2. Forward. The image data restoration unit 5 extracts undamaged image data from the multi-image file and transfers it to the image file creation unit 2.

  The image file creation unit 2 creates the multi-image file again and records it on the recording medium 6 when the image data necessary to repair the multi-image file is ready.

  Next, FIG. 2 is a block diagram illustrating a configuration example of an image file creation device applied to a digital camera.

  The image file creation device applied to this digital camera includes an imaging unit 11, an A / D conversion unit 12, a bus 13, a RAM 14, an image processing circuit 15, an image display unit 16, and the recording medium 6 described above. Are provided with an interface (I / F) 17, an operation unit 18, and a microcomputer 19.

  The imaging unit 11 photoelectrically converts an imaging optical system including a lens and a diaphragm that forms an optical image of a subject and an optical image formed by the imaging optical system to generate an analog electrical image signal. And an imaging device for output.

  The A / D converter 12 converts an analog image signal obtained from the imaging unit 11 into digital image data.

  The digital image converted by the A / D conversion unit 12 is stored in the RAM 14 via the bus 13. Here, the bus 13 is used when each unit transmits and receives data. The A / D conversion unit 12, the RAM 14, the image processing circuit 15, the image display unit 16, the I / F 17, the operation unit 18, and the microcomputer 19 are used. Is connected.

  The RAM 14 is configured as a storage unit that can be accessed at a relatively high speed, such as a DRAM, for example, and the image from the A / D conversion unit 12, the image processed by the image processing circuit 15, and the I / O from the recording medium 6. In addition to being used as a buffer for storing an image read out via F17, it is also used as a work area by the microcomputer 19.

  The image processing circuit 15 performs various kinds of image processing including encoding processing (JPEG compression or the like) on the digital image (RAW data) stored in the RAM 14, and records image data (in this embodiment, JPEG data). Is assumed) and written back to the RAM 14 again, and also serves as the image data restoration unit 5. The image processing circuit 15 also performs a process of decoding the compressed image data read from the recording medium 6 and writing it into the RAM 14. Further, the image processing circuit 15 generates display image data as necessary and writes it to the RAM 14.

  The recording image data generated by the image processing circuit 15 is added with a header or the like by a microcomputer 19 to generate an image file.

  The recording medium 6 records the generated image file in a non-volatile manner, and is composed of, for example, a flash memory.

  The I / F 17 performs data writing to the recording medium 6 and data reading from the recording medium 6 under the control of the microcomputer 19.

  The image display unit 16 displays an image based on display image data stored in the RAM 14, and includes a display device such as an LCD.

  The operation unit 18 is used by the user to input various operations to the image file creation apparatus applied to the digital camera. Operations that can be performed by the operation unit 18 include, for example, a power on / off operation, a release operation for instructing start of image shooting, a playback operation for instructing image playback, an exposure bracket shooting mode, white balance ( WB) Mode selection operation for selecting a shooting mode such as a bracket shooting mode, an image selection operation for selecting an image, a setting operation of a repair mode for repairing a multi-image file based on a RAW file as described later, For example.

  The microcomputer 19 is a control unit that integrally controls each unit in the image file creation apparatus applied to the digital camera. The microcomputer 19 further determines whether or not sub-image data can be generated from the raw data from which the main image data is generated, based on sub-image generation conditions such as a shooting mode. It also serves as part 3. In addition, when the microcomputer 19 determines that the sub-image data can be generated from the RAW data from which the main image data is generated, the microcomputer 19 sends the RAW data to the image processing circuit 15 based on the sub-image generation condition. Sub-image data is generated, and one multi-image file including the generated sub-image data and main image data (here, in the present embodiment, it is assumed that the extension is “JPG”). In addition to the creation, the image file creation unit 2 also creates a RAW file including RAW data in association with the multi-image file. The microcomputer 19 also serves as the above-described repair determination unit 4.

  Next, FIG. 3 is a chart showing shooting modes and image quality modes that can be set in the image file creation device applied to the digital camera.

  As described above, the image file creation device is configured to select the exposure bracket shooting mode and the WB bracket shooting mode as the shooting mode. Here, only one of the exposure bracket shooting mode and the WB bracket shooting mode can be selected, or both can be selected at the same time.

  In addition, as the image quality mode, the JPEG mode that saves only the JPG file, the RAW + JPEG mode that saves both the RAW file and the JPG file, the JPG file alone, or the RAW file and the JPG file are both saved. An AUTO mode that automatically selects the mode can be selected alternatively.

  FIG. 4 is a chart showing what type of file is saved in the combination of the image quality mode and the shooting mode shown in FIG.

  First, when the image quality mode is set to the JPEG mode, regardless of whether the shooting mode is set to the exposure bracket shooting mode or the WB bracket shooting mode, a plurality of images obtained by the exposure bracket or the WB bracket are used. JPEG data is stored as individual JPG files.

  When the image quality mode is set to RAW + JPEG mode and the shooting mode is set to the exposure bracket shooting mode, the RAW data is first saved as a RAW file, and each RAW data with different exposure shot by the exposure bracket is also stored. JPEG data is generated for each, and these JPEG data are saved as individual JPG files.

  On the other hand, when the image quality mode is set to RAW + JPEG mode and the shooting mode is set to the WB bracket shooting mode, RAW data is first saved as a RAW file, and from one RAW data obtained by shooting, A plurality of JPEG data having different white balances are generated by the WB bracket, and the plurality of JPEG data are collected and stored as one multi-image file.

  Next, when the image quality mode is set to the AUTO mode and the shooting mode is set to the exposure bracket shooting mode, the exposure image shot by the exposure bracket is set in the same manner as when the image quality mode is set to the JPEG mode. JPEG data is generated for each different RAW data, and these JPEG data are saved as individual JPG files.

  When the image quality mode is set to the AUTO mode and the shooting mode is set to the WB bracket shooting mode, the RAW data is first saved as a RAW file in the same manner as when the image quality mode is set to the RAW + JPEG mode. In addition, a plurality of JPEG data with different white balances are generated from a single RAW data obtained by shooting using a WB bracket, and the plurality of JPEG data are collected and stored as one multi-image file. It has become.

  Note that what type of file is saved when both the exposure bracket shooting mode and the WB bracket shooting mode are simultaneously set as the shooting mode will be described later with reference to FIG. .

  Next, FIG. 5 is a diagram showing a main part of header information recorded in the header of the multi-image file.

  Information necessary for restoring one or more sub-image data from RAW data is recorded in the header of the multi-image file.

  This information includes image processing condition information related to the multi-image tag, the number of sub-images, and the first to n-th sub-images (n is an integer equal to or greater than 1 and matches the number of sub-images).

  Here, the multi-image tag is not a JPG file that includes only one image data (JPEG data) (except for a thumbnail image), but a multi-image file that stores a plurality of JPEG data therein. It is a tag indicating that there is. As described above, in the present embodiment, it is assumed that the extension of a multi-image file is “JPG”, which is the same as that of a normal JPG file. Alternatively, since it is not possible to determine whether the file is a multi-image file, such a tag is provided.

  Next, the number of sub-images (“n” described above) is information indicating how many sub-image data (excluding thumbnail images) are stored in the multi-image file. Therefore, the total number of images including the main image included in the multi-image file is (n + 1).

  The first image processing condition information is information indicating what kind of image processing conditions the first sub-image data is generated from the RAW data from which the main image data is generated. It is. The same applies to the second to nth image processing condition information.

  Next, FIG. 6 is a diagram illustrating a relationship between a file and an object created when the RAW + JPEG mode is set and three images are captured by the exposure bracket.

  In the example shown in FIG. 6 as well, the exposure bracket photographing is performed in the same manner as the example described with reference to FIG. 12, and the exposure value is changed by −1 EV from the appropriate exposure image based on the photometric value. Assume that three images, that is, an image and an image whose exposure value is different from the appropriate exposure by +1 EV are captured.

  First, when an image with proper exposure is captured, as shown in FIG. 6A, one RAW file including RAW data with proper exposure is saved, and then created based on this RAW data. One JPG file containing JPEG data is stored. The RAW file and JPG file created at this time have the same file name portion excluding the extension.

  Next, when an image having an exposure value different from that of the appropriate exposure by −1 EV is captured, as shown in FIG. 6B, one RAW file including −1 EV RAW data is stored, and then One JPG file including JPEG data created based on the RAW data is stored. The RAW file and the JPG file created at this time have the same file name portion excluding the extension.

  Subsequently, when an image with an exposure value different from the appropriate exposure by +1 EV is captured, as shown in FIG. 6C, one RAW file including +1 EV RAW data is stored. One JPG file including JPEG data created based on the RAW data is stored. The RAW file and the JPG file created at this time have the same file name portion excluding the extension.

  Therefore, at this time, a total of six files are created, but there are three types of file names excluding the extension. The RAW file and JPG file shown in FIG. 6A constitute the first object, and the RAW file and JPG file shown in FIG. 6B constitute the second object. The shown RAW file and JPG file constitute a third object.

  Next, FIG. 7 is a diagram illustrating a relationship between a file and an object created when the RAW + JPEG mode or the AUTO mode is set and three pieces of image data are generated by the white balance bracket.

  With reference to FIG. 13, the WB bracket obtains a plurality of image data by performing digital image processing with different parameters based on one RAW data obtained by imaging. The same as described above. That is, in the example shown in FIG. 7, JPEG data with an appropriate white balance, JPEG data that has been color-corrected to the blue side of the appropriate white balance, and color correction to the amber side of the appropriate white balance by WB bracket shooting. It is assumed that three pieces of JPEG data, that is, the JPEG data, are created from one RAW data.

  At this time, as shown in FIG. 7, one RAW file including the RAW data is saved, and then JPEG data with appropriate white balance created based on the RAW data and color correction on the blue side are performed. One multi-image file including the JPEG data and the JPEG data subjected to color correction on the amber side is saved. The RAW file and the multi-image file created at this time have the same file name portion excluding the extension. Therefore, the RAW file and the multi-image file constitute one object, and one object is generated and two files are created in the example shown in FIG. By adopting such an object configuration, unlike the example described with reference to FIG. 13, the RAW data to be stored is only one and does not overlap. It is possible to avoid such a wasteful consumption of recording capacity.

  Next, FIG. 8 shows a file created when 3 × 3 = 9 pieces of JPEG data are generated when the RAW + JPEG mode or the AUTO mode is set and the exposure bracket and the white balance bracket are simultaneously performed. It is a figure which shows the relationship with an object.

  First, when an image with proper exposure is captured, as shown in FIG. 8 (A), one RAW file including RAW data with proper exposure is stored, and each created based on this RAW data. One multi-image file including the JPEG data of the appropriate white balance, the JPEG data corrected in color on the blue side, and the JPEG data corrected in color on the amber side is saved. The RAW file and the multi-image file created at this time have the same file name portion excluding the extension.

  Next, when an image having an exposure value different from that of the appropriate exposure by -1 EV is captured, as shown in FIG. 8B, one RAW file including -1 EV RAW data is stored. One multi-image file that includes JPEG data with appropriate white balance, JPEG data that is color-corrected on the blue side, and JPEG data that is color-corrected on the amber side, each created based on this -1EV RAW data Is saved. The RAW file and the multi-image file created at this time have the same file name portion excluding the extension.

  Subsequently, when an image having an exposure value different from the appropriate exposure by +1 EV is captured, as shown in FIG. 8C, one RAW file including +1 EV RAW data is stored. One multi-image file that contains JPEG data with appropriate white balance, JPEG data with color correction on the blue side, and JPEG data with color correction on the amber side, created based on + 1EV RAW data, is saved The The RAW file and the multi-image file created at this time have the same file name portion excluding the extension.

  Therefore, at this time, a total of six files are created, and there are three types of file names excluding the extension. The RAW file and multi-image file shown in FIG. 8A constitute a first object, and the RAW file and multi-image file shown in FIG. 8B constitute a second object. The RAW file and multi-image file shown in FIG.

  In the example shown in FIG. 8 as well, the same RAW data is not recorded redundantly, and it is possible to avoid wasteful consumption of recording capacity.

  Next, FIG. 9 is a flowchart showing a part of the action at the time of shooting by the image file creating apparatus applied to the digital camera, and FIG. 10 is another action at the time of shooting by the image file creating apparatus applied to the digital camera. It is a flowchart which shows a part. 9 and 10 are originally intended to be described as one drawing, but are divided into two drawings for the sake of space.

  When the image file creation apparatus applied to the digital camera is turned on and a release operation is performed by the operation unit 18, this photographing process is performed.

  When this process is started, first, the shooting mode is checked (step S1). In this shooting mode check, it is checked whether one or both of the exposure bracket shooting mode and the WB bracket shooting mode is set.

  Next, photometry of the subject is performed (step S2), and exposure control for setting the aperture and exposure time of the imaging unit 11 based on the photometry result is performed (step S3). Then, based on the set exposure condition, the imaging unit 11 performs photoelectric conversion on the optical image of the subject to perform imaging processing (step S4), and the obtained image signal is converted into digital image data by the A / D conversion unit 12. After conversion, it is stored in the RAM 14 (step S5).

  Subsequently, it is determined whether or not the exposure bracket is finished (step S6). If it is determined that the exposure bracket shooting mode has been set and the acquisition of the set number of shots has not yet been completed, the exposure condition is changed according to the mode setting (step S7) Thereafter, the process returns to step S3 described above, and the next image is captured based on the changed exposure condition.

  In step S6, if the exposure bracket shooting mode is not set, or if the exposure bracket shooting mode is set and the acquisition of the set number of shots is completed, the exposure bracket is ended. Then, the image processing circuit 15 performs white balance correction processing (step S8). When the white balance correction process in step S8 is first performed in a series of photographing, a white balance gain is first set so that the white balance is appropriate.

  Next, for example, when the image pickup unit 11 is configured to include a single-plate image pickup device, image data including three color components per pixel is generated by performing a synchronization process ( Step S9).

  Then, by performing color conversion processing, parameters are set to enhance saturation, or color space (sRGB color space, AdobeRGB color space, etc., for example) is converted (conversion of this color space). (This is image processing based on a kind of parameter setting) (step S10).

  Subsequently, by performing gradation conversion processing by setting parameters, image data having gradation characteristics corresponding to the output device or the like is generated (step S11).

  Further, JPEG data is generated by setting parameters and performing JPEG compression processing (step S12), and the generated JPEG data is stored again in the RAM 14 (step S13).

  Subsequently, it is determined whether or not the white balance bracket has been completed (step S14). If it is determined that the WB bracket shooting mode has been set and the generation of the set number of JPEG data has not yet been completed, the WB gain is changed according to the mode setting (step In step S15, the process returns to step S8, and the next JPEG data is generated based on the changed WB gain.

  In step S14, when the WB bracket shooting mode is not set, or when the WB bracket shooting mode is set and generation of the set number of JPEG data is finished, the WB bracket is finished. After the determination, the process proceeds to the next process as shown in FIG.

  That is, as shown in FIG. 10, the microcomputer 19 determines whether or not the image quality mode is the JPEG mode (step S16).

  If it is determined that the mode is JPEG mode, the microcomputer 19 creates a file header (JPEG header) corresponding to the JPEG data (step S17), and creates a JPG file from the JPEG data and the file header. (Step S18), the created JPG file is recorded on the recording medium 6 via the I / F 17 (Step S19).

  Thereafter, it is determined whether or not the processing for all the JPEG data has been completed (step S20). If it is determined that the processing has not yet been completed, the processing returns to step S17 and the processing described above for the next JPEG data. On the other hand, if it is determined that the process has been completed, the process is terminated. Therefore, in this case (that is, when the JPEG mode is set, regardless of whether the exposure bracket shooting mode or the WB bracket shooting mode is set), as shown in FIG. All JPEG data is recorded as individual JPG files.

  If it is determined in step S16 that the image quality mode is not JPEG mode, it is determined whether or not a plurality of JPEG data is generated from one RAW data (step S21). In the examples shown in FIG. 3 and FIG. 4, when the WB bracket shooting mode is set (that is, regardless of whether the exposure bracket is set at the same time), a plurality of JPEG data is converted from one RAW data. It is determined that it has been generated, and when it is not set, it is determined that it has not been generated.

  If it is determined that a plurality of JPEG data is not generated from one RAW data, it is further determined whether or not the image quality mode is the AUTO mode (step S22). If it is determined that the image quality mode is the AUTO mode, the process proceeds to step S17 to perform the same processing as in the JPEG mode. This case corresponds to a case where the AUTO mode is set and one JPEG data is generated from one RAW data (that is, the exposure bracket shooting mode shown in FIG. 4 is set). To do.

  On the other hand, if it is determined in step S22 that the mode is not the AUTO mode, the microcomputer 19 creates a RAW file including RAW data (step S23), and records the created RAW file on the recording medium 6 (step S23). S24). Further, the microcomputer 19 creates a file header (step S25), sets the image file name according to the RAW file (that is, the same as the RAW file excluding the extension), and creates a JPG file (step S25). S26) The created JPG file is recorded on the recording medium 6 (step S27).

  Then, it is determined whether or not the processing for all the RAW data and JPEG data has been completed (step S28). If it is determined that the processing has not yet been completed, the process returns to step S23 to return to the next RAW data and JPEG data. On the other hand, if it is determined that the processing has been completed, the processing is terminated. Since this case is neither JPEG mode nor AUTO mode and one JPEG data is generated from one RAW data, it is the RAW + JPEG mode shown in FIG. This is the case when the mode is set.

  When it is determined in step S21 described above that a plurality of JPEG data is generated from one RAW data, a RAW file including the RAW data is created (step S29), and the created RAW file is Recording is performed on the recording medium 6 (step S30). Further, the microcomputer 19 combines a plurality of JPEG data created from one RAW data into one (step S31), creates a file header for the multi-image file (step S32), and expands the image file name. A multi-image file is created by setting it to be the same as the RAW file except for the child (step S33), and the created multi-image file is recorded on the recording medium 6 (step S34).

  Then, it is determined whether or not processing for all RAW data and JPEG data has been completed (step S35). If it is determined that processing has not yet been completed, the process returns to step S29 to return to the next RAW data and JPEG data. On the other hand, if it is determined that the processing has been completed, the processing is terminated. Since this case is not the JPEG mode and a plurality of JPEG data is generated from one RAW data, the RAW + JPEG mode or the AUTO mode shown in FIG. 4 and the WB bracket shooting is performed. This is the case when the mode is set.

  Next, FIG. 11 is a flowchart showing an operation when the image file creation apparatus is set to the repair mode.

  When this process is started, the header information of the image file selected via the operation unit 18 is chucked (step S41). As described above, in this embodiment, since the extension of “JPG” is added to the multi-image file as in the case of a normal JPG file, it is possible to determine which is the file name alone. Can not. However, as described with reference to FIG. 5, in the case of a multi-image file, since a multi-image tag is attached to the file header, whether or not the file is a multi-image file is checked by checking the header information. Can be determined.

  In the case of a multi-image file, each sub-image data is actually stored based on the number of sub-images described in the header and a pointer (not shown) to each sub-image described in the header. (Step S42). If the image file is a normal JPG file, the sub-image data is not included, so this process is passed as it is.

  Then, based on the check result, it is determined whether or not there is a defect in the sub-image (step S43). Here, when it is determined that there is no defect in the sub-image (it is determined that there is no defect in the sub-image even in the case of a normal JPG file), this is left as it is. The repair mode processing ends.

  On the other hand, if it is determined in step S43 that the sub-image is missing, RAW data is obtained from a RAW file belonging to the same object as the multi-image file (that is, the file name excluding the extension is the same). After reading (step S44), the read RAW data is stored in the RAM 14 (step S45).

  Next, based on the image processing condition information (see FIG. 5) recorded in the header, image processing is performed to generate JPEG data.

  That is, first, white balance correction processing is performed by the image processing circuit 15 (step S46).

  Next, by performing a synchronization process, image data in which three color components are aligned per pixel is generated (step S47).

  Then, by performing color conversion processing, parameters are set to enhance saturation, or color space conversion is performed (step S48).

  Subsequently, image data having gradation characteristics corresponding to the output device or the like is generated by setting parameters and performing gradation conversion processing (step S49).

  Further, JPEG data is generated by setting parameters and performing JPEG compression processing (step S50), and the generated JPEG data is stored again in the RAM 14 (step S51).

  Note that the processing in steps S46 to S51 is performed for all of the sub-image data in which the loss is confirmed. Further, it is not necessary to regenerate sub-image data that is not lost, and it is sufficient to extract it from the original multi-image file as described above.

  Thus, when all the JPEG data necessary for restoring the multi-image file is obtained, the plurality of JPEG data are combined into one (step S52), and the file header for the multi-image file is restored (if necessary) (Step S53), the multi-image file having the same file name as the original is recorded on the recording medium 6 (step S54), and the process is terminated.

  In the above description, the exposure bracket shooting mode is taken as an example of a shooting mode in which one JPEG data is generated from one RAW data, and the WB bracket is taken as an example of a shooting mode in which a plurality of JPEG data is generated from one RAW data. The shooting modes are listed, but not limited to these.

  For example, as a shooting mode in which one JPEG data is generated from one RAW data, a continuous shooting mode for shooting a plurality of images (for example, about several to several tens of images per second) in a short time, shooting direction Panorama shooting mode for shooting multiple images while shifting and combining them later to generate a single image with a wide angle of view. Shooting multiple images with different camera locations around the subject. And a multi-viewpoint shooting mode for allowing the image to be observed stereoscopically.

  On the other hand, in a shooting mode in which a plurality of JPEG data is generated from one RAW data, it is only necessary to generate a plurality of images with different parameters in image processing. The parameters at this time include the following. For example, changing the image sharpness based on the parameter, changing the image contrast based on the parameter, changing the saturation enhancement level based on the parameter, changing the tone conversion curve based on the parameter Those that perform conversion, those that select a color space (such as the sRGB color space or AdobeRGB color space described above) based on parameters, and the like. Then, the image data determination unit 3 is 1 or more when the sub-image generation condition such as the shooting mode is a condition for generating one or more sub-image data from the RAW data by changing only parameters in predetermined image processing. It is determined that the sub-image data can be generated from the raw data from which the main image data is generated.

  In the above description, an example in which the sub image data is restored from the RAW data when the sub image data is damaged has been described. However, since the main image data is also generated from the RAW data, the main image is damaged. Even if it is received, it can be restored from the RAW data.

  Further, in the above description, an example in which the extension of “JPG” similar to that of a normal JPG file is added to a multi-image file has been described, but it is needless to say that the present invention is not limited to this.

  In the above description, the image file creation apparatus has been mainly described. However, an image file creation method that performs the same operation may of course be used, and an image file creation program for causing a computer to perform the same processing. Also good.

  According to the first embodiment, when a plurality of image data is recorded as one multi-image file, a RAW file including RAW data is always recorded, and a sub-image in the multi-image file is damaged. Even if the sub-image data in the multi-image file is damaged by existing devices or software that do not support multi-image files, the sub-image data and thus the multi-image file can be restored. It becomes possible to do.

  In addition, since the information necessary to restore the sub-image data is included in the header of the multi-image file, it is not necessary to create another file that contains the restoration information, and the number of files can be reduced. At the same time, the compatibility with existing devices and software that read the header information and perform various processes is increased.

  The image file creation apparatus 1 itself is provided with the restoration determination unit 4 and the image data restoration unit 5, so that actual restoration can be performed by the image file creation apparatus 1. However, the restoration determination unit 4 and the image data restoration unit 5 may be provided in a device (such as an image file restoration device for restoring a multi-image file) separate from the image file creation device 1. In this case, the image file repair device also includes an image file creation unit. According to the image file repairing apparatus, it is possible to repair a multi-image file created by any of the image file creating apparatus, the image file creating method, or the computer executing the image file creating program. is there.

  Note that the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, you may delete a some component from all the components shown by embodiment. Furthermore, the constituent elements over different embodiments may be appropriately combined. Thus, it goes without saying that various modifications and applications are possible without departing from the spirit of the invention.

1 is a block diagram conceptually showing the structure of an image file creation device in Embodiment 1 of the present invention. FIG. 2 is a block diagram showing a configuration example of an image file creation device applied to a digital camera in the first embodiment. FIG. 3 is a chart showing shooting modes and image quality modes that can be set in the image file creation device applied to the digital camera in the first embodiment. FIG. 5 is a chart showing what type of file is saved in the combination of the image quality mode and the shooting mode shown in FIG. 3 in the first embodiment. The figure which shows the principal part of the header information recorded on the header of a multi-image file in the said Embodiment 1. FIG. FIG. 6 is a diagram illustrating a relationship between a file and an object created when three images are captured by an exposure bracket when the RAW + JPEG mode is set in the first embodiment. FIG. 5 is a diagram showing a relationship between a file and an object created when three image data are generated by the white balance bracket when the RAW + JPEG mode or the AUTO mode is set in the first embodiment. In the first embodiment, files and objects created when 3 × 3 = 9 pieces of JPEG data are generated by setting the RAW + JPEG mode or the AUTO mode and performing the exposure bracket and the white balance bracket at the same time. FIG. 5 is a flowchart showing a part of the action at the time of shooting by the image file creation device applied to the digital camera in the first embodiment. 9 is a flowchart showing another part of the action at the time of shooting by the image file creation device applied to the digital camera in the first embodiment. 9 is a flowchart showing an operation when the image file creation device is set in a repair mode in the first embodiment. The figure which shows the relationship between the file and object which are created when three images are image | photographed with the exposure bracket conventionally. The figure which shows the relationship between the file and object which are created when three JPEG data are produced | generated conventionally by the white balance bracket.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Image file creation apparatus 2 ... Image file creation part 3 ... Image data discrimination | determination part 4 ... Restoration discrimination | determination part 5 ... Image data restoration part 6 ... Recording medium 11 ... Imaging part 12 ... A / D conversion part 13 ... Bus 14 ... RAM
15. Image processing circuit (image data restoration unit)
16 ... Image display unit 17 ... I / F
18 ... operation unit 19 ... microcomputer (image data discrimination unit, image file creation unit, repair discrimination unit)

Claims (6)

An image file creation device capable of creating a multi-image file including main image data generated based on one RAW data and one or more sub-image data related to the main image data,
An image data determination unit that determines whether or not the one or more sub-image data can be generated from the RAW data based on a sub-image generation condition that is a condition for generating the sub-image data;
When it is determined by the image data determination unit that the image data can be generated, one multi-image file including the one or more sub-image data and the main image data is created and associated with the one multi-image file. An image file creation unit for creating a RAW file including the RAW data;
An image file creation device comprising:   2. The multi-image file according to claim 1, wherein the image file creating unit creates the multi-image file so as to include information necessary for restoring the one or more sub-image data from the RAW data. The image file creation device described. A repair discriminating unit for discriminating whether or not at least a part of the sub-image data included in the multi-image file is damaged;
The RAW associated with the multi-image file based on information necessary to restore the sub-image data when the repair determining unit determines that at least a part of the sub-image data is damaged. An image data restoration unit that generates the damaged sub-image data from the RAW data included in the file;
Further comprising
3. The image file creation apparatus according to claim 2, wherein the image file creation unit creates the multi-image file again using the sub-image data generated by the image data restoration unit.   The image data determination unit may generate the one or more sub-image data when the sub-image generation condition is a condition for generating the one or more sub-image data from the RAW data by changing only parameters in predetermined image processing. 2. The image file creation apparatus according to claim 1, wherein the image file creation apparatus determines that image data can be generated from the RAW data. An image file creation method for creating a multi-image file including main image data generated based on one RAW data and one or more sub-image data related to the main image data,
Determining whether the one or more sub-image data can be generated from the RAW data based on a sub-image generation condition that is a condition for generating the sub-image data;
If it is determined that it can be generated, one multi-image file including the one or more sub-image data and the main image data is created,
Creating a RAW file including the RAW data in association with the one multi-image file;
Image file creation method. An image data restoration device for restoring a multi-image file created by the image file creation device according to claim 2 based on a RAW file created in association with the multi-image file by the image file creation device. ,
A repair discriminating unit for discriminating whether or not at least a part of the sub-image data included in the multi-image file is damaged;
The RAW associated with the multi-image file based on information necessary to restore the sub-image data when the repair determining unit determines that at least a part of the sub-image data is damaged. An image data restoration unit that generates the damaged sub-image data from the RAW data included in the file;
An image file creation unit that creates the multi-image file again using the sub-image data generated by the image data restoration unit;
An image file restoration apparatus comprising:

Images