JP2018023033A - Image data generator, image data reproduction apparatus, and image data editing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image data generator which stores plural pieces of image data each having different exposure condition in a single image file which is capable of allowing a print/display device to print/display while selecting/composing an image of tone characteristics suitable to respective dynamic range.SOLUTION: A digital camera 101 includes: means that generates a piece of first image data which is picked up under a first exposure condition; means that generates a piece of second image data which is picked up under a second exposure condition; and means that records the first image data and the second image data, which are stored in a single file.SELECTED DRAWING: Figure 3

Description

  The present disclosure relates to an image data generation apparatus that records an image file that stores a plurality of image data with different exposure conditions in one file.

  Patent Document 1 discloses a digital still camera (hereinafter referred to as “digital camera”) that generates an image file capable of storing a plurality of images in one file.

  This digital camera generates display image data (eg, horizontal 1920 pixels × vertical 1080 pixels) from captured image data (eg, horizontal 6000 pixels × vertical 4000 pixels). The image data for display has the number of pixels of a high-definition television. This digital camera manages captured image data and display image data in the same image file.

  As a result, the digital camera can store and record image data composed of all pixels of the captured image and image data for display on a high-definition television in one file.

International Publication No. 2009/066471

  According to Patent Document 1 described above, there is an advantage that an image can be displayed quickly by storing a plurality of image data matching the number of pixels of each display device in an image file. On the other hand, in devices having different printing / display dynamic ranges, such as printers and televisions, the gradation characteristics of images to be printed / displayed are the same, and images suitable for each printing / display device cannot be printed / displayed.

  The present disclosure has been made in consideration of the above-described problems. By storing a plurality of pieces of image data with different exposure conditions in one image file, the printing / display apparatus can be used for each dynamic range. It is an object of the present invention to provide an image data generation apparatus that can select / synthesize an image having a tonal characteristic and print / display it.

  (1) A first image data generation device according to the present disclosure includes a unit that generates first image data captured under a first exposure condition, and a second exposure condition that is different from the first exposure condition. Means for generating photographed second image data, and means for storing and recording the first image data and the second image data in one file.

  (2) A second image data generation device according to the present disclosure includes a unit that generates first image data captured under a first exposure condition, and a second exposure condition that is different from the first exposure condition. Means for generating photographed third image data, the second image data and the first image data photographed under an exposure condition that is a difference between the first exposure condition and the second exposure condition; And means for generating third image data, and means for storing and recording the first image data or the second image data and the third image data in one file. Prepare.

  (3) A third image data generation device according to the present disclosure is configured to generate a first image data photographed under a first exposure condition, and a second exposure condition different from the first exposure condition. Means for generating photographed second image data, means for generating fourth image data obtained by combining the first image data and the second image data, and the first image data or the first image data. Means for storing and recording the second image data and the fourth image data in one file.

  (4) A fourth image data generation device according to the present disclosure includes a unit that generates first image data that has been photographed under a first exposure condition and has a first gradation characteristic, and the first exposure condition. Means for generating second image data having the first gradation characteristic, photographed under a different second exposure condition; and combining the first image data and the second image data to generate the first image data. Means for generating fourth image data having a second gradation characteristic different from the gradation characteristic, and the first image data or the second image data and the fourth image data in one file; Means for storing and recording.

  (5) An image data reproduction device according to the present disclosure includes first image data and second image data having the same first gradation characteristics that are captured in different exposure conditions in an image file to be displayed on a display device. The first image data and the second image data are included in the image file, and the display device supports the second gradation characteristic. Means for synthesizing the first image data and the second image data to generate third image data having a second gradation characteristic different from the first gradation characteristic; 3 for reproducing the image data.

  (6) In the image data editing apparatus according to the present disclosure, whether or not the image file to be edited includes first image data and second image data that are captured under different exposure conditions and have the same first gradation characteristics. The first image data and the second image data are included in the image file, and the display device corresponds to the second gradation characteristic, Means for synthesizing the first image data and the second image data to generate third image data having a second gradation characteristic different from the first gradation characteristic; and the third image data Means for recording.

  According to the image data generation device of the present disclosure, it is possible to store and record one file of image data for storing a plurality of image data. According to the image data reproducing device of the present disclosure, it is possible to select and reproduce an image suitable for the gradation characteristics of the display device. According to the image data editing apparatus of the present disclosure, it is possible to edit and process the gradation characteristics of an image in accordance with the dynamic range of the display production apparatus and the user's intention.

1 is a block diagram showing a configuration of a digital camera according to a first embodiment. 1 is a rear view of a digital camera according to a first embodiment. Data structure diagram of image file in Embodiment 1 Other data structure diagram of image file The figure which showed the detail of management table T10 Flowchart of the first recording operation in the first embodiment Flowchart of second recording operation in the first embodiment Flowchart of third recording operation in the first embodiment Flowchart of the fourth recording operation in the first embodiment Schematic diagram showing a recorded image containing subjects with different brightness The figure which showed the luminance histogram of the recorded image of FIG. Flowchart of composition process of fourth recording operation in embodiment 1 Conceptual diagram of composition process of fourth recording operation in Embodiment 1 Flowchart of reproduction operation in the first embodiment Other data structure diagram of image file The figure which showed the detail of another management table T10

  Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

  The applicant provides the accompanying drawings and the following description in order for those skilled in the art to fully understand the present disclosure, and is not intended to limit the subject matter described in the claims. Absent.

(Embodiment 1)
In the first embodiment, the case where the image data processing apparatus is applied to a digital camera will be described with reference to the drawings.

[1-Configuration]
[1-1. Electrical configuration of digital camera)
FIG. 1 is a block diagram illustrating a configuration of the digital camera 101 according to the first embodiment of the present disclosure. The digital camera 101 captures the subject image formed by the optical system 120 with the image sensor 141. The image data generated by the image sensor 141 is subjected to various processes by the image processing unit 160 and stored in the memory card 108 or the built-in memory 109. The image data stored in the memory card 108 or the like can be displayed on the liquid crystal monitor 110. Hereinafter, the configuration of the digital camera 101 will be described in detail.

  The optical system 120 includes an objective lens 121, a zoom lens 122, a diaphragm 123, an OIS unit 124, and a focus lens 125. The optical system 120 collects light from the subject and forms a subject image.

  The objective lens 121 is a lens arranged closest to the subject. The zoom lens 122 can enlarge or reduce the subject image by moving along the optical axis of the optical system 120. The diaphragm 123 adjusts the amount of light transmitted through the optical system 120 by adjusting the size of the opening according to the setting of the user or automatically. The OIS unit 124 includes a correction lens that can move in a plane perpendicular to the optical axis. The OIS unit 124 reduces the blur of the subject image by driving the correction lens in a direction that cancels the blur of the digital camera 101. The focus lens 125 adjusts the focus of the subject image by moving along the optical axis of the optical system 120.

  The drive system 130 drives each optical element in the optical system 120.

  The zoom motor 132 drives the zoom lens 122 along the optical axis of the optical system 120. The zoom motor 132 may drive the zoom lens 122 via a mechanism such as a cam mechanism or a ball screw. The zoom motor 132 may be realized by a pulse motor, a DC motor, a linear motor, a servo motor, or the like.

  The diaphragm actuator 133 is a drive unit for changing the size of the opening of the diaphragm 123. The aperture actuator 133 can be realized by a motor or the like.

  The OIS actuator 134 drives the correction lens in the OIS unit 124 in a plane perpendicular to the optical axis. The OIS actuator 134 can be realized by a planar coil or an ultrasonic motor.

  The focus motor 135 drives the focus lens 125 along the optical axis of the optical system 120. The focus motor 135 may drive the focus lens 125 via a mechanism such as a cam mechanism or a ball screw. The focus motor 135 may be realized by a pulse motor, a DC motor, a linear motor, a servo motor, or the like. Further, the focus motor 135 may be omitted, and the zoom motor 132 may be used as a driving unit that drives the zoom lens 122 and the focus lens 125.

  The image sensor 141 is configured by a CMOS or a CCD, and captures a subject image formed by the optical system 120 to generate image data. The timing generator 142 generates a timing signal for driving the image sensor 141. The image sensor 141 performs various operations such as exposure, transfer, and electronic shutter according to the timing signal generated by the timing generator 142. The AD converter 105 converts the image data generated by the image sensor 141 into a digital signal.

  The image processing unit 160 performs various processes on the image data converted by the AD converter 105. The image processing unit 160 processes the image data generated by the image sensor 141 to generate image data to be recorded on the memory card 108 or to generate image data to be displayed on the liquid crystal monitor 110. Or In addition, the image processing unit 160 performs processing on the image data stored in the memory card 108 to generate image data to be displayed on the liquid crystal monitor 110 and to store the image data in the memory card 108 again. Or image data to be transmitted to an external device via the communication unit 111. The image processing unit 160 can be realized by a DSP or a microcomputer.

  The preprocessing unit 161 performs various image processing such as gamma correction, white balance correction, and flaw correction on the image data converted by the AD converter 105. The YC conversion unit 162 converts image data expressed in RGB into image data expressed in a YC (Y: luminance signal, C: color difference signal) signal.

  The electronic zoom processing unit 165 electronically enlarges or reduces the image data. At that time, the electronic zoom processing unit 165 appropriately executes processes such as a part of the image data clipping process, a thinning process, and an interpolation process on the image data. In short, the electronic zoom processing unit 165 is means for converting the number of pixels of the image data.

  The compression unit 163 compresses image data expressed in YC by performing DCT (Discrete Cosine Transform), Huffman coding, and the like. For example, the compression unit 163 compresses the image data in a compression format compliant with the JPEG standard. However, the present disclosure is not limited to JPEG image data.

  When the compressed image data stored in the memory card 108 is reproduced on the liquid crystal monitor 110, the decompression unit 164 decodes the image data into an uncompressed state.

  The combining unit 166 combines a plurality of image data stored in the buffer memory 115, the memory card 108, the built-in memory 109, and the like to generate a new image. The synthesized image may be expressed in YC, may be expressed in RGB, or may be a RAW image. The synthesized image can change gradation characteristics from the image before synthesis.

  The controller 150 is a control unit that controls the entire digital camera 101. The controller 150 can be realized by a semiconductor element or the like. The controller 150 may be configured only by hardware, or may be realized by combining hardware and software. The controller 150 can be realized by a microcomputer.

  The buffer memory 115 functions as a work memory for the image processing unit 160 and the controller 150. The buffer memory 115 can be realized by a DRAM, a ferroelectric memory, or the like, for example. A card slot 107 is detachable from the memory card 108. The card slot 107 can be mechanically and electrically connected to the memory card 108. The memory card 108 includes a flash memory, a ferroelectric memory, and the like, and can store data.

  The built-in memory 109 can be realized by a flash memory or a ferroelectric memory. The controller 150 can store the generated image file in the memory card 108 or the built-in memory 109. Further, the controller 150 reads out the image file stored in the memory card 108 and stores it in the built-in memory 109 or reads out the image file stored in the built-in memory 109 and stores it in the memory card 108. be able to.

  The liquid crystal monitor 110 can display an image indicated by image data generated by the image sensor 141 or an image indicated by image data read from the memory card 108 or the like. The liquid crystal monitor 110 can display various setting information of the digital camera 101. For example, the liquid crystal monitor 110 can display an EV value or the like.

  The communication unit 111 is means for performing communication with an external device. The communication unit 111 can be configured by a wireless LAN unit, a USB communication unit, or the like. The operation unit 170 is a component that collectively refers to various operation means. The operation unit 170 receives a user instruction and transmits the instruction to the controller 150. The flashlight 113 emits light that irradiates the subject.

  The rotation detection unit 190 detects the rotation state of the digital camera 101. The controller 150 can acquire information related to the rotation state of the digital camera 101 detected by the rotation detection unit 190. For example, the rotation detection unit 190 can be realized by a rotation sensor or an angular velocity sensor. Note that the OIS actuator 134 may serve as the rotation detection unit 190. This is because it is possible to detect how much the casing is tilted according to the magnitude of the drive current.

[1-2. Digital camera rear configuration)
FIG. 2 is a rear view of the digital camera 101 according to the first embodiment of the present disclosure. Hereinafter, various operation members will be described with reference to FIG.

  The release button 171, zoom dial 172, and mode dial 174 are arranged on the upper surface of the camera body. Release button 171 accepts a pressing operation. The controller 150 starts AE control and AF control in response to the release button 171 being pressed halfway. The digital camera 101 captures an image of the subject in response to the release button 171 being fully pressed.

  The zoom dial 172 is rotatably arranged around the release button 171. The controller 150 starts optical zoom control and electronic zoom control in response to the zoom dial 172 being rotated.

  The mode dial 174 receives a rotation operation. The mode dial 174 is provided with a scale, and the operation mode of the digital camera 101 is assigned to each scale. The operation mode of the digital camera 101 includes, for example, a playback mode and a shooting mode. The controller 150 controls the digital camera 101 in an operation mode designated by the mode dial 174 in accordance with the rotation operation of the mode dial 174.

  The power switch 173, the cross key 180, the delete button 186, the display button 187, and the liquid crystal monitor 110 are arranged on the back of the camera body. The power switch 173 receives a slide operation. The power switch 173 switches the power state of the digital camera 101 according to the slide operation.

  The liquid crystal monitor 110 displays image data, a menu screen, and the like stored in the memory card 108 according to the operation mode selected by the mode dial 174.

  The cross key 180 accepts pressing operations of five patterns (181 to 185) in the four directions and the central portion. The controller 150 performs a display operation on the liquid crystal monitor 110 such as switching of reproduced image data in response to the cross key 180 being pressed.

  The delete button 186 accepts a pressing operation. The controller 150 deletes the previously selected image data in response to the delete button 186 being pressed.

  The display button 187 receives a pressing operation. The controller 150 switches the display content of the liquid crystal monitor 110 in response to the display button 187 being pressed.

[1-3. (Data structure of image file format)
[1-3-1. (Overall file structure)
FIG. 3 is a diagram illustrating a data structure of an image file format handled by the digital camera 101 according to the first embodiment of the present disclosure. The data structure of the image file format will be described with reference to FIG.

  The image file D10 stores first image data D25 as main image data and second image data D33 as sub image data. The second image data D33 is created under exposure conditions different from those of the first image data D25. That is, the first image data D25 is generated under the first exposure condition, and the second image data D33 is generated under a second exposure condition different from the first exposure condition. Here, the different exposure conditions include different exposure times and presence / absence of a treatment for dimming with an ND filter. The first image data D25 is assigned to the image data created under the second exposure condition, and the second image data D33 is assigned to the image data generated under the first exposure condition different from the second exposure condition. It doesn't matter. The image file D10 is created using a first recording operation and a second recording operation which will be described later.

  The image file D40 shown in FIG. 4A is created using a third recording operation described later, and the image file D50 shown in FIG. 4B is created using a fourth recording operation described later. . The first image data D25 of the image file D40 or the image file D50 is general-purpose data, and the third image data D43 of the image file D40 or the fourth image data D53 of the image file D50 is upward compatible data. .

  A FAT (File Allocation Table) stored in the memory card 108 manages the image file D10 as one file by managing the head identifier D22, the tail identifier D34, and the like. The controller 150 can distinguish and manage image files by reading FAT.

  Hereinafter, the structure of the image file D10 will be described in detail.

[1-3-2. (Main header)
[1-3-2-1. (General configuration of main header)
The main header part D20 has a head identifier D22 and a header part D23.

  The head identifier D22 is a marker representing the starting point of the image file D10, and is, for example, start information (xFFD8) of a file defined by the JPEG standard.

  The header part D23 is an area for storing management data for the entire image file D10. The header part D23 includes a management table T10, thumbnail image data D24, and the like as management data.

  The management table T10 includes information for distinguishing the first image data D25 and the second image data D33 from each other.

  The thumbnail image data D24 is reduced image data created based on the first image data D25. The thumbnail image data D24 has, for example, an image size of 160 horizontal pixels × 120 vertical pixels. In the Exif standard, the thumbnail image data D24 is defined as being stored in the header part D23.

[1-3-2-2. Management table)
The management table T10 will be described in detail with reference to FIG. 5A to 5D are schematic diagrams of the management table T10. The management table T10 holds information relating to main image data and sub image data. The head address T11, image gradation characteristic information T12, composition state information T13 indicating presence / absence of image composition, and exposure. Each piece of information is managed in a state in which a shooting order T14 indicating the number of images shot in the changed shooting and the exposure condition information T15 indicating the length of the exposure time of the image are associated with each other.

  The start address T11 is information indicating the start address of an area in which image data is stored.

  The image gradation characteristic information T12 is information indicating how many bits the image is stored in the memory card 108 and a gamma value that is a numerical value indicating the response characteristic of the image gradation.

  Next, the reason for storing the identifier of each image in the header part D23 will be described. If there is no identifier for each image, the controller 150 needs to read all image headers or each image data when searching for image data. However, if all image headers or image data are read every time each image data is retrieved, the processing becomes complicated and the processing load on the controller 150 becomes heavy. Therefore, in order to solve such a problem, the identifier of each image is stored in the header part D23.

  Since the header part D23 stores the gradation characteristic information T12, the composite state information T13, the shooting order T14, and the exposure condition information T15 of the sub-image, the controller 150 refers to the composite state information T13 and the exposure condition information T15 of each image. Thus, it is possible to select a reproduction method corresponding to each image data.

[1-3-2-2-3. (Thumbnail image data)
Returning to FIG. 3, the thumbnail image data D24 will be described. The thumbnail image data D24 is generated when the electronic zoom processing unit 165 performs a thinning process, a clipping process, an interpolation process, and the like on the first image data D25. The header part D23 stores thumbnail image data D24. Thereby, the liquid crystal monitor 110 can display a thumbnail image instantaneously.

[1-3-2-4. Other stored information)
The header part D23 stores the protection information of the main first image data D25 and the sub image data D33 in addition to the management table T10 and the thumbnail image data D24. When the protect information is stored, the first image data D25 is protected against deletion. That is, the first image data D25 cannot be deleted until the protect information is deleted.

  Here, the protection information for the first image data can be stored in the main header, and the protection information for each image can be stored in the image header of the corresponding sub image data. As a result, the first image and the sub image can be protected independently. In addition, since it is only necessary to update the header corresponding to the protection and cancellation of each image, data handling becomes easy.

  In the present embodiment, the protection information for the first image data and the protection information for the sub image data are stored in the corresponding headers. However, such a configuration is not necessarily required.

  For example, when protect information is stored in the main header, the image data of the entire image file may be protected. Thereby, protection of all the image data stored in the same image file can be handled collectively.

  Also, two pieces of protection information can be stored in the main header, and the protection information can also be stored in each image header. At this time, one protection information stored in the main header manages the protection state of the image data of the entire image file. The other protect information manages the protect state of the first image data. The protection information stored in each image header manages the protection state of the corresponding sub-image data. As a result, the user can select whether to manage the protection state of the image data in units of image files or to manage the protection state of each image data independently.

[1-3-3. First image data section]
The first image data portion D21 stores information related to the first image. The first image data D25 is 8-bit image data obtained by compressing image data of an image captured by the digital camera 101 in the JPEG format. Note that the first image data D25 is not necessarily image data compressed in the JPEG format, and may be image data such as GIF data or RAW data. That is, the first image data D25 is not necessarily compressed. Moreover, even if it is compressed, any compression format may be used.

  The tail identifier D26 is a marker (xFFD9) indicating the end point of the first image data portion D21. By providing a table for managing this marker in the header part D23, when dividing some image data in the image file D10, it is not necessary to newly add SOI or EOI to the file. Therefore, the file can be easily divided.

[1-3-4. Second image part]
In FIG. 3, the sub second image data portion D30 stores information related to the second image. The head identifier D31 is a marker indicating the starting point of the sub second image data portion D30. A table for managing this marker is provided in the header part D23. Thereby, the second image data can be easily searched. In addition, when dividing a file, a dividing point can be easily found. Furthermore, by providing this marker, when dividing the image file D10, it is not necessary to newly add SOI or EOI to the file. Therefore, the file can be easily divided.

  The second image header D32 stores attribute information of the second image data D33 and the like. For example, information relating to the fact that the sub-image data D33 is image data generated under a second exposure condition different from that of the first image is stored.

  The second image header D32 stores thumbnail image data of the second image data D33. The thumbnail image data is generated based on the second image data. Thereby, it is possible to instantaneously display thumbnail images for the sub image data.

  The Exif standard stipulates that it is necessary to include thumbnail image data in the header part. Therefore, when dividing the first image data and the second image data, it is necessary to store the thumbnail image data again in the image header. In this embodiment, since thumbnail image data corresponding to the sub-image is stored in each image header, when the first and second image data are divided, the thumbnail image data is stored again in the sub-image header. There is no need.

  The second image data D33 has the same first gradation characteristic as the first image data D25 or a second gradation characteristic different from the first image data D25.

  The tail identifier D34 is a marker indicating the end point of the second image data part D30. A table for managing this marker is provided in the header part D23. Thus, when dividing the image file D10, there is no need to newly add SOI or EOI to the file. Therefore, the file can be easily divided.

  In the embodiment, as shown in FIG. 3, the first image data D25 and the second image data D33 are recorded as image data having different exposure conditions, but the first image data and the second image data D33 are recorded. In the case of recording the third image data, which is a combination with the image data, the first image data D25 and the third image data D43 are stored and recorded as shown in FIG. In addition, when recording image data in which the gradation characteristics are changed by combining the first image data and the second image data, as shown in FIG. 4B, the first image data D25 and the second image data are recorded. Four image data D53 is stored and recorded.

[2. (Recording operation)
A first recording operation of the digital camera 101 of the present disclosure will be described with reference to FIGS. 6, 10, and 11. FIG. 6 is a flowchart of the recording operation, FIG. 10 is a schematic diagram showing a recorded image including two subjects having different luminances, and FIG. 11 is a diagram showing a luminance histogram of the recorded image in FIG.

  When the user fully presses the release button 171 in the shooting mode (S101), the RAW data of the first shooting operation output from the image sensor 141 is stored in the buffer memory 115 (S102 to S104). The first shooting operation is shot under the first exposure condition. Image processing is performed on the RAW data in the buffer memory 115 by the pre-processing unit 161, and first YC data of the image data P10 shown in FIG. 10A is generated by the YC conversion unit 162 (S105). The image data P10 includes a subject P11 and a subject P12 when a specific scene is photographed. In FIG. 11A to FIG. 11D, the horizontal axis indicates the tone value of the Y signal, and the vertical axis indicates the total number of pixels corresponding to the value. FIG. 11A shows the appearance frequencies G11 and G12 of the luminance corresponding to the subject P11 and the subject P12 in FIG. The subject P11 is overexposed.

  The first YC data is compressed by the compression unit 163 based on the first encoding method, and is stored in the buffer memory 115 as a first image (S106 to S107). The first compression method may be, for example, a JPEG compression method.

  Next, the RAW data of the second photographing operation output from the image sensor 141 is stored in the buffer memory 115 (S108 to S110). The second imaging operation is performed under a second exposure condition that is different from the first exposure condition. Image processing is performed on the RAW data in the buffer memory 115 by the preprocessing unit 161, and second YC data of the image data P20 shown in FIG. 10B is generated by the YC conversion unit 162 (S111). The image data P20 includes a subject P21 and a subject P22 when the same scene as the image data P10 is captured. Subject P21 and subject P11 are the same subject, and subject P22 and subject P12 are the same subject. FIG. 11B shows the appearance frequencies G21 and G22 of the brightness corresponding to the subject P21 and the subject P22 of FIG. The subject P22 is blackened. The second YC data is compressed by the compression unit 163 based on the first encoding method, and is stored in the buffer memory 115 as a second image (S112 to 113). The second image data generated in this way is combined with the first image data, and recorded as one file on the memory card 108 in the format shown in FIG. 3 (S114). At this time, as shown in FIG. 5A, in the gradation characteristic information T12 in the management table T10, both the first image data and the second image data are stored in 8 bits, and the gamma value is 0. Information indicating .45 is recorded. In the combination state information T13, information indicating that the first image data and the second image data are not combined is recorded. In the photographing order T14, information that the first image data is the first of the two images and information that the second image data is the second of the two are recorded. In the exposure condition information T15, information that the first image is long-time exposure is recorded, and information that the second image is short-time exposure is recorded.

  Hereinafter, the second to fourth recording operations according to other methods of the present disclosure will be described below.

  Regarding the second recording operation of the digital camera 101, using the flowchart of the recording operation in FIG. 7, the schematic diagram showing the recorded images with different luminances in FIG. 10, and the diagram showing the luminance histogram of the recorded images in FIG. explain. In the second recording operation, a method of sequentially reading a short signal having a short photographing time and a long signal having a long photographing time by non-destructive reading in one photographing operation is used.

  When the user fully presses the release button 171 in the shooting mode (S201), the RAW data until the first shooting data output from the image sensor 141 is stored in the buffer memory 115 (S202 to S203). This RAW data is obtained by a short signal.

  Image processing is performed on the RAW data in the buffer memory 115 in the preprocessing unit 161, and the first YC data of the image data P20 shown in FIG. 10B is generated by the YC conversion unit 162 (S204). . The image data P20 includes a subject P21 and a subject P22 when a specific scene is photographed. FIG. 11B shows the appearance frequencies G21 and G22 of the brightness corresponding to the subject P21 and the subject P22 of FIG. The subject P22 is blackened.

  The first YC data is compressed by the compression unit 163 based on the first encoding method, and stored as a first image in the buffer memory (S205 to S206). The first compression method may be, for example, a JPEG compression method.

  Next, the RAW data output by the image sensor 141 and read by the second shooting data until the end of the shooting operation is stored in the buffer memory (S207 to S208). This RAW data is obtained by a long signal. Image processing is performed on the RAW data in the buffer memory by the preprocessing unit 161, and second YC data of the image data P10 shown in FIG. 10A is generated by the YC conversion unit 162 (S209). The image data P10 includes a subject P11 and a subject P12 when the same scene as the image data P20 is photographed. FIG. 11A shows the appearance frequencies G11 and G12 of the brightness corresponding to the subject P11 and the subject P12 in FIG. The subject P11 is overexposed. The second YC data is compressed by the compression unit 163 based on the first encoding method, and stored as a second image in the buffer memory (S210 to S212). The second image data generated in this way is combined with the first image data and recorded in the memory card 108 in the format shown in FIG. 3 as one file (S213). At this time, as shown in FIG. 5B, in the gradation characteristic information T12 in the management table T10, both the first image data and the second image data are stored in 8 bits, and both have a gamma value of 0. Information indicating .45 is recorded. In the combination state information T13, information indicating that the first image data and the second image data are not combined is recorded. In the photographing order T14, information that the first image data is the first of the two images and information that the second image data is the second of the two are recorded. In the exposure condition information T15, information that the first image is short-time exposure is recorded, and information that the second image is long-time exposure is recorded.

  Next, regarding the third recording operation of the digital camera 101, the flowchart of the recording operation in FIG. 8, the schematic diagram showing the recorded images with different luminances in FIG. 10, and the diagram showing the luminance histogram of the recorded images in FIG. It explains using. In the third recording operation, a method of generating the third image data by combining the first image data generated in the first imaging operation and the second image data generated in the second imaging operation is used.

  When the user fully presses the release button 171 in the shooting mode (S301), RAW data of the first shooting operation output from the image sensor 141 is stored in the buffer memory 115 (S302 to S304). The first shooting operation is shot under the first exposure condition. Image processing is performed on the RAW data in the buffer memory 115 by the preprocessing unit 161, and the first YC data of the image data P10 shown in FIG. 10A is generated by the YC conversion unit 162 (S305). . The image data P10 includes a subject P11 and a subject P12 when a specific scene is photographed. FIG. 11A shows the appearance frequencies G11 and G12 of the brightness corresponding to the subject P11 and the subject P12 in FIG. The subject P11 is overexposed.

  The first YC data is compressed by the compression unit 163 based on the first encoding method, and is stored in the buffer memory 115 as a first image (S306 to S307). The first compression method may be, for example, a JPEG compression method.

  Next, the RAW data of the second photographing operation output from the image sensor 141 is stored in the buffer memory (S308 to S310). The second imaging operation is performed under a second exposure condition that is different from the first exposure condition. Image processing is performed on the RAW data in the buffer memory in the preprocessing unit 161, and second YC data of the image data P20 shown in FIG. 10B is generated by the YC conversion unit 162 (S311). The image data P20 includes a subject P21 and a subject P22 when the same scene as the image data P10 is captured. FIG. 11B shows the appearance frequencies G21 and G22 of the brightness corresponding to the subject P21 and the subject P22 of FIG. The subject P22 is blackened.

  The combining unit 166 combines the first YC data of the image data P10 shown in FIG. 10A and the second YC data of the image data P20 shown in FIG. 10B, and FIG. It becomes the third YC of the image data P30 shown (S312). The subject P31 and the subject P32 are created by combining the subject P11 and the subject P21 and combining the subject P12 and the subject P22, respectively. In FIG. 11C, the appearance frequency G31 of the luminance of the subject P31 and the subject P32 obtained by combining the subject P12 and the subject P21 by removing the overexposed subject P11 and the blacked-out subject P22 with a filter in the composition unit 166. , G32. The third YC data is compressed by the compression unit 163 based on the second encoding method, and stored in the buffer memory 115 as a third image (S313 to S314). The second encoding method may be, for example, an HEVC intraframe compression method (HEVC-i) or a JPEG compression method. In this way, as shown in FIG. 4A, the third image data D43 is combined with the first image data D25 and recorded as one file on the memory card 108 (S315). At this time, as shown in FIG. 5C, in the gradation characteristic information T12 in the management table T10, the first image data and the third image data are both stored in 8 bits, and both have a gamma value of 0. Information indicating .45 is recorded. In the combination state information T13, information indicating that the first image data is not combined is recorded, and information indicating that the third image is combined is recorded. In the shooting order T14, information that the first image data is the first of the two images is recorded, but the third image data is not recorded. In the exposure condition information T15, information that the first image is long-time exposure is recorded, and the third image is not recorded.

  Finally, regarding the fourth recording operation of the digital camera 101, a flowchart of the recording operation in FIG. 9, a schematic diagram showing recorded images with different luminances in FIG. 10, a luminance histogram of the recorded images in FIG. This will be described with reference to a flowchart of the synthesis process and a conceptual diagram of the synthesis process of FIG. In the fourth recording operation, the first image data having the first gradation characteristic generated by the first photographing operation and the second image data having the first gradation characteristic generated by the second photographing operation. Is used to generate fourth image data having the second gradation characteristic.

  The fourth recording operation is the same in that step 412 of FIG. 9 is changed to step 312 of FIG. 8 of the third recording operation.

  When the user fully presses the release button 171 in the shooting mode (S401), the raw data of the first shooting operation output from the image sensor 141 is stored in the buffer memory 115 (S402 to S404). The first shooting operation is shot under the first exposure condition. The preprocessing unit 161 performs image processing on the RAW data in the buffer memory 115 with the first gradation characteristics, and the YC conversion unit 162 further performs first YC data of the image data P20 shown in FIG. Is generated (S405). The image data P20 includes a subject P21 and a subject P22 when a specific scene is photographed. FIG. 11B shows the appearance frequencies G21 and G22 of the brightness corresponding to the subject P21 and the subject P22 of FIG. The subject P22 is blackened.

  The first YC data is compressed by the compression unit 163 based on the first encoding method, and stored as a first image in the buffer memory (S406 to S407). The first compression method may be, for example, a JPEG compression method.

  Next, the RAW data of the second photographing operation output from the image sensor 141 is stored in the buffer memory (S408 to S410). The second imaging operation is performed under a second exposure condition that is different from the first exposure condition. Image processing is performed on the RAW data in the buffer memory by the first gradation characteristic in the pre-processing unit 161, and second YC data of the image data P10 shown in FIG. 10A is generated by the YC conversion unit 162. (S411). The image data P10 includes a subject P11 and a subject P12 when the same scene as the image data P20 is photographed. FIG. 11A shows the appearance frequencies G11 and G12 of the brightness corresponding to the subject P11 and the subject P12 in FIG. The subject P11 is overexposed.

  The combining unit 166 combines the first YC data of the image data P20 shown in FIG. 10B and the second YC data of the image data P10 shown in FIG. This becomes the fourth YC of the image data P40 shown in FIG. 10D (S412). FIG. 11D shows the appearance frequencies G41 and G42 of the brightness corresponding to the subject P41 and the subject P42 in FIG. The subject P41 and the subject P42 are created by combining the subject P11 and the subject P21 and combining the subject P12 and the subject P22, respectively. FIG. 11D shows the image data P10 taken with a long exposure time (for example, 1 second) and the short exposure time (for example, 1) by removing the overexposed subject P11 and the blacked-out subject P22 with a filter in the synthesis unit 166. In consideration of the image data P20 captured in (/ 60 seconds), the Y signal value of the subject P41 is YNB and the Y signal value of the subject P42 is YNA.

  Details of the synthesis process (S412) will be described below with reference to FIGS.

  In the synthesizing process (S412), the synthesizing unit 166 performs signal processing including the inverse transformation of the first gradation characteristic on the first YC to generate a first linear RGB signal (S501). Next, the second YC is subjected to signal processing including inverse transformation of the first gradation characteristic to generate a second linear RGB signal (S502).

  Hereinafter, in the present embodiment, it is assumed that the second exposure condition is exposed for a shorter time than the first exposure condition. Specifically, the exposure time under the first exposure condition is 1/60 seconds, and the exposure time under the second exposure condition is 1 second.

  Next, the first linear RGB or the second linear RGB is determined as a range conversion target (S503). In S503, since the longer exposure time is selected as the range conversion target, in this case, the second image data (second linear RGB) photographed under the second exposure condition is selected. It reaches. In step S504, the signal width of the second linear RGB signal is compressed so as to correspond to the first exposure time to generate a third linear RGB signal. That is, the signal width S2MAX indicated by G51 in FIG. 13 is the second linear RGB signal having the maximum signal width, and the signal width S3MAX indicated by G52 is the third linear RGB signal having the maximum signal width. Compress. The maximum signal width of the first linear RGB signal value is S1MAX indicated by G51.

  Next, a first linear luminance Y is generated from the first linear RGB signal value, and a third linear luminance Y is generated from the third linear RGB signal value (S505). In accordance with the blend ratio shown in FIG. 13, the first linear RGB signal value and the third linear RGB signal value in each pixel are added from the first linear luminance Y and the third linear luminance Y. Calculate the blend ratio. The first linear RGB signal value is the blend rate of G53 in FIG. 13, and the third linear RGB signal value is the blend rate of G54 in FIG. 13 (S506). The first linear RGB signal value and the third linear RGB signal value are added according to the blend ratio to generate a fourth linear RGB (S507). Next, the fourth linear RGB signal value is signal-processed with the second gradation characteristic to generate a fourth YC (S508).

  The case where the first exposure condition is shorter than the second exposure condition has been described so far. However, when the first exposure condition is exposed for a longer time than the second exposure condition, the following is performed. In this case, since the first image data (first linear RGB) photographed under the first exposure condition is selected, the process proceeds to step S510. In step S510, the signal width is compressed so that the first linear RGB signal corresponds to the second exposure condition to generate a third linear RGB signal. That is, the signal width S1MAX indicated by G51 in FIG. 13 is changed to the first linear RGB signal having the maximum signal width, and the signal width S3MAX indicated by G52 is changed to the third linear RGB signal having the maximum signal width. Compress.

  Next, a second linear luminance Y is generated from the second linear RGB signal value, and a third linear luminance Y is generated from the third linear RGB signal value (S511). According to the blend ratio shown in FIG. 13, the second linear RGB signal value and the third linear RGB signal value in each pixel are added together from the second linear luminance Y and the third linear luminance Y. Calculate the blend ratio. The second linear RGB signal value is the blend rate of G53 in FIG. 13, and the third linear RGB signal value is the blend rate of G54 in FIG. 13 (S512). The fourth linear RGB is generated by adding the second linear RGB signal value and the third linear RGB signal value according to the blend ratio (S513). Next, the fourth linear RGB signal value is signal-processed with the second gradation characteristic to generate a fourth YC (S508).

  The fourth YC data is compressed by the compression unit 163 based on the second encoding method, and stored as the fourth image in the buffer memory 115 (S413 to S414). The second encoding method may be, for example, an HEVC intraframe compression method (HEVC-i) or a JPEG compression method. In this way, as shown in FIG. 4B, the fourth image data D53 is combined with the first image data D25 and recorded as one file on the memory card 108 (S415).

  At this time, as shown in FIG. 5D, the gradation characteristic information T12 in the management table T10 includes information indicating that the first image data is stored in 8 bits and the gamma value is 0.45. To be recorded. The fourth image data is stored with 10 bits, and information indicating that the gamma value is 0.55 is recorded. In the combination state information T13, information indicating that the first image data is not combined is recorded, and information indicating that the fourth image is combined is recorded. In the shooting order T14, information that the first image data is the first of the two images is recorded, but the third image data is not recorded. In the exposure condition information T15, information that the first image is short-time exposure is recorded, and the third image is not recorded.

[3. (Playback operation)
The reproduction operation of the image data generated in the first to fourth recording operations of the present disclosure will be described using the flowchart of the reproduction operation in FIG.
In the reproduction mode, the management table T10 of the image to be reproduced is read from the memory card 108 (S601), and it is determined whether or not the reproduction apparatus supports the second gradation characteristic (S6502). If the playback device does not support the second gradation characteristic, the first image data D25 is played back (S606).

  When the reproduction apparatus supports the second gradation characteristic, the gradation characteristic information T12 stored in the management table T10 is the second gradation characteristic (for example, 10 bits, gamma value 0.55). It is determined whether or not the image is included (S603). As shown in FIG. 5D, if the reproduction file includes image data having the second gradation characteristic, the reproduction file is reproduced according to the start address T11 of the fourth image data D53 in the management table T10 (S605). .

  As shown in FIG. 5A, when the reproduction file does not include the image of the second gradation characteristic, the first image data D25 and the second image data D33 are combined by the combining unit 166 to generate the first floor. Fourth image data having second gradation characteristics different from the gradation characteristics is generated. Thereafter, the management table T10 is created, and the fourth image data D53 is combined with the first image data D25 and the second image data D33 as shown in FIG. Recorded (S604) and reproduced according to the head address T11 of the image data of the fourth image in the management table T10 (S605).

  With the above configuration, the digital camera 101 according to the present embodiment plays back and plays back the fourth image data in the playback operation of the image data if the playback device supports the second gradation characteristic. If the apparatus does not support the second gradation characteristic, the first image data is reproduced. In addition, if the reproduction apparatus corresponds to the second gradation characteristic and the image data having the second gradation characteristic is not included in the reproduction file, the fourth image data having the second gradation characteristic is synthesized and reproduced. .

  The second gradation characteristic is a gradation characteristic suitable for a reproducing apparatus having a wide dynamic range, and according to the present embodiment, it is possible to reproduce image data suitable for the dynamic range of the reproducing apparatus.

[4. (Edit)
Editing of image data in the digital camera 101 of the present disclosure will be described.

  The digital camera 101 corresponds to an image data editing apparatus, and the user of the digital camera 101 converts the gradation characteristics of the image data stored in the image file into an image having gradation characteristics in accordance with the dynamic range of the display apparatus. Process and edit. Specifically, it is as follows.

  In the digital camera 101 of the present disclosure, by performing the above-described steps S601, S602, S603, and S604 of FIG. 14, the first and second recording operations cause the first image data D25 and Since the second image data D33 is independently stored in one file, the first image data D25 as shown in FIG. 15 with respect to the first image data D25 and the second image data D33. The synthesized data having the second gradation characteristic different from the gradation characteristic possessed by can be added as the fourth image data D53. Further, as shown in FIG. 4A, the second image data D33 can be replaced with third image data obtained by synthesizing the first image data D25 and the second image data D33.

  In the digital camera 101 of the present disclosure, the first image data D25 and the third image data D43 or the fourth image data are obtained by the third and fourth recording operations as shown in FIGS. 4 (a) and 4 (b). Since the image data D53 is independently stored in one file, the gradation characteristics are independent of the first image data D25 and the third image data D43 or the fourth image data D53, respectively. It is possible to change. That is, the digital camera 101 of the present disclosure reproduces an image file from the memory card 108, and the user of the digital camera 101 receives either the first image data D25, the third image data D43, or the fourth image data D53. Select whether to change the gradation. When changing the gradation characteristics of the first image data D25, the gradation characteristics of the first image data D25 are changed and recorded. When changing the gradation characteristics of the third image data D43 or the fourth image data D53, the third image data D43 or the fourth image data D53 is changed according to the start address of the third image data D43 or the fourth image data D53 in the management table T10. The gradation of the image data D43 or the fourth image data D53 is changed and recorded.

  As described above, the digital camera 101 can also process and edit an image having gradation characteristics according to the user's intention.

[5. Effect etc.)
(1) In the present embodiment, the digital camera 101 is photographed under a second exposure condition different from the first exposure condition and means for generating first image data photographed under the first exposure condition. Means for generating second image data, and means for storing and recording the first image data and the second image data in one file.

  Thus, when printing or displaying an image, the recorded image file is converted into the first or second image data or the first and second image data according to the gradation characteristics suitable for the dynamic range of each device. Image data generated by combining the image data can be printed or displayed.

  (2) In the present embodiment, the digital camera 101 is photographed under a second exposure condition different from the first exposure condition and means for generating first image data photographed under the first exposure condition. Means for generating third image data, wherein the second image data photographed under an exposure condition that is a difference between the first exposure condition and the second exposure condition is combined with the first image data. Means for generating third image data, and means for storing and recording the first image data or the second image data and the third image data in one file.

  Thus, when printing or displaying an image, the recorded image file is converted into the first or second image data or the first and second image data according to the gradation characteristics suitable for the dynamic range of each device. It is possible to print or display the third image data with a small pixel shift generated by combining the image data.

  (3) In the present embodiment, the digital camera 101 is photographed under a second exposure condition different from the first exposure condition and means for generating first image data photographed under the first exposure condition. Means for generating second image data, means for generating fourth image data obtained by combining the first image data and the second image data, and the first image data or the second image data. Means for storing and recording image data and the fourth image data in one file.

  Thereby, when printing or displaying an image, the recorded image file can be printed or displayed as the first or second image data or the fourth image data according to the respective devices.

  (4) In the present embodiment, the digital camera 101 is different from the first exposure condition, and means for generating first image data that has been photographed under the first exposure condition and has first gradation characteristics. Means for generating second image data having the first gradation characteristic and photographed under two exposure conditions; and combining the first image data and the second image data to produce the first gradation Means for generating fourth image data having a second gradation characteristic different from the characteristics, and storing the first image data or the second image data and the fourth image data in one file. And means for recording.

  Thus, when printing or displaying an image, the recorded image file is stored in the first or second image data or the second image data according to the gradation characteristics and the number of gradations suitable for the dynamic range of each device. 4 image data can be printed or displayed.

  (5) In the present embodiment, the digital camera 101 captures first image data and second image data having the same first gradation characteristics that are photographed under different exposure conditions in an image file to be displayed on the display device. Means for determining whether or not the image file includes the first image data and the second image data, and the display device corresponds to the second gradation characteristic. In the case, means for combining the first image data and the second image data to generate third image data having a second gradation characteristic different from the first gradation characteristic; Means for reproducing third image data.

  Accordingly, the user of the image reproduction device according to the present disclosure can select and reproduce the image data according to the dynamic range of each image reproduction device or the user's intention.

  (6) In this embodiment, does the digital camera 101 include first image data and second image data that are captured under different exposure conditions and have the same first gradation characteristics in the image file to be edited? When the means for determining whether the first image data and the second image data are included in the image file and the display device supports the second gradation characteristic, Means for combining the first image data and the second image data to generate third image data having second gradation characteristics different from the first gradation characteristics; and the third image Means for recording data.

  Accordingly, the user of the image editing apparatus according to the present disclosure can select and reproduce image data along the dynamic range of each display device.

(Other embodiments)
As described above, the first embodiment has been described as an example of the technique disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments that have been changed, replaced, added, omitted, and the like. Moreover, it is also possible to combine each component demonstrated in the said Embodiment 1, and it can also be set as a new embodiment.

  Therefore, other embodiments will be exemplified below.

  In the first recording operation, the first shooting data reading (S102 to S104) from the start of the first shooting operation and the second shooting data reading (S108 to S110) from the start of the second shooting operation are sequentially performed. The first photographing data and the second photographing data are acquired using the second exposure condition using the first exposure condition, but an ND filter is attached to a part of the cells of the image sensor 141. The photographing data is read once from the start of the photographing operation, the first photographing data is generated from the photographing data of the cell with the ND filter attached in the preprocessing 161 using the first exposure condition, and the ND filter is not attached. The second image data may be generated from the image data of the cell using the second exposure condition. Further, two image sensors 141, AD converters 105, timing generators 142, and image processing units 160 are used, and a half mirror is inserted between the optical system 120 and the two image sensors 141 to output 2 of the optical system 120. The first image data having the first exposure condition and the second image data having the second exposure condition may be acquired by dividing the image data into two and causing the two image sensors 141 to receive the light.

  In the second recording operation, when the shooting data is read once from the start of the shooting operation and the third image data shot under the second exposure condition different from the first image data is generated, The image sensor 141 combines the second image data and the first image data captured under the exposure condition that is the difference between the exposure condition and the second exposure condition (S202 to S208), but the imaging operation is started. From the first image data photographed under the first exposure condition and the second image data photographed under the exposure output condition that is the difference between the first exposure condition and the second exposure condition. The third image data may be generated using the combining unit 166 of the image processing unit 160.

  In the first and second recording operations, image data photographed under the first exposure condition and the second exposure condition is generated, but the third exposure condition is different from the first exposure condition and the second exposure condition. Image data captured under the exposure conditions may be generated and stored. In the third and fourth recording operations, the third or fourth image data is generated by the synthesis unit 166 of the image processing unit 160 using the first YC and the second YC. (S312), the RAW data as the first shooting data and the RAW data as the second shooting data are combined using the combining unit 166 of the image processing unit 160, and then image processing is performed. Then, the third or fourth YC may be generated.

  In the third and fourth recording operations, only the first image data is recorded in the memory card 108 in the format shown in FIG. 3 among the first image data and the second image data which are non-composite images. However, the second image data may be recorded instead of the first image data, and the first image data and the second image data may be recorded as the third image data or the fourth image data. Along with this, it may be recorded.

  In the third and fourth recording operations, image data shot under the first exposure condition and the second exposure condition is generated and the two image data are combined. Image data shot under a third exposure condition that is different from the second exposure condition may be generated, and the image data shot under the three exposure conditions may be combined.

  In this embodiment, the tone response characteristic of the image in the tone characteristics is a single gamma value, but it may be divided into a plurality of gamma values in the dark part and the bright part of the image, and the input / output characteristics are The LUT shown may be used.

  In the present embodiment, the image file is recorded on the memory card 108, but may be recorded on the built-in memory 109 built in the digital camera 101.

  In the present embodiment, the digital camera 101 corresponds to an image data playback device, and the user of the digital camera 101 selects and plays back image data according to the dynamic range of the display device. It is also possible to select and reproduce image data according to the intention.

  In the present embodiment, the management table T10 shown in FIGS. 5A to 5D is used. However, the management table T10 shown in FIGS. 5A to 5D includes the first section (darkest part) to the fifth. A management table T10 shown in FIG. 16 to which luminance histogram information T16 in the image up to the section (brightest part) is added may be used. Further, the management table T10 may include only the information of the sub image data or only the head address of the sub image.

  In the present embodiment, when the image file does not include the second gradation characteristic image data during the reproduction operation, the second gradation characteristic image data is synthesized in step S604 as shown in FIG. The fourth image data D53 is combined with the first image data D25 and the second image data D33 and recorded as one file on the memory card 108, but the fourth image data D53 is replaced with the second image data D33 of FIG. The image data D53 may be recorded on the memory card 108 as a file shown in FIG. 4B combined with the first image data D25. Furthermore, the fourth image data D53 generated in step S604 may not be recorded in the image file.

  In the present embodiment, if the image file does not include the second gradation characteristic image data during the editing operation, the second gradation characteristic image data is synthesized in step S604 as shown in FIG. The fourth image data D53 is combined with the first image data D25 and the second image data D33 and recorded as one file on the memory card 108, but the fourth image data D53 is replaced with the second image data D33 of FIG. The image data D53 may be recorded on the memory card 108 as a file shown in FIG. 4B combined with the first image data D25.

  As described above, the embodiments considered to be the best mode by the applicant and other embodiments are provided by the accompanying drawings and the detailed description. These are provided to those skilled in the art to illustrate the claimed subject matter by reference to specific embodiments. Therefore, the constituent elements described in the accompanying drawings and the detailed description may include not only the constituent elements essential for solving the problem but also other constituent elements. Therefore, just because those non-essential components are described in the accompanying drawings and detailed description, the non-essential components should not be recognized as essential immediately. Various modifications, replacements, additions, omissions, and the like can be made to the above-described embodiments within the scope of the claims and the equivalent scope thereof.

  According to the present disclosure, in devices having different dynamic ranges, such as printers and televisions, image data having a plurality of gradation characteristics optimal for each device can be recorded in one file and edited / reproduced. For example, the present invention can be applied to a digital still camera, a digital video camera, a mobile phone terminal with a camera function, and the like.

101 Digital Camera 108 Memory Card 109 Built-in Memory 110 LCD Monitor 111 Communication Unit 115 Buffer Memory 141 Image Sensor 150 Controller 160 Image Processing Unit 162 YC Conversion Unit 163 Compression Unit 164 Expansion Unit 165 Electronic Zoom Processing Unit 166 Composition Unit 174 Mode Dial

Claims (7)

Means for generating first image data photographed under a first exposure condition;
Means for generating second image data photographed under a second exposure condition different from the first exposure condition;
Means for storing and recording the first image data and the second image data in one file;
An image data generation device. Means for generating first image data photographed under a first exposure condition;
Means for generating third image data photographed under a second exposure condition different from the first exposure condition, wherein the photograph is performed under an exposure condition that is a difference between the first exposure condition and the second exposure condition; Means for generating the third image data by combining the second image data and the first image data,
Means for storing and recording the first image data or the second image data and the third image data in one file;
An image data generation device. Means for generating first image data photographed under a first exposure condition;
Means for generating second image data photographed under a second exposure condition different from the first exposure condition;
Means for generating fourth image data obtained by combining the first image data and the second image data;
Means for storing and recording the first image data or the second image data and the fourth image data in one file;
An image data generation device. The means for generating the first image data generates first image data having a first gradation characteristic,
The means for generating the second image data generates second image data having the first gradation characteristic,
The means for generating the fourth image data is a fourth image having a second gradation characteristic different from the first gradation characteristic by combining the first image data and the second image data. The image data generation device according to claim 3, which generates data.   2. The image according to claim 1, wherein a first photographing operation for generating the first image data and a second photographing operation for generating the second image data are performed in parallel in time. Data generator. Means for determining whether or not the image file to be displayed on the display device includes first image data and second image data which are photographed under different exposure conditions and have the same first gradation characteristics;
When the first image data and the second image data are included in the image file, and the display device supports the second gradation characteristic, the first image data Means for combining the second image data and the second image data to generate third image data having a second gradation characteristic different from the first gradation characteristic;
Means for reproducing the third image data;
An image data reproducing apparatus comprising: Means for determining whether or not the image file to be edited includes first image data and second image data which are photographed under different exposure conditions and have the same first gradation characteristics;
In a case where the first image data and the second image data are included in the image file and the display device supports the second gradation characteristic, the first image data and Means for combining the second image data to generate third image data having a second gradation characteristic different from the first gradation characteristic;
Means for recording the third image data;
An image data editing apparatus.