JP2005268952A - Image pickup apparatus, apparatus, system and method for image processing - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image pickup apparatus, an image processing apparatus, an image processing system and an image processing method capable of applying gradation conversion processing of an appropriate gradation characteristic to RAW data photographed in accordance with arbitrary exposure criteria. <P>SOLUTION: An image pickup unit 3 performs image pickup to acquire image processing data before being applied with at least gradation conversion processing, and on generating an image file 5 on the basis of the data before image processing, an exposure reference value stored in an exposure reference value storage unit 2 is recorded together with the data before image processing. An image processing apparatus 21 selects a gradation conversion table from a gradation conversion table storage unit 25 on the basis of the exposure reference value recorded in the image file 5, and performs gradation conversion processing for the data before image processing in a gradation/inverse gradation conversion processing unit 24 on the basis of the selected gradation conversion table. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an imaging device, an image processing device, an image processing system, and an image processing method.

  A conventional digital camera is known which has a function of directly recording image data before image processing (hereinafter referred to as RAW data) on a recording medium or the like. In other words, the RAW data is obtained by directly converting the output of the image sensor into a digital image. Therefore, the raw data cannot be viewed or printed as an image. In this sense, it is assumed that the RAW data is subjected to image processing in a dedicated image processing apparatus or a PC application having an image processing function.

  Usually, elements related to image quality (for example, image gradation characteristics, color reproduction, white balance, etc.) when image processing is performed by a digital camera are determined at the time of shooting. Conversion from RAW data to image data after image processing is irreversible, and changing the tone characteristics, white balance, etc. again after image processing is performed when tone conversion or white balance processing is performed directly on RAW data. Compared with this, there is a risk of image quality degradation. On the other hand, when image processing is performed after shooting RAW data, elements relating to image quality can be freely changed without deterioration in image quality, which is recognized as the utility value of RAW data.

Here, the tone characteristics are determined by the exposure level when shooting RAW data and the tone conversion table when tone conversion is performed. The exposure level is determined at the time of shooting. On the other hand, with respect to the gradation conversion table, a method using a pre-stored image processing apparatus or an image processing apparatus analyzes RAW data, and an appropriate gradation conversion table is determined according to the result of the analysis. Various methods have been proposed, such as a method of generating and a method of transferring a gradation conversion table to an image processing apparatus in association with RAW data. Japanese Patent Application Laid-Open No. 2004-26883 discloses a gradation conversion table in which imaging gamma information indicating a gamma correction amount based on imaging characteristics of an imaging apparatus is transferred to the image processing apparatus and stored in advance in the image processing apparatus based on the information. A technique has been proposed in which is updated in accordance with output characteristics.
JP 2003-244626 A

  The method for storing the gradation conversion table in the image processing apparatus in advance is based on the premise that the exposure standard when the RAW data to be processed is captured is known. However, since the concept regarding the appropriate exposure level generally differs depending on the camera model, the design philosophy of the manufacturer, and the like, a gradation conversion table that is different for each model or manufacturer is used. Therefore, it is necessary to store a gradation conversion table corresponding to each camera in advance, and the capacity of the memory for storing the gradation conversion table increases. Further, image processing cannot be performed when a gradation conversion table for a camera developed after the sale of the image processing apparatus is not stored.

  Further, in the method of transferring the image data to the image processing apparatus accompanied with the gradation conversion table, the data capacity increases by the amount of the accompanying data, which affects the transfer speed of the image data. Furthermore, the utility value of RAW data other than the gradation characteristics realized by performing image processing using the attached gradation conversion table is impaired.

  The present invention has been made in view of the above circumstances, and an imaging apparatus and an image processing apparatus capable of performing gradation conversion processing with appropriate gradation characteristics on RAW data photographed in accordance with an arbitrary exposure standard An object of the present invention is to provide an image processing system and an image processing method.

  In order to achieve the above object, the imaging apparatus according to the first aspect of the present invention images a subject based on an exposure reference value serving as a reference for exposure at the time of imaging, and is subjected to at least gradation conversion processing. Image acquisition means for obtaining previous image data; and image output means for outputting the image data obtained by the image acquisition means together with the exposure reference value.

  According to the first aspect, an exposure reference value for performing gradation conversion with appropriate gradation characteristics can be output together with image data.

  In order to achieve the above object, an image processing apparatus according to the second aspect of the present invention includes an image input unit that inputs image data before at least gradation conversion processing, and the image data is captured. Exposure reference value input means for inputting an exposure reference value to be used as an exposure reference, gradation conversion table storage means for storing a gradation conversion table corresponding to a plurality of exposure reference values, and the exposure reference value input Gradation conversion table selection means for selecting a gradation conversion table corresponding to the exposure reference value input by the means from a plurality of gradation tables stored in the gradation conversion table storage means; and the gradation conversion Gradation conversion processing means for performing gradation conversion processing on the image data input by the image input means based on the gradation conversion table selected by the table selection means. And butterflies.

  According to the second aspect, by using the exposure reference value, an appropriate gradation conversion process can be performed on the image data before the gradation conversion process is performed.

  In order to achieve the above object, an image processing system according to the third aspect of the present invention images a subject based on an exposure reference value that is a reference for exposure at the time of imaging, and at least performs gradation conversion processing. An image acquisition means for obtaining image data before being applied; an image output means for outputting the image data obtained by the image acquisition means together with the exposure reference value; and an image output means. Input means for inputting the output image data and the exposure reference value, gradation conversion table storage means for storing a gradation conversion table corresponding to a plurality of exposure reference values, and exposure reference input by the input means A gradation conversion table selecting means for selecting a gradation conversion table corresponding to the value from a plurality of gradation tables stored in the gradation conversion table storage means; A gradation conversion processing unit that performs gradation conversion processing on the image data input by the input unit based on the gradation conversion table selected by the conversion table selection unit. And

  In order to achieve the above object, the image processing method according to the fourth aspect of the present invention images at least a subject based on an exposure reference value serving as a reference for exposure at the time of imaging, and performs at least gradation conversion processing. An image acquisition step for obtaining image data before being applied, an output step for outputting the image data obtained in the image acquisition step and the exposure reference value, and an exposure reference value output in the output step A gradation conversion table selection step for selecting a gradation conversion table from a plurality of gradation conversion tables, and image data output in the output step based on the gradation conversion table selected in the gradation conversion table selection step. And a gradation conversion processing step for performing gradation conversion processing.

  According to the present invention, an imaging apparatus, an image processing apparatus, an image processing system, and an image processing method capable of performing gradation conversion processing with appropriate gradation characteristics on RAW data photographed according to an arbitrary exposure standard Can be provided.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram for explaining a conceptual configuration of an image processing system according to an embodiment of the present invention. In other words, the image processing system includes the imaging device 1 and the image processing device 21.

First, the imaging device 1 will be described. The imaging device 1 includes an exposure reference value storage unit 2, an imaging unit 3, and a recording medium 4.
The imaging unit 3 captures a subject (not shown) according to an exposure reference value (details will be described later) stored in the exposure reference value storage unit 2 to obtain image data. Thereafter, image processing is performed on the acquired image data as necessary.

  After the image data is acquired by the imaging unit 3, the exposure reference value is added as header information of the acquired image data to generate an image file 5, and the generated image file 5 is recorded on the recording medium 4. The

  Next, the image processing device 21 will be described. The image processing device 21 is an image processing device capable of processing equivalent to gradation conversion processing and inverse gradation conversion, and includes a gradation conversion table selection unit 22, a gradation conversion table correction unit 23, and gradation conversion / inverse. A gradation conversion processing unit 24 and a gradation conversion table storage unit 25 are included. Here, the process corresponding to the inverse gradation conversion process of the gradation conversion is to convert the image data that has been subjected to the gradation conversion process into image data that is substantially linear with the amount of light before the gradation conversion is performed. It is processing. Note that this processing does not necessarily match the image data before gradation conversion, but by performing such conversion, even when processing such as white balance correction is performed again on the image data after image processing. More appropriate processing can be performed. In the following description, processing corresponding to inverse conversion of gradation conversion is simply referred to as inverse gradation conversion processing.

  The image file 5 generated in the imaging device 1 is input to the image processing device 21. In the present embodiment, the image processing device directly generates the exposure reference value stored in the exposure reference value storage unit 2 and the image data acquired by the imaging unit 3 without generating the image file 5 in the imaging device 1. It is also possible to input to 21.

  After that, when the user instructs an image gradation conversion process, the gradation conversion table selection unit 22 selects a gradation conversion table according to the input exposure reference value. Here, as shown in FIG. 1, the gradation conversion table storage unit 25 stores a plurality of gradation conversion tables corresponding to a plurality of exposure reference values, and the levels corresponding to the input exposure reference values. The tone conversion table is selected by the tone conversion table selection unit 22.

  Thereafter, when there is an instruction to modify the gradation conversion table from the user, the gradation conversion table modification unit 23 modifies the gradation conversion table.

  Thereafter, different processing is performed depending on whether or not image processing (gradation conversion processing) has been performed on the image data acquired by the imaging unit 3.

  When the input image data is not subjected to gradation conversion processing, based on the gradation conversion table selected by the gradation conversion table selection unit 22 and corrected by the gradation conversion table correction unit 23, A gradation conversion process for the input image data is performed by the gradation conversion / inverse gradation conversion processing unit 24. On the other hand, when tone conversion processing is performed on the input image data, the tone conversion table is selected by the tone conversion table selection unit 22 and is corrected by the tone conversion table correction unit 23. Thus, the gradation conversion / inverse gradation conversion processing unit 24 performs the inverse gradation conversion processing on the input image data.

The image processing system in FIG. 1 will be described in more detail.
FIG. 2 is a block diagram illustrating a configuration of a digital camera 100 as an example of the imaging apparatus 1 in FIG. 2 includes an imaging unit 101, an A / D conversion unit 102, a bus line 103, a RAM 104, a microcomputer 105, an image processing unit 106, and an exposure reference value storage unit. It comprises a ROM 107 and a recording medium 108 as storage means.

  The imaging unit 101 includes a photographic optical system, an imaging device (CCD), and the like. That is, in the imaging unit 101, a light beam from a subject (not shown) is imaged on the imaging element via the photographing optical system, and is converted into an electric signal by the imaging element. In the A / D conversion unit 102, the analog image signal output from the imaging unit 101 is converted into digital image data. This image data is temporarily stored in the RAM 104 via the bus line 103. In addition to temporarily storing image data, the RAM 104 also temporarily stores various data during various calculations such as distance measurement calculation and photometry calculation. Hereinafter, the image data output from the A / D conversion unit 102 before image processing is referred to as RAW data.

  Thereafter, different processing is performed depending on whether the image quality mode is set to the JPEG mode (image quality mode for performing image processing) or RAW mode (image quality mode for not performing image processing).

  That is, when the image quality mode is set to the JPEG mode, RAW data stored in the RAM 104 is input to the image processing unit 106 via the bus line 103. The image processing unit 106 includes a white balance (WB) correction unit 106a, a synchronization unit 106b, a color conversion unit 106c, a gradation conversion unit 106d, and a JPEG compression unit 106e. An image is input to the input RAW data. Apply processing. In the WB correction unit 106a, white balance correction processing for adjusting the RGB gain in the image is performed. The synchronization unit 106b performs a synchronization process for synchronizing Bayer data. The color conversion unit 106c performs color matrix calculation for standardizing RGB data. Further, the gradation conversion unit 106d performs gradation conversion processing based on the exposure reference value stored in the ROM 107 and the gradation conversion table.

  Here, the exposure reference value will be described. The exposure reference value is a value that serves as a reference for exposure at the time of shooting. In this embodiment, the exposure reference value is a target value for exposure control (LV0) and a value obtained by gradation-converting LV0 (LV1). Is used. More specifically, LV0 is a pixel value of RAW data (that is, an output from the A / D converter 102) obtained when a uniform surface is imaged by automatic exposure control, and LV1 stores LV0 in the ROM 107. This is the pixel value after gradation change according to the gradation conversion table.

  The image data processed as described above is input to the JPEG compression unit 106e. In the JPEG compression unit 106e, the input image data is JPEG compressed. Hereinafter, the compressed image data is referred to as JPEG data. Thereafter, header information is added to the JPEG data to generate a JPEG file. In the header information, exposure reference values LV0 and LV1 are recorded in addition to a white balance gain at the time of white balance correction processing, a color conversion matrix at the time of color conversion processing, an image quality mode at the time of photographing, and the like.

  Next, the microcomputer 105 records the JPEG file thus generated by the image processing unit 106 on the recording medium 108. Here, the microcomputer 105 is a control unit that controls the entire digital camera 100. In addition to the recording control, the microcomputer 105 performs focus control of the imaging optical system in the imaging unit 101, drive control of the image sensor, and distance measurement. Calculation control such as calculation and photometry calculation is also performed. The recording medium 108 is assumed to be a detachable recording medium such as a memory card. However, if the data can be exchanged between the digital camera 100 and the image processing apparatus, the recording medium 108 is incorporated. It may be an expression.

  When the image quality mode is set to the RAW mode, the same header information as described above is added to the RAW data output from the A / D conversion unit 102 to generate a RAW file. The microcomputer 105 records the RAW file generated in this way on the recording medium 108.

  FIG. 3A is a block diagram showing a configuration of a PC 200 as an example of the image processing apparatus 21 in FIG. 3A includes a file interface (I / F) 201 as an image input unit and an exposure reference value input unit, a gradation conversion table selection unit 202, a gradation conversion table storage unit 203, a gradation A conversion table correction unit 204, a user interface (I / F) 205 as an instruction unit, and an image processing unit 206 are included. Some of these configurations are realized by application software in the PC.

  When the image file 5 is input to the PC 200 via the file I / F 201, the gradation conversion table selection unit 202 reads the exposure reference values LV0 and LV1 recorded in the image file 5, and stores them in the LV0 and LV1. A corresponding gradation conversion table is selected from the gradation conversion table storage unit 203. FIG. 3B shows a gradation conversion table stored in the gradation conversion table storage unit 203. That is, the gradation conversion table storage unit 203 stores a plurality of gradation conversion tables (9 in Table 1 to Table 9 in FIG. 3B) corresponding to a plurality of sets of LV0 and LV1. In the table selection unit 202, the gradation conversion table that is closest to the read combination of LV0 and LV1 is selected. FIG. 4 shows an example of a gradation conversion table. That is, at the time of gradation conversion, according to the gradation conversion table shown in FIG. 4, the input from the A / D conversion unit 102 (pixel value represented by 12 bits of 0 to 4095) is an 8-bit pixel of 0 to 255. Converted to a value.

  Next, when an instruction to correct the gradation conversion table is given via the user I / F 205 such as a keyboard or a pointing device, the gradation conversion table correction unit 204 corrects the gradation conversion table. The correction of the gradation conversion table is performed when the user instructs to change the contrast of the image and when the user instructs to correct the exposure of the image. Note that the exposure correction here is not performed by the digital camera 100 but is an exposure correction performed as post-processing of the PC 200.

  First, the correction of the gradation conversion table by the contrast change instruction will be described. FIG. 5A is a diagram illustrating a modification example of the gradation conversion table by changing the contrast, and FIG. 5B is a diagram illustrating the gradation conversion characteristic curve of FIG.

  For example, when the user instructs to increase the contrast of the image, the gradation conversion table (before correction) shown in FIG. 5A is corrected to the gradation conversion table (contrast Hi). On the other hand, when the user instructs to reduce the contrast of the image, the gradation conversion table (before correction) is corrected to the gradation conversion table (contrast Low). Here, in this embodiment, when correcting the gradation conversion table, the gradation conversion table is corrected so as to pass the coordinates of (LV0, LV1) shown in FIG. In this modification, a gradation conversion table may be newly generated according to the contrast instructed by the user, or a plurality of gradation conversion tables corresponding to the contrast change in the gradation conversion table may be stored in the gradation conversion table storage unit 203. A gradation conversion table may be further stored, and the gradation conversion table may be selected from the gradation conversion table storage unit 203 in accordance with the contrast designated by the user. If a gradation conversion table corresponding to the contrast instructed by the user is not stored, a new gradation conversion table may be generated by interpolation calculation from a nearby gradation conversion table.

  As described above, in the present embodiment, when the image file is generated, the exposure reference values LV0 and LV1 are recorded simultaneously with the image data. Therefore, the PC 200 side can pass the coordinates of (LV0, LV1). The key conversion table can be easily generated. Here, as described above, LV0 and LV1 are reference values for exposure at the time of photographing. Therefore, by correcting the gradation conversion table so as not to change these values, the appropriate exposure is maintained. Only the contrast of the image can be changed.

Note that the gradation conversion table of FIG. 5A is represented as 5 (b). Here, in FIG. 5B, since the horizontal axis is log ₂ (input value / LV0), the vertical axis is LV1 when the horizontal axis is 0 (input value = LV0). In the gradation characteristic curve as shown in FIG. 5B, the curve before correction and the curve after contrast change are both curves that pass (0, LV1), and only the halftone characteristics are different from each other. .

  Next, the correction of the gradation conversion table by the exposure correction instruction will be described. FIG. 6A is a diagram illustrating correction of the gradation conversion table by exposure correction, and FIG. 6B is a diagram illustrating the gradation characteristic curve of FIG. Further, FIG. 6C is an enlarged view near the saturation region of the gradation characteristic curve of FIG.

For example, when the user instructs to correct the exposure to the + side, the gradation conversion table (before correction) shown in FIG. 6A is corrected to the gradation conversion table (exposure correction +). On the other hand, when the user is instructed to correct the exposure to the minus side, the gradation conversion table is corrected to the gradation conversion table (exposure correction −). That is, in the case of exposure correction, LV0 is
LV0 (after exposure compensation) = LV0 (before exposure compensation) × 2 ^{(−exposure compensation value)} (Formula 1)
The gradation conversion table is modified so that it passes through LV0 (after exposure correction) and LV1. Here, LV1 is not a value obtained by gradation conversion of LV0 (after exposure correction) but LV1 before exposure correction. In this case, the exposure of the entire image can be changed without changing the reference exposure. The exposure correction value is a value indicating how much exposure correction is performed, that is, how much gain the RAW data is amplified by, and is specified by the user.

  That is, in this embodiment, since LV0 and LV1 are recorded in the image file 5, the output is saturated as shown by the broken line in FIG. 6C, or the output is saturated (pixel value 255). Therefore, it is possible to perform appropriate exposure correction in consideration of characteristics on the digital camera side.

  After the gradation conversion table is corrected as necessary, the gradation conversion process or inverse conversion process of the image data is performed based on the gradation table.

  Next, an image processing method performed by the image processing system including the digital camera 100 and the PC 200 as described above will be described in more detail with reference to flowcharts.

  FIG. 7 is a flowchart for explaining control on the digital camera 100 side. That is, when a release button (not shown) is turned on, the control in FIG. 7 is started. First, photometry is performed based on the brightness of the image acquired by the imaging unit 101 (step S1). Next, the exposure reference values LV0 and LV1 stored in the ROM 107 are read (step S2 exposure reference value reading step). Thereafter, the exposure time and the like are calculated based on the result of photometry in step S1 and the exposure reference value read in step S2. This may be performed based on the average value of the brightness of the entire image, or may be performed based on the brightness of a part of the image such as the central portion of the image.

  Thereafter, exposure control is performed based on the calculated exposure time and the like, and imaging processing such as amplification of the obtained signal or digital conversion is performed (step S3, step S4, image acquisition process).

  Next, it is determined whether or not the image quality mode is the JPEG mode (step S5). If it is determined in step S5 that the image quality mode is JPEG mode, the white balance correction process, the synchronization process, the color conversion process, the gradation conversion process, and the JPEG compression process are performed (step S6 to step S6). S10).

  Thereafter, header information of the image file is created (step S11), and the created header information and the image data are merged to generate an image file (JPEG file) (step S12). The generated JPEG file is recorded on the recording medium 108 (step S13).

  On the other hand, if it is determined in step S5 that the image quality mode is not the JPEG mode, that is, the RAW mode, the process proceeds from step S5 to step S11. Then, an image file (RAW file) is generated in the same manner as the JPEG file, and the generated RAW file is recorded on the recording medium 108.

  After the recording of the image file is completed, the image file recorded on the recording medium 108 is output to the PC 200 (step S14 output step).

  FIG. 8 is a flowchart for explaining the control on the PC 200 side. That is, when an image file is input and this image file is opened by the user (step S21), header information and image data (step S22, step S23) are read out. Next, the gradation conversion table is selected based on the exposure reference values LV0 and LV1 recorded as the header information of the image file (step S24 gradation conversion table selection step).

  Next, it is determined from the header information of the image file whether the image quality mode of the image data is the JPEG mode (step S25). If it is determined in step S25 that the image quality mode is not the JPEG mode, that is, the RAW mode, white balance correction processing, synchronization processing, and color conversion processing are performed in the same manner as in the digital camera 100 side. (Step S26 to step S28), and further, gradation conversion processing is performed based on the gradation conversion table selected in step S24 (step S29 gradation conversion processing step). On the other hand, if it is determined in step S25 that the image quality mode is the JPEG mode, the JPEG data is decompressed (step S30).

  After the above processing, an image is displayed on a display (not shown) (step S31). Next, it is determined whether or not a user has instructed gradation change (step S32).

  If it is determined in step S32 that a tone change instruction has been issued, different processing is performed depending on whether the image quality mode is the RAW mode or the JPEG mode. When the image quality mode is the RAW mode, the gradation conversion table is corrected as described with reference to FIG. 5A (step S33 gradation conversion table correction step), and then the process proceeds to step S26 to perform image processing. I do. On the other hand, when the image quality mode is the JPEG mode, reverse gradation conversion processing is performed on the JPEG decompressed data (step S34), and image data that is substantially linear with the light amount of the subject before gradation conversion is generated. Then, after correcting the gradation conversion table (step S35), gradation conversion processing based on the corrected gradation conversion table is performed (step S36).

  As described above, in this embodiment, when it is determined that the image quality mode is the JPEG mode, the reverse gradation conversion process is performed before the gradation is changed. As a result, the gradation can be changed with image data that is closer to the original image data at the time of photographing, as compared with directly changing the gradation of the JPEG data. Note that white balance correction or the like may be performed after the reverse gradation conversion processing in step S34.

  If it is determined in step S32 that no tone change instruction has been issued, it is determined whether an exposure correction instruction has been issued, that is, whether an exposure correction value has been designated by the user (step S32). S37). If it is determined in step S37 that an exposure correction instruction has been issued and the image quality mode is the RAW mode, LV0 is corrected according to the above (Equation 1) (step S38), and accordingly. The gradation conversion table is corrected (step S39), and the process returns to step S26. On the other hand, if it is determined in step S37 that an exposure correction instruction has been given and the image quality mode is the JPEG mode, LV0 is corrected according to (Equation 1) above (step S40), and accordingly Then, the gradation conversion table is corrected (step S41), and the process returns to step S34.

  If it is determined in step S37 that no exposure correction instruction has been given, the process ends.

  As described above, according to the present embodiment, since the exposure reference values LV0 and LV1 are recorded as header information when a RAW file is acquired, it is not necessary to depend on the camera model or the design concept of the manufacturer. , Appropriate gradation conversion processing can be performed on the RAW data. Further, since there is little information to be recorded as header information, the transfer speed of the image file does not decrease.

  In the present embodiment, when it is determined that the image quality mode is the JPEG mode, the reverse gradation conversion processing of the image data is performed, so that the gradation of the JPEG data can be directly changed. In comparison, an appropriate gradation can be changed.

  Further, in the present embodiment, by recording the exposure reference value in the image file, exposure correction can be performed by correcting the gradation conversion table more easily and appropriately than manually.

  In the present embodiment, both LV0 and LV1 are recorded together with the image data as exposure reference values, but only one of the other may be recorded as a fixed value. For example, only LV0 that is a value (LV1 = 118 (8 bits)) that is a measurement standard of ISO sensitivity may be described as the exposure standard value. In this embodiment, the bit precision of LV0 and LV1 is 12 bits and 8 bits, respectively, but the present invention is not limited to this. For example, LV0 and LV1 may be expressed as a percentage of the saturation level.

  In this embodiment, the exposure reference values LV0 and LV1 are values read from the exposure reference value storage unit 2, but an exposure reference value correction unit 6 as shown in FIG. The exposure reference value read out from may be corrected. In the exposure reference value correction unit 6, the exposure reference value is corrected according to conditions such as the presence or absence of strobe light emission, which are determined based on the photometric result.

  Although the present invention has been described based on the above embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.

  Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, the problem described in the column of the problem to be solved by the invention can be solved, and the effect described in the column of the effect of the invention Can be extracted as an invention.

1 is a block diagram illustrating a configuration of an image processing system according to an embodiment of the present invention. It is a block diagram which shows the structure of the digital camera as an example of an imaging device. FIGS. 3A and 3B are diagrams illustrating a configuration of a PC as an example of an image processing apparatus, in which FIG. 3A is a block diagram of the PC, and FIG. 3B is a diagram illustrating a gradation conversion table. It is a figure shown about the example of a gradation conversion table. FIG. 5A is a diagram showing correction of the gradation conversion table by contrast correction, and FIG. 5B is a diagram showing the gradation characteristic curve of FIG. 6A is a diagram showing correction of the gradation conversion table by exposure correction, FIG. 6B is a diagram showing the gradation characteristic curve of FIG. 6A, and FIG. FIG. 7 is an enlarged view of the vicinity of the saturation region in FIG. It is a flowchart shown about the process by the side of a digital camera for demonstrating the image processing method which concerns on one Embodiment of this invention. It is a flowchart shown about the process by the side of an image processing apparatus for demonstrating the image processing method which concerns on one Embodiment of this invention. It is a block diagram shown about the modification of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 2 ... Exposure reference value memory | storage part, 3,101 ... Imaging part, 4,108 ... Recording medium, 5 ... Image file, 6 ... Exposure reference value correction part, 21 ... Image processing apparatus, 22 ... Tone Conversion table selection unit, 23 ... gradation conversion table correction unit, 24 ... gradation conversion / inverse gradation conversion processing unit, 25 ... gradation conversion table storage unit, 100 ... digital camera, 102 ... A / D conversion unit, 103 ... bus line, 104 ... RAM, 105 ... microcomputer, 106,206 ... image processing unit, 106a ... white balance (WB) correction unit, 106b ... synchronization unit, 106c ... color conversion unit, 106d ... tone conversion unit, 106e ... JPEG compression unit, 107 ... ROM, 200 ... PC, 201 ... file interface (I / F), 202 ... gradation conversion table selection unit, 203 ... gradation conversion table storage , 204 ... gradation conversion table correction section, 205 ... User interface (I / F), 206 ... image processing unit

Claims (19)

Image acquisition means for capturing an image of a subject based on an exposure reference value serving as a reference for exposure at the time of imaging, and obtaining image data before at least gradation conversion processing is performed;
Image output means for outputting the image data obtained by the image acquisition means together with the exposure reference value;
An imaging apparatus comprising: Exposure reference value storage means for storing the exposure reference value;
The imaging apparatus according to claim 1, wherein the image acquisition unit performs the imaging by reading the exposure reference value from the exposure reference value storage unit. Exposure reference value storage means for storing the exposure reference value;
Exposure reference value correction means for correcting the exposure reference value read from the exposure reference value storage means;
Further comprising
The imaging apparatus according to claim 1, wherein the image acquisition unit performs the imaging after the exposure reference value read from the exposure reference value storage unit is corrected by the exposure reference value correction unit.   2. The imaging apparatus according to claim 1, further comprising storage means for storing the image data and the exposure reference value corresponding to the image data as one image file.   The imaging apparatus according to claim 2, wherein the storage unit includes a recording medium that is detachable from the imaging apparatus.   The exposure reference value includes at least one of an exposure control target value that is a target of exposure control at the time of imaging and a value obtained when gradation conversion processing is performed on the exposure control target value. The imaging device according to any one of claims 1 to 4.   The imaging apparatus according to claim 1, wherein the exposure reference value is a value corresponding to a reference pixel value for measuring sensitivity. Image input means for inputting image data before being subjected to at least gradation conversion processing;
An exposure reference value input means for inputting an exposure reference value serving as a reference for exposure when the image data is captured;
Gradation conversion table storage means for storing a gradation conversion table corresponding to a plurality of exposure reference values;
Gradation conversion table selection means for selecting a gradation conversion table corresponding to the exposure reference value input by the exposure reference value input means from a plurality of gradation tables stored in the gradation conversion table storage means; ,
Gradation conversion processing means for performing gradation conversion processing on the image data input by the image input means based on the gradation conversion table selected by the gradation conversion table selection means;
An image processing apparatus comprising: Instruction means for instructing the gradation characteristics of the image;
A gradation conversion table correcting means for correcting the gradation conversion table selected by the gradation conversion table selecting means in accordance with the gradation characteristics of the image instructed by the instruction means;
The image processing apparatus according to claim 8, further comprising:   The image processing apparatus according to claim 9, wherein the gradation characteristic of the image instructed by the instruction unit includes at least a contrast of the image.   11. The gradation conversion table correcting means corrects the gradation conversion table so that the exposure reference value is not changed when the contrast of the image is instructed by the instruction means. The image processing apparatus described. An image acquisition unit that captures an image of a subject based on an exposure reference value that is a reference for exposure at the time of imaging, and obtains at least image data before gradation conversion processing, and the image data obtained by the image acquisition unit An image output means for outputting together with the exposure reference value,
The input means for inputting the image data and the exposure reference value output by the image output means, the gradation conversion table storage means for storing the gradation conversion table corresponding to a plurality of exposure reference values, and the input means Gradation conversion table selection means for selecting a gradation conversion table corresponding to the input exposure reference value from a plurality of gradation tables stored in the gradation conversion table storage means; and the gradation conversion table selection. An image processing apparatus comprising: gradation conversion processing means for performing gradation conversion processing on the image data input by the input means based on the gradation conversion table selected by the means;
An image processing system comprising: The imaging apparatus further includes exposure reference value storage means for storing the exposure reference value,
13. The image processing system according to claim 12, wherein the image acquisition unit performs the imaging by reading the exposure reference value from the exposure reference value storage unit. The imaging apparatus is
Exposure reference value storage means for storing the exposure reference value;
Exposure reference value correction means for correcting the exposure reference value read from the exposure reference value storage means;
Further comprising
13. The image processing system according to claim 12, wherein the image acquisition unit performs the imaging after the exposure reference value read from the exposure reference value storage unit is corrected by the exposure reference value correction unit. The image processing apparatus includes:
Instruction means for instructing the gradation characteristics of the image;
A gradation conversion table correcting means for correcting the gradation conversion table selected by the gradation conversion table selecting means in accordance with the gradation characteristics of the image instructed by the instruction means;
The image processing system according to claim 12, further comprising: An image acquisition step of capturing an image of a subject based on an exposure reference value that serves as a reference for exposure at the time of imaging, and obtaining image data before at least gradation conversion processing is performed;
An output step of outputting the image data obtained in the image acquisition step and the exposure reference value;
A gradation conversion table selection step of selecting a gradation conversion table corresponding to the exposure reference value output in the output step from a plurality of gradation conversion tables;
A gradation conversion processing step for performing gradation conversion processing on the image data output in the output step based on the gradation conversion table selected in the gradation conversion table selection step;
An image processing method comprising:   The image processing method according to claim 16, further comprising an exposure reference value reading step of reading the exposure reference value from a storage unit prior to the image acquisition step. Prior to the image acquisition step, an exposure reference value reading step of reading the exposure reference value from the storage unit,
An exposure reference value correcting step of correcting the exposure reference value read in the exposure reference value reading step;
The image processing method according to claim 16, further comprising: An instruction process for instructing the gradation characteristics of the image;
A gradation conversion table correction step of correcting the gradation conversion table selected in the gradation conversion table selection step according to the gradation characteristics of the image instructed by the instruction step;
The image processing method according to claim 16, further comprising:

Images