JP2006203565A - Apparatus and method for processing image, and image recording apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain an image with optimum image quality in response to purpose concerning the processing of image data which is photographed with a digital camera, etc. <P>SOLUTION: An input 101 acquires scene reference raw data where image pickup apparatus characteristic correcting data (reproduction auxiliary data) and picked-up information data are attached. A scene reference image data generator 104 performs processing to correct the apparatus characteristic peculiar to the image pickup apparatus in the scene reference raw data, based on the image pickup apparatus characteristic correcting data, so as to generate scene reference image data. A header information editor 106 performs the editing of a part or the whole of elements constituting the image pickup apparatus characteristic correcting data in response to the purpose of a viewed image, so as to generate edited reproduction auxiliary data. Then the edited reproduction auxiliary data and the picked-up information data are attached to the scene reference image data, and the scene reference image data are recorded in a recording medium. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus, an image recording apparatus, and an image processing method for performing image processing on digital image data obtained by an imaging apparatus such as a digital camera to form an appreciation image on an output medium.

  In recent years, digital image data photographed by an imaging device such as a digital camera is displayed on a display device such as a CRT (Cathode Ray Tube), a liquid crystal display, a plasma display, or a small liquid crystal monitor of a mobile phone, or a digital printer, an inkjet There are a variety of display / printing methods such as printing as a hard copy image from an output device such as a printer or a thermal printer.

  When displaying and outputting digital image data for viewing purposes, gradation adjustment, brightness adjustment, color balance adjustment, sharpness enhancement are performed so that the desired image quality can be obtained on a display monitor or hard copy used for viewing. In general, various image processes represented by the above are performed.

For example, a technique for generating versatile image data by recording reproduction reference data for standardizing scene reference raw data attached to scene reference raw data depending on imaging device characteristics is disclosed. (See Patent Document 1).
JP 2004-96500 A

  However, in recent years, the same photographed image is often used for a plurality of purposes, and it is desired that the image quality is optimal for each purpose because of the user's desire for higher image quality. With the increase in image quality, the size of image files has increased, and recording and storing image files for each application has been a heavy burden from the standpoint of file management and environmental maintenance.

  The present invention has been made in view of the above problems in the prior art, and an object of the present invention is to provide an image processing apparatus, an image recording apparatus, and an image processing method capable of obtaining an optimal image according to the application. .

  In order to solve the above-mentioned problem, the invention described in claim 1 is an image processing apparatus, wherein the scene reference raw data depending on the imaging device characteristics of the imaging device and the reproduction auxiliary data attached to the scene reference raw data are provided. And a scene reference image data generation means for generating scene reference image data by applying a process for correcting device characteristics specific to the imaging device to the scene reference raw data based on the reproduction auxiliary data. Reproduction that generates edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the use of the viewing image formed on the output medium using the scene reference image data Auxiliary data editing means, and a recording means for recording the edited reproduction auxiliary data attached to the scene reference image data. That.

  Here, “generation” in the description of the present specification means that a program and a processing circuit that operate in the image processing apparatus and the image recording apparatus according to the present invention newly generate an image signal and data. “Create” may be used as a synonym.

  The “imaging device” is a device including an imaging element (image sensor) having a photoelectric conversion function, and includes a so-called digital camera and scanner. As an example of the image pickup device, there is a CCD type image pickup device provided with a color sensitivity by combining a CCD (Charge Coupled Device), a charge transfer mechanism, and a checkered color filter, or a CMOS type image pickup device. Can be mentioned. The output currents of these image sensors are digitized by an A / D converter. The contents of each color channel at this stage are signal intensities based on the spectral sensitivity unique to the image sensor.

  The “scene reference raw data depending on the imaging device characteristics” is a raw output signal directly recorded on the imaging device in which information faithful to the subject is recorded, and the data itself digitized by the A / D converter, It means data obtained by performing noise correction such as fixed pattern noise and dark current noise on the data, and includes RAW data. This scene reference raw data is generated by image processing that modifies the contents of the data to improve the effects during image viewing such as gradation conversion, sharpness enhancement, and saturation enhancement, and each color channel based on the spectral sensitivity inherent to the image sensor. Signal strength of RMM RGB (Reference Input Medium Metric RGB), ERIMM RGB (Extended Reference Input Medium Metric RGB) (see Journal of Imaging Science and Technology 45, pp. 418-426 (2001)), sRGB, etc. It is characterized in that the process of mapping to the color space is omitted. The information amount (for example, the number of gradations) of the scene reference raw data is preferably equal to or greater than the information amount (for example, the number of gradations) required for the viewing image reference data in accordance with the performance of the A / D converter. . For example, when the number of gradations of the viewing image reference data is 8 bits per channel, the number of gradations of the scene reference raw data is preferably 12 bits or more, more preferably 14 bits or more, and even more preferably 16 bits or more.

  The “scene reference image data” means that the signal intensity of each color channel based on at least the spectral sensitivity of the image sensor itself has been mapped to a standard color space such as RIM RGB, ERIMM RGB, etc., and gradation conversion / sharpness enhancement / It means image data in a state in which image processing for modifying data contents in order to improve the effect at the time of image viewing such as saturation enhancement is omitted. The scene reference image data is a correction of the photoelectric conversion characteristics of the imaging device (opto-electronic conversion function defined by ISO1452; for example, “Fine Imaging and Digital Photography” (see page 449 of the Japan Photographic Society Publishing Committee)) It is preferable to have performed. The information amount (for example, the number of gradations) of the scene reference image data is preferably equal to or greater than the information amount (for example, the number of gradations) required for the viewing image reference data in accordance with the performance of the A / D converter. . For example, when the number of gradations of the viewing image reference data is 8 bits per channel, the number of gradations of the scene reference image data is preferably 12 bits or more, more preferably 14 bits or more, and even more preferably 16 bits or more.

  Further, “processing for correcting device characteristics unique to the imaging device” means processing for converting the “scene reference raw data” into “scene reference image data”. The content of this process depends on the state of the scene reference raw data, but includes a process of mapping the signal intensity of each color channel based on at least the spectral sensitivity unique to the image sensor to a standard color space such as RIM RGB or ERIMM RGB. For example, when the scene reference raw data is not subjected to interpolation processing based on the color filter array, it is necessary to perform the processing (for details of the interpolation processing based on the color filter array, see, for example, “Fine (Imaging and digital photography ", page 51 of the publishing committee of the Japan Photographic Society). As a result, it is possible to obtain scene reference image data having the same amount of information as the scene reference raw data, but in which the difference in signal value between different imaging devices is corrected.

  “Reproduction assistance data” refers to data that is referred to when performing image processing for forming an optimal viewing image on an output medium. In the present invention, each item of reproduction assistance data is called an element. The “reproduction assistance data” is preferably recorded as tag information in the header portion of the image file, for example, in accordance with an image format Digital Negative (DNG) recommended by Adobe Systems.

  When the image data to which the “reproduction assistance data” is attached is scene reference raw data, the “reproduction assistance data” includes correction information used when performing processing for correcting the device characteristics unique to the imaging device. Is preferred. In this case, the “reproduction auxiliary data” includes information that enables the signal intensity of each color channel based on the spectral sensitivity of the image sensor itself to be mapped to a standard color space such as RIM RGB or ERIMM RGB, that is, the image sensor specific A matrix coefficient to be used when converting to a specific standard color space such as spectral sensitivity characteristics or RIMM RGB is described. For example, when only the model name of the imaging device is described, there is a possibility that the image processing device or image recording device that performs this processing may not have a correspondence table between the model name and the matrix coefficient. It's not data. Also, for example, even if sufficient information is not directly described when performing this processing, if the URL indicating the location of the information on the Internet is described, sufficient information is sufficient to perform this processing. It can be regarded as data.

  The “reproduction auxiliary data” preferably includes contents according to the application of the appreciation image formed on the output medium, and preferably has a plurality of pieces of information for some or all of the elements constituting the reproduction auxiliary data. By editing the reproduction assistance data, it is preferable that each data set is given meaning of use / purpose. Furthermore, it is preferable that the plurality of pieces of information correspond to a plurality of uses. The use is preferably at least 2 or more, and may be 3 or more as required. For example, in the DNG format, two sets of tags can be attached. When a use cannot be envisaged, there is only one use, and information according to the use that is most frequently used, or information that can be used for multiple uses on average even if it is not optimal for each use It may be (edited). In addition, if the information does not change according to the use, information may be described only in a part corresponding to one use among a plurality of uses, and the information may be referred to commonly in any use. May be described respectively.

  “Reproduction auxiliary data” includes, for example, the type of output medium and output device (inkjet / silver salt / sublimation / CRT / liquid crystal display / plasma display), output size (large / medium / small), observation distance (far / near) Observation viewing angle (2 ° / 10 °), observation light source (D65 / D50), image reproduction color gamut (sRGB / ERIMM / Adobe RGB), can be used for public authentication without intentional image processing Whether the image is a manufacturer-guaranteed image or an ornamental image subjected to noise removal processing / edge enhancement processing is included.

  The “output medium” is, for example, a display device such as a CRT, a liquid crystal display, or a plasma display, or a paper for generating a hard copy image such as a silver salt photographic paper, an inkjet paper, or a thermal printer paper.

  According to a second aspect of the present invention, in the image processing apparatus according to the first aspect of the present invention, an appreciation image reference for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data A data generation means is provided.

  Here, “appreciation image reference data” means appreciation image formation on an output medium such as a display device such as a CRT, a liquid crystal display, or a plasma display, or an output device such as a silver salt photographic paper, an ink jet paper, or a thermal printer paper. This means digital image data used for.

  “Image processing to form an optimal viewing image” is optimal on display devices such as CRTs, liquid crystal displays, and plasma displays, and on output media such as silver halide photographic paper, inkjet paper, and thermal printer paper. This is a process for obtaining a clear image. For example, when it is assumed that the image is displayed on a CRT display monitor compliant with the sRGB standard, processing is performed so as to obtain an optimum color reproduction within the color gamut of the sRGB standard. If output to silver salt photographic paper is assumed, processing is performed so that optimum color reproduction is obtained within the color gamut of silver salt photographic paper. In addition to color gamut compression, gradation compression from 16 bits to 8 bits, reduction of the number of output pixels, and processing for handling output characteristics (LUT) of the output device are also included. Furthermore, it goes without saying that image processing such as noise suppression, sharpening, gray balance adjustment processing, saturation adjustment, or dodging processing is performed.

  The invention according to claim 3 is an image processing device, wherein the image acquisition device acquires the scene reference raw data depending on the imaging device characteristics of the imaging device, and the reproduction auxiliary data attached to the scene reference raw data, Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the application of the appreciation image formed on the output medium using the scene reference raw data Data editing means and recording means for recording the edited reproduction auxiliary data attached to the scene reference raw data are provided.

  According to a fourth aspect of the present invention, in the image processing apparatus according to the third aspect of the present invention, the image reference device that generates the image reference data for image processing by performing image processing for forming an optimal image for the scene reference raw data. A data generation means is provided.

  According to a fifth aspect of the present invention, in the image processing apparatus according to any one of the first to fourth aspects, the reproduction auxiliary data editing unit is configured to perform the reproduction auxiliary data according to a plurality of uses of the appreciation image. A plurality of pieces of information are generated with respect to some or all of the elements constituting the.

  According to a sixth aspect of the present invention, in the image processing apparatus, an apparatus specific to the imaging apparatus based on reproduction auxiliary data attached to the scene reference raw data with respect to the scene reference raw data depending on the imaging apparatus characteristics of the imaging apparatus. Data for acquiring scene reference image data that has been subjected to processing for correcting characteristics, and edited reproduction auxiliary data that has been edited according to the use of an appreciation image formed on an output medium using the scene reference image data And an appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data based on the edited reproduction auxiliary data. It is characterized by having.

  The invention according to claim 7 is used in an image processing apparatus for scene reference raw data depending on imaging device characteristics of an imaging device, and for an appreciation image formed on an output medium using the scene reference raw data. A data acquisition means for acquiring edited reproduction auxiliary data edited in accordance with the image, and an image to be subjected to image processing for forming an optimal viewing image for the scene reference raw data based on the edited reproduction auxiliary data Appreciation image reference data generation means for generating reference data is provided.

  According to an eighth aspect of the present invention, in the image processing device according to the seventh aspect, the appreciation image reference data generation means is specific to the scene reference raw data based on the edited reproduction auxiliary data. A scene reference image data is generated by performing a process for correcting the device characteristics, and an image process for forming the optimum viewing image is performed on the generated scene reference image data based on the edited reproduction auxiliary data. The appreciation image reference data is generated.

  According to a ninth aspect of the present invention, in the image processing device according to any one of the sixth to eighth aspects, a part of the elements constituting the edited reproduction auxiliary data or the part of the edited reproduction auxiliary data according to the use of the appreciation image All are provided with selection means for selecting data to be used when performing image processing for forming the optimum viewing image.

  In the image processing apparatus, the scene reference raw data depending on the imaging device characteristics of the imaging apparatus, the reproduction auxiliary data attached to the scene reference raw data, and the shooting condition setting at the time of shooting are provided. Data acquisition means for acquiring certain shooting information data, and scene reference image for generating scene reference image data by performing processing for correcting device characteristics specific to the imaging device on the scene reference raw data based on the reproduction auxiliary data Edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the use of the data generation means and the viewing image formed on the output medium using the scene reference image data Reproduction auxiliary data editing means for generating the edited reproduction auxiliary data and shooting information data attached to the scene reference image data and recorded A recording unit that, and further comprising a.

  Here, the “shooting information data” is a record of shooting condition settings at the time of shooting, and may include the same tag information written in the header portion of the Exif file. Specifically, exposure time, shutter speed, aperture value (F number), ISO sensitivity, brightness value, subject distance range, light source, strobe emission, subject area, white balance, zoom magnification, subject composition, shooting scene type, A tag (code) or the like indicating information on the amount of reflected light of the strobe light source, shooting saturation, type of subject, and the like.

  “Photographing information data” is a value obtained at the time of photographing by a sensor provided in the camera, data processed from the value of the sensor, or a value of the sensor in order to automate the exposure setting and focus function of the imaging device. It is classified into the camera shooting conditions set on the basis of this, but in addition to this, a shooting mode dial (for example, portrait, sports, macro shooting mode, etc.), a strobe forced flash setting switch, etc. Also included is information manually set by the photographer.

  According to an eleventh aspect of the present invention, in the image processing device according to the tenth aspect, an appreciation image reference for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data. A data generation means is provided.

  According to the invention of claim 12, in the image processing device, the scene reference raw data depending on the imaging device characteristics of the imaging device, the reproduction auxiliary data attached to the scene reference raw data, and the shooting condition setting at the time of shooting Data acquisition means for acquiring certain shooting information data, and editing part or all of the elements constituting the reproduction assistance data depending on the use of the viewing image formed on the output medium using the scene reference raw data And reproduction auxiliary data editing means for generating edited reproduction auxiliary data, and recording means for recording the edited reproduction auxiliary data and shooting information data attached to the scene reference raw data. And

  According to a thirteenth aspect of the present invention, in the image processing device according to the twelfth aspect of the present invention, an appreciation image reference data is generated by performing image processing for forming an optimal appreciation image for the scene reference raw data. A data generation means is provided.

  According to a fourteenth aspect of the present invention, in the image processing apparatus according to any one of the tenth to thirteenth aspects, the reproduction auxiliary data editing unit is configured to perform the reproduction auxiliary data according to a plurality of uses of the appreciation image. A plurality of pieces of information are generated with respect to some or all of the elements constituting the.

  The invention according to claim 15 is an image processing apparatus, which is unique to the imaging apparatus based on reproduction auxiliary data attached to the scene reference raw data for scene reference raw data depending on the imaging apparatus characteristics of the imaging apparatus. Scene reference image data that has been subjected to processing for correcting characteristics, edited reproduction auxiliary data that is edited according to the purpose of an appreciation image formed on the output medium using the scene reference image data, and Data acquisition means for acquiring shooting information data as shooting condition settings, and image processing for forming an optimal viewing image for the scene reference image data based on the edited reproduction auxiliary data and shooting information data Appreciation image reference data generating means for generating appreciation image reference data is provided.

  According to the sixteenth aspect of the present invention, in the image processing device, depending on the use of the scene reference raw data depending on the imaging device characteristics of the imaging device and the appreciation image formed on the output medium using the scene reference raw data. Based on the edited reproduction auxiliary data and the shooting information data which is the shooting condition setting at the time of shooting, and the edited reproduction auxiliary data and shooting information data, the scene reference raw data is converted into the scene reference raw data. Appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image is provided.

  According to a seventeenth aspect of the present invention, in the image processing device according to the sixteenth aspect, the appreciation image reference data generation means is specific to the scene reference raw data based on the edited reproduction auxiliary data. A process for correcting device characteristics is performed to generate scene reference image data, and the optimal viewing image is formed on the generated scene reference image data based on the edited reproduction auxiliary data and shooting information data The viewing image reference data is generated by performing image processing.

  According to an eighteenth aspect of the present invention, in the image processing apparatus according to any one of the fifteenth to seventeenth aspects, a part of elements constituting the edited reproduction auxiliary data or a part of the edited reproduction auxiliary data according to the use of the appreciation image All are provided with selection means for selecting data to be used when performing image processing for forming the optimum viewing image.

  According to a nineteenth aspect of the present invention, in an image recording apparatus, the image processing apparatus according to any one of the first to eighteenth aspects and an image forming unit that forms an appreciation image on an output medium are provided. It is characterized by.

  The invention according to claim 20 is a data acquisition step for acquiring scene reference raw data dependent on an imaging device characteristic of an imaging device and reproduction auxiliary data attached to the scene reference raw data in the image processing method, Using the scene reference image data, a scene reference image data generation step for generating scene reference image data by performing processing for correcting device characteristics specific to the imaging device on the scene reference raw data based on the reproduction auxiliary data The reproduction auxiliary data editing step for editing part or all of the elements constituting the reproduction auxiliary data and generating edited reproduction auxiliary data according to the use of the viewing image formed on the output medium, and the editing And a recording step of recording the auxiliary reproduction auxiliary data attached to the scene reference image data.

  According to a twenty-first aspect of the present invention, in the image processing method according to the twentieth aspect, the image reference method for generating the image reference data to be subjected to image processing for forming an optimum image to be applied to the scene reference image data. It includes a data generation step.

  According to a twenty-second aspect of the present invention, in the image processing method, a data acquisition step of acquiring scene reference raw data dependent on an imaging device characteristic of the imaging device, and reproduction auxiliary data attached to the scene reference raw data; Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the application of the appreciation image formed on the output medium using the scene reference raw data A data editing step; and a recording step of recording the edited reproduction auxiliary data attached to the scene reference raw data.

  According to a twenty-third aspect of the present invention, in the image processing method according to the twenty-second aspect, the viewing image reference data is generated by performing image processing for forming an optimal viewing image on the scene reference raw data. It includes a data generation step.

  According to a twenty-fourth aspect of the present invention, in the image processing method according to any one of the twenty-second to twenty-third aspects, in the reproduction auxiliary data editing step, the reproduction auxiliary data according to a plurality of uses of the appreciation image. A plurality of pieces of information are generated with respect to some or all of the elements constituting the.

  The invention according to claim 25 is an image processing method, wherein the image reference device is a device specific to the image pickup device based on the reproduction auxiliary data attached to the scene reference raw data for the scene reference raw data depending on the image pickup device characteristics of the image pickup device. Data for acquiring scene reference image data that has been subjected to processing for correcting characteristics, and edited reproduction auxiliary data that has been edited according to the use of an appreciation image formed on an output medium using the scene reference image data And an appreciation image reference data generation step of generating appreciation image reference data by performing image processing for forming an optimal appreciation image on the scene reference image data based on the edited reproduction auxiliary data. It is characterized by including.

  According to a twenty-sixth aspect of the present invention, in the image processing method, the scene reference raw data depending on the imaging device characteristics of the imaging device, and the application of the appreciation image formed on the output medium using the scene reference raw data. A data acquisition process for acquiring edited reproduction auxiliary data edited in accordance with the image, and an image to be subjected to image processing for forming an optimal viewing image for the scene reference raw data based on the edited reproduction auxiliary data An appreciation image reference data generation step for generating reference data.

  According to a twenty-seventh aspect of the present invention, in the image processing method according to the twenty-sixth aspect, in the appreciation image reference data generation step, the scene reference raw data is included in the scene reference raw data based on the edited reproduction auxiliary data. A scene reference image data is generated by performing a process for correcting the device characteristics, and an image process for forming the optimum viewing image is performed on the generated scene reference image data based on the edited reproduction auxiliary data. The appreciation image reference data is generated.

  According to a twenty-eighth aspect of the present invention, in the image processing method according to any one of the twenty-fifth to twenty-seventh aspects, a part of elements constituting the edited reproduction auxiliary data or a part of the edited reproduction auxiliary data according to the use of the appreciation image A selection step of selecting data to be used when performing image processing for forming the optimum viewing image for all is included.

  The invention according to claim 29 is the image processing method, wherein the scene reference raw data depends on the imaging device characteristics of the imaging device, the reproduction auxiliary data attached to the scene reference raw data, and the shooting condition setting at the time of shooting. A scene reference image for generating scene reference image data by performing a process for correcting device characteristics specific to the imaging apparatus on the scene reference raw data based on the data acquisition step for acquiring certain shooting information data and the reproduction auxiliary data Depending on the data generation step and the application of the viewing image formed on the output medium using the scene reference image data, some or all of the elements constituting the reproduction auxiliary data are edited, and the edited reproduction auxiliary data A reproduction auxiliary data editing step for generating the edited reproduction auxiliary data and shooting information data attached to the scene reference image data and recorded A recording step that, characterized in that it comprises a.

  According to a thirty-third aspect of the present invention, in the image processing method according to the twenty-ninth aspect, an appreciation image reference data is generated by performing image processing for forming an optimal appreciation image on the scene reference image data. It includes a data generation step.

  The invention according to claim 31 is an image processing method comprising: scene reference raw data depending on imaging device characteristics of an imaging device; reproduction auxiliary data attached to the scene reference raw data; and shooting condition setting at the time of shooting. Depending on the data acquisition process for acquiring certain shooting information data and the use of the viewing image formed on the output medium using the scene reference raw data, some or all of the elements constituting the reproduction assistance data are edited. A reproduction auxiliary data editing step for generating edited reproduction auxiliary data, and a recording step for recording the edited reproduction auxiliary data and shooting information data attached to the scene reference raw data. To do.

  According to a thirty-second aspect of the present invention, in the image processing method according to the thirty-first aspect, an appreciation image reference for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference raw data. It includes a data generation step.

  According to a thirty-third aspect of the present invention, in the image processing method according to any one of the twenty-ninth to thirty-second aspects, in the reproduction auxiliary data editing step, the reproduction auxiliary data according to a plurality of uses of the appreciation image. A plurality of pieces of information are generated with respect to some or all of the elements constituting the.

  According to a thirty-fourth aspect of the present invention, in the image processing method, for the scene reference raw data depending on the imaging device characteristics of the imaging device, the device unique to the imaging device based on the auxiliary reproduction data attached to the scene reference raw data Scene reference image data that has been subjected to processing for correcting characteristics, edited reproduction auxiliary data that is edited according to the purpose of an appreciation image formed on the output medium using the scene reference image data, and Based on the data acquisition step of acquiring shooting information data as shooting condition settings, and the edited reproduction auxiliary data and shooting information data, image processing for forming an optimal viewing image for the scene reference image data is performed. An appreciation image reference data generating step for generating appreciation image reference data.

  According to a thirty-fifth aspect of the present invention, in the image processing method, the scene reference raw data depending on the imaging device characteristics of the imaging device, and the application of the appreciation image formed on the output medium using the scene reference raw data. Based on the edited reproduction auxiliary data and the shooting information data which is the shooting condition setting at the time of shooting, and the edited reproduction auxiliary data and shooting information data, the scene reference raw data is converted into the scene reference raw data. And an appreciation image reference data generation step of generating appreciation image reference data by performing image processing for forming an optimal appreciation image.

  According to a thirty-sixth aspect of the present invention, in the image processing method according to the thirty-fifth aspect, in the appreciation image reference data generation step, the scene reference raw data is added to the scene reference raw data based on the edited reproduction auxiliary data. A process for correcting device characteristics is performed to generate scene reference image data, and the optimal viewing image is formed on the generated scene reference image data based on the edited reproduction auxiliary data and shooting information data The viewing image reference data is generated by performing image processing.

  A 37th aspect of the present invention is the image processing method according to any one of the 34th to 36th aspects, wherein a part of elements constituting the edited reproduction auxiliary data or a part of the edited reproduction auxiliary data is used according to the use of the appreciation image. A selection step of selecting data to be used when performing image processing for forming the optimum viewing image for all is included.

  According to the first and second aspects of the invention, some or all of the elements constituting the auxiliary reproduction data are edited according to the use of the appreciation image formed on the output medium, and the edited reproduction auxiliary data is obtained. Since it is attached to the scene reference image data and recorded, it is possible to retain the scene reference image data having the basic characteristics, and attach information used for forming the viewing image later as edited reproduction auxiliary data. it can. Therefore, it is possible to provide information for obtaining an optimal image according to the application to an external device without causing information loss of the captured image information.

  According to the second and 21st aspects of the present invention, the viewing image reference data is generated by performing image processing for forming an optimal viewing image for the scene reference image data, so that a high-quality viewing image is provided. Can do.

  According to the invention described in claims 3 and 22, a part or all of the elements constituting the reproduction auxiliary data are edited in accordance with the use of the appreciation image formed on the output medium, and the edited reproduction auxiliary data is obtained. Since the scene reference raw data is recorded and recorded, information used when an appreciation image is formed later can be attached as edited reproduction auxiliary data while retaining the scene reference raw data. Therefore, it is possible to provide information for obtaining an optimal image according to the application to an external device without causing information loss of the captured image information. Further, there is an advantage that the size capacity is small as compared with the case where the edited reproduction auxiliary data is attached to the scene reference image data and recorded.

  According to the invention described in claims 4 and 23, the image processing for forming the optimum viewing image for the scene reference raw data is performed to generate the viewing image reference data, so that a high quality viewing image is provided. Can do.

  According to the fifth and 24th aspects of the present invention, a plurality of pieces of information are generated for some or all of the elements constituting the reproduction assistance data in accordance with a plurality of uses of the appreciation image. A plurality of applications can be supported.

  According to the invention described in claims 6 and 25, the scene reference image data and the edited reproduction auxiliary data are obtained, and an optimum viewing image is formed for the scene reference image data based on the edited reproduction auxiliary data. Appreciation image reference data is generated by performing image processing, so that an optimal appreciation image can be provided according to the application.

  According to the invention described in claims 7 and 26, the scene reference raw data and the edited reproduction auxiliary data are obtained, and an optimum viewing image is formed on the scene reference raw data based on the edited reproduction auxiliary data. Appreciation image reference data is generated by performing image processing, so that an optimal appreciation image can be provided according to the application. Since the image information is recorded as the scene reference raw data, the same effects as in claims 6 and 25 can be obtained even though the file capacity is suppressed.

  According to the invention described in claims 8 and 27, based on the edited reproduction auxiliary data, the scene reference raw data is subjected to the process of correcting the device characteristics specific to the imaging device, and the scene reference image data is generated and edited. Based on the reproduction assistance data, it is possible to generate appreciation image reference data by performing image processing for forming an optimal appreciation image for the generated scene reference image data.

  According to the ninth and 28th aspects of the present invention, image processing for forming an optimal appreciation image is performed on some or all of the elements constituting the edited reproduction auxiliary data according to the use of the appreciation image. Since data to be used at the time is selected, an optimal viewing image can be provided according to the application.

  According to the inventions of claims 10 and 29, some or all of the elements constituting the reproduction auxiliary data are edited according to the use of the appreciation image formed on the output medium, and the edited reproduction auxiliary data and Since shooting information data is recorded attached to scene reference image data, edited reproduction auxiliary data and shooting information to be used later when an appreciation image is formed while retaining scene reference image data having basic characteristics. Data can be attached. Therefore, it is possible to provide information for obtaining an optimal image according to the application to an external device without causing information loss of the captured image information.

  According to the invention described in claims 11 and 30, the image processing for forming the optimum viewing image for the scene reference image data is performed to generate the viewing image reference data, so that a high quality viewing image is provided. Can do.

  According to the invention described in claims 12 and 31, some or all of the elements constituting the reproduction auxiliary data are edited according to the use of the appreciation image formed on the output medium, and the edited reproduction auxiliary data and Since the shooting information data is recorded attached to the scene reference raw data, the edited reproduction auxiliary data and shooting information data to be used later when an appreciation image is formed can be attached while retaining the scene reference raw data. . Therefore, it is possible to provide information for obtaining an optimal image according to the application to an external device without causing information loss of the captured image information. Further, there is an advantage that the size capacity is small as compared with the case where the edited reproduction auxiliary data and the photographing information data are attached to the scene reference image data and recorded.

  According to the inventions of claims 13 and 32, the image processing for forming the optimum viewing image for the scene reference raw data is performed to generate the viewing image reference data, so that a high quality viewing image is provided. Can do.

  According to the invention described in claims 14 and 33, a plurality of pieces of information are generated for some or all of the elements constituting the reproduction assistance data in accordance with a plurality of uses of the appreciation image. A plurality of applications can be supported.

  According to the invention described in claims 15 and 34, the scene reference image data, the edited reproduction auxiliary data, and the shooting information data are obtained, and based on the edited reproduction auxiliary data and the shooting information data, the scene reference image data is optimal. Appreciation image reference data is generated by performing image processing for forming an appropriate appreciation image, so that an optimum appreciation image can be provided according to the application.

  According to the sixteenth and thirty-fifth aspects of the present invention, scene reference raw data, edited reproduction auxiliary data, and shooting information data are obtained, and are optimal for scene reference raw data based on the edited reproduction auxiliary data and shooting information data. Appreciation image reference data is generated by performing image processing for forming an appropriate appreciation image, so that an optimum appreciation image can be provided according to the application. Since the image information is recorded as the scene reference raw data, the same effects as in claims 15 and 34 can be obtained even though the file capacity is suppressed.

  According to the invention described in claims 17 and 36, based on the edited reproduction auxiliary data, the scene reference raw data is subjected to the process of correcting the device characteristics specific to the imaging device, and the scene reference image data is generated and edited. Based on the reproduction assistance data and the shooting information data, it is possible to generate the viewing image reference data by performing image processing for forming an optimal viewing image on the generated scene reference image data.

  According to the invention described in claims 18 and 37, image processing for forming an optimal appreciation image is applied to some or all of the elements constituting the edited reproduction auxiliary data according to the use of the appreciation image. Since data to be used at the time is selected, an optimal viewing image can be provided according to the application.

  According to the nineteenth aspect of the present invention, the edited reproduction auxiliary data is recorded by being attached to the scene reference image data or the scene reference raw data, or the scene reference image data or scene to which the edited reproduction auxiliary data is attached. By using the reference raw data, it is possible to obtain an optimal image according to the application without accompanying information loss of captured image information.

[First Embodiment]
A first embodiment of the present invention will be described with reference to FIGS.

<Configuration of Imaging Device 21>
First, the imaging device 21 that generates scene reference raw data used in the image processing device according to the first embodiment will be described.

First, the configuration of the imaging device 21 will be described.
FIG. 1 is a block diagram illustrating a functional configuration of the imaging device 21. As shown in FIG. 1, the imaging device 21 includes a lens 1, an aperture 2, a CCD 3, an analog processing circuit 4, an A / D converter 5, a temporary storage memory 6, an image processing unit 7, a header information processing unit 8, and a storage device. 9, CCD drive circuit 10, control unit 11, device characteristic correction information processing unit 13, operation unit 14, display unit 15, strobe drive circuit 16, strobe 17, focal length adjustment circuit 18, automatic focus drive circuit 19, motor 20, etc. It is configured with.

The optical system of the imaging device 21 includes a lens 1, a diaphragm 2, and a CCD (solid-state imaging device) 3.
The lens 1 adjusts the focus and forms an optical image of the subject. The diaphragm 2 adjusts the amount of light beam that has passed through the lens 1. The CCD 3 photoelectrically converts subject light imaged on the light receiving surface by the lens 1 into an electrical signal (imaging signal) of an amount corresponding to the amount of incident light for each sensor in the CCD 3. Then, the CCD 3 is sequentially controlled by the timing pulse output from the CCD drive circuit 10 to sequentially output this image pickup signal to the analog processing circuit 4.

  The analog processing circuit 4 performs R, G, B signal amplification, noise reduction processing, and the like on the image pickup signal input from the CCD 3. The processing in the analog processing circuit 4 is switched ON / OFF via the control unit 11 in accordance with an operation signal from the operation unit 14.

The A / D converter 5 converts the imaging signal input from the analog processing circuit 4 into digital image data and outputs it.
The temporary storage memory 6 is a buffer memory or the like, and temporarily stores the digital image data output from the A / D converter 5.

  The image processing unit 7 performs image quality improvement processing such as gradation correction of digital image data used for display on the display unit 15, crosstalk correction of spectral sensitivity, dark current noise suppression, sharpening, white balance adjustment, and saturation adjustment. In addition, processing such as image size change, trimming, and aspect conversion is performed. The processing in the image processing unit 7 is switched on / off via the control unit 11 in accordance with an operation signal from the operation unit 14.

  The header information processing unit 8 writes the imaging device characteristic correction data d <b> 1 generated by the device characteristic correction information processing unit 13 as header information to the digital image data stored in the temporary storage memory 6.

  The storage device 9 is configured by a nonvolatile semiconductor memory or the like, and includes a recording medium such as a memory card that records captured digital image data, and a readable memory that stores a control program for the imaging device 21. It is configured.

  The recording medium is a storage medium used for storing data output from the imaging device 21, and is a compact flash (registered trademark), memory stick, smart media, multimedia card, hard disk, floppy (registered trademark) disk, magnetic storage medium. (MO) or CD-R may be used. In addition, the unit for writing to the storage medium is installed in a wired state via a cord even if it is integrated with the imaging device, installed independently or remotely in a wireless state via communication or the Internet Any aspect of the unit or the like may be used. The file format for recording on the recording medium is not a format specific to the imaging device, but is a standardized general-purpose format such as TIFF (Tagged Image File Format), JPEG (Joint Photographic Experts Group), Exif (Exchangeable Image File Format) It is preferably recorded in a file format.

  The CCD drive circuit 10 outputs a timing pulse based on the control signal output from the control unit 11 and controls the drive of the CCD 3.

  The control unit 11 is configured by a CPU (Central Processing Unit) or the like, reads a control program for the imaging device 21 stored in the storage device 9, and controls the entire imaging device 21 according to the read program. Specifically, the control unit 11 includes an automatic focus drive circuit 19, a focal length adjustment circuit 18, a CCD drive circuit 10, an analog processing circuit 4, a temporary storage memory 6, an image processing unit 7, an operation unit 14, a display unit 15, The flash drive circuit 16 and the apparatus characteristic correction information processing unit 13 are controlled to perform photographing.

  When the output of the scene reference raw data is designated by the operation unit 14, the control unit 11 performs a scene reference raw data storage process, which will be described later, and performs signal amplification, noise reduction processing, and image processing in the analog processing circuit 4 at the time of shooting. The processing in the unit 7 is omitted, and the imaging device characteristic correction data d1 is written as header information in the recording medium of the storage device 9, and the photographed digital image data is recorded as scene reference raw data d2.

  In response to an operation signal from the operation unit 14, the device characteristic correction information processing unit 13 stores the scene reference raw data d 2 that is not processed by the analog processing circuit 4 and the image processing unit 7 under the control of the control unit 11. When recording on a recording medium, imaging device characteristic correction data d1 is generated as information necessary for converting the scene reference raw data d2 into scene reference image data d4 in a standardized color space such as RIMM RGB or ERIM RGB. And output to the header information processing unit 8. The imaging device characteristic correction data d1 corresponds to “reproduction assistance data” recited in the claims.

  The operation unit 14 includes a release button (not shown), various function buttons such as a power ON / OFF button, a zoom button, and cursor keys. The operation signal corresponding to each button or key is input to the control unit 11 as an input signal. Output. In the present embodiment, the operation unit 14 includes a function button for designating output of scene reference raw data.

  The display unit 15 displays digital image data according to a control signal from the control unit 11 and also displays information for the user of the imaging device 21 to confirm settings and conditions related to shooting.

The strobe drive circuit 16 controls the strobe 17 to emit light when the subject brightness is low, based on a control signal from the control unit 11.
The strobe 17 boosts the battery voltage to a predetermined high voltage and stores the charge in a capacitor. Then, by being driven by the strobe driving circuit 16, the X tube emits light by the electric charge stored in the capacitor, and the subject is irradiated with auxiliary light.

The focal length adjustment circuit 18 controls the motor 20 for adjusting the focal length by moving the lens 1 in accordance with a control signal from the control unit 11.
The automatic focus driving circuit 19 controls the motor 20 for adjusting the focus (focus) by moving the lens 1 according to a control signal from the control unit 11.

<Operation of Imaging Device 21>
Next, the operation of the imaging device 21 will be described.
FIG. 2 shows a scene reference raw data storage process executed by the control of the control unit 11 when the operation unit 14 sets the output of the captured digital image data as scene reference raw data and the release switch is pressed. It is a flowchart which shows A. Hereinafter, the scene reference raw data storage processing A will be described with reference to FIG.

  When the release button of the operation unit 14 is pressed, the control unit 11 controls each unit and performs shooting (step S1). The imaging signal obtained from the CCD 3 is converted into digital image data by the A / D converter 5, and scene reference raw data d2 is generated (step S2). Further, under the control of the control unit 11, the device characteristic correction information processing unit 13 performs processing for correcting device characteristics unique to the imaging device (hereinafter referred to as imaging device property correction processing) to the generated scene reference raw data d2. Necessary data, that is, imaging device characteristic correction data d1 is generated (step S3).

  After the generation of the scene reference raw data d2 and the imaging device characteristic correction data d1, the header information processing unit 8 records the imaging device characteristic correction data d1 as tag information in the file header of the scene reference raw data d2 under the control of the control unit 11. The attached data file is created (step S5). For example, the imaging device characteristic correction data d1 is recorded according to the DNG format. The attached data file is recorded and stored in a recording medium of the storage device 9 configured to be detachable from the imaging device 21 (step S6).

  FIG. 3 is a diagram showing a data structure of the digital image data recorded on the recording medium of the storage device 9 in step S6. As shown in FIG. 3, the captured digital image data is recorded as scene reference raw data d2, and imaging device characteristic correction data d1 is recorded in the header area. By taking out this recording medium from the imaging device 21 and mounting it on an external device such as an image processing device or an image recording device, the scene reference raw data d2 and the imaging device characteristic correction data d1 can be output to these external devices. it can.

<Configuration of Imaging Device 22>
Next, in order to obtain a more preferable image at the output destination of the digital image data, an imaging device 22 configured by adding the imaging information data processing unit 12 to the configuration of the imaging device 21 will be described. FIG. 4 is a block diagram illustrating a functional configuration of the imaging device 22.

  The shooting information data processing unit 12 generates shooting information data d3. The shooting information data d3 includes information directly related to the camera type (model) such as camera name and code number, or exposure time, shutter speed, aperture value (F number), ISO sensitivity, luminance value, subject distance range, light source, etc. Information on the shooting conditions such as the presence / absence of strobe light emission, the subject area, white balance, zoom magnification, subject composition, shooting scene type, amount of reflected light from the strobe light source, shooting saturation, and the like.

<Operation of Imaging Device 22>
FIG. 5 shows an image pickup apparatus 22 shown in FIG. 4 in which the operation unit 14 sets the output of the photographed digital image data based on the scene reference raw data, and the control unit 11 controls the release switch when the release switch is pressed. It is a flowchart which shows the scene reference raw data preservation | save process B performed. Hereinafter, the scene reference raw data storage process B will be described with reference to FIG.

  When the release button of the operation unit 14 is pressed, each unit is controlled by the control unit 11 and photographing is performed (step S11). The imaging signal obtained from the CCD 3 is converted into digital image data by the A / D converter 5 to generate scene reference raw data d2 (step S12). Further, the apparatus characteristic correction information processing unit 13 generates imaging apparatus characteristic correction data d1 (step S13), and the shooting information data processing unit 12 generates shooting information data d3 (step S14).

  After the generation of the scene reference raw data d2, the imaging device characteristic correction data d1, and the shooting information data d3, the imaging device characteristic correction data d1 and the shooting information data d3 are recorded and attached as tag information to the file header of the scene reference raw data d2. In step S15, an attached data file is created (step S16). For example, the imaging device characteristic correction data d1 is recorded in the DNG tag, and the shooting information data d3 is recorded in the Exif tag. The attached data file is recorded and stored in a recording medium of the storage device 9 configured to be detachable from the imaging device 22 (step S17).

  FIG. 6 is a diagram showing a data structure of the digital image data recorded on the recording medium of the storage device 9 in step S17. As shown in FIG. 6, the captured digital image data is recorded as scene reference raw data d2, and imaging device characteristic correction data d1 and shooting information data d3 are recorded in the header area. By taking out this recording medium from the image pickup device 22 and mounting it on an external device such as an image processing device or an image recording device, the scene reference raw data d2, the image pickup device characteristic correction data d1, and the shooting information data d3 are obtained from these external devices. Can be output.

  Although the imaging device 21 and the imaging device 22 have been described above, these are merely examples of devices that generate scene reference raw data, reproduction assistance data, and shooting information data, and are a color negative film, a color reversal film, a black and white negative film, and a black and white image. Reproduced on film scanners that input frame image data of photographic photosensitive material recorded by analog cameras such as reversal film, image data reproduced on color paper as silver salt photographic paper, other reflective originals, and transparent originals Alternatively, the image data may be acquired using a flatbed scanner or the like for inputting the image data, and the data may be generated based on the acquired image data.

<Configuration of Image Processing Device 121>
Next, the image processing apparatus 121 according to the first embodiment of the present invention will be described.
First, the configuration of the image processing apparatus 121 will be described.
FIG. 7 is a block diagram illustrating a functional configuration of the image processing apparatus 121. As shown in FIG. 7, the image processing device 121 performs an imaging device characteristic correction process on the scene reference raw data d2 based on the input unit 101, the header information analysis unit 102, and the imaging device characteristic correction data d1, and performs scene reference image data. The imaging device characteristic correction processing unit 114 that generates d4, and image processing (hereinafter referred to as optimization processing) for forming an optimal appreciation image for the scene reference image data d4 generated by the imaging device characteristic correction processing unit 114. And an optimization processing unit 115 that generates appreciation image reference data d5. The header information analysis unit 102 is connected to the imaging device characteristic correction processing unit 114 and the optimization processing unit 115, respectively, and the storage device 111, the output device 112, and the display device 113 are respectively connected to the optimization processing unit 115. Connection is possible. Each of the above components operates under the overall control of a control unit (not shown) configured by a CPU or the like.

  The input unit 101 includes a recording medium mounting unit (not shown). When a recording medium in which data files (see FIGS. 3 and 6) recorded by the imaging devices 21 and 22 described above are mounted on the mounting unit, the input unit 101 stores the recorded data file. Read out and output to the header information analysis unit 102. In the present embodiment, the input unit 101 is described as reading data from a mounted recording medium. However, a data communication cable, wireless communication, or wired communication from the recording medium or the imaging devices 21 and 22 described above. Data may be input via the communication means. The input unit 101 has a function as data acquisition means of the image processing apparatus described in the claims.

  The header information analysis unit 102 analyzes the data input from the input unit 101 and divides the data into scene reference raw data d2, imaging device characteristic correction data d1 attached to the scene reference raw data d2, and shooting information data d3. The imaging device characteristic correction data d1 is output to the device characteristic correction processing unit 103a, the scene reference raw data d2 is output to the scene reference image data generation unit 104, and the shooting information data d3 is output to the shooting information data processing unit 107.

  As shown in FIG. 7, the imaging device characteristic correction processing unit 114 includes a device characteristic correction processing unit 103a, a processing condition table 103b, a scene reference image data generation unit 104, a temporary storage memory 105, and a header information editing unit 106. It is configured. The imaging device characteristic correction processing unit 114 has a function as a scene reference image data generation unit of the image processing device described in the claims.

  When the imaging device characteristic correction data d1 is input from the header information analysis unit 102, the device characteristic correction processing unit 103a determines a generation condition of the scene reference image data d4 by referring to the processing condition table 103b. The processing condition table 103b is a table that stores the processing conditions for generating the scene reference image data d4 in association with each characteristic of the imaging apparatus.

  The scene reference image data generation unit 104 performs imaging device characteristic correction processing on the scene reference raw data d2 input from the header information analysis unit 102 according to the generation conditions determined by the device characteristic correction processing unit 103a, and performs imaging The scene reference image data d4 independent of the characteristics is generated and output to the temporary storage memory 105. Specifically, in the imaging device characteristic correction process, the signal intensity of each color channel based on at least the spectral sensitivity inherent to the imaging device of the imaging device that generated the scene reference raw data d2 is set to a standard color such as RIMM RGB or ERIMM RGB, for example. Includes mapping to space.

  The temporary storage memory 105 is output from the scene reference image data d4 generated by the scene reference image data generation unit 104, the edited reproduction auxiliary data d6 generated by the header information editing unit 106, and the shooting information data processing unit 107. The shooting information data d3 is temporarily stored.

  The header information editing unit 106 edits part or all of the elements constituting the imaging device characteristic correction data d1 input from the header information analysis unit 102, and generates edited reproduction auxiliary data d6. Editing refers to adding n sets (where n is an integer equal to or greater than 1), adding existing n sets (when n is an integer greater than or equal to 0), or existing or This means a process of adding, modifying, deleting, etc., the description contents of each added set as necessary. The header information editing unit 106 has a function as reproduction auxiliary data editing means of the image processing apparatus described in the claims.

  Further, the header information editing unit 106 writes the edited reproduction auxiliary data d6 as header information of the scene reference image data d4 stored in the temporary storage memory 105, and records it on the recording medium of the storage device 111. When the edited reproduction auxiliary data d6 and the shooting information data d3 are attached to the scene reference image data d4 and recorded, the edited reproduction auxiliary data d6 and the shooting information data d3 are used as header information of the scene reference image data d4. Write and record on the recording medium of the storage device 111.

  FIG. 8A shows an example of reproduction assistance data before editing (imaging device characteristic correction data d1), and FIGS. 8B to 8H show examples of edited reproduction assistance data after editing. The reproduction assistance data shown in FIG. 8B is obtained by correcting the information of element 1 of the reproduction assistance data shown in FIG. The reproduction assistance data shown in FIG. 8C is obtained by adding information on the element 6 to the reproduction assistance data shown in FIG. Reproduction assistance data shown in FIGS. 8D and 8E is obtained by adding information corresponding to another application 2 to the reproduction assistance data shown in FIG. As shown in FIG. 8 (d), all information may be described for each use. However, if there are elements of the same information even when the uses are different, as shown in FIG. Information may be described only for the purpose of use and used in common. In addition, as shown in FIG. 8F, it is possible to set elements necessary only for a specific application. Further, as shown in FIGS. 8 (g) and (h), information about only usage 2 or usage 2 and usage 3 may be described without inheriting the usage of the reproduction auxiliary data before editing. .

  Further, when the reproduction assistance data is attached to the scene reference raw data d2, as shown in FIG. 9, information for converting the scene reference raw data d2 into the scene reference image data d4 as one of uses, That is, it is preferable that the imaging device characteristic correction data d1 is described. Information necessary for converting the scene reference raw data d2 into the scene reference image data d4, and information unnecessary for converting the scene reference image data d4 into the viewing image reference data d5 (for example, the imaging device) Whether the CCD array is a Bayer array, a honeycomb array, or the like) may be described only in a portion corresponding to the imaging device characteristic correction data d1.

  The reproduction assistance data preferably has a plurality of pieces of information for each application with respect to a plurality of elements constituting the reproduction assistance data. FIG. 10 shows a specific example of reproduction assistance data. Different information may be described depending on the application (for example, elements 5 and 6 in FIG. 10). If the information does not change depending on the application, one of a plurality of applications is selected, Information may be described only in the corresponding part, and may be referred to in common (for example, element 1 and element 2 in FIG. 10), or information having the same content may be described (for example, the element in FIG. 10). 4, element 8 etc.). Examples of elements constituting the reproduction assistance data include contents described in the DNG tag.

  As shown in FIG. 7, the optimization processing unit 115 includes a shooting information data processing unit 107, an appreciation image reference data generation unit 108, a temporary storage memory 109, and a setting input unit 110. The optimization processing unit 115 has a function as an appreciation image reference data generation unit of the image processing apparatus described in the claims.

  The shooting information data processing unit 107 determines a generation condition for generating the viewing image reference data d5 according to the shooting condition based on the shooting information data d3 input from the header information analysis unit 102, and the viewing image reference data. The data is output to the generation unit 108. Further, the shooting information data processing unit 107 outputs the shooting information data d3 to the temporary storage memory 105.

  When the operation information regarding the types of the storage device 111, the output device 112, and the display device 113 that outputs the digital image data generated by the image processing device 121 is input, the setting input unit 110 receives the operation information as appreciation image reference data. The data is output to the generation unit 108.

  The appreciation image reference data generation unit 108 reads the scene reference image data d4 from the temporary storage memory 105, and stores the input of the appreciation image reference data d5 determined by the shooting information data processing unit 107 and the setting input unit 110. Based on the operation information regarding the types of the device 111, the output device 112, and the display device 113, the viewing image reference data d5 is generated by performing an optimization process for obtaining an optimal image at the output destination, and the temporary storage memory 109 together with the operation information is generated. Output to. The optimization processing includes, for example, compression to the output destination color gamut, gradation compression from 16 bits to 8 bits, reduction of the number of output pixels, processing to cope with output characteristics (LUT) of output devices and display devices, and the like. It is. Furthermore, image processing such as noise suppression, sharpening, color balance adjustment, saturation adjustment, and dodging processing is included.

  The temporary storage memory 109 stores the viewing image reference data d5 input from the viewing image reference data generation unit 108 under the control of the control unit according to the operation information from the setting input unit 110, the storage device 111, the output device 112, and the display device 113. Output to either of these.

  In FIG. 7, for the sake of simplicity, the temporary storage memory 105, which is a memory for generating image data files, and the temporary storage memory 109, which is a memory for forming an appreciation image, are illustrated separately. It may be used.

<Operation of Image Processing Device 121>
FIG. 11 is a flowchart showing the auxiliary reproduction data editing process A executed by the cooperation of the units of the image processing apparatus 121. Hereinafter, the operation of the image processing apparatus 121 will be described with reference to the drawings.

  When a recording medium on which the image data file having the data structure shown in FIG. 3 or FIG. 6 is loaded, a digital image data file recorded on the recording medium is acquired by the input unit 101 (step 21). The content of the acquired digital image data is analyzed by the header information analysis unit 102 (step S22), raw scene reference data d2 (step S23), imaging device characteristic correction data d1 (step S24), and shooting information data d3 ( In step S25), the raw scene reference data d2 and the imaging device characteristic correction data d1 are output to the imaging device characteristic correction processing unit 114, and the imaging information data d3 is output to the optimization processing unit 115.

  When the imaging apparatus characteristic correction data d1 is input to the imaging apparatus characteristic correction processing unit 114, the processing condition table 103b is referred to by the apparatus characteristic correction processing unit 103a, and a processing condition for generating the scene reference image data d4 is determined. The The scene reference image data generation unit 104 performs imaging device characteristic correction processing on the scene reference raw data d2 based on this processing condition (step S26), and scene reference image data d4 is generated and optimized processing unit. 115 (step S27).

  The header information editing unit 106 edits some or all of the elements constituting the imaging device characteristic correction data d1 (step S28), and edited reproduction auxiliary data d6 is generated (step S29). . Then, the edited reproduction auxiliary data d6 (and shooting information data d3) are attached as tag information to the file header of the scene reference image data d4 (step S30), and an attached data file is generated (step S31). The attached data file is recorded and saved on the recording medium of the storage device 111 (step S32).

  Further, when the shooting information data d3 is input to the optimization processing unit 115, the shooting information data processing unit 107 causes the shooting information data d3 to generate viewing image reference data d5 corresponding to the shooting conditions based on the shooting information data d3. Is determined. The scene reference image data d4 input from the imaging device characteristic correction processing unit 114 is processed by the viewing image reference data generation unit 108 by the processing conditions determined by the shooting information data processing unit 107 and the operation information input from the setting input unit 110. Based on the above, an optimization process corresponding to the output destination is performed (step S33), and viewing image reference data d5 is generated and output to the device set by the setting input unit 110 (step S34).

  12A to 12D are diagrams showing an output data structure when the scene reference image data d4 is generated and output to the storage device 111. FIG. The image data file shown in FIG. 12A is recorded with the edited reproduction auxiliary data d6 attached to the scene reference image data d4. Further, as shown in FIG. 12B, photographing information data d3 may be further attached. Also, as shown in FIG. 12 (c), a plurality of edited reproduction auxiliary data d61 to d6n may be attached to the scene reference image data d4 according to a plurality of uses of the appreciation image to be generated later. Further, as shown in FIG. 12D, imaging device characteristic correction data d1 that is reproduction auxiliary data before editing may be attached as one piece of edited reproduction auxiliary data d6. By attaching a recording medium storing these image data files to an external device such as a display device or an image recording device, the scene reference image data d4 and the edited reproduction auxiliary data d6 (and shooting information data d3) are stored in the external device. And can be optimized by an external device according to its own device.

  As described above, according to the image processing apparatus 121, some or all of the elements constituting the reproduction auxiliary data (imaging apparatus characteristic correction data d1) are changed depending on the application of the viewing image formed on the output medium. Since the edited reproduction auxiliary data d6 (and shooting information data d3) are recorded and attached to the scene reference image data d4, the scene reference image data d4 having the basic characteristics is retained and viewed later. Edited reproduction auxiliary data d6 and (and photographing information data d3) used when forming an image can be attached. Therefore, it is possible to provide information for obtaining an optimal image according to the application to an external device without causing information loss of the captured image information.

  In addition, since a plurality of pieces of information are generated for some or all of the elements constituting the reproduction assistance data according to a plurality of uses of the viewing image, one image can be made compatible with a plurality of uses. .

  If the appreciation image reference data d5 for the assumed use is attached to the scene reference image data d4, the recording capacity increases and the load is high. In addition, when only the viewing image reference data d5 is recorded, there is a possibility that data loss from the scene reference image data d4 is expected when used for a use different from the intended use, and there is a risk of image quality deterioration. It is preferable to keep d4.

  The reproduction assistance data (imaging device characteristic correction data d1) is useful for generating the scene reference image data d4 from the scene reference raw data d2, but the scene reference image data d4 is generated and recorded on the recording medium. It can be said that this role is fulfilled. For this reason, it is considered unnecessary to record the reproduction assistance data before editing on the recording medium.

[Second Embodiment]
<Configuration of Image Processing Device 122>
Next, a second embodiment to which the present invention is applied will be described.
The image processing apparatus 122 according to the second embodiment has a configuration in which a temporary storage memory 116 is added to the image processing apparatus 121 described in the first embodiment. FIG. 13 is a block diagram illustrating a functional configuration of the image processing apparatus 122. In the image processing apparatus 122, the same components as those of the image processing apparatus 121 described in the first embodiment are denoted by the same reference numerals, and description thereof is omitted. Hereinafter, a configuration and processing characteristic of the second embodiment will be described.

  The header information analysis unit 102 analyzes the data input from the input unit 101 and divides the data into scene reference raw data d2, imaging device characteristic correction data d1 attached to the scene reference raw data d2, and shooting information data d3. The imaging device characteristic correction data d1 is output to the device characteristic correction processing unit 103a, the scene reference raw data d2 is output to the scene reference image data generation unit 104 and the temporary storage memory 116, and the shooting information data d3 is output to the shooting information data processing unit 107. .

  The header information editing unit 106 edits part or all of the elements constituting the imaging device characteristic correction data d1 output from the header information analysis unit 102, and generates edited reproduction auxiliary data d6. Then, the header information editing unit 106 writes the edited reproduction auxiliary data d6 as header information of the scene reference raw data d2 stored in the temporary storage memory 116, and records it on the recording medium of the storage device 111. When the edited reproduction auxiliary data d6 and the shooting information data d3 are attached to the scene reference raw data d2 and recorded, the edited reproduction auxiliary data d6 and the shooting information data d3 are used as header information of the scene reference raw data d2. Write and record on the recording medium of the storage device 111.

  The temporary storage memory 116 temporarily stores the scene reference raw data d2 input from the header information analysis unit 102.

<Operation of Image Processing Device 122>
FIG. 14 is a flowchart showing the reproduction assistance data editing process B executed by cooperation of the units of the image processing apparatus 122. Hereinafter, the operation of the image processing apparatus 122 will be described with reference to the drawings.

  When the recording medium on which the image data file having the data structure shown in FIG. 3 or FIG. 6 is recorded is loaded, the digital image data file recorded on the recording medium is acquired by the input unit 101 (step 41). The content of the acquired digital image data is analyzed by the header information analysis unit 102 (step S42), raw scene reference data d2 (step S43), imaging device characteristic correction data d1 (step S44), and shooting information data d3 ( In step S45), the scene reference raw data d2 and the imaging device characteristic correction data d1 are output to the imaging device characteristic correction processing unit 114, and the imaging information data d3 is output to the optimization processing unit 115. The scene reference raw data d2 is stored in the temporary storage memory 116.

  When the imaging apparatus characteristic correction data d1 is input to the imaging apparatus characteristic correction processing unit 114, the processing condition table 103b is referred to by the apparatus characteristic correction processing unit 103a, and a processing condition for generating the scene reference image data d4 is determined. The The scene reference image data generation unit 104 performs imaging device characteristic correction processing on the scene reference raw data d2 based on this processing condition (step S46), and scene reference image data d4 is generated and optimized. 115 (step S47).

  The header information editing unit 106 edits some or all of the elements constituting the imaging device characteristic correction data d1 (step S48), and edited reproduction auxiliary data d6 is generated (step S49). . Then, the edited reproduction auxiliary data d6 (and shooting information data d3) is attached as tag information to the file header of the scene reference raw data d2 (step S50), and an attached data file is generated (step S51). The attached data file is recorded and stored in the recording medium of the storage device 111 (step S52).

  Further, when the shooting information data d3 is input to the optimization processing unit 115, the shooting information data processing unit 107 causes the shooting information data d3 to generate viewing image reference data d5 corresponding to the shooting conditions based on the shooting information data d3. Is determined. The scene reference image data d4 input from the imaging device characteristic correction processing unit 114 is processed by the viewing image reference data generation unit 108 by the processing conditions determined by the shooting information data processing unit 107 and the operation information input from the setting input unit 110. Is applied to the output destination (step S53), and the viewing image reference data d5 is generated and output to the device set by the setting input unit 110 (step S54).

  FIGS. 15A to 15D are diagrams illustrating an output data structure when the scene reference raw data d2 is output to the storage device 111. FIG. The image data file shown in FIG. 15A is recorded with the edited reproduction auxiliary data d6 attached to the scene reference raw data d2. Further, as shown in FIG. 15B, photographing information data d3 may be further attached. Further, as shown in FIG. 15C, a plurality of edited reproduction auxiliary data d61 to d6n may be attached to the scene reference raw data d2 in accordance with a plurality of uses of an appreciation image to be generated later. As shown in FIG. 15D, imaging device characteristic correction data d1, which is reproduction auxiliary data before editing, may be attached as one piece of edited reproduction auxiliary data d6. By attaching a recording medium storing these image data files to an external device such as a display device or an image recording device, the scene reference raw data d2 and edited reproduction auxiliary data d6 (and photographing information data d3) are stored in the external device. And can be optimized by an external device according to its own device.

As described above, according to the image processing device 122, some or all of the elements constituting the reproduction assistance data (imaging device characteristic correction data d1) are changed depending on the application of the appreciation image formed on the output medium. The edited reproduction auxiliary data d6 (and the shooting information data d3) are recorded and attached to the scene reference raw data d2, so that the scene reference raw data d2 is retained and used when an appreciation image is formed later. Edited reproduction auxiliary data d6 (and photographing information data d3) can be attached. Therefore, it is possible to provide information for obtaining an optimal image according to the application to an external device without causing information loss of the captured image information.
Further, as in the first embodiment, there is an advantage that the size capacity is small as compared with the case where the edited reproduction auxiliary data d6 and the shooting information data d3 are attached to the scene reference image data d4 and recorded.

[Third Embodiment]
<Configuration of Image Processing Device 151>
Next, an image processing apparatus 151 according to the third embodiment of the present invention will be described.
First, the configuration of the image processing apparatus 151 will be described.
FIG. 16 is a block diagram illustrating a functional configuration of the image processing apparatus 151. As shown in FIG. 16, the image processing apparatus 151 performs optimization processing on the input unit 131, the header information analysis unit 132, the header information selection unit 146, and the scene reference image data d4 to generate the viewing image reference data d5. The processing unit 145 is configured. A storage device 141, an output device 142, and a display device 143 can be connected to the optimization processing unit 145. Each of the above components operates under the overall control of a control unit (not shown) configured by a CPU or the like.

  The input unit 131 includes a recording medium mounting unit (not shown). A file (FIG. 12 (FIG. 12 (FIG. 12) in which the edited reproduction auxiliary data d6 (and shooting information data d3) is attached to the scene reference image data d4 generated by the image processing device 121 shown in the first embodiment) to the mounting unit. When the recording media on which (a) to (d) are recorded) are loaded, the input unit 131 reads the recorded data file and outputs it to the header information analysis unit 132. In the present embodiment, the input unit 131 is described as reading data from an attached recording medium. However, the input unit 131 includes a data communication cable and a wireless or wired communication unit, and through these communication units. Data may be input. The input unit 131 has a function as data acquisition means of the image processing apparatus described in the claims.

  The header information analysis unit 132 analyzes the data input from the input unit 131 and divides it into scene reference image data d4, edited reproduction auxiliary data d6 attached to the scene reference image data d4, and shooting information data d3. The scene reference image data d4 is output to the temporary storage memory 147, the edited reproduction auxiliary data d6 is output to the header information selection unit 146, and the shooting information data d3 is output to the shooting information data processing unit 137.

  The header information selection unit 146 selects information to be used from the edited reproduction auxiliary data d6 input from the header information analysis unit 132 in accordance with the application of the viewing image to be formed later, and outputs the information to the processing condition acquisition unit 148a. To do. For example, when the edited reproduction auxiliary data d6 shown in FIG. 10 is acquired, for the element 10, sRGB is selected for use 1 and Adobe RGB is used for use 2. If the information does not change according to the use and the information is described only for a predetermined use among a plurality of uses, the information may be acquired (for example, FIG. 10). Element 1, element 2, etc.).

  The optimization processing unit 145 includes a temporary storage memory 147, a processing condition acquisition unit 148a, a processing condition table 148b, a shooting information data processing unit 137, an appreciation image reference data generation unit 138, a temporary storage memory 139, and a setting input unit 140. Configured. The optimization processing unit 145 has a function as appreciation image reference data generation means of the image processing apparatus described in the claims.

  The temporary storage memory 147 temporarily stores the scene reference image data d4 input by the header information analysis unit 132.

  When the reproduction auxiliary data selected according to the application of the viewing image is input by the header information selection unit 146, the processing condition acquisition unit 148a determines the generation condition of the viewing image reference data d5 by referring to the processing condition table 148b. To do. The processing condition table 148b is a table that stores the processing conditions for generating the viewing image reference data d5 in association with each reproduction auxiliary data. Here, the processing condition is determined by referring to the processing condition table 148b. However, when the reproduction auxiliary data includes a value indicating the intensity of the process, this is converted into 1 such as a conversion formula that is a substantial content of the process. The processing conditions may be determined by various methods known in the art other than the table reference such as adoption as a parameter.

  The shooting information data processing unit 137 determines a generation condition for generating the viewing image reference data d5 according to the shooting condition based on the shooting information data d3 input from the header information analysis unit 132, and the viewing image reference data. The data is output to the generation unit 138.

  When the setting input unit 140 receives operation information regarding the types of the storage device 141, the output device 142, and the display device 143 that output the digital image data generated by the image processing apparatus 151, the setting input unit 140 converts the operation information into the appreciation image reference data. The data is output to the generation unit 138.

  The appreciation image reference data generation unit 138 reads the scene reference image data d4 from the temporary storage memory 147, and the generation condition of the appreciation image reference data d5 determined by the processing condition acquisition unit 148a, determined by the shooting information data processing unit 137. Optimization processing for obtaining an optimal image at the output destination based on the generation conditions of the appreciation image reference data d5 and the operation information regarding the types of the storage device 141, the output device 142, and the display device 143 input from the setting input unit 140 To generate appreciation image reference data d5 and output it to the temporary storage memory 139 together with the operation information.

  The temporary storage memory 139 stores the viewing device 141, the output device 142, and the display device 143 according to the operation information from the setting input unit 140 based on the viewing image reference data d5 input from the viewing image reference data generation unit 138 under the control of the control unit. Output to either of these.

<Operation of Image Processing Device 151>
FIG. 17 is a flowchart showing an image optimization process A executed by cooperation of the units of the image processing apparatus 151. Hereinafter, the operation of the image processing apparatus 151 will be described with reference to the drawings.

  When a recording medium on which an image data file having the data structure shown in FIGS. 12A to 12D is loaded, a digital image data file recorded on the recording medium is acquired by the input unit 131 ( Step 61). The contents of the acquired digital image data are analyzed by the header information analysis unit 132 (step S62), scene reference image data d4 (step S63), shooting information data d3 (step S64), edited reproduction auxiliary data d6 ( In step S65), the scene reference image data d4 is output to the temporary storage memory 147, the shooting information data d3 is output to the shooting information data processing unit 137, and the edited reproduction auxiliary data d6 is output to the header information selection unit 146. Then, the header information selection unit 146 selects information to be used from the edited reproduction auxiliary data d6 according to the application of the viewing image to be formed later (step S66).

  When the selected reproduction assistance data is input to the processing condition acquisition unit 148a, the processing condition acquisition unit 148a refers to the processing condition table 148b and determines a processing condition for generating the viewing image reference data d5.

  Further, when the shooting information data d3 is input to the shooting information data processing unit 137, a processing condition for generating appreciation image reference data d5 corresponding to the shooting condition is determined based on the shooting information data d3.

  The scene reference image data d4 stored in the temporary storage memory 147 is determined by the viewing image reference data generation unit 138 by the shooting information data processing unit 137 and the generation conditions of the viewing image reference data d5 determined by the processing condition acquisition unit 148a. Based on the processed processing conditions and the operation information input from the setting input unit 140, an optimization process corresponding to the output destination is performed (step S67), and the viewing image reference data d5 is generated. The data is output to the set device (step S68).

Next, an image optimization process B for performing an optimization process according to a plurality of applications will be described with reference to FIG.
FIG. 18 is a flowchart showing an image optimization process B executed by cooperation of the units of the image processing apparatus 151.

  When a recording medium on which an image data file having the data structure shown in FIGS. 12A to 12D is loaded, a digital image data file recorded on the recording medium is acquired by the input unit 131 ( Step 71). The content of the acquired digital image data is analyzed by the header information analysis unit 132 (step S72), scene reference image data d4 (step S73), shooting information data d3 (step S74), edited reproduction auxiliary data d6 ( In step S75), the scene reference image data d4 is output to the temporary storage memory 147, the shooting information data d3 is output to the shooting information data processing unit 137, and the edited reproduction auxiliary data d6 is output to the header information selection unit 146. Then, the header information selection unit 146 selects information to be used (reproduction auxiliary data 1, reproduction auxiliary data 2) from the edited reproduction auxiliary data d6 according to the application of the viewing image to be formed later (step S76). , S77).

  When the selected reproduction auxiliary data 1 and reproduction auxiliary data 2 are input to the processing condition acquisition unit 148a, the processing condition acquisition unit 148a refers to the processing condition table 148b, and appreciation image reference data d5 (appreciation image reference data 1, Processing conditions for generating the appreciation image reference data 2) are determined.

  Further, when the shooting information data d3 is input to the shooting information data processing unit 137, a processing condition for generating appreciation image reference data d5 corresponding to the shooting condition is determined based on the shooting information data d3.

  The scene reference image data d4 stored in the temporary storage memory 147 is determined by the viewing image reference data generation unit 138 by the shooting information data processing unit 137 and the generation conditions of the viewing image reference data d5 determined by the processing condition acquisition unit 148a. Based on the processed processing conditions and the operation information input from the setting input unit 140, optimization processing (optimization processing 1, optimization processing 2) corresponding to the output destination is performed (steps S78 and S79). Image reference data d5 (appreciation image reference data 1, appreciation image reference data 2) is generated and output to the devices set by the setting input unit 140 (steps S80 and S81).

  As described above, according to the image processing apparatus 151, the scene reference image data d4, the edited reproduction auxiliary data d6, and the shooting information data d3 are acquired, and the scene reference image data d4 is obtained based on the edited reproduction auxiliary data d6. Is subjected to optimization processing to generate appreciation image reference data d5, and the appreciation image is formed on the output medium using the appreciation image reference data d5, so that an optimal appreciation image can be provided according to the application.

  Further, since the data to be used when performing the optimization process is selected for some or all of the elements constituting the edited reproduction auxiliary data d6 according to the use of the viewing image, the optimum viewing image is selected according to the use. Can be provided.

[Fourth Embodiment]
<Configuration of Image Processing Device 152>
Next, a fourth embodiment to which the present invention is applied will be described.
FIG. 19 is a block diagram illustrating a functional configuration of the image processing apparatus 152 according to the fourth embodiment. The image processing device 152 has a configuration in which an imaging device characteristic correction processing unit 144 is added to the image processing device 151 shown in the third embodiment. In the image processing apparatus 152, the same components as those of the image processing apparatus 151 shown in the third embodiment are denoted by the same reference numerals, and description thereof is omitted. Hereinafter, a configuration and processing characteristic of the fourth embodiment will be described.

  The input unit 131 includes a recording medium mounting unit (not shown). A file (FIG. 15 (FIG. 15) in which the edited reproduction auxiliary data d6 (and the shooting information data d3) are attached to the scene reference raw data d2 generated by the image processing device 122 shown in the second embodiment is attached to the mounting unit. When the recording media on which (a) to (d) are recorded) are loaded, the input unit 131 reads the recorded data file and outputs it to the header information analysis unit 132.

  The header information analysis unit 132 analyzes the data input from the input unit 131 and divides the data into scene reference raw data d2, edited reproduction auxiliary data d6 attached to the scene reference raw data d2, and shooting information data d3. The scene reference raw data d2 is output to the scene reference image data generation unit 134, the edited reproduction auxiliary data d6 is output to the header information selection unit 146, and the shooting information data d3 is output to the shooting information data processing unit 137.

  The header information selection unit 146 selects information to be used from the edited reproduction auxiliary data d6 input from the header information analysis unit 132 in accordance with the application of the viewing image to be formed later, and outputs the information to the processing condition acquisition unit 148a. To do. The header information selection unit 146 also reproduces auxiliary data corresponding to an application for generating scene reference image data d4 from the scene reference raw data d2 from the edited reproduction auxiliary data d6 input from the header information analysis unit 132, that is, The imaging device characteristic correction data d1 is selected and output to the device characteristic correction processing unit 133a.

  The imaging device characteristic correction processing unit 144 includes a device characteristic correction processing unit 133a, a processing condition table 133b, a scene reference image data generation unit 134, and a temporary storage memory 135.

  When the imaging device characteristic correction data d1 is input from the header information selection unit 146, the apparatus characteristic correction processing unit 133a determines a generation condition of the scene reference image data d4 by referring to the processing condition table 133b. The processing condition table 133b is a table that stores the processing conditions for generating the scene reference image data d4 in association with each characteristic of the imaging device.

  The scene reference image data generation unit 134 performs imaging device characteristic correction processing on the scene reference raw data d2 input from the header information analysis unit 132 according to the generation conditions determined by the device characteristic correction processing unit 133a. The scene reference image data d4 independent of the characteristics is generated and output to the temporary storage memory 135.

  The temporary storage memory 135 temporarily stores the scene reference image data d4 generated by the scene reference image data generation unit 134.

<Operation of Image Processing Device 152>
FIG. 20 is a flowchart showing an image optimization process C executed by cooperation of the units of the image processing apparatus 152. Hereinafter, the operation of the image processing apparatus 152 will be described with reference to the drawings.

  When a recording medium on which an image data file having the data structure shown in FIGS. 15A to 15D is recorded is loaded, a digital image data file recorded on the recording medium is acquired by the input unit 131 ( Step 91). The content of the acquired digital image data is analyzed by the header information analysis unit 132 (step S92), raw scene reference data d2 (step S93), shooting information data d3 (step S94), edited reproduction auxiliary data d6 ( In step S95), the scene reference raw data d2 is output to the scene reference image data generation unit 134, the shooting information data d3 is output to the shooting information data processing unit 137, and the edited reproduction auxiliary data d6 is output to the header information selection unit 146. The The header information selection unit 146 then outputs the imaging device characteristic correction data d1 in the edited reproduction auxiliary data d6 to the device characteristic correction processing unit 133a (step S96). Further, information to be used is selected from the edited reproduction auxiliary data d6 in accordance with the application of the appreciation image to be formed later, and the selected reproduction auxiliary data is output to the processing condition acquisition unit 148a (step S97).

  When the imaging device characteristic correction data d1 is input to the device characteristic correction processing unit 133a, the processing condition table 133b is referred to by the device characteristic correction processing unit 133a, and a processing condition for generating the scene reference image data d4 is determined. . The scene reference image data generation unit 134 performs imaging device characteristic correction processing on the scene reference raw data d2 based on this processing condition (step S98), and scene reference image data d4 is generated and optimized. It is output to 145 (step S99).

  When the selected reproduction assistance data is input to the processing condition acquisition unit 148a, the processing condition acquisition unit 148a refers to the processing condition table 148b and determines a processing condition for generating the viewing image reference data d5.

  Further, when the shooting information data d3 is input to the shooting information data processing unit 137, a processing condition for generating appreciation image reference data d5 corresponding to the shooting condition is determined based on the shooting information data d3.

  The scene reference image data d4 input from the imaging device characteristic correction processing unit 144 is generated by the appreciation image reference data generation unit 138, the generation conditions of the appreciation image reference data d5 determined by the processing condition acquisition unit 148a, and the shooting information data processing unit. Based on the processing conditions determined in 137 and the operation information input from the setting input unit 140, an optimization process according to the output destination is performed (step S100), and the viewing image reference data d5 is generated and the setting input is performed. The data is output to the device set by the unit 140 (step S101).

  As described above, according to the image processing device 152, the scene reference raw data d2, the edited reproduction auxiliary data d6, and the shooting information data d3 are acquired, and the scene reference raw data d2 is obtained based on the edited reproduction auxiliary data d6. Is subjected to imaging device characteristic correction processing to generate scene reference image data d4, and the generated scene reference image data d4 is optimized based on the edited reproduction auxiliary data d6 and shooting information data d3 to provide an appreciation image. Since the reference data d5 is generated and the appreciation image is formed on the output medium using the appreciation image reference data d5, an optimal appreciation image can be provided according to the application. Since the image information is recorded as the scene reference raw data d2, the same effect as that of the third embodiment can be obtained even though the file capacity is suppressed.

  In the fourth embodiment, the scene reference image data d4 is generated from the scene reference raw data d2, and then the viewing image reference data d5 is generated from the scene reference image data d4. However, the scene reference image data d4 is generated. The viewing image reference data d5 may be directly generated from the scene reference raw data d2 based on the reproduction auxiliary data without generating the image once. When generating the viewing image reference data d5 from the scene reference raw data d2, various processing contents may be integrated in order to reduce the processing load.

[Fifth Embodiment]
<Configuration of Image Recording Apparatus 201>
Next, an image recording apparatus 201 according to the fifth embodiment of the present invention will be described with reference to FIGS.
FIG. 21 is a perspective view illustrating an overview configuration of the image recording apparatus 201. The image recording apparatus 201 includes an image recording unit that forms an image as an output device, and a CRT display monitor as a display device.

  As shown in FIG. 21, the image recording apparatus 201 includes a magazine loading unit 203 on one side of the main body 202. Inside the main body 202, an exposure processing unit 204 that exposes the silver salt photographic paper as an output medium and a print creation unit 205 that develops the exposed silver salt photographic paper, dries and creates a print are provided. The produced print is discharged to a tray 206 provided on the other side of the main body 202.

  In addition, a CRT (Cathode Ray Tube) 208 as a display device, a film scanner unit 209 that is a device for reading a transparent original, a reflective original input device 210, and an operation unit 211 are provided on the upper portion of the main body 202. The CRT 208 constitutes display means for displaying an image of image data to be printed on the screen. Further, the main body 202 includes an image reading unit 214 that can read image data recorded on various digital recording media, and an image writing unit 215 that can write (output) image signals to various digital recording media. . In addition, a control unit 207 that centrally controls each of these units is provided inside the main body 202.

  The image reading unit 214 includes a PC card adapter 214a and a floppy (registered trademark) disk adapter 214b, and a PC card 213a and a floppy disk 213b can be inserted therein. The PC card 213a has a memory in which a plurality of frame image data captured by a digital camera is recorded. For example, a plurality of frame image data captured by a digital camera is recorded on the floppy disk 213b. In addition, examples of the recording medium having frame image data include a multimedia card, a memory stick, and a CD-ROM.

  The image writing unit 215 includes a floppy disk adapter 215a, an MO adapter 215b, and an optical disk adapter 215c. The FD 216a, the MO 216b, and the optical disk 216c can be inserted into the image writing unit 215, respectively. You can write. Examples of the optical disk 216c include a CD-R and a DVD-R.

  In FIG. 21, the operation unit 211, the CRT 208, the film scanner unit 209, the reflective original input device 210, and the image reading unit 214 are integrally provided in the main body 202, but any one of these is provided. Two or more may be provided separately.

  In the image recording apparatus 201 shown in FIG. 21, there is illustrated an apparatus that creates a print by exposing to a photosensitive material and developing it. However, the print creation method is not limited to this. A method such as a photographic method, a thermal method, or a sublimation method may be used.

<Internal Configuration of Image Recording Apparatus 201>
FIG. 22 is a block diagram showing an internal configuration of the image recording apparatus 201. As shown in FIG. 22, the image recording apparatus 201 includes a control unit 207, an exposure processing unit 204, a print creation unit 205, a film scanner unit 209, a reflection original input device 210, an image reading unit 214, a communication means (input) 240, An image writing unit 215, a data storage unit 271, an operation unit 211, a CRT 208, and a communication unit (output) 241 are included.

  The control unit 207 is configured by a microcomputer, and the image recording apparatus 201 is cooperated with various control programs such as an image processing program stored in a storage unit (not shown) such as a ROM and a CPU (not shown). The operation of each part constituting the is controlled.

  The control unit 207 includes an image processing unit 270, and reads image data acquired by the film scanner unit 209 or the reflective original input device 210 from the image reading unit 214 based on an input signal (command information) from the operation unit 211. The received image data and image data input from the external device via the communication means (input) 240 are subjected to image processing to generate output image data, which are output to the exposure processing unit 204. Further, the image processing unit 270 performs a conversion process corresponding to the output form on the image processed image data, and outputs the converted image data. Output destinations of the image processing unit 270 include a CRT 208, an image writing unit 215, a communication unit (output) 241 and the like.

  The exposure processing unit 204 exposes an image on the photosensitive material and outputs the photosensitive material to the print creating unit 205. The print creating unit 205 develops and exposes the exposed photosensitive material to create prints P1, P2, and P3. The print P1 is a service size, high-definition size, panoramic size print, the print P2 is an A4 size print, and the print P3 is a business card size print.

  The film scanner unit 209 reads frame image data from a developed negative film N obtained by developing an image obtained by imaging with an analog camera. The reflection original input device 210 reads frame image data from the print P that has been developed by printing the frame image on photographic paper.

  An original read from the film scanner unit 209 or the reflective original input device 210 includes a photographic photosensitive material. Examples of the photographic photosensitive material include a color negative film, a color reversal film, a black and white negative film, and a black and white reversal film. Frame image data captured by an analog camera is recorded on the photographic material. It can be converted into digital image data by the film scanner of the film scanner unit 209 and used as frame image data. Further, when the photographic photosensitive material is a color paper which is a silver salt photographic paper, it can be converted into frame image data by the flatbed scanner of the reflective original input device 210.

  The image reading unit 214 reads frame image data recorded on the PC card 213 a and the floppy disk 213 b and transfers the frame image data to the control unit 207. The image reading unit 214 includes a PC card adapter 214a, a floppy disk adapter 214b, and the like as the image transfer means 230. The image reading unit 214 reads frame image data recorded on the PC card 213 a inserted into the PC card adapter 214 a and the floppy disk 213 b inserted into the floppy disk adapter 214 b and transfers the frame image data to the control unit 207. For example, a PC card reader or a PC card slot is used as the PC card adapter 214a.

  The communication means (input) 240 receives image data representing a captured image and a print command signal from another computer in the facility where the image recording apparatus 201 is installed, or a remote computer via the Internet or the like.

  The image writing unit 215 includes a floppy disk adapter 215a, an MO adapter 215b, and an optical disk adapter 215c as the image transport unit 231. The image writing unit 215 is inserted into the floppy disk 216a inserted into the floppy disk adapter 215a, the MO 216b inserted into the MO adapter 215b, and the optical disk adapter 215c according to the write signal input from the control unit 207. The generated image data is written on the optical disk 216c.

  The data storage unit 271 stores information such as image data and order information corresponding to the image data (information on how many prints are to be created from images of which frames, print size information, and the like) and sequentially stores them.

  The operation unit 211 includes information input means 212. The information input unit 212 is configured by a touch panel, for example, and outputs a press signal of the information input unit 212 to the control unit 207 as an input signal. The operation unit 211 may include a keyboard, a mouse, and the like. The CRT 208 displays image data and the like according to a display control signal input from the control unit 207.

  The communication means (output) 241 transfers the image data after the image processing and the accompanying order information to another computer in the facility where the image recording apparatus 201 is installed, or a remote computer via the Internet or the like. Send to.

<Configuration of Image Processing Unit 270>
FIG. 23 is a block diagram illustrating a functional configuration of the image processing unit 270 of the image recording apparatus 201. As shown in FIG. 23, the image processing unit 270 includes a film scan data processing unit 701, a reflection original scan data processing unit 702, an image data format decoding processing unit 703, an image adjustment processing unit 704, a CRT specific processing unit 705, a printer specific Processing unit (1) 706, printer-specific processing unit (2) 707, image data format creation processing unit 708, header information analysis unit 302, device characteristic correction processing unit 303a, processing condition table 303b, scene reference image data generation unit 304, The imaging information data processing unit 307 and the appreciation image reference data generation unit 308 are configured.

  The film scan data processing unit 701 performs a calibration operation specific to the film scanner unit 209, negative / positive reversal in the case of a negative document, dust flaw removal, gray balance adjustment, contrast adjustment, and granular noise on the image data input from the film scanner unit 209. Removal, sharpening, and the like are performed, and the result is output to the image adjustment processing unit 704. The film scan data processing unit 701 also includes information on film size, negative / positive type, ISO sensitivity optically or magnetically recorded on the film, manufacturer name, information on main subjects, and shooting conditions (for example, description information content of APS) ) And the like are also output to the image adjustment processing unit 704.

  The reflected original scan data processing unit 702 performs a calibration operation unique to the reflective original input device 210, negative / positive reversal in the case of a negative original, dust flaw removal, gray balance adjustment, and contrast adjustment for the image data input from the reflective original input device 210. , Noise removal, sharpening enhancement, and the like, and output to the image adjustment processing unit 704.

  The image data format decoding processing unit 703 performs compression code restoration, color data expression method conversion, and the like as necessary in accordance with the data format of the image data input from the image transfer unit 230 or the communication unit (input) 240. Then, the data is converted into a data format suitable for calculation in the image processing unit 270 and output to the image adjustment processing unit 704. In addition, the image data format decoding processing unit 703 receives the image data file (see FIGS. 15A to 15D) in the format by the image processing apparatus 122 shown in the second embodiment as the image transfer unit 230 or the communication unit. (Input) It is determined whether or not the image is input from 240, and the input image data is output to the header information analysis unit 302.

  Further, the information from the operation unit 211 is supplemented and supplemented with information on the main subject and information on the photographing conditions from the film scanner unit 209, the reflection original input device 210, the image transfer unit 230, and the communication unit (input) 240. Can also be sent to the image adjustment processing unit 704.

  The designation about the size of the output image is input from the operation unit 211. In addition, when the size of the output image acquired from the communication unit (input) 240 is specified, or the size of the output image embedded in the header information or tag information of the image data acquired by the image transfer unit 230. Is specified, the image data format decoding processing unit 703 detects the information and outputs it to the image adjustment processing unit 704.

  The header information analysis unit 302 analyzes the input image data and divides it into scene reference raw data d2, edited reproduction auxiliary data d6, and shooting information data d3. Then, the scene reference raw data d2 is sent to the scene reference image data generation unit 304, the imaging device characteristic correction data d1 of the edited reproduction auxiliary data d6 is sent to the device characteristic correction processing unit 303a, and the other edited reproduction auxiliary data d6 is viewed. The imaging information data d3 is output to the imaging information data processing unit 307 to the image reference data generation unit 308.

  When the imaging device characteristic correction data d1 is input from the header information analysis unit 302, the apparatus characteristic correction processing unit 303a determines a generation condition of the scene reference image data d4 by referring to the processing condition table 303b. The processing condition table 303b is a table that stores the processing conditions for generating the scene reference image data d4 in association with each characteristic of the imaging apparatus.

  The scene reference image data generation unit 304 performs an imaging device characteristic correction process on the scene reference raw data d2 input from the header information analysis unit 302 according to a generation condition determined by the device characteristic correction processing unit 303a. Scene reference image data d4 that does not depend on characteristics is generated and output to the appreciation image reference data generation unit 308 and the data storage unit 271.

  The shooting information data processing unit 307 determines a generation condition for generating the viewing image reference data d5 corresponding to the shooting condition based on the shooting information data d3 input from the header information analysis unit 302, and the viewing image reference data The data is output to the generation unit 308.

  The image adjustment processing unit 704, based on commands from the operation unit 211 and the control unit 207, sets image processing conditions for generating the viewing image reference data d5 adapted to the output destination device and the output medium, as viewing image reference data. Transfer to the generation unit 308.

  The appreciation image reference data generation unit 308 is based on the image processing conditions determined by the shooting information data processing unit 307, the image processing conditions based on the edited reproduction auxiliary data d6, and the image processing conditions transmitted from the image adjustment processing unit 704. The viewing image reference data d5 is generated from the scene reference image data d4.

  The image adjustment processing unit 704 operates on image data received from the film scanner unit 209, the reflective original input device 210, the image transfer unit 230, and the communication unit (input) 240 based on a command from the operation unit 211 or the control unit 207. The digital image data for output is generated by performing image processing so as to give an image that gives a favorable impression when observing the image on the output medium, and the CRT specific processing unit 705, the printer specific processing unit (1) 706, the printer The processed image signal is sent to the unique processing unit (2) 707, the image data format creation processing unit 708, and the data storage unit 271.

  The CRT specific processing unit 705 performs processing such as changing the number of pixels and color matching on the image data input from the image adjustment processing unit 704 as necessary, and combines the information with information that needs to be displayed, such as control information. Image data is output to the CRT 208.

  A printer-specific processing unit (1) 706 performs printer-specific calibration processing, color matching, pixel number change, and the like on the image data input from the image adjustment processing unit 704 as necessary. Output.

  When an external printer 251 such as a large-format ink jet printer is connected to the image recording apparatus 201, a printer specific processing unit (2) 707 is provided for each connected printer. The printer-specific processing unit (2) 707 performs appropriate printer-specific calibration processing, color matching, pixel number change, and the like on the image data input from the image adjustment processing unit 704.

  The image data format creation processing unit 708 converts the image data input from the image adjustment processing unit 704 into various general-purpose image formats represented by JPEG, TIFF, Exif, and the like as necessary. The data is output to the transport unit 231 and the communication means (output) 241.

  Note that the image data generated by the appreciation image reference data generation unit 308 is the CRT specific processing unit 705, the printer specific processing unit (1) 706, the printer specific processing unit (2) 707, and the image data format creation processing unit 708. The image data format creation processing unit 708 is optimal for CRT, exposure processing unit, external printer, communication means (output), etc., based on the format of the viewing image reference data d5. After attaching a status file indicating that the image data has been converted, the image data can be individually transmitted to the image transport unit 231 and stored.

  The above-described film scan data processing unit 701, reflection original scan data processing unit 702, image data format decoding processing unit 703, image adjustment processing unit 704, CRT specific processing unit 705, printer specific processing unit (1) 706, printer specific processing Section (2) 707 and image data format creation processing section 708 are sections provided to help understanding of the function of the image processing section 270, and are not necessarily realized as physically independent devices. For example, it may be realized as a type of software processing in a single CPU.

  The header information analysis unit 302, device characteristic correction processing unit 303a, shooting information data processing unit 307, scene reference image data generation unit 304, and appreciation image reference data generation unit 308 are classified into the functions of the present invention in the image processing unit 270. This section is provided to assist understanding of the above, and is not necessarily realized as a physically independent device. For example, it may be realized as a section of the type of software processing in a single CPU.

<Operation of Image Processing Unit 270>
FIG. 24 is a flowchart showing an image forming process executed by cooperation of the units of the image processing unit 270. Hereinafter, the operation of each unit of the image processing unit 270 will be described with reference to the drawings.

  Data is input to the image processing unit 270 from the image transfer unit 230 or the communication unit (input) 240 (step S111), and the input data is shown in FIGS. 15A to 15D by the image data format decoding processing unit 703. If it is determined that the file is a format image data file (step S112), the contents of the input digital image data file are analyzed by the header information analysis unit 302 (step S113), and the scene reference raw data d2 (step S114). The imaging device characteristic correction data d1 (step S115), the reproduction auxiliary data excluding the imaging device characteristic correction data d1 (step S116), and the photographing information data d3 (step S117).

  The imaging device characteristic correction data d1 is output to the device characteristic correction processing unit 303a, and processing conditions for generating the scene reference image data d4 are determined by referring to the processing condition table 303b by the device characteristic correction processing unit 303a. The raw scene reference data d2 is output to the scene reference image data generation unit 304 and subjected to an imaging device characteristic correction process based on the processing conditions determined by the device characteristic correction processing unit 303a (step S118). d4 is generated and output to the appreciation image data generation unit 308 (step S119).

  As shown in FIG. 25, the imaging apparatus characteristic correction processing includes filter interpolation calculation (a), matrix calculation (b), photoelectric conversion characteristic and gain correction (c) for scene reference raw data d2.

  The filter interpolation calculation shown in FIG. 25A is a process of interpolating from image data having a filter arrangement of one pixel and one color into linear image data of one pixel and three colors (RGB). Here, the filter array is an array pattern of color filters for color discrimination of CCD, and an RGB primary color Bayer array is generally used. As a filter interpolation method, a nearest neighbor method, a bi-linear interpolation method, a bi-cubic convolution method, or the like can be applied.

  In the nearest neighbor method, a pixel nearest to the target pixel is selected, the pixel is enlarged or reduced as it is according to the size of enlargement / reduction, and the pixel is interpolated only at a necessary portion. In the bilinear method, linear density interpolation is performed from the density values of four pixels around the target pixel according to the coordinates (real values). In the bicubic method, in order to perform interpolation with higher accuracy than in the bilinear method, interpolation is performed using a cubic function from the density values of 16 pixels around the pixel of interest. The equation used for interpolation is sin (πx) / πx, which is the most complete density interpolation equation in theory (sampling theorem). This is approximated by a third-order term of x by Taylor expansion and used as an interpolation formula.

  The matrix calculation shown in FIG. 25B is an arithmetic process for correcting a difference in which the same subject color is recorded as a different signal from the difference in spectral characteristics of the color filter and spectral sensitivity characteristics of the image sensor. Conversion from RGB to tristimulus values in the XYZ color system is performed by matrix calculation.

  FIG. 25C shows processing for correcting a difference associated with photoelectric conversion characteristics (linear conversion characteristics) and gain correction (parallel movement) of the image sensor. As shown in FIG. 25C, this process has a characteristic that logY (Y: stimulus value of XYZ color system) is linearly converted with respect to logE (E: exposure amount).

  By the imaging device characteristic correction process as shown in FIGS. 25A to 25C, the scene reference raw data d2 depending on the characteristics of the imaging device is changed to the XYZ values in the standardized color space such as the scene reference image data d4. Converted. Note that the color filter array pattern, matrix calculation matrix coefficients a to i, coefficient values for correcting differences associated with photoelectric conversion characteristics and gain correction, which are applied in the imaging apparatus characteristic correction processing, are all different for each imaging apparatus. is there.

The shooting information data d3 is output to the shooting information data processing unit 307, and the shooting information data processing unit 307 determines processing conditions for generating appreciation image reference data d5 corresponding to shooting conditions based on the shooting information data d3. The Further, based on commands from the operation unit 211 and the control unit 207, the image adjustment processing unit 704 determines an image processing condition for generating appreciation image reference data d5 adapted to the output device and the output medium. The scene reference image data d4 input from the scene reference image data generation unit 304 is an image based on the image processing conditions determined by the shooting information data processing unit 307 and the edited reproduction auxiliary data d6 by the viewing image reference data generation unit 308. Optimization processing is performed based on the processing conditions and the image processing conditions determined by the image adjustment processing unit 704 (step S120), and appreciation image reference data d5 is generated (step S121). The viewing image reference data d5 is sent to any one of the CRT specific processing unit 705, the printer specific processing unit (1) 706, the printer specific processing unit (2) 707, and the image data format creation processing unit 708 according to the output destination. Is output. The appreciation image reference data d5 is subjected to processing specific to the output destination in the output processing unit (step S122), and is output from the output destination specified by the operation unit 211 (step S123).
This completes the image forming process.

  As described above, according to the image recording apparatus 201, the scene reference raw data d2 to which the edited reproduction auxiliary data d6 and the shooting information data d3 are attached is acquired and viewed without loss of information of the captured image information. Generate image reference data d5 and use it on output devices such as CRT, liquid crystal display, plasma display and other display devices, and hard copy image generation paper such as silver salt photographic paper, inkjet paper, thermal printer paper, etc. Accordingly, an optimal viewing image can be formed.

  In the fifth embodiment, the case where the same process as the image optimization process C shown in the fourth embodiment is performed has been described as an example, but the reproduction assistance shown in the first embodiment is described. Data editing processing A, reproduction auxiliary data editing processing B shown in the second embodiment, and image optimization processing A or image optimization processing B shown in the third embodiment may be executed.

3 is a block diagram illustrating a functional configuration of the imaging device 21. FIG. 5 is a flowchart illustrating scene reference raw data storage processing A executed by the control unit 11 of the imaging device 21. It is a figure which shows the data structure of the digital image data recorded on the recording medium of the memory | storage device 9 by step S6. FIG. 2 is a block diagram illustrating a functional configuration of the imaging device 22. 10 is a flowchart illustrating scene reference raw data storage processing B executed by the control unit 11 of the imaging device 22. It is a figure which shows the data structure of the digital image data recorded on the recording medium of the storage device 9 by step S17. It is a block diagram which shows the functional structure of the image processing apparatus 121 in the 1st Embodiment of this invention. It is a figure for demonstrating the structure of reproduction auxiliary data. It is a figure for demonstrating the structure of reproduction auxiliary data. It is a figure for demonstrating the structure of reproduction auxiliary data. FIG. 10 is a flowchart showing auxiliary reproduction data editing processing A executed by the image processing apparatus 121. It is a figure which shows the data structure of the image data file produced | generated by step S31. It is a block diagram which shows the functional structure of the image processing apparatus 122 in 2nd Embodiment. FIG. 10 is a flowchart showing auxiliary reproduction data editing processing B executed by the image processing apparatus 122. It is a figure which shows the data structure of the image data file produced | generated by step S51. It is a block diagram which shows the functional structure of the image processing apparatus 151 in 3rd Embodiment. It is a flowchart which shows the image optimization process A performed by the image processing apparatus 151. FIG. It is a flowchart which shows the image optimization process B performed by the image processing apparatus 151. FIG. It is a block diagram which shows the functional structure of the image processing apparatus 152 in 4th Embodiment. It is a flowchart which shows the image optimization process C performed by the image processing apparatus 152. FIG. It is a perspective view which shows the general-view structure of the image recording device 201 in 5th Embodiment. 2 is a block diagram showing an internal configuration of an image recording apparatus 201. FIG. 3 is a block diagram illustrating a functional configuration of an image processing unit 270 of the image recording apparatus 201. FIG. FIG. 10 is a flowchart showing image forming processing executed by an image processing unit 270. It is a figure for demonstrating the content of an imaging device characteristic correction process.

Explanation of symbols

1 Lens 2 Aperture 3 CCD
4 Analog processing circuit 5 A / D converter 6 Temporary storage memory 7 Image processing unit 8 Header information processing unit 9 Storage device 10 CCD drive circuit 11 Control unit 12 Shooting information data processing unit 13 Device characteristic correction information processing unit 14 Operation unit 15 Display unit 16 Strobe drive circuit 17 Strobe 18 Focal length adjustment circuit 19 Automatic focus drive circuit 20 Motor 21 Imaging device 22 Imaging device 101 Input unit 102 Header information analysis unit 103a Device characteristic correction processing unit 103b Processing condition table 104 Scene reference image data generation Unit 105 temporary storage memory 106 header information editing unit 107 photographing information data processing unit 108 appreciation image reference data generation unit 109 temporary storage memory 110 setting input unit 111 storage device 112 output device 113 display device 114 imaging device characteristic correction processing unit 11 5 Optimization processing unit 116 Temporary storage memory 121 Image processing device 122 Image processing device 131 Input unit 132 Header information analysis unit 133a Device characteristic correction processing unit 133b Processing condition table 134 Scene reference image data generation unit 135 Temporary storage memory 137 Shooting information data Processing unit 138 Appreciation image reference data generation unit 139 Temporary storage memory 140 Setting input unit 141 Storage device 142 Output device 143 Display device 144 Imaging device characteristic correction processing unit 145 Optimization processing unit 146 Header information selection unit 147 Temporary storage memory 148a Processing conditions Acquisition unit 148b Processing condition table 151 Image processing device 152 Image processing device 201 Image recording device 202 Main body 203 Magazine loading unit 204 Exposure processing unit 205 Print creation unit 206 Tray 207 Control unit 208 CRT
209 Film scanner unit 210 Reflected document input device 211 Operation unit 212 Information input unit 214 Image reading unit 215 Image writing unit 230 Image transfer unit 231 Image transport unit 240 Communication unit (input)
241 Communication means (output)
251 External Printer 270 Image Processing Unit 701 Film Scan Data Processing Unit 702 Reflected Original Scan Data Processing Unit 703 Image Data Format Decoding Processing Unit 704 Image Adjustment Processing Unit 705 CRT Specific Processing Unit 706 Printer Specific Processing Unit (1)
707 Printer-specific processing unit (2)
708 Image data format creation processing unit 302 Header information analysis unit 303a Device characteristic correction processing unit 303b Processing condition table 304 Scene reference image data generation unit 307 Shooting information data processing unit 308 Appreciation image reference data generation unit 271 Data storage unit d1 Imaging device characteristics Correction data d2 scene reference raw data d3 shooting information data d4 scene reference image data d5 appreciation image reference data d6 edited reproduction auxiliary data

Claims (37)

Data acquisition means for acquiring scene reference raw data depending on the imaging device characteristics of the imaging device, and reproduction auxiliary data attached to the scene reference raw data;
Scene reference image data generating means for generating scene reference image data by performing processing for correcting device characteristics specific to the imaging device on the scene reference raw data based on the reproduction auxiliary data;
Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the use of the appreciation image formed on the output medium using the scene reference image data Data editing means,
Recording means for recording the edited reproduction auxiliary data attached to the scene reference image data;
An image processing apparatus comprising: The image processing apparatus according to claim 1.
An image processing apparatus comprising: appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data. Data acquisition means for acquiring scene reference raw data depending on imaging device characteristics of the imaging device, and reproduction auxiliary data attached to the scene reference raw data;
Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the application of the appreciation image formed on the output medium using the scene reference raw data Data editing means,
Recording means for recording the edited reproduction auxiliary data attached to the scene reference raw data;
An image processing apparatus comprising: The image processing apparatus according to claim 3.
An image processing apparatus comprising appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference raw data. In the image processing device according to any one of claims 1 to 4,
The reproduction auxiliary data editing means generates a plurality of information for some or all of the elements constituting the reproduction auxiliary data according to a plurality of uses of the appreciation image. Scene reference image data subjected to processing for correcting device characteristics unique to the imaging device based on reproduction auxiliary data attached to the scene reference raw data for scene reference raw data depending on the imaging device characteristics of the imaging device; And data acquisition means for acquiring edited reproduction auxiliary data edited according to the use of the appreciation image formed on the output medium using the scene reference image data;
Appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data based on the edited reproduction auxiliary data;
An image processing apparatus comprising: Data that acquires scene reference raw data that depends on the imaging device characteristics of the imaging device, and edited reproduction auxiliary data that is edited according to the application of the viewing image formed on the output medium using the scene reference raw data Acquisition means;
Appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference raw data based on the edited reproduction auxiliary data;
An image processing apparatus comprising: The image processing apparatus according to claim 7.
The appreciation image reference data generation means generates scene reference image data by performing a process for correcting device characteristics specific to the imaging device on the scene reference raw data based on the edited reproduction auxiliary data, and generates the edited scene reference image data. An image processing apparatus that generates image for viewing appreciation by performing image processing for forming the optimum viewing image on the generated scene reference image data based on reproduction auxiliary data. In the image processing device according to any one of claims 6 to 8,
Selection means for selecting data to be used when performing image processing for forming the optimum appreciation image for some or all of the elements constituting the edited reproduction auxiliary data in accordance with the use of the appreciation image An image processing apparatus comprising: Data acquisition means for acquiring scene reference raw data depending on the imaging device characteristics of the imaging device, reproduction auxiliary data attached to the scene reference raw data, and shooting information data which is shooting condition settings at the time of shooting;
Scene reference image data generating means for generating scene reference image data by performing processing for correcting device characteristics specific to the imaging device on the scene reference raw data based on the reproduction auxiliary data;
Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the use of the appreciation image formed on the output medium using the scene reference image data Data editing means,
Recording means for recording the edited reproduction auxiliary data and shooting information data attached to the scene reference image data,
An image processing apparatus comprising: The image processing apparatus according to claim 10.
An image processing apparatus comprising: appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data. Data acquisition means for acquiring scene reference raw data depending on imaging device characteristics of the imaging device, reproduction auxiliary data attached to the scene reference raw data, and shooting information data which is shooting condition settings at the time of shooting;
Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the application of the appreciation image formed on the output medium using the scene reference raw data Data editing means,
Recording means for recording the edited reproduction auxiliary data and shooting information data attached to the scene reference raw data,
An image processing apparatus comprising: The image processing apparatus according to claim 12.
An image processing apparatus comprising appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference raw data. In the image processing device according to any one of claims 10 to 13,
The reproduction auxiliary data editing means generates a plurality of information for some or all of the elements constituting the reproduction auxiliary data according to a plurality of uses of the appreciation image. Scene reference image data subjected to processing for correcting device characteristics unique to the imaging device based on reproduction auxiliary data attached to the scene reference raw data for scene reference raw data depending on the imaging device characteristics of the imaging device; Data acquisition means for acquiring edited reproduction auxiliary data edited according to the use of the appreciation image formed on the output medium using the scene reference image data, and shooting information data which is shooting condition setting at the time of shooting When,
Appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data based on the edited reproduction auxiliary data and shooting information data;
An image processing apparatus comprising: Scene reference raw data depending on the image pickup device characteristics of the image pickup device, edited reproduction auxiliary data edited according to the use of an appreciation image formed on the output medium using the scene reference raw data, and at the time of shooting Data acquisition means for acquiring shooting information data as shooting condition settings;
Appreciation image reference data generating means for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference raw data based on the edited reproduction auxiliary data and shooting information data;
An image processing apparatus comprising: The image processing apparatus according to claim 16.
The appreciation image reference data generation means generates scene reference image data by performing a process for correcting device characteristics specific to the imaging device on the scene reference raw data based on the edited reproduction auxiliary data, and generates the edited scene reference image data. Image processing characterized in that the appreciation image reference data is generated by subjecting the generated scene reference image data to image processing for forming the optimal appreciation image based on reproduction auxiliary data and photographing information data. apparatus. In the image processing device according to any one of claims 15 to 17,
Selection means for selecting data to be used when performing image processing for forming the optimum appreciation image for some or all of the elements constituting the edited reproduction auxiliary data in accordance with the use of the appreciation image An image processing apparatus comprising: The image processing apparatus according to any one of claims 1 to 18,
Image forming means for forming an appreciation image on an output medium;
An image recording apparatus comprising: A data acquisition process for acquiring scene reference raw data depending on imaging device characteristics of the imaging device, and reproduction auxiliary data attached to the scene reference raw data;
A scene reference image data generation step for generating scene reference image data by performing processing for correcting device characteristics unique to the imaging device on the scene reference raw data based on the reproduction auxiliary data;
Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the use of the appreciation image formed on the output medium using the scene reference image data Data editing process,
A recording step of recording the edited reproduction auxiliary data attached to the scene reference image data;
An image processing method comprising: The image processing method according to claim 20, wherein
An image processing method comprising: an appreciation image reference data generating step of generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data. A data acquisition step of acquiring scene reference raw data depending on the imaging device characteristics of the imaging device, and reproduction auxiliary data attached to the scene reference raw data;
Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the application of the appreciation image formed on the output medium using the scene reference raw data Data editing process,
A recording step of recording the edited reproduction auxiliary data attached to the scene reference raw data;
An image processing method comprising: The image processing method according to claim 22, wherein
An image processing method comprising: an appreciation image reference data generating step of generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference raw data. The image processing method according to any one of claims 20 to 23,
In the reproduction auxiliary data editing step, a plurality of pieces of information are generated for some or all of the elements constituting the reproduction auxiliary data according to a plurality of uses of the appreciation image. Scene reference image data subjected to processing for correcting device characteristics unique to the imaging device based on reproduction auxiliary data attached to the scene reference raw data for scene reference raw data depending on the imaging device characteristics of the imaging device; And a data acquisition step of acquiring edited reproduction auxiliary data edited according to the use of the appreciation image formed on the output medium using the scene reference image data;
An appreciation image reference data generating step for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data based on the edited reproduction auxiliary data;
An image processing method comprising: Data that acquires scene reference raw data that depends on the imaging device characteristics of the imaging device, and edited reproduction auxiliary data that is edited according to the application of the viewing image formed on the output medium using the scene reference raw data Acquisition process;
An appreciation image reference data generating step for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference raw data based on the edited reproduction auxiliary data;
An image processing method comprising: The image processing method according to claim 26.
In the appreciation image reference data generation step, based on the edited reproduction auxiliary data, the scene reference raw data is subjected to processing for correcting device characteristics unique to the imaging device to generate scene reference image data, and the edited image reference data An image processing method characterized in that the appreciation image reference data is generated by subjecting the generated scene reference image data to image processing for forming the optimal appreciation image based on auxiliary reproduction data. The image processing method according to any one of claims 25 to 27,
A selection step of selecting data to be used when performing image processing for forming the optimum appreciation image for some or all of the elements constituting the edited reproduction auxiliary data according to the use of the appreciation image. An image processing method comprising: A data acquisition step of acquiring scene reference raw data depending on imaging device characteristics of the imaging device, reproduction auxiliary data attached to the scene reference raw data, and shooting information data that is shooting condition settings at the time of shooting,
A scene reference image data generation step for generating scene reference image data by performing processing for correcting device characteristics unique to the imaging device on the scene reference raw data based on the reproduction auxiliary data;
Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the use of the appreciation image formed on the output medium using the scene reference image data Data editing process,
A recording step of recording the edited reproduction auxiliary data and shooting information data attached to the scene reference image data;
An image processing method comprising: 30. The image processing method according to claim 29, wherein:
An image processing method comprising: an appreciation image reference data generating step of generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data. A data acquisition step of acquiring scene reference raw data depending on the imaging device characteristics of the imaging device, reproduction auxiliary data attached to the scene reference raw data, and shooting information data which is shooting condition settings at the time of shooting,
Reproduction assistance for editing edited reproduction auxiliary data by editing part or all of the elements constituting the reproduction auxiliary data according to the application of the appreciation image formed on the output medium using the scene reference raw data Data editing process,
A recording step of recording the edited reproduction auxiliary data and shooting information data attached to the scene reference raw data;
An image processing method comprising: The image processing method according to claim 31, wherein
An image processing method comprising: an appreciation image reference data generating step of generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference raw data. The image processing method according to any one of claims 29 to 32,
In the reproduction auxiliary data editing step, a plurality of pieces of information are generated for some or all of the elements constituting the reproduction auxiliary data according to a plurality of uses of the appreciation image. Scene reference image data subjected to processing for correcting device characteristics unique to the imaging device based on reproduction auxiliary data attached to the scene reference raw data for scene reference raw data depending on the imaging device characteristics of the imaging device; A data acquisition step of acquiring edited reproduction auxiliary data edited according to the use of an appreciation image formed on the output medium using the scene reference image data, and shooting information data which is shooting condition setting at the time of shooting. When,
An appreciation image reference data generating step for generating appreciation image reference data by performing image processing for forming an optimal appreciation image for the scene reference image data based on the edited reproduction auxiliary data and shooting information data;
An image processing method comprising: Scene reference raw data depending on the image pickup device characteristics of the image pickup device, edited reproduction auxiliary data edited according to the use of an appreciation image formed on the output medium using the scene reference raw data, and at the time of shooting A data acquisition process for acquiring shooting information data as shooting condition settings;
An appreciation image reference data generation step of generating appreciation image reference data by performing image processing for forming an optimal appreciation image on the scene reference raw data based on the edited reproduction auxiliary data and shooting information data;
An image processing method comprising: The image processing method according to claim 35, wherein
In the appreciation image reference data generation step, based on the edited reproduction auxiliary data, the scene reference raw data is subjected to processing for correcting device characteristics unique to the imaging device to generate scene reference image data, and the edited image reference data Image processing characterized in that the appreciation image reference data is generated by subjecting the generated scene reference image data to image processing for forming the optimal appreciation image based on reproduction auxiliary data and photographing information data. Method. The image processing method according to any one of claims 34 to 36,
A selection step of selecting data to be used when performing image processing for forming the optimum appreciation image for some or all of the elements constituting the edited reproduction auxiliary data according to the use of the appreciation image. An image processing method comprising:

Images