JP5040628B2 - Imaging apparatus, printing system, imaging apparatus control program, and imaging apparatus control method - Google Patents

Description

  The present invention relates to an imaging apparatus, a printing system, and an imaging apparatus control program and an imaging apparatus control method used for the imaging apparatus.

2. Description of the Related Art Conventionally, there has been known an imaging device that can be connected to a printer by USB or the like, and can output captured image data to a printer for printing and reproduction (see, for example, Patent Document 1).
JP 2002-190982 A

  However, the color of the image to be printed and reproduced is determined by the printer, printing paper, printing ink, etc. at the time of printing. Therefore, if the image is simply captured and printed and reproduced based on the captured image data, an image close to the color desired by the user cannot be reproduced.

  The present invention has been made in view of such conventional problems, and provides an imaging apparatus, a printing system, an imaging apparatus control program, and an imaging apparatus control method capable of reproducing an image close to a color desired by a user. Objective.

In order to solve the above-described problem, in the imaging apparatus according to the first aspect of the present invention, the filter means for changing the transmission wavelength band of the subject light according to the input drive signal, and the drive signal to the filter means , A spectral control means for changing the transmission wavelength band in a plurality of stages, an imaging means arranged behind the filter means for imaging each time the filter means changes the transmission wavelength band, and the imaging means Correction means for correcting at least one spectral image data in the spectral image data for each transmission wavelength band imaged by the correction data based on the correction data of the corresponding wavelength band in a predetermined correction element, and the spectral corrected by the correction means and output means for outputting to the outside the spectral image data of each of the transmission wavelength band including the image data as playback image data, said predetermined accessory The element is an illumination light source at the time of imaging by the imaging unit, and the correction unit is at least one spectral image in the spectral image data for each transmission wavelength band when the same subject imaged by the imaging unit is in the sun. and data based on at least one of the spectral image data in the spectral image data of each of the transmission wavelength band when it is in the shade, to estimate the illumination source at the time of shooting, the Rukoto comprises means for setting the correction data Features.

Further, in the imaging apparatus according to the invention of claim 2, wherein the predetermined correction elements, the illumination light source at the time of reproduction for reproducing an image based on prior Symbol reproduced image data, the image based on the image data for replay It is characterized in that it includes at least one of a multi-color printer, a printing ink, a printing paper, and a film virtually used at the time of imaging by the imaging means.

  The image pickup apparatus according to a third aspect of the present invention further includes storage means for storing the reproduction image data, and the output means outputs the reproduction image data stored in the storage means. It is characterized by doing.

  In the imaging device according to the fourth aspect of the present invention, a synthesizing unit that synthesizes spectral image data for each transmission wavelength band, a synthesized image data obtained by the synthesizing unit, and a transmission wavelength band. Storage means for storing spectral image data in association with each other, and the output means is either one of the composite image data stored in the storage means and the spectral image data for each transmission wavelength band. Is output as image data for reproduction.

  In the imaging device according to the fifth aspect of the present invention, when the predetermined correction element is the multicolor printer, it is determined whether or not the printer is capable of printing based on the spectral image data. Determining means for determining, and when the output means is capable of printing based on the spectral image data based on the determination result of the determining means, the spectral image data for each transmission wavelength band is reproduced as image data for reproduction. If it is impossible, the composite image data is output as reproduction image data.

  In the image pickup apparatus according to claim 6, when the predetermined correction element is the multicolor printer, the output unit prints the reproduction image data directly by the printer. It is characterized by being converted into data that can be used for output.

  In the image pickup apparatus according to the seventh aspect of the invention, when the predetermined correction element is the multicolor printer, the correction means is provided for the multicolor printer output from the multicolor printer. Receiving means for receiving the spectral characteristic correction data is provided, and the spectral characteristic correction data received by the receiving means is used as the correction data.

Further, in the imaging apparatus according to the invention of claim 8, before Symbol correcting means obtains a spectral radiance data of the illumination light source at the time of imaging of the spectral radiance data and the imaging means of the standard light source acquired And the spectral image data for each transmission wavelength band imaged by the imaging means based on the spectral radiance data of the standard light source and the spectral radiance data of the illumination light source acquired by the acquisition means. It is characterized in that it is converted into spectral image data assumed to be imaged with a light source.

Further, in the imaging apparatus according to the invention of claim 9 wherein, prior SL correction means, based on the spectral reflectance characteristic imaged is known subject by the imaging unit, the spectral emissivity of the illumination light during image capture An acquisition means for acquiring characteristics is provided, and a spectral emissivity characteristic of illumination light acquired by the acquisition means at the time of imaging is used as the correction data.

In the case in the imaging device according to the invention of claim 1 0, wherein the predetermined correction element is a type of virtual been films used during imaging of the imaging means, said correcting means, said film The spectral sensitivity characteristic is used as the correction data.

Further, in the imaging apparatus according to the invention of claim 1 1, wherein the film that is virtual using it, characterized infrared film, ultraviolet films, the black and white film, which is either a general visible light color film And

Further, in the imaging apparatus according to the invention of claim 1 wherein a plurality of display means for displaying the type names of the film, selection means for selecting one from the class names on the film on the display unit And the correction means uses the spectral sensitivity characteristic corresponding to the type name of the film selected by the selection means as the correction data.

Further, in the imaging apparatus according to the invention of claim 1 3, wherein a display means for displaying the characteristics of a plurality of films, and selection means for selecting any of the characteristics of the displayed film on the display unit And the correction means uses the spectral sensitivity characteristic corresponding to the characteristic of the film selected by the selection means as the correction data.

Further, in the printing system according to the invention of claim 1 4, wherein a printing system consisting of an imaging device and the multi-color printer, the image pickup apparatus in response to a drive signal input, the object light Filter means for changing the transmission wavelength band, a spectral control means for inputting a drive signal to the filter means and changing the transmission wavelength band in a plurality of stages, and a filter means disposed behind the filter means, the filter means transmitting An image pickup means for picking up an image every time the wavelength band is changed, and an output means for outputting spectral image data for each transmission wavelength band picked up by the image pickup means and color profile information relating to the spectral image data to the printer, A printer receiving means for receiving spectral image data and color profile information for each transmission wavelength band output by the output means; , Correction means for correcting at least one spectral image data in the spectral image data for each transmission wavelength band received by the receiving means based on the received color profile information, and the spectral image data corrected by the correcting means Output means for printing out spectral image data for each transmission wavelength band including reproduction image data as reproduction image data, and the color profile information includes correction data of a corresponding wavelength band in the illumination light source at the time of imaging by the imaging means The correction means includes at least one spectral image data in the spectral image data for each transmission wavelength band when the same subject imaged by the imaging means is in the sun, and the shadow image in the shade Based on at least one spectral image data in the spectral image data for each transmission wavelength band It estimates the illumination source at the time of shooting, characterized in that it comprises means for setting the correction data.

Further, in the imaging apparatus control program according to the invention of claim 1 5 wherein, in response to a drive signal input, input filter means for changing the transmission wavelength band of the subject light, a drive signal to the filter means Then, the imaging apparatus includes: a spectral control unit that changes the transmission wavelength band in a plurality of stages; and an imaging unit that is disposed behind the filter unit and captures an image every time the filter unit changes the transmission wavelength band. Correction means for correcting at least one spectral image data in spectral image data for each transmission wavelength band imaged by the imaging means based on correction data of a corresponding wavelength band in a predetermined correction element; and the correction means The spectral image data for each of the transmission wavelength bands, the spectral image data of which is corrected by the An imaging device control program that functions as an output unit , wherein the predetermined correction element is an illumination light source at the time of imaging by the imaging unit, and the correction unit sets the same subject imaged by the imaging unit in the sun. Illumination at the time of photographing based on at least one spectral image data in the spectral image data for each transmission wavelength band in a certain case and at least one spectral image data in the spectral image data for each transmission wavelength band in the shade It includes means for estimating a light source and setting the correction data .

Further, in the imaging apparatus control method according to the invention of claim 1 6, wherein, in response to a drive signal input, input filter means for changing the transmission wavelength band of the subject light, a drive signal to the filter means Then, control of an imaging apparatus comprising: a spectral control unit that changes the transmission wavelength band in a plurality of stages; and an imaging unit that is arranged behind the filter unit and captures an image every time the filter unit changes the transmission wavelength band. A correction step of correcting at least one spectral image data in spectral image data for each transmission wavelength band imaged by the imaging unit based on correction data of a corresponding wavelength band in a predetermined correction element; Spectral image data for each transmission wavelength band in which the spectral image data is corrected in the correction step is output to the outside as reproduction image data. Look including an output step, the predetermined correction element is a lighting source during imaging of the imaging unit, wherein the correction step, the transmission wavelength band in the case of the same subject captured by the imaging means is in Hinata Based on at least one spectroscopic image data in each spectroscopic image data and at least one spectroscopic image data in the spectroscopic image data for each transmission wavelength band in the shade, estimating an illumination light source at the time of photographing, the step of setting the correction data and said free Mukoto.

  According to the present invention, it is possible to reproduce an image close to the color desired by the user.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a circuit configuration of a digital camera (spectral camera) 1 according to an embodiment of the present invention. As shown in the figure, the digital camera 1 has a control circuit 2. The control circuit 2 includes a CPU 3, an interface 5, an audio input / output circuit 6, an input circuit 7, a memory card / IF 8, a USB controller 9, an input / output interface 10, an input / output connected to the CPU 3 via a data bus 4. A circuit 11, input / output ports 12 and 13, and an HDD / IF 14 are provided. A microphone 16 is connected to the audio input / output circuit 6 via an amplifier 17 and an A / D converter 18, and a speaker 19 is connected via an amplifier 20 and a D / A converter 21. An operation input unit 22 provided with various operation keys, switches and the like is connected to the input circuit 7, and an image memory medium 25 provided detachably is connected to the memory card / IF 8. The USB controller 9 is connected to a USB terminal 26, and the input / output interface 10 is connected to a wireless LAN transmission / reception unit 28 having an antenna 27 via a communication controller 29. Further, an external trigger terminal 30 is connected to the input / output circuit 11 via a trigger detection unit 31.

  Note that a printer can be connected to the USB terminal 26, and thus the control circuit 2 can communicate with the printer connected to the USB terminal 26 via the USB controller 9.

  A spectral filter drive unit 32, a temperature detection circuit 33, a focus lens drive unit 34, a zoom drive unit 35, a shake correction drive unit 36, an aperture drive unit 37, and a shutter drive unit 38 are connected to the input / output port 12. In addition, a strobe 39 is connected via a strobe drive circuit 40, and an LED 41 is connected via an LED drive circuit 42. That is, the LED 41 is also for generating auxiliary light during AF or photographing, like the strobe 39. The LED 41 can be driven to change the emission color, emission wavelength, and emission wavelength band of the LED 41.

  The temperature detection circuit 33 detects the temperature near the spectral filter 59. In the input / output port 13, an angular velocity sensor (Y / Pitch) 43 for detecting the vertical blur of the digital camera 1 and an angular velocity sensor (X / Yaw) for detecting the vertical blur are respectively detected by the detection circuits 44. , 46 are connected. An HDD storage device 47 is connected to the HDD / IF 14. The HDD storage device 47 includes a disk medium 48, and also includes a motor 49, a motor driver 50, a microcomputer unit 51, a VC motor 52, a head amplifier 53, a read / write channel + CODEC 54, an HDD control unit 55, and the like.

  A battery 56 is connected to the control circuit 2 via a power supply control unit 57, and the power supply control unit 57 is controlled by the control circuit 2 to supply power from the battery 56 to each unit. Further, an audio CODEC (encoder / decoder) 15, a program memory 23 and a data memory 24 are connected to the data bus 4. The audio CODEC 15 encodes an audio signal and decodes audio data. The program memory 23 stores a program for operating the control circuit 2 shown in the flowchart described later. The data memory 24 stores various data in advance and stores other data other than image data.

  On the other hand, the imaging optical system 58 includes a lens group driven by the focus lens driving unit 34, the zoom driving unit 35, and the blur correction driving unit 36, and a spectral filter 59 is disposed on the front optical axis. The image sensor 60 is disposed on the rear optical axis.

  By the way, a CMOS image sensor capable of shooting at a high resolution and a high frame rate, such as 60 frames / second with a resolution of 6 million pixels and 300 frames / second or more with a low resolution of VGA, has been developed and put into practical use. Has reached the point. In the present embodiment, this image sensor is used as the image sensor 60 on the premise of the existence of such an image sensor that has already been developed and put into practical use and is capable of photographing at a high resolution and a high frame rate. In addition, in the imaging optical system 58, a diaphragm 61 driven by the diaphragm driving unit 37 and a shutter 62 driven by the shutter driving unit 38 are interposed.

  The image pickup device 60 is capable of high-speed reading for performing shooting at the high frame rate such as parallel reading, but unlike a general image pickup device, an RGB color filter having a Bayer arrangement for each pixel or the like. Is not provided. The image sensor 60 includes an image sensor unit 63, a horizontal scanning unit 64, a vertical scanning unit 65, and a P / S conversion unit 66. The horizontal scanning unit 64 includes a signal reading unit, a signal processing unit, and a CDS (correlated double sampling circuit) / ADC (A / D converter). A DSP unit 67 is connected to the image sensor 60. The DSP unit 67 includes an S / P conversion unit 68 for processing the image signal captured from the P / S conversion unit 66 of the image sensor 60, a preprocessing unit 69, a buffer memory (A) 70, and a signal processing unit for each band. 71, a multi-plane addition circuit 72, an RGB conversion unit 73, a gradation conversion gamma correction unit 74, a color matrix circuit 75, and a resolution conversion unit 76, and a controller 77 for controlling the period of the vertical scanning unit 65. In addition, an image feature extraction processing / image recognition processing unit 78 and a photometric processing / focus detection / spectral characteristic extraction / correction unit 79 are provided.

The resolution conversion unit 76, the image feature extraction processing / image recognition processing unit 78, the photometric processing / focus detection / spectral characteristic extraction / correction unit 79 are connected to a buffer memory (B) 81, an image CODEC (image CODEC) via an image data bus 80. The encoder / decoder 82, the moving image CODEC (encoder / decoder) 83, and the display driving circuit 84 are connected. The image data bus 80 is connected to the interface 5 of the control circuit 2. The buffer memory (B) 81 temporarily stores image data when the image CODEC 82 and the moving image CODEC 83 are encoded and decoded, and the display driving circuit 84 drives a display unit 85 including an LCD.
The spectral filter 59 is a filter having transmission wavelength characteristics in a narrow band in the near ultraviolet to visible light region to near infrared light region. Examples of the filter having the narrow-band transmission wavelength characteristic include a riot filter and a Fabry-Perot interference filter described later. Also, an electronically controllable filter such as LCTF (liquid crystal tunable filter) or LCFP (liquid crystal Fabry-Perot) etalon can be used.

  (First embodiment)

  FIG. 5 is an explanatory diagram showing an outline of the first embodiment of the present invention. In this embodiment, the printer 100 is connected to the digital camera 1 through the USB terminal 26, and spectral characteristic correction data (printer spectral correction data (ink, paper, etc.)) is received from the printer 100 in the shooting mode set by the user. The received image data is corrected and recorded based on the received spectral characteristic correction data of the printer system, and the recorded image is output to the printer later.

  Therefore, the data memory 24 stores the printer spectral correction data (ink, paper, etc.) received from the printer 100 shown in FIG. 5, and the spectral correction data of the illumination light source shown in FIG. The spectral correction data is stored.

  FIG. 2 and FIG. 3 are a series of flowcharts showing the procedure of the imaging control in the first embodiment of the present invention. More specifically, this embodiment takes a spectral image of a selected wavelength band for each wavelength band, and transmits optical system transmittance characteristics, imaging device sensitivity accuracy, illumination light source emissivity characteristics, printing ink / paper spectroscopy. Spectral image data or general image data corrected by the characteristics is output.

  The control circuit 2 executes processing as shown in this flowchart based on the program stored in the program memory 23. First, a shooting mode is selected and a shooting condition and the like are selected in accordance with an operation performed by the user on the operation input unit 22 (step S101). Next, it is determined whether or not the selected photographing mode is the spectral photographing mode (step S102). If the selected photographing mode is not the spectral photographing mode, the process proceeds to other mode processing (step S103).

  In the case of the spectral imaging mode, the through image wavelength band and the imaging wavelength band are respectively selected in accordance with the operation of the operation input unit 22 by the user (step S104). In this step S104, the wavelength band of the through video is the wavelength band of the through image displayed on the display unit 85, and the imaging wavelength band is the wavelength band for shooting and recording. This imaging wavelength band is the entire wavelength band that is spectrally separated by the spectral filter 59 unless otherwise specifically set. In the following description, the entire wavelength band is selected as the imaging wavelength band. To do.

  Next, an illumination profile at the time of reproduction and a printer profile are selected according to the operation of the operation input unit 22 by the user (step S105). That is, the data memory 24 stores the illumination profile and printer profile data at the time of reproduction for each illumination type and printer type. Then, according to the user's operation, an illumination profile corresponding to the illumination type when the printer reproduces the image after shooting and a printer profile corresponding to the printer type are selected or set.

  Subsequently, spectral through image display processing and spectral characteristic data acquisition processing are executed (step S106). In the spectral image display process in step S106, among the spectral image data for each wavelength band obtained by operating the spectral filter 59, spectral image data in the through video wavelength band set in step S104 is acquired. Then, a through image is displayed on the display unit 85 based on the acquired spectral image data. In the spectral characteristic data acquisition process in step S106, spectral characteristic data indicating the characteristics of spectral image data for each wavelength band obtained by operating the spectral filter 59 is acquired, and the buffer memory (A) is acquired. Save to 70.

  Next, it is determined whether or not the release button provided in the operation input unit 22 is half-pressed (step S107). If the release button is not pressed halfway, other key processing is executed (step S108), and the process returns to step S106. If the release button is half-pressed, AF processing, AE processing, and AWB processing are executed (step S109).

  Thereafter, it is determined whether or not the release button has been fully pressed (step S110). If the release button is not fully pressed, it is determined whether or not the release button is half-pressed (step S111). If the half-press of the release button is not continued and the half-press is released, the process returns to step S106. If the release button is half-pressed continuously, the spectral through image display process and the spectral characteristic data acquisition process are executed in the same manner as in step S106 described above (step S112), the process returns to step S110, and step S110 → The loop of S111 → S112 → S110 is repeated.

  When the release button is fully pressed in a state where this loop is repeated, the process proceeds from step S110 to step S113, and it is determined whether or not high-speed continuous shooting synthesis of the spectral image is set or selected in advance. When the high-speed continuous shooting composition of the spectral image is not set or selected, the process proceeds to another photographing process (step S114).

  If high-speed continuous shooting / compositing of spectral images is set or selected, the image sensor 60 and the DS10P unit 67 are set to the high-speed continuous shooting / multiplane addition mode (step S115). Next, the number (n) of transmission wavelength bands and each exposure time (t / n) are reset according to the imaging conditions (step S116). In other words, if an exposure and photographing process is performed for each of the n transmission wavelength bands within the exposure time (t) for one photographed image, the exposure time for each transmission wavelength band is “t / n”. The exposure time (t / n) and the number of transmission wavelength bands (n) are set.

  Next, the first wavelength band (λi = λ1) is selected from the wavelength bands of the image divided into the number (n) of transmission wavelength bands (step S117). This first wavelength band (λi = λ1) may be the shortest wavelength side or the longest band side.

  Then, a predetermined drive signal is added to the electronic control filter (spectral filter 59), and the transmission wavelength band is set to the wavelength band λ1 selected in step S117 (step S118 in FIG. 3). Subsequently, exposure (shutter opening) & photographing processing is executed, the shutter drive unit 38 is operated to open the shutter 62, and the image data from the image sensor unit 63 is stored in the buffer memory (A) 70 (step S119). . Therefore, spectral image data including the wavelength band λi transmitted through the spectral filter 59 is stored in the buffer memory (A) 70 by the processing in step S119.

  Next, it is determined whether or not each exposure time (t / n) reset in step S116 has elapsed (step S120). If each exposure time (t / n) has elapsed, the shutter drive unit 38 is operated to close the shutter 62 and end the exposure (step S121). Then, the spectral image data photographed in step S119 and stored in the buffer memory (A) 70 is read from the buffer memory (A) 70 (step S122). Subsequently, the read spectral image data is corrected for each wavelength band (λi) according to the transmittance T (λi) of the lens (shooting optical system 58) and spectral filter 32, and the sensitivity S (λi) and the like are corrected. Correction is performed (step S123).

  Further, it is determined whether or not the correction of the illumination light source at the time of shooting is selected or set (step S124). When the correction of the illumination light source at the time of photographing is selected or set, the radiation characteristic (λi) of the selected or set illumination light source stored in advance in the data memory 24 is acquired (step S125). Then, the spectral image signal is corrected for each wavelength band (λi) in accordance with the ratio of the spectral characteristics of the illumination light source at the time of photographing and the illumination light source at the time of reproduction acquired in step S125 (step S126).

  In the present embodiment, the spectral image signal is corrected for each wavelength band (λi) according to the ratio of the spectral characteristics of the illumination light source at the time of shooting and the illumination light source at the time of reproduction. The spectral image signal may be corrected for each wavelength band (λi) based on only the spectral characteristics of the illumination light source or only the spectral characteristics of the illumination light source during reproduction.

  Further, in the case where the spectral image signal is corrected for each wavelength band (λi) by the spectral characteristics of the illumination light source at the time of shooting, not only the radiation characteristic (λi) of the illumination light source at the time of shooting is acquired in step S125, Spectral radiation characteristics of the standard light source are acquired, and based on the acquired radiation characteristics of the standard light source and the spectral radiation characteristics (λi) of the illumination light source, spectral image data for each transmission wavelength band imaged in step S126. May be converted into spectral image data assumed to have been imaged with the standard light source. Thereby, since it can convert into an image when illuminated with a standard light source, reproduction with good color reproducibility can be performed.

  In addition, it is determined whether correction of the printer used, the printing ink, and the printing paper when printing an image after shooting is selected or set (step S127). When the correction of the printer used, the printing ink, and the printing paper is selected or set, the spectral characteristic data R of the printer, printing ink, and printing paper that is selected or set and stored in advance in the data memory 24 (Λi) is acquired (step S128). Then, the spectral image signal is corrected for each wavelength band (λi) according to the spectral characteristics of the printer, printing ink, and printing paper used in step S128 (step S129).

  In this embodiment, the spectral image signal is corrected in accordance with the spectral characteristics of the printer, printing ink, and printing paper used. However, the printer and printing ink used, the printer used and printing paper, and the printing ink are used. You may make it correct | amend according to the spectral characteristic of only printing paper, the printer used, only printing ink, and only printing paper.

  Next, it is determined whether recording or outputting with spectral image data is selected or set (step S130). When recording or outputting with spectral image data is selected or set, spectral image data V (x, y; λi) for each wavelength band (λi) is recorded in the buffer memory (B) 81 (step S131). ).

  Further, it is determined whether or not recording or outputting with general image data is selected or set (step S132). When recording or outputting with general image data is selected or set, the luminance value V (x, y; λi) of each pixel is multiplied by a color matching function, and converted to R, G, B data. (Step S133). Further, the R, G, B data of each pixel of the captured spectral image of each wavelength band is subjected to multi-plane addition synthesis and stored in the buffer memory (B) 81 (step S134).

  Accordingly, when recording or outputting as spectral image data is selected or set in the buffer memory (B) 81, the spectral image data V (x, y) for each wavelength band (λi) for each t / n. Λi) is stored, and when recording or outputting as general image data is selected or set, multi-plane addition of R, G, B data of each pixel of the spectral image taken every t / n The synthesized composite image is stored while being updated. In addition, when recording or outputting with spectral image data and recording or outputting with general image data are selected or set, both are stored.

  Next, it is determined whether or not spectral images having n bands have been captured, that is, whether i ≧ n is satisfied (step S135). If i ≧ n is not satisfied and n spectral images of the number of bands have not been captured, i is incremented (i = i + 1), and the next wavelength band (λi) indicated by the value of i is set. Select (step S136), and repeat the processing from step S118. Therefore, the process of steps S118 to S135 is repeated n times at the timing of t / n. When the process is repeated n times, the determination in step S135 is YES, and the process proceeds from step S135 to step S137.

  Therefore, by repeating the processing of steps S118 to S135 n times, when recording or outputting with spectral image data is selected or set in the buffer memory (B) 81, every n wavelength bands are selected. If the spectral image is stored or recorded or output as general image data is selected or set, the R, G, and B data of each pixel of the spectral image in each of the n wavelength bands are multiplane addition synthesized. The single synthesized image thus stored is stored. Of course, when recording or outputting as spectral image data and recording or outputting as general image data are both selected, the buffer memory (B) 81 stores spectral images for n wavelength bands and n number of spectral images. A single composite image in which R, G, and B data of each pixel of the spectral image in each wavelength band is subjected to multi-plane addition synthesis is stored.

Next, compression and encoding processing of the captured image data stored in the buffer memory (B) 81 is executed (step S137). Further, a color profile of the photographed image is added to the photographed image that has been subjected to the compression and encoding processing (step S138). Then, the captured image data to which the color profile of the captured image is added is stored and recorded in the image memory medium 25 (step S139).
Therefore, by connecting a printer to the USB terminal 26 after the photographing and setting the printer mode, data obtained by adding the color profile of each spectral image to the spectral image for each wavelength band, or a single data obtained by multi-plane addition synthesis. It is possible to output data obtained by adding the color profile of the composite image to the composite image.

  Thereafter, an image based on the photographed image data stored and recorded in the image memory medium 25 is preview displayed on the display unit 85 (step S140).

  In the present embodiment, correction is performed in steps S126 and S129 for all spectral images of n bands, but at least one of the spectral images of n bands has been corrected. Corrections may be made to this.

  FIG. 4 is a diagram illustrating the operation in the present embodiment. That is, in the present embodiment, the spectral image data V (x, y; λ1) to V (x, y; λ1n) continuously shot are spectral characteristics of the imaging system including “transmittance” and “sensitivity”. The spectral characteristics of the imaging system are corrected by the data (a), and the spectral characteristics of the illumination light source are corrected by the spectral emissivity characteristics (b) of the illumination light composed of “illumination light at the time of photography” and “illumination light at the time of reproduction”. , The spectral characteristics of the printer system are corrected by the spectral characteristics data (c) of the printer system including “printing paper”, “printing ink”, and “overpaint correction coefficient”. After that, based on the CMYK color matching function (d), tristimulus values of each pixel are calculated, multiplane addition is performed, and trimming / enlargement or noise removal / sharpening processing is performed as necessary to obtain CMY or OMYK data. Can be output.

  Therefore, when the printer performs a printing operation based on these CMY or OMYK data, an image close to the accurate color of the subject at the time of actual shooting can be reproduced and printed even when the spectral characteristics of the printing color of the printer vary. Can do.

  In addition, the spectral radiation characteristic Er (λ) of the light source irradiated to the subject at the time of photographing is selected, measured, or estimated, and this is corrected in the same manner, so that the spectral radiation characteristic Er (λ) of the light source is corrected. Recording can be performed after conversion to the spectral emissivity characteristic Ep (λ) of the illumination light source during reproduction or print viewing. Similarly, color image data with the desired spectral characteristics is created taking into account the spectral emissivity characteristics Rk (λ) of each color ink of the printer system used for printing, the spectral emissivity characteristics Rw (λ) of the paper (W), etc. In addition, the characteristics of the printer can be supplemented, and an image with higher fidelity and reproducibility can be printed and used.

  5-8 is a figure which shows the usage condition of the digital camera 1 which concerns on this Embodiment. FIG. 5 shows the spectral image data group captured as described above, corrected and recorded in the digital camera 1 according to the illumination during reproduction and the spectral characteristics of the printer 100, and converted into RGB data to the printer 100. This is a case where the data is output and converted from RGB to CMY (CMYK) on the printer 100 side for printing.

  However, instead of correcting and recording in accordance with the spectral characteristics of the printer 100 at the time of reproduction in this way, the continuously shot spectral image data V (x, y; λ1 to λn) is stored as it is on the digital camera 1 side. In the print mode, the spectral characteristic correction data is received from the printer 100, and the image data V (x, y; λ1 to λn) that has been photographed and recorded is corrected based on the received spectral characteristic correction data of the printer system. To the printer 100.

The spectral image data V (x, y; λ1 to λn) based on the printer spectral characteristic correction data stored in advance in the digital camera 1 without receiving the printer spectral characteristic correction data from the printer 100. May be corrected and recorded.
FIG. 6 illustrates a case where the spectral image data group captured as described above is corrected in the digital camera 1 according to illumination during reproduction or spectral characteristics of the printer 100, and then converted into CMY or CMYK and output to the printer 100. It is.

  FIG. 7A is a diagram illustrating a case where an image captured by the digital camera 1 is printed and reproduced using the printer 102 that does not support spectral images. In this case, a PC (personal computer) 101 is connected to the digital camera 1, and a printer 102 that does not support spectral images is connected to the PC 101. The general image data is output from the digital camera 1 to the PC 101, converted from RGB to CMYK by the printer driver in the PC 101, and output to the printer 102.

  FIG. 5B is a diagram illustrating a case where an image captured by the digital camera 1 is printed and reproduced using the printer 103 corresponding to the spectral image. In this case, a PC (personal computer) 101 is connected to the digital camera 1 and a printer 103 corresponding to a spectral image is connected to the PC 101. Then, the spectral image data is output from the digital camera 1 to the PC 101, converted from RGB to CMYK by the printer driver corresponding to the spectral image in the PC 101, and output to the printer 103. That is, using the spectral image data in the image file, the printer driver performs its own color processing according to “paper type”, “print quality”, “color adjustment”, and the like set by the user.

  FIG. 8 is a diagram illustrating a case where an image captured by the digital camera 1 is printed and reproduced using the printer 102 that does not support spectral images. In this case, a PC (personal computer) 101 is connected to the digital camera 1, and a printer 102 that does not support spectral images is connected to the PC 101. The spectral image-compatible color management module with built-in application allows the spectral image-compatible CMM with built-in application to create a spectral image profile on the “source color space” (input) side and print paper on the “print color space” (output) side. Print using the profile.

  9 to 11 are diagrams showing an example of a recording method in the case where the photographed image data to which the color profile of the photographed image is added in step S138 is filed in step S139 and recorded on a memory recording medium. FIG. 9 shows an example in which the general image and the spectral image group are stored as separate files in the same folder, and the correspondence is grouped and set using a DPOF file or the like. A spectral image file group is also stored in association with the general image file (full band image). As a result, when connecting to a non-spectral-compatible printer that cannot handle spectral images, the general image data of the general image file is used for printing, and when connecting to a spectral-compatible printer that supports spectral images, The spectral image data of the image file group can be used for printing.

  FIG. 10 shows an example in which the general image and the spectral image group are stored in different folders as separate files, and the correspondence is set as a group by playlist description data (described in MPV, MPEG7, XML, etc.). Even in this case, when connecting to a non-spectral-compatible printer that cannot handle spectral images, the general image data of the general image file is used for printing, and when connecting to a spectral-compatible printer that supports spectral images, The spectral image data of the spectral image file group can be used for printing.

  FIG. 11 shows an example in which a general (full band) image and a spectral image group are recorded as one image data. FIG. 12 shows an example of the structure of a compressed data file.

FIG. 13 shows an example of the spectral distribution of the sun and shade that can be regarded as a mixture of “sunlight + skylight”. By storing this in the program memory 23, the spectral radiation characteristics of sunlight and skylight can be estimated and calculated from the spectral distribution of the sun and shade.
Hyuga: Csun (λ) = R (λ) (Esky (λ) + Esun (λ)),
Shade: Cshade (λ) = R (λ) Esky (λ),
Csun (λ) −Cshade (λ) = R (λ) Esky (λ)
R (λ) = {Csun (λ) −Cshade (λ)} / Esun (λ)
Therefore, R (λ) can be erased. Sky light Esky (λ) = Sunlight Esun (λ) Cshade (λ) / {Csun (λ) −Cshade (λ)}

  14A is a diagram showing the relationship between the distribution emissivity characteristics of blackbody radiation and the color temperature, and FIG. 14B is a diagram showing the spectral emissivity characteristics of daylight (daylight sunlight). ) Is a diagram showing the spectral emissivity characteristics of an incandescent lamp, (d) is a graph showing the spectral emissivity characteristics of an incandescent fluorescent lamp, and (e) is a diagram showing the spectral emissivity characteristics of a three-wavelength fluorescent lamp (daylight color). is there.

  By storing these spectral emissivity characteristics in the program memory 23, when the spectral radiation characteristic E (λi) of the illumination light source is acquired in step S125, the spectral memory characteristics can be easily obtained by a simple process of reading from the program memory 23. In addition, the spectral radiation characteristic E (λi) of the illumination light source can be acquired.

Next, structural details, operations, and operational details in the present embodiment will be described.
[Spectral filter 59]
As the spectral filter 59, a filter having a narrow band transmission wavelength characteristic is used. Examples of the filter having the narrow-band transmission wavelength characteristic include a Riot filter and a Fabry-Perot interference filter. Also, an electronically controllable filter such as LCTF (liquid crystal tunable filter) or LCFP (liquid crystal Fabry-Perot) etalon can be used.

(1) Rio filter The Rio filter is an optical filter that transmits light of a very narrow wavelength using interference by a birefringent crystal plate, and is between two parallel polarizing plates. Birefringence crystal plates such as calcite and quartz are arranged. The light transmitted through the birefringent crystal plate (thickness d) is separated into two light beams of normal light and extraordinary light in vibration directions perpendicular to each other, and have different refractive indexes and phase velocities. In the case of a refractive index Ne for light linearly polarized in the X-axis direction of the crystal and a refractive index No for light linearly polarized in the Y-axis direction,
The phase difference δ is expressed as δ = (2π / λ) (Ne−No) d (1)
The transmittance T is T = cos ² δ / 2 (2)
In the separated normal light and extraordinary light, only light having a wavelength equal to an integral multiple of the optical path length in the same polarization state is emitted from the crystal plate. If the crystal plate is rotated 45 degrees between two parallel polarizing plates, the entire wavelength characteristic becomes a comb-like transmission wavelength characteristic having a large number of transmission peaks periodically. By rotating the angle of the crystal plate with a motor or the like, the peak of the transmission wavelength can be changed and the filter characteristics can be tuned.

Further, a plurality of N crystal plates are sequentially dk = 2 ^k−1 × d (k = 1, 2,..., N−1) so that the thickness d is twice that of the next crystal plate. As a result, it is possible to select only light having a desired wavelength from a number of peaks of the transmission wavelength. The total transmittance of the multilayer filter is expressed by the following equation when x = δ / 2.
T = T ₁ T ₂ T ₃ ... T _N-1 = cos ² × (2x) cos ² (4x)... Cos ² (2 ^N−1 x) Expression (3)

(2) Fabry-Perot interference filter A Fabry-Perot interference filter (Fabry-Perot Filter, Fabry-PerotEtalon) transmits only light of a narrow wavelength castle using the interference effect of multiple reflected rays. It has a simple structure in which a reflective film such as a metal thin film or a dielectric multilayer thin film is coated on both surfaces of a parallel plate of quartz or the inner surfaces of two glass plates, and is widely used in various optical devices. A light beam that has passed through the reflective film (semi-transparent mirror) and entered the inside is subjected to multiple reflections between the two surfaces. The wavefront of the transmitted light is a superposition of the component wavefronts that are transmitted after receiving an even number of reflections.
Phase difference δ = (2π / λ) 2nd cos θ = 4πnd cos θ / λ Expression (4)
For the incident light Iin, the transmitted light It becomes It = Iin × (1−R ² / {(1−R) ² + 4Rsin ² (δ)}.
Transmittance T = (1−R) ² / {(1−R) ² + 4Rsin ² (δ) (5)
Here, δ: phase difference, λ: wavelength, θ: incident angle, d: physical distance between mirrors, n: refractive index of medium (n = 1 in the case of air), R: reflectance of mirror.

The transmitted light is maximized when there is no phase difference between the component wavefronts. At this time, the difference in optical distance is an integral multiple of the wavelength λ. mλ = 2nd cos θ, (m = 1, 2, 3,...) (6)
At this time, at other wavelengths, canceling interference occurs between the transmitted component wavefronts, and the transmitted light is reduced to near zero. Although the mirror can be a metal film coating in which Ag, Au, AI, Cr, Rh, etc. are vapor-deposited for visible light, a multilayer dielectric thin film or the like is mainly used because of a large absorption loss. In the visible light region, a dielectric multilayer film in which a high refractive index H film (ZnS or the like) and a low refractive index L film (MgF2 or the like) are alternately stacked by 13 layers each of λ / 4 is about 99.5%. Reflectance is obtained.

The distance d between the mirrors can be designed variously from several microns (μm) to several centimeters (cm), and the wavelength to be transmitted can be selected by changing the distance d or the refractive index n of the medium. Further, the wavelength characteristics can be finely adjusted by adjusting the inclination of the filter. Compared to prisms and diffraction gratings, the resolution is very high, and the transmittance is high and absorption is low compared to Rio filters using polarizing plates. The value obtained by dividing the interval FSR (Free Spectral Range) between adjacent peak wavelengths by the full width at half maximum FWHM (Fu11 Width at Half Maximum) of the transmission peak, which is the minimum bandwidth, is called Finesse, and the filter performance is Show.
Finesse F = FSR / FWHM = Δλ / δλ = π√R / (1-R) (7)

Here, free spectral range FSR = Δλ = δλ = λo ² / (2nd) (8)
Full width at half maximum of peak wavelength FWHM = δλ = FSR / F (9)
As the reflectivity R of the mirror surface is increased, the finesse F is increased, the wavelength resolution FWHM = δλ can be narrowed, and the transmission peak can be sharpened.
Further, the intensity It (θ, λ) of the transmitted light having the wavelength λ incident at the incident angle θ is expressed by the following equation.
It (θ, λ) = Io (λ) / [1+ {4R / (1-R) ² } sin ² (nd · cos θ / λ) at 2π] = Io (λ) / {1+ (F / π) 2sin 2 (Δ / 2)} Equation (10)
Here, Io (λ) is the transmitted light intensity at the center of a concentric interference pattern (Hadinger fringe).

If the light source is monochromatic (single wavelength), the etalon will only transmit light at incident angles that meet certain conditions. For this reason, when a monochromatic spherical wave is incident, a concentric ring (interference pattern) is generated. When using a Fabry-Perot etalon (the one with a fixed interval is called an etalon plate) as a filter, the incident angle θ is made smaller than the incident angle corresponding to the innermost interference ring (ring). The viewing angle FOV (Field of view) of the following equation must be limited.
Viewing angle FOV = √ {(8 / λ) Xδλ} (11)

(3) Electronically controllable interference filter When the above-mentioned Rio filter or Fabry-Perot filter is combined with a birefringent element such as a liquid crystal element or an electro-optic crystal, the transmission wavelength characteristic is electronically variable. A narrow band filter can be constructed, and spectroscopic imaging can be performed in a desired wavelength band selected.

  A liquid crystal tunable filter (LCTF) sandwiches a birefringent crystal plate and a liquid crystal element between two polarizers of an input polarizer and an output polarizer in each layer of the above-mentioned Rio filter. It has a sandwich structure and a plurality of layers. Incident light passes through the input polarizer, and then is divided into two components of ordinary light and extraordinary light having different phase velocities by a birefringent crystal plate whose crystal axis is set at 45 degrees with respect to the polarization ring of the polarizer. Divided into quantities. Due to the difference in refractive index between the long ring direction and the short ring direction of the liquid crystal molecules, the optical path length difference (Δ1φ = 2πΔz / λ) between the light polarized in the long ring direction and the light in the orthogonal polarization direction Occurs. When the voltage applied between the electrodes of the liquid crystal element is changed, the direction of the long ring of the liquid crystal molecules is inclined, so that the optical path length difference is reduced. The voltage (V) applied to the liquid crystal element changes the refractive index of one of the crystal axes of the liquid crystal, so that one light is delayed compared to the other light. In this way, the liquid crystal element functions as a phase retarder, and the two components exiting the liquid crystal element are synthesized by the output polarizer, but have periodic transmission characteristics with respect to wavelength due to interference.

  With these as one stage, the final transmission characteristic of incident light can be narrowed by stacking a plurality of stages so that the thickness of the birefringent crystal plate is twice that of the previous stage. Therefore, instead of rotating the crystal plate like a Rio filter, simply changing the voltage applied between the transparent electrodes of the liquid crystal elements inserted in each layer, the selected wavelength of each layer can be varied continuously at high speed, A narrow-band spectroscopic camera can be realized by selectively transmitting only light of a desired wavelength that is transmitted through all layers by combination and imaging with a CCD or the like.

(4) Selection of transmission wavelength of LCTF In order to align the transmittance peak in all filters at a desired wavelength, the voltage of AC (alternating current) or direct current (DC) rectangular wave applied to the liquid crystal is adjusted, and the desired wavelength is selected. It is necessary to match the transmittance peak of each filter to a narrow band wavelength.
Characteristic data of spectral transmittance at each voltage of each layer filter or voltage data to be applied to the liquid crystal element of each layer for adjustment to each wavelength (λi) is stored in advance in a memory as a reference table (LUT), and the control circuit In 2, the control may be performed so that the selection characteristics of the filter can be automatically adjusted with reference to them.

  Note that a polarizing plate is necessary on both sides of the liquid crystal and the crystal plate in order to block polarized light in an unnecessary direction with the laminated type LCTF. In addition, in order to obtain a spectral image by imaging a selected wavelength band with only a narrow band of about 5 to 10 nm, the number of filter layers, that is, the number of crystal plates and liquid crystal layers is increased and transmitted simultaneously. It is necessary to separate wavelengths, and the number of polarizing plates increases, so the transmittance decreases. In particular, on the short wavelength side (purple to ultraviolet side), there is a problem that the transmittance is considerably lowered (darkened). The transmittance varies between the central portion and the peripheral portion, and is not uniform. In addition, in the LCTF, high-speed imaging is limited if the rise time of the liquid crystal, the switching process of wavelength characteristics, and the adjustment process take time. For example, when photographing 400 to 700 nm in the visible light region at every wavelength interval of 10 nm, it is necessary to photograph 31 images, and if it takes about 50 ms or more for the liquid crystal rise time and wavelength switching, the exposure condition is satisfied. However, since only about 20 shots (bands) can be taken per second, there are restrictions such as taking 1.5 seconds or more to shoot all bands.

(5) Liquid crystal Fabry-Perot etalon (LCFP: Liquid Crystal 1 Fabry-Perotalon)
As a liquid crystal Fabry-Perot etalon (LCFP), one manufactured by SSI (Scientific Solutions Inc.) is known. LCFP encloses a liquid crystal layer between two glass plates (or crystal plates) on which thin film mirrors are formed, and forms transparent electrodes on both sides of the Fabry-Perot interference filter that uses multiple reflection. It is a thing. In addition to optimally designing the mirror interval (gap) so as to achieve a predetermined wavelength characteristic, the refractive index n of the liquid crystal layer can be changed by changing the voltage applied to the electrodes on both sides of the liquid crystal layer to fill the gap width of the etalon. Then, the wavelength is changed so as to give a transmittance peak to a wavelength that was not a peak until then, and according to the above formulas (4) and (5) in the Fabry-Perot interference filter,
Substituting the distance d and the refractive index n including the liquid crystal layer into the equation (4),
Phase difference δ = 4πnd cos θ / λ (formula 4)
And substituting the phase difference δ into equation (5),
Transmittance T = (1-R) ² / {(1-R) ² + 4Rsin ² (δ)} (formula 5)
The spectral transmittance characteristics at each wavelength of the filter can be obtained.

  Alternatively, the refractive index n of the liquid crystal having the desired transmission characteristics and the required driving voltage V can be obtained from the simulation result or the reverse calculation result based on these theoretical formulas and the driving voltage-refractive index characteristic data of the liquid crystal. The filter can have a desired spectral transmittance characteristic. Furthermore, by stacking etalons with different mirror spacing in multiple layers and changing the voltage applied to the liquid crystal layer provided in each layer, the wavelength band that passes through all of the multiple layers of filters is changed to the desired narrowband wavelength band λ. Tuning is possible, and only light in the wavelength band selected in sequence can be imaged and used for spectroscopic imaging. However, as a characteristic of the liquid crystal, this refractive index change functions only in one of the two orthogonal components of polarized light, so the other component cannot contribute to tuning, and in order to block this unnecessary component, LCFP and It is necessary to insert a polarizing plate in series.

(6) Design of liquid crystal Fabry-Perot etalon (LCFP) When the operating wavelength range of a filter used in spectroscopic imaging is, for example, the entire visible light with a wavelength of 400 nm to 700 nm, a coating that provides high reflectivity in the entire region is applied. It is necessary to deposit on an etalon substrate with high flatness. In addition, Finesse F that can be practically and easily realized due to the conflict between the reflectance and transmittance of the coating, the flatness of the etalon surface, and the parallel accuracy of the intervals, for example (in the case of a standard product of LCFP manufactured by SSI) ) There are some limitations such as F ≦ 8 at a wavelength of 400 nm, F ≦ 10 at 600 nm, F ≦ 12 at 800 nm, F ≦ 15 at i200 nm, F ≦ 20 at 1500 nm, and the like.

  When it is desired to set the wavelength resolution (minimum bandwidth) in a desired band to FWHM = δλ = 50 nm or 10 nm, for example, in the visible light range of 400 to 700 nm, it is considered that finesse F is about 8 to 10 From the above equation (6), since finesse F = Δjλ / δλ, when δλ = 50 nm, the peak wavelength interval FSR = Δ1λ = δλ × F = 50 nm × 8 = 400 nm, and a single etalon However, although it can be used in the entire visible light range, when δλ = 10 nm, FSR = δλXF = 10 nm × 8 = 80 nm, and 3 to 4 peak wavelengths are transmitted simultaneously within the band, and 3 to 4 Order separation filter. Further, even if a desired FSR is possible from the viewpoint of finesse, the relationship between the FSR and the wavelength λ with respect to various gap widths (mirror intervals), for example, when the minimum gap width of the etalon that can be realized is 3 μm, In the etalon, since the FSR is only about 30 to 80 nm in the entire visible light range, it is understood that about 4 to 10 order separation filters are required. In such a case, a multilayer LCFP in which a plurality of etalons are combined is used.

(7) Multi-layer LCFP
When multiple etalons are used in combination, the first etalon with the larger gap width (wavelength-resolved etalon) defines the transmission width of the entire system, and the second etalon with the smaller gap width (order suppression etalon). Defines the FSR. The FSR of the entire system depends on the ratio of the FSRs of both etalons. If the integer ratio of FSR ₁ of the first etalon and FSR _{2 of} the second etalon can be expressed in B / A,
FSR = A × FSR ₁ = B × FSR ₂ Formula (12)
When B = 1, the FSR _{2 of} the second etalon itself becomes the entire FSR. Otherwise, the overall FSR is B times larger than the FSR _{2 of the} order-suppressing etalon. From the equation (12), in the system combining two etalons, the FSR of the wavelength-resolved etalon is expanded A times, and the total number of transmission bands that can exist in the FSR of the entire system is also A times (FSR expansion coefficient). Can be expanded.

  In order to minimize the number of order separation filters, it is necessary to maximize the etalon FSR within a range that does not exceed the tunable range (refractive index change range) of the liquid crystal. For example, in an etalon with a gap width of 3 μm, the visible light region (4004 m to 700 n surfaces are filled with 10 orders, but when the gap width of 6 μm and an etalon of 7.4 μm are combined, the obtained FSR has a gap width of 3 μm. A device equivalent to a single etalon having twice the single etalon and a gap width of 1.5 μm can be realized.

(8) Color image capturing process Generally, a function of spectral reflectance of a certain reflecting object at time (t) of three-dimensional spatial coordinates (x, y, z) at wavelength (λ) is expressed as O (x, y, z , T, λ), the material is illuminated with a light source having a spectral emissivity E (λ), imaged through a lens having a spectral transmittance T _L (λ), and the spectral transmittance T _Fi (λ). When the image is taken with a camera of an image sensor having a filter and a spectral sensitivity S (λ), a two-dimensional image Vi (x, y) that is an image pickup output of the camera can be expressed by the following equation.
Vi (x, y) = ∫∫∫T _L (λ) T _Fi (λ) S (λ) t (t) A (z) O (x, y, z, t, λ) E (λ) dλdtdz · ..Formula (13)
(Where t (t): exposure time, A (z): imaging function by lens (3D-2D conversion function)).

In the camera, the exposure time t can also be approximated by a rectangular function of ON / OFF for a predetermined time. Here, focusing on color reproducibility, the coordinate axis, time function, lens imaging function, etc. are simplified.
Vi (x, y) = ∫T _L (λ) T _Fi (λ) S (λ) O (x, y, λ) (λ) dλ (Equation 14)
It becomes.
In the case of an RGB three-band image based on the conventional three primary colors, i = R, G, B and the spectral transmittance T _Fi (λ) is T _FR (λ), T _FG ( λ) and T _FB (λ).
In the case of the spectral camera (digital camera 1) according to the present embodiment or a spectral image for each narrow band, if the band number i = 1, 2,..., N, the spectral transmittance T · (λ) is , T _F1 (λ), T _F2 ,..., T _Fn (λ), corresponding to filters for each narrow band. (In the above equation, if the object is replaced by the spectral radiance Oe (λ) of the object instead of O (λ) E (λ) of the reflecting object and the light source, the same can be applied to the case of the radiating object.)

(9) Color Reproduction by Three Primary Colors Generally, in color reproduction, three color separation images V _R , V _G , and V _B are converted into color matching functions x￣ (λ), yλ (λ, for example, in the CIE-XYZ color system. ), Z￣ (λ), etc., the so-called tristimulus values (X _i , Y _i , Z _i ) of the original object correspond to the following (X _O , Y _O , Z _O ) Colorimetric color reproduction is performed.
X _O = K _O ∫O (λ) E (λ) x￣ (λ) dλ,
Y _O = K _O ∫O (λ) E (λ) y￣ (λ) dλ,
Z _O = K _O ∫O (λ) E (λ) z￣ (λ) dλ, Equation (15)
Here, K _O = 100 [%] / {∫E (input) y￣ (λ) dλ},

Also, when a recorded image is used as a hard copy and observed with an illumination light source E ′ (λ) having a different spectral emissivity, the light source E (λ) is set to E ′ (λ), and the spectral reflectance O ( If λ) is replaced with the spectral reflectance (or spectral density) O ′ (λ) of the image, the tristimulus values (X _h , Y _h , Z _h ) are expressed by the following equations.
X _h = K∫O '(λ) E' (λ) x￣ (λ) dλ,
Y _h = K∫O ′ (λ) E ′ (λ) y￣ (λ) dλ,
Z _h = K∫O ′ (λ) E ′ (λ) z￣ (λ) dλ, expression (16)
Here, K = 100 [%] / {∫E ′ (λ) y￣ (λ) dλ},

  Even if the representation format, conversion matrix, or LUT (Lookup Table) is different, such as a hard copy such as a film, a photograph, or a print, or an electronic display, it can be considered in the same manner as described above. Thus, as is clear from the equations (15) and (16), the tristimulus values of the object and the image depend on the spectral emissivity E (λ), E ′ (λ), etc. of the illumination light source. Become.

(10) Spectral image color representation In the case of a spectral image as in this embodiment, the equation (14)
Vi (x, y) = ∫T _L (λ) T _Fi (λ) S (λ) O (x, y, λ) (λ) dλ (formula (14))
(Where, vi (x, y): two-dimensional image, E (λ): spectral emission factor of light source, T _L (λ): spectral transmittance of photographing lens, T _Fi (λ): spectral component of i-th filter Transmittance, spectral sensitivity of the S (λ) image sensor, O (x, y, λ.): Spectral reflectance of the object.

(11) Conversion to a wideband image In a DSP in which a plurality of obtained spectral image data is transferred and input at high speed, an image luminance signal V (x, y; λi) in each wavelength band λi is converted into a photographing lens for each band. The spectral transmittance F (λi) of the image sensor and the interference filter, and the spectral sensitivity S (λi) of the image sensor are stored in the memory in the camera, and multiplied by a predetermined ratio corresponding to the reciprocal number of them. A spectral image V ′ (x, y; λi) in which sensitivity variation for each band is corrected is obtained. In other words,
V ′ (x, y; λi) = V (x, y; λi) / F (λi) · S (λi)

Further, R for each surface element (x, y) is multiplied by a color matching function such as r￣ (λi) and g (λi) b￣ (λi) for each wavelength band (λi) of each spectral image. Obtain tristimulus values such as G, B,
Ri (x, y) = V ′ (x, y; λi) × r￣ (λi),
Gi (x, y) = V ′ (x, y; λi) × g￣ (λi),
Bi (x, y) = V ′ (x, y; λi) × b￣ (λi),
Further, the RGB values of each surface element (x, y) in each wave band (λi) can be added and synthesized by a multi-plane addition circuit in the DSP, and converted into wideband color image data such as RGB.
R (x, y) = ΣiRi (x, y),
G (x, y) = ΣiGi (x, y),
B (x, y) = ΣiBi (x, y), Formula (19)

  Also, tone correction and gamma correction are performed according to the gamma characteristics of standard monitors, etc., and converted to other color space coordinates such as rgb chromaticity values and YUV (YCrCb) signals for each pixel (x, y). May be output. In this way, a spectral image captured at high speed within a very short time, which is almost the same timing of a plurality of wavelength bands, is read at high speed, added and synthesized, and one wide band having high resolution with high color reproducibility. Image data can be generated and output or recorded.

  FIG. 15 is a flowchart showing a processing procedure for estimating or calculating the spectral characteristics of the light source. It is determined whether it is indoor lighting (step S201), and if it is indoor lighting, it is determined whether it is a known light source (step S202). If the light source is a known light source, the type of light source such as a fluorescent lamp or a light bulb is selected (step S203). Further, the corresponding spectral emissivity data E (λ) is read from the data memory 24 in accordance with the type of the selected light source (step S204). Then, the spectral correction data of the spectral image is set based on the obtained (read) illumination and spectral radiation rate characteristics of the light source (step S5).

If the light source is not a known light source as a result of the determination in step S202, it is determined whether or not a subject having a known reference color chart or spectral reflectance is present in the currently captured image (step S206). ). In some cases, a reference color chart such as a Macbeth chart or an object with a known spectral reflectance is instructed to be photographed under the illumination (step S207). Next, the wavelength bands are sequentially switched to continuously capture spectral images for each band (step S208), and the spectral distribution data C (λ) of luminance is measured and stored from the captured spectral image data (step S209). ). Further, a spectral emissivity characteristic E (λ) is obtained from the stored luminance spectral distribution data C (λ) by the following equation (step S210).
E (λ) = C (λ) / R (λ)
However,
R (λ): Spectral reflectance of subject or part thereof C (λ): Spectral distribution characteristic of luminance of subject or part thereof Thereafter, based on the obtained spectral emissivity characteristic of illumination or light source, the spectral of the spectral image Set characteristic correction data.

If the result of determination in step S206 is that there is no subject with a known reference color chart or spectral reflectance, first, an instruction is given to shoot with a known light source of the subject (step S211). Then, when the subject is irradiated with the known light source E ₀ (λ), the wavelength band (λ) is sequentially switched, and the spectral image group for each band is continuously photographed (step S212). Next, the spectral distribution data C ₀ (λ) of the brightness of the subject in the sun is measured and stored from the spectral image data obtained by the continuous shooting (step S213). Further, the processing from step S207 described above is executed with the spectral reflectance of the subject as R (λ) = C ₀ (λ) / E ₀ (λ).

On the other hand, if the result of determination in step S201 is not indoor lighting, it is determined whether or not shooting is outdoors (step S215). If the result of determination in step S215 is not outdoor shooting, processing returns to step S202 described above. If it is outdoor shooting, it is determined whether it is direct sunlight (step S216). If it is direct sunlight, sunlight E _sun (λ) is selected as the type of light source (step S217), and the process proceeds to step S204 described above.

If the result of determination in step S216 is not direct sunlight, an instruction is given to shoot when the same subject is in the sun (step S218). Then, when the subject is sunny, the wavelength band (λ) is sequentially switched, and the spectral image group for each band is continuously photographed (step S219). Next, the spectral distribution data C _sun (λ) of the brightness of the subject in the _sun is measured and stored from the spectral image data obtained by the continuous photographing (step S220).

Next, an instruction is given to shoot when the same subject is in shade (step S221). When the same subject is in the shade, the wavelength band (λ) is sequentially switched, and the spectral image group for each band is continuously photographed (step S222). Next, the spectral distribution data C _shade (λ) of the luminance of the shaded subject is measured and stored from the spectral image data obtained by the continuous photographing (step S223). Subsequently, the spectral emissivity E _sky (λ) of sky light (or shade) is obtained by the following equation (step S224).
E _sky (λ) = E _sun (λ) × C _shade (λ) / {C _sun (λ) −C _shade (λ)}
However,
E _sun (λ): Spectral emissivity of sunlight (daylight) The skylight E _sky (λ) is added with weighted (w) sunlight E _sun (λ) according to the degree of shade to _sun. , E (λ) = E _sky (λ) + wE _sun (λ) (step S225)
. Thereafter, spectral correction data of the spectral image is set based on the obtained spectral emissivity characteristics of the illumination and the light source (step S205).

  That is, sunlight can be acquired by directly observing the sun at the time of scene photography. On the other hand, the sky light can be assumed to be uniform illumination from the sky hemisphere, but because the sky is not completely uniform due to the influence of clouds etc., it will be estimated using the sun and shade in outdoor scenes .

  In addition, since the spectral characteristic correction data set in this way is stored in the data memory 24, even when the light source is unknown, the spectral emissivity characteristic of the illumination light source can be easily estimated and calculated. Since it can be set easily, even in the case of a desired light source at the time of reproduction, a subject under illumination at the time of photographing and a highly reproducible image can be reproduced.

(Second Embodiment)
FIG. 16 and FIG. 17 are a series of flowcharts showing the procedure of the imaging control in the second embodiment of the present invention. This embodiment not only corrects the imaging system and imaging sensitivity, but also corrects the spectral emissivity characteristics of the light source that illuminates the subject, the spectral reflection characteristics of the printer system, etc., as well as infrared films, infrared sensitizing films, and ultraviolet rays. Shooting control is performed when processing for intentionally converting imaging spectral sensitivity characteristics is performed, such as when shooting with a special film such as a film.

  The control circuit 2 executes processing as shown in this flowchart based on the program stored in the program memory 23. First, a shooting mode is selected and a shooting condition and the like are selected in accordance with an operation performed by the user on the operation input unit 22 (step S301). Next, it is determined whether or not the selected photographing mode is the spectral photographing mode (step S302). If the selected photographing mode is not the spectral photographing mode, the process proceeds to other mode processing (step S303).

  If it is in the spectral imaging mode, the wavelength band of the through image and the imaging wavelength band are respectively selected according to the operation of the operation input unit 22 by the user (step S304). In this step S304, the wavelength band of the through image is the wavelength band of the through image displayed on the display unit 85, and the imaging wavelength band is the wavelength band for shooting and recording. This imaging wavelength band is the entire wavelength band that is spectrally separated by the spectral filter 59 unless otherwise specifically set. In the following description, the entire wavelength band is selected as the imaging wavelength band. To do.

  Next, a spectral sensitivity characteristic to be converted, such as an infrared film effect, is set or selected in accordance with an operation on the operation input unit 22 by the user (step S305). That is, the data memory 24 stores the spectral sensitivity characteristics of various films, such as the spectral sensitivity characteristics of the infrared film, for each film type. And according to a user's operation, the film type which produces | generates a desired effect is selected or set.

  At this time, the film type name is displayed on the display unit 85, and the film type can be easily selected by operating the operation input unit 22 based on the displayed film type name. .

  Subsequently, spectral through image display processing and spectral characteristic data acquisition processing are executed (step S306). In the spectral image display process in step S306, among the spectral image data for each wavelength band obtained by operating the spectral filter 59, spectral image data in the through-video wavelength band set in step S304 is acquired. Then, a through image is displayed on the display unit 85 based on the acquired spectral image data. In the spectral characteristic data acquisition process in step S306, spectral characteristic data indicating the characteristics of spectral image data for each wavelength band obtained by operating the spectral filter 59 is acquired, and the buffer memory (A) is acquired. Save to 70.

  Next, it is determined whether or not the release button provided in the operation input unit 22 is half-pressed (step S307). If the release button is not pressed halfway, other key processing is executed (step S308), and the process returns to step S306. If the release button is half-pressed, AF processing, AE processing, and AWB processing are executed (step S309).

  Thereafter, it is determined whether or not the release button has been fully pressed (step S310). If the release button is not fully pressed, it is determined whether or not the release button is half-pressed (step S311). If the half-press of the release button is not continued and the half-press is released, the process returns to step S306. If the release button is pressed halfway down, the spectral through image display process and the spectral characteristic data acquisition process are executed in the same manner as in step S306 described above (step S312), the process returns to step S310, and step S310 → The loop of S311 → S312 → S310 is repeated.

  If the release button is fully pressed in a state where this loop is repeated, the process proceeds from step S310 to step S313, and it is determined whether or not high-speed continuous shooting combination of spectral images has been set or selected in advance. If high-speed continuous shooting / compositing of the spectral image is not set or selected, the process proceeds to other photographing processing (step S314).

  If the high-speed continuous shooting / combining of spectral images is set or selected, the image sensor 60 and the DS30P unit 67 are set to the high-speed continuous shooting / multiplane addition mode (step S315). Next, the number (n) of transmission wavelength bands and each exposure time (t / n) are reset according to the imaging conditions (step S316). In other words, if an exposure and photographing process is performed for each of the n transmission wavelength bands within the exposure time (t) for one photographed image, the exposure time for each transmission wavelength band is “t / n”. The exposure time (t / n) and the number of transmission wavelength bands (n) are set.

  Next, the first wavelength band (λi = λ1) is selected from the wavelength bands of the image divided into the number (n) of transmission wavelength bands (step S317). This first wavelength band (λi = λ1) may be the shortest wavelength side or the longest band side.

  Then, a predetermined drive signal is added to the electronic control filter (spectral filter 59) to set the transmission wavelength band to the wavelength band λ1 selected in step S317 (step S318 in FIG. 17). Subsequently, exposure (shutter opening) & photographing processing is executed, the shutter drive unit 38 is operated to open the shutter 62, and image data from the image sensor unit 63 is stored in the buffer memory (A) 70 (step S319). . Therefore, spectral image data including the wavelength band λi transmitted through the spectral filter 59 is stored in the buffer memory (A) 70 by the processing in step S319.

  Next, it is determined whether or not each exposure time (t / n) reset in step S316 has elapsed (step S320). If each exposure time (t / n) has elapsed, the shutter drive unit 38 is operated to close the shutter 62 and end the exposure (step S321). Then, the spectral image data captured in step S319 and stored in the buffer memory (A) 70 is read from the buffer memory (A) 70 (step S322). Subsequently, the read spectral image data is corrected for each wavelength band (λi) according to the transmittance T (λi) of the lens (shooting optical system 58) and spectral filter 32, and the sensitivity S (λi) and the like are corrected. Correction is performed (step S323).

  Further, it is determined whether or not the correction of the illumination light source at the time of photographing is selected or set (step S324). When the correction of the illumination light source at the time of photographing is selected or set, the radiation characteristic (λi) of the illumination light source that is stored in advance in the data memory 24 is acquired (step S325). Then, the spectral image signal is corrected for each wavelength band (λi) in accordance with the ratio of the spectral characteristics of the illumination light source at the time of photographing and the illumination light source at the time of reproduction acquired in step S325 (step S326).

  In the present embodiment, the spectral image signal is corrected for each wavelength band (λi) according to the ratio of the spectral characteristics of the illumination light source at the time of shooting and the illumination light source at the time of reproduction. The spectral image signal may be corrected for each wavelength band (λi) based on only the spectral characteristics of the illumination light source or only the spectral characteristics of the illumination light source during reproduction.

Further, it is determined whether or not conversion is selected or set for the spectral sensitivity characteristic such as the infrared film effect (step S327). When conversion is selected or set for spectral sensitivity characteristics such as an infrared film effect, the selected or set spectral sensitivity characteristics S _f2 (λ) or conversion characteristics stored in advance in the data memory 24. S _f1 (λ) → S _f2 (λ) is set (step S328). Then, the spectral image signal is converted into the spectral sensitivity characteristic S _f2 (λ) set in step S328 for each wavelength band (λi) (step S326).

  Next, it is determined whether recording or outputting with spectral image data is selected or set (step S330). When recording or outputting with spectral image data is selected or set, the spectral image V (x, y; λi) for each wavelength band (λi) is recorded in the buffer memory (B) 81 (step S331). .

  Further, it is determined whether or not recording or outputting with general image data is selected or set (step S332). When recording or outputting with general image data is selected or set, the luminance value V (x, y; λi) of each pixel is multiplied by a color matching function, and converted to R, G, B data. (Step S333). Further, the R, G, B data of each pixel of the captured spectral image of each wavelength band is subjected to multiplane addition synthesis and stored in the buffer memory (B) 81 (step S334).

  Accordingly, when recording or outputting as spectral image data is selected or set in the buffer memory (B) 81, the spectral image V (x, y; for each wavelength band (λi) for each t / n is selected. λi) is stored, and when recording or outputting as general image data is selected or set, R, G, B data of each pixel of the spectral image photographed every t / n is added to the multiplane The synthesized image is stored while being updated. When recording or outputting with spectral image data and recording or outputting with general image data are selected or set, both are stored.

  Next, it is determined whether or not spectral images having n bands have been captured, that is, whether or not i ≧ n is satisfied (step S335). If i ≧ n is not satisfied and n spectral images of the number of bands have not been captured, i is incremented (i = i + 1), and the next wavelength band (λi) indicated by the value of i is set. Select (step S336) and repeat the process from step S318. Therefore, the process of steps S318 to S335 is repeated n times at the timing of t / n. When the process is repeated n times, the determination in step S335 is YES, and the process proceeds from step S335 to step S337.

  Therefore, by repeating the processes of steps S318 to S335 n times, when recording or outputting with spectral image data is selected or set in the buffer memory (B) 81, every n wavelength bands are selected. If the spectral image is stored or recorded or output as general image data is selected or set, the R, G, and B data of each pixel of the spectral image in each of the n wavelength bands are multiplane addition synthesized. The single synthesized image thus stored is stored. Of course, when recording or outputting as spectral image data and recording or outputting as general image data are both selected, the buffer memory (B) 81 stores spectral images for n wavelength bands and n number of spectral images. A single composite image in which R, G, and B data of each pixel of the spectral image in each wavelength band is subjected to multi-plane addition synthesis is stored.

Next, compression and encoding processing of the captured image data stored in the buffer memory (B) 81 is executed (step S337). Further, the color profile of the photographed image is added to the photographed image that has been subjected to the compression and encoding processing (step S338). The photographed image data to which the color profile of the photographed image is added is stored and recorded in the image memory medium 25 (step S339).
Therefore, by connecting a printer to the USB terminal 26 after the photographing and setting the printer mode, data obtained by adding the color profile of each spectral image to the spectral image for each wavelength band, or a single data obtained by multi-plane addition synthesis. It is possible to output data obtained by adding the color profile of the composite image to the composite image.

  Thereafter, an image based on the photographed image data stored and recorded in the image memory medium 25 is preview displayed on the display unit 85 (step S340).

  FIG. 18 is a diagram illustrating the operation in the present embodiment. That is, in the present embodiment, the spectral image data V (x, y; λ1) to V (x, y; λ1n) continuously shot are spectral characteristics of the imaging system including “transmittance” and “sensitivity”. The spectral characteristics of the imaging system are corrected by the data (a), and the spectral characteristics of the illumination light source are corrected by the spectral emissivity characteristics (b) of the illumination light composed of “illumination light at the time of photography” and “illumination light at the time of reproduction”. Different spectral sensitivity characteristics (C) such as infrared film are converted. That is, in the wavelength band λ1 to λn, “sensitivity characteristic before conversion” is converted to “sensitivity characteristic after conversion. Thereafter, the tristimulus of each pixel is based on the color matching function (d) of the RGB color system. The values are calculated and added to the multiplane, and trimming / enlarging and noise removal / sharpening processing are performed as necessary to output RGB data.

  Therefore, by displaying an image based on this RGB data or printing an image with a printer, unlike a general digital camera, a special shooting is performed as with a film having a different spectral sensitivity characteristic. You can enjoy the effect. Of course, in addition to infrared films, UV sensitivity expansion films, black and white, and general visible light color films can also be used to vary and simulate the differences in characteristics and variations in the development process between manufacturers and products. It can also be used to reproduce.

  FIG. 19 is a diagram showing the spectral imaging sensitivity characteristics of various films, where the vertical axis represents logarithmic sensitivity and the horizontal axis represents wavelength. Accordingly, the illustrated spectral imaging sensitivity characteristic is stored in the data memory 24, and the spectral sensitivity characteristic is converted so as to be the spectral imaging sensitivity characteristic of the film for each band in the process of step S329 described above. It is also possible to display an image with characteristics as if it were taken with the film or to print and reproduce it.

  Further, when setting / selecting the spectral sensitivity characteristics to be converted such as the infrared film effect in step S305, the spectral sensitivity characteristics of the various films shown in the figure are displayed on the display unit 85, and the operation using the operation input unit 22 is performed. Thus, any of the displayed spectral sensitivity characteristics of various films can be selected. Thus, the user can easily set / select desired spectral sensitivity characteristics while confirming the spectral imaging sensitivity characteristics of various films.

  In the first embodiment described above, the spectral image signal is obtained in step S129 on the digital camera 1 side for each wavelength band (λi), and the used printer, printing ink, and printing paper obtained in step S128 are separated. Correction was made according to the characteristics. However, this processing may be performed on the printer side.

  That is, in a printing system including a digital camera 1 and a printer connected to the digital camera 1, the digital camera 1 side takes n spectral images of the number of bands and outputs it to the printer. For each band (λi), a correction process (step S129) is performed according to the spectral characteristics of the printer, printing ink, and printing paper used in step S128. Thereby, even in the printing system, an image close to the accurate color of the subject at the time of actual photographing can be reproduced.

  In the first embodiment described above, the spectral image signal is obtained in step S129 on the digital camera 1 side for each wavelength band (λi), and the used printer, printing ink, and printing paper obtained in step S128 are separated. Correction was made according to the characteristics. However, in a printing system including the digital camera 1 and a printer connected to the digital camera 1 via the USB terminal 26, the digital camera 1 side takes a spectral image of n transmission wavelength bands and takes the spectral image. Record the data.

  Thereafter, the recorded spectral image data and color profile information related to the spectral image data are output to the printer via the USB terminal 26, and the printer receives and records the spectral image data and color profile information for each transmission wavelength band. To do. Then, at least one spectral image data in the spectral image data for each transmission wavelength band received and recorded is corrected based on the color profile information received and recorded in the same manner. Further, the spectral image data for each transmission wavelength band including the corrected spectral image data is printed out on a predetermined sheet as reproduction image data.

  Thereby, also in the printing system, an image close to the accurate color of the subject at the time of actual photographing can be reproduced by printing.

It is a block diagram which shows the circuit structure of the digital camera common to each embodiment of this invention. It is a flowchart which shows the imaging | photography control processing procedure in the 1st Embodiment of this invention. It is a flowchart following FIG. It is a figure which shows the effect | action in 1st Embodiment. It is a figure which shows the usage condition of the digital camera which concerns on the embodiment. It is a figure which shows the other usage condition of the digital camera which concerns on the embodiment. It is a figure which shows the other usage condition of the digital camera which concerns on the embodiment. It is a figure which shows the other usage condition of the digital camera which concerns on the embodiment. It is a figure which shows the example of the recording method in the embodiment. It is a figure which shows the example of the other recording method in the same embodiment. It is a figure which shows the example of the other recording method in the same embodiment. It is a figure which shows the structural example of a compression data file. It is a figure which shows the example of the spectral distribution of the sun and shade which can be considered as the mixture of "sunlight + skylight." (A) is a figure which shows the relationship between the distribution emissivity characteristic of black body radiation, and color temperature, (b) is a figure which shows the spectral emissivity characteristic of daylight (sunlight of daytime), (c) is an incandescent lamp The figure which shows the spectral emissivity characteristic of (2), (d) is a figure which shows the spectral emissivity characteristic of an incandescent fluorescent lamp, (e) is a figure which shows the spectral emissivity characteristic of a 3 wavelength type | mold fluorescent lamp (daylight color). It is a flowchart which shows the process sequence which estimates or calculates the spectral characteristic of a light source. It is a flowchart which shows the imaging | photography control processing procedure in the 2nd Embodiment of this invention. It is a flowchart following FIG. It is a figure which shows the effect | action in the 2nd Embodiment of this invention. It is a figure which shows the spectral imaging sensitivity characteristic of various films.

Explanation of symbols

1 Digital Camera 2 Control Circuit 3 CPU
DESCRIPTION OF SYMBOLS 22 Operation input part 23 Program memory 24 Data memory 25 Memory card medium 25 Image memory medium 32 Spectral filter drive part 33 Temperature detection circuit 34 Focus lens drive part 35 Zoom drive part 36 Shake correction drive part 47 HDD storage device 48 Disk medium 49 Motor 58 Imaging Optical System 59 Spectral Filter 60 Image Sensor 62 Shutter 63 Image Sensor Unit 64 Horizontal Scanning Unit 65 Vertical Scanning Unit 66 P / S20 Conversion Unit 67 DSP Unit 68 S20 / P Conversion Unit 69 Preprocessing Unit 71 Band-Based Signal Processing Unit 72 Multiplane adder circuit 73 RGB converter 75 Color matrix circuit

Claims (16)

Filter means for changing the transmission wavelength band of the subject light in accordance with the input drive signal;
Spectral control means for inputting a drive signal to the filter means and changing the transmission wavelength band in a plurality of stages;
An imaging unit disposed behind the filter unit and capturing an image each time the filter unit changes a transmission wavelength band;
Correction means for correcting at least one spectral image data in the spectral image data for each transmission wavelength band imaged by the imaging means, based on correction data of a corresponding wavelength band in a predetermined correction element;
Output means for outputting spectral image data for each transmission wavelength band including the spectral image data corrected by the correction means to the outside as reproduction image data ,
The predetermined correction element is an illumination light source at the time of imaging by the imaging means,
The correction means includes at least one spectral image data in the spectral image data for each transmission wavelength band when the same subject imaged by the imaging means is in the sun, and a spectral for each transmission wavelength band in the shade. at least based on the one of the spectral image data, and estimates the illumination source at the time of shooting, the correction data imaging apparatus according to claim Rukoto comprising means for setting the image data. Wherein the predetermined correction factor, prior Symbol illumination source at the time of reproduction for reproducing an image based on the image data for reproduction, multicolor printers used to print reproducing the image based on the reproduction image data, printing inks, printing paper The imaging apparatus according to claim 1, wherein the imaging apparatus includes at least one kind of film virtually used at the time of imaging by the imaging unit. A storage means for storing the reproduction image data;
The imaging apparatus according to claim 1, wherein the output unit outputs the reproduction image data stored in the storage unit. A synthesizing unit that synthesizes spectral image data for each transmission wavelength band;
Storage means for storing the combined image data obtained by the combining means and the spectral image data for each transmission wavelength band in association with each other;
The output means outputs any one of the composite image data stored in the storage means and the spectral image data for each transmission wavelength band as reproduction image data. Or the imaging device of 2. In the case where the predetermined correction element is the multicolor printer,
A determination means for determining whether the printer is capable of printing based on the spectral image data;
The output means outputs the spectral image data for each transmission wavelength band as reproduction image data when printing based on the spectral image data is possible based on the determination result of the determination means. 5. The imaging apparatus according to claim 4, wherein in some cases, the composite image data is output as reproduction image data. In the case where the predetermined correction element is the multicolor printer,
3. The imaging apparatus according to claim 2, wherein the output means converts the reproduction image data into data that can be directly used for printing by the printer and outputs the data. In the case where the predetermined correction element is the multicolor printer,
The correction means includes
Receiving means for receiving spectral characteristic correction data related to the multicolor printer output from the multicolor printer;
The imaging apparatus according to claim 2, wherein the spectral characteristic correction data received by the receiving unit is used as the correction data. Before Symbol correction means,
An acquisition means for acquiring spectral radiance data of a standard light source and spectral radiance data of an illumination light source at the time of imaging by the imaging means,
Based on the spectral radiance data of the standard light source and the spectral radiance data of the illumination light source acquired by the acquisition unit, spectral image data for each transmission wavelength band captured by the imaging unit is captured by the standard light source. converting the spectral image data it is assumed that the image pickup apparatus according to claim 1, wherein. Before Symbol correction means,
An acquisition means for acquiring the spectral emissivity characteristic of illumination light at the time of imaging based on a subject whose spectral reflectance characteristic imaged by the imaging means is known;
Imaging device according to claim 1, wherein the spectral emissivity characteristic of the illumination light, characterized in that said correction data at the time imaging obtained by the obtaining means. In the case where the predetermined correction element is a type of film virtually used at the time of imaging by the imaging means,
The imaging apparatus according to claim 2, wherein the correction unit uses the spectral sensitivity characteristic of the film as the correction data. The virtualized using film, infrared film, ultraviolet films, black and white film, imaging apparatus according to claim 1 0, wherein a is any one of the general visible light color film. Display means for displaying a plurality of film type names;
Selecting means for selecting any one of the film type names displayed on the display means;
Wherein the correction means, the image pickup apparatus according to claim 1 0 or 1 1, wherein the spectral sensitivity characteristics corresponding to the type name of the selected film by the selection means to said correction data. Display means for displaying the characteristics of a plurality of films;
Selecting means for selecting any one of the characteristics of the film displayed on the display means;
Wherein the correction means, the image pickup apparatus according to claim 1 0 or 1 1, wherein that the spectral sensitivity characteristic of the correction data corresponding to the characteristics of the selected film by the selection unit. A printing system comprising an imaging device and a multicolor printer,
The imaging device
Filter means for changing the transmission wavelength band of the subject light in accordance with the input drive signal;
Spectral control means for inputting a drive signal to the filter means and changing the transmission wavelength band in a plurality of stages;
An imaging unit disposed behind the filter unit and capturing an image each time the filter unit changes a transmission wavelength band;
Spectral image data for each transmission wavelength band imaged by the imaging means and output means for outputting color profile information related to the spectral image data to the printer,
The printer is
Receiving means for receiving spectral image data and color profile information for each transmission wavelength band output by the output means;
Correction means for correcting at least one spectral image data in the spectral image data for each transmission wavelength band received by the receiving means based on the received color profile information;
Output means for printing out the spectral image data for each of the transmission wavelength bands including the spectral image data corrected by the correction means as reproduction image data ;
The color profile information includes correction data of a corresponding wavelength band in the illumination light source at the time of imaging by the imaging unit,
The correction means includes at least one spectral image data in the spectral image data for each transmission wavelength band when the same subject imaged by the imaging means is in the sun, and a spectral for each transmission wavelength band in the shade. A printing system comprising: means for estimating an illumination light source at the time of photographing based on at least one spectral image data in image data and setting the correction data . Filter means for changing the transmission wavelength band of the subject light according to the input drive signal, spectral control means for changing the transmission wavelength band to a plurality of stages by inputting the drive signal to the filter means, and the filter A computer having an imaging device that is arranged behind the device and includes an imaging device that captures an image every time the filter device changes a transmission wavelength band;
Correction means for correcting at least one spectral image data in spectral image data for each transmission wavelength band imaged by the imaging means, based on correction data of a corresponding wavelength band in a predetermined correction element;
An imaging apparatus control program that functions as output means for outputting the spectral image data for each of the transmission wavelength bands, the spectral image data of which has been corrected by the correction means, as reproduction image data .
The predetermined correction element is an illumination light source at the time of imaging by the imaging means,
The correction means includes at least one spectral image data in the spectral image data for each transmission wavelength band when the same subject imaged by the imaging means is in the sun, and a spectral for each transmission wavelength band in the shade. An imaging apparatus control program comprising means for estimating an illumination light source at the time of photographing based on at least one spectral image data in image data and setting the correction data . Filter means for changing the transmission wavelength band of the subject light in accordance with the input drive signal;
Spectral control means for inputting a drive signal to the filter means to change the transmission wavelength band in a plurality of stages, and imaging that is arranged behind the filter means and picks up every time the filter means changes the transmission wavelength band A method of controlling an imaging apparatus comprising:
A correction step of correcting at least one spectral image data in the spectral image data for each transmission wavelength band imaged by the imaging means, based on correction data of a corresponding wavelength band in a predetermined correction element;
Look including an output step of outputting the spectral image data of the respective transmission wavelength bands corrected the spectral image data by the correction step to the outside as reproduction image data,
The predetermined correction element is an illumination light source at the time of imaging by the imaging means,
The correcting step includes at least one spectral image data in the spectral image data for each transmission wavelength band when the same subject imaged by the imaging means is in the sun, and a spectral for each transmission wavelength band in the shade. at least based on the one of the spectral image data in the image data, and estimates the illumination source at the time of shooting, the image pickup apparatus control method comprising the free Mukoto step of setting the correction data.

Images