Embodiment
Below, with reference to description of drawings execution mode of the present invention.
Fig. 1 is the integrally-built figure that the color adjusting device of an embodiment of the invention is shown.Color adjusting device 20 shown in Figure 1 has housing, and this housing possesses light source chamber 20a and these two chambers of photograph unit room 20b.These light source chambers 20a and photograph unit room 20b were opened by circular hole slab in 23 minutes.On circular hole slab 23, be formed with circular hole 23a.
In light source chamber 20a, dispose camera bellows 21.On the face relative of camera bellows 21, be formed with circular hole 21a with photograph unit room 20b.In addition, in camera bellows 21, be provided with light source 22.Light source 22 for example is the such standard sources of A light source.Spectral sensitivity characteristic at this A light source shown in Fig. 2.As light source 22,, also can use the light source beyond the A light source here, so long as the radiation grade gets final product to the light source that long wavelength side increases continuously monotonously from short wavelength side.In structure shown in Figure 1, inject to photograph unit room 20b via circular hole 21a, 23a from the light of the light source 22 in the camera bellows 21.
In photograph unit room 20b, be provided with digital camera 26.In addition, between digital camera 26 and circular hole slab 23, dispose BPF disk 24.In this structure, can in 24 pairs of camera bellows 21 of BPF disk, take by digital camera 26.
Fig. 3 is the structure chart of digital camera 26 employed camera system parts.As shown in the drawing, remove harmful infrared composition through the light from light source 22 of imaging lens system group 11 incidents through infrared (IR) light cutoff filter mirror 12 as optics low pass filtered light microscopic, incide imaging apparatus portion 13 then.
Imaging apparatus portion 13 has microlens array 13a, filter 13b and imaging apparatus 13c.The light that microlens array 13a through imaging apparatus portion 13 is assembled according to each pixel for example images on the imaging apparatus 13c via the filter 13b as the color component cutting unit that former colour system Baeyer is arranged.Here, the filter that so-called former colour system Baeyer is arranged refers to 4 pixels of R, Gr, Gb, B as the itemize filter of position of a line of pixels.
As shown in Figure 4, with a plurality of, for example the different respectively logical optical filterings (BPF) 241~247 of bands of 7 peak wavelengths are configured in the BPF disk 24 that constitutes on the same circumference as spectrophotometric unit.And, motor 25 is installed on the central shaft of BPF disk 24.Can drive through the rotation of this motor 25, with being with logical optical filtering 241~247 to be inserted on the light path between light source 22 and the digital camera 26 arbitrarily.Here, the peak wavelength that band is led to optical filtering 241~247 is made as 440 [nm], 480 [nm], 520 [nm], 560 [nm], 600 [nm], 620 [nm], 640 [nm], and half breadth is made as 20 [nm] respectively.
And, in Fig. 1, on digital camera 26, being connected with stube cable 27, stube cable 27 is connected with personal computer (PC) 28.Stube cable 27 is stube cables of USB etc. for example.PC 28 has as the function of spectral sensitivity detecting unit, as the function of white balance coefficient calculation unit, as the function of color of object correction coefficient calculation; Calculate the corrected value of each digital camera 26, and the corrected value that set-up and calculated goes out in digital camera 26.In addition, PC 28 also controls through the rotation of motor 25 and drives the selection of the logical optical filtering 241~247 of band that is inserted into the BPF disk 24 in the light path, the actions such as photography in the digital camera 26.
The action of the color adjusting device of this execution mode then, is described.
Fig. 5 is the flow chart of contents processing that the color adjustment method of such digital camera 26 that is provided with as shown in Figure 1 is shown.Processing according to the program execution 5 in the for example hard disk of the PC 28 that is stored in Fig. 1.
At first, as initial setting, PC 28 will represent that the variable n of the wavelength of the logical optical filtering of the band of BPF disk 24 is set at initial value " 1 " (step S1).
Afterwards, PC 28 after the logical optical filtering 24n (n is 1~7) of the band that will be represented by variable n is inserted in the light path of digital camera 26, the photography (step S2) of the light source 22 that combine digital camera 26 carries out.The corresponding color signal data of the color alignment with filter 13b that obtain as the photography result of digital camera 26 are input to PC 28 via stube cable 27.After carrying out photography, whether the value of PC 28 decision variable n has reached the quantity N (N=7 in the example at Fig. 4) (step S3) at the logical optical filtering of all bands that forms on the BPF disk 24.In the judgement of step S3, do not reach under the situation of N in the value of variable n, the value of 28 couples of variable n of PC adds 1 (step S4).Afterwards, PC 28 returns processing to step S2, uses the logical optical filtering of new band to carry out photography.
In the photography of having used the logical optical filtering of each band, as shown in Figure 6, calculate the mean value of each color component of R, Gr, Gb, B of for example vertical 32 pixels * horizontal 32 pixels of the central portion of the color signal data that obtain through photography.Particularly Gr, Gb are further calculated as follows.
G=(Gr+Gb)/2
Thus, can calculate the mean value of each color component of R, G, B.Under the situation of Fig. 4, R, B are respectively the average of 256 color of pixel signal datas, and G is the average of 512 color of pixel signal datas.Through the processing of repeated execution of steps S2~S4, calculate the average color signal data of several 7 * 3 (RGB)=21 of sheet of the logical optical filtering of band, as the result of the photography of the logical optical filtering 241~247 of all bands that uses BPF disk 24.
In the judgement of step S3; Under the value that is judged to be variable n and the situation that all quantity N of the logical optical filtering of band equate, PC 28 uses the relative spectral sensitivity data (step S5) of the camera system parts of 21 color signal data computation digital cameras 26 that obtain through photographing for 7 times.
In step S5, PC 28 carries out the influence of computing with the spectral sensitivity of from the color signal data, eliminating light source 22 and the spectral transmission of being with logical optical filtering.Here, be under the situation of the logical optical filtering 241 of band of 440 [nm] at for example peak wavelength, when the spectral sensitivity characteristic of light source 22 is as shown in Figure 2, clip the wavelength 440 [nm] in this characteristic, 20 [nm] are half breadth.Here; If the value that the spectral sensitivity characteristic that is located at the scope interior focusing source 22 of wavelength 420 [nm]~460 [nm] is carried out behind the integration is Arsc_440; The spectral transmission that the wavelength 440 [nm] of the logical optical filtering 241 of band is located is Tr_440 (0<Tr_440<1); The color signal data that when photography, calculate mean value are respectively R_440in, G_440in, B_440in; When the spectral sensitivity data of each color component of obtaining are respectively R_cam_440, G_cam_440, B_cam_440, can obtain these values as follows.
R_cam_440=R_440_in/(Asrc_440×Tr_440)
G_cam_440=G_440_in/(Asrc_440×Tr_440)
B_cam_440=B_440_in/ (Asrc_440 * Tr_440) (formula 1)
The logical optical filtering 242~247 of other bands is also carried out and (formula 1) same computing.After 21 data that obtain to the results of the computings of the logical optical filtering of all bands, in order to make the computing that begins from subordinate easy, 21 data are carried out normalization, so that the maximum among the result who obtains as operation result becomes 1024.
Then, PC 28 judges whether the IR light cutoff filter mirror 12 of the camera system parts that are used as digital camera 26 is infrared external reflection type (step S6).If in digital camera 26, store the kinds of information of expression IR light cutoff filter mirror 12 in advance, then can be through obtaining the judgement that information is carried out step S6 from digital camera 26.
Generally speaking, the relative spectral sensitivity characteristic of known imaging apparatus has the characteristic of that kind shown in Figure 7.As shown in Figure 7, the R composition also has sensitivity in region of ultra-red.Therefore, for the correct light that detects the R composition, need to remove the infrared composition in the light that is included in the R composition.Therefore, at the former configuration IR of imaging apparatus portion 13 light cutoff filter mirror 12.Here, known IR light cutoff filter mirror exists INFRARED ABSORPTION type and infrared external reflection type.
The IR light cutoff filter mirror of INFRARED ABSORPTION type is the IR light cutoff filter mirror that constitutes the infrared composition of the light that absorbs institute's incident.
In addition, the IR light cutoff filter mirror of infrared external reflection type is the IR light cutoff filter mirror that constitutes the infrared composition of the light that reflects institute's incident.Example in the spectral transmission characteristic of the IR light cutoff filter mirror of the type of infrared external reflection shown in Fig. 8.The emulation of carrying out through the applicant obtains the characteristic of Fig. 8.
Generally speaking, the manufacture deviation of the cut-off wavelength of the IR light cutoff filter mirror of known infrared reflection type is bigger.Fig. 8 considers that this deviation shows three specific characters.Characteristic TYP shown in Figure 8 shows IR-cut to begin wavelength and IR-cut and finishes the spectral transmission characteristic that wavelength is respectively the representative IR light cutoff filter mirror of predetermined value (in Fig. 8, be 620 [nm], be 640 [nm] by finishing wavelength by the beginning wavelength).In addition, the characteristic MIN result that shows the spectral transmission characteristic that detects a plurality of IR light cutoff filter mirrors begins the characteristic that wavelength has moved to the lowest wavelength side for IR-cut.In addition, the characteristic of the characteristic MAX result that shows the spectral transmission characteristic that detects a plurality of IR light cutoff filter mirrors long wavelength side for the IR-cut wavelength has moved to.
Known have wavelength beyond obtaining the wavelength that also comprises the logical optical filtering of band that BPF disk 24 has, during as the whole relative spectral sensitivity characteristic of camera system parts the relative spectral sensitivity characteristic of the combination of IR light cutoff filter mirror 12 and imaging apparatus portion 13 (promptly as); If about infrared band is that the scope of wavelength 620 [nm]~640 [nm] is carried out spline interpolation merely, then the error with the sensitivity of reality becomes big.If the IR light cutoff filter mirror of INFRARED ABSORPTION type then can reduce the error with actual sensitivity through to carrying out linear interpolation between wavelength 620 [nm] and the wavelength 640 [nm].Relative therewith, under the situation of the IR of infrared external reflection type light cutoff filter mirror, shown in the A of Fig. 9, when between to wavelength 620 [nm] and wavelength 640 [nm], carrying out linear interpolation, become big with the error of the sensitivity of reality.Therefore, in this execution mode, whether carry out different interpolation processing for the infrared external reflection type according to the IR light cutoff filter mirror that is used as the camera system parts 12.
In the judgement of step S6, be under the situation of infrared external reflection type at IR light cutoff filter mirror 12, PC 28 obtains the relative spectral sensitivity data (step S7) of the interpolation wavelength beyond 7 kinds of specific wavelengths in step S5, obtaining.Obtain relative spectral sensitivity performance data R_cam_x, G_cam_x, the B_cam_x of the wavelength shown in the following table 1 here.X representes the value of the wavelength of following table 1.The value of the wavelength shown in the table 1 is to have set the value behind the wavelength of the spline interpolation of stating after being suitable for according to each color component.These wavelength are corresponding with the part that the relative spectral sensitivity data of each color component are carried out characteristic change respectively.
[table 1]
When obtaining relative spectral sensitivity data R_cam_x, G_cam_x, B_cam_x, suppose that the relative spectral sensitivity performance data of each wavelength of camera system parts of the representativeness combination of the IR light cutoff filter mirror that is provided with characteristic TYP is known here.Below, the relative spectral sensitivity performance data of each wavelength of the R composition of the camera system parts of the IR light cutoff filter mirror that is provided with this characteristic TYP, G composition, B composition is made as reference data, and be expressed as R_ref_x respectively, G_ref_x, B_ref_x.X representes the value of wavelength, and the grade according to per 1 [nm] between wavelength 380 [nm]~wavelength 700 [nm] changes.And; Specifically with after state; But, suppose that the relative spectral sensitivity data of wavelength 620 [the nm]~wavelength 640 [nm] in the R composition of camera system parts of representativeness combination of the IR light cutoff filter mirror that is provided with characteristic MIN and characteristic MAX also are known for the relative spectral sensitivity performance data of the R composition of obtaining wavelength 630 [nm].The relative spectral sensitivity performance data of camera system parts that is provided with the IR light cutoff filter mirror of characteristic TYP, characteristic MIN and characteristic MAX all can be obtained through actual measurement or emulation etc.
When supposition be provided with characteristic TYP IR light cutoff filter mirror the camera system parts each wavelength relative spectral sensitivity performance data and be provided with characteristic MIN and the R composition of the camera system parts of the representativeness of the IR light cutoff filter mirror of characteristic MAX combination in the relative spectral sensitivity data of wavelength 620 [nm]~wavelength 640 [nm] when known, can as following (formula 2), obtain in the relative spectral sensitivity data of each shown in the table 1.
R_cam_380=R_ref_380
G_cam_380=G_ref_380
B_cam_380=B_ref_380
R_cam_420=R_cam_440×(R_ref_420/R_ref_440)
G_cam_420=G_cam_440×(G_ref_420/G_ref_440)
B_cam_420=B_cam_440×(B_ref_420/B_ref_440)
G_cam_460=G_cam_440×(G_ref_460/G_fef_440)
B_cam_460=B_cam_440×(B_ref_460/B_ref_440)
(formula 2)
R_cam_500=R_cam_520×(R_ref_500/R_ref_520)
G_cam_500=G_cam_520×(G_ref_500/G_ref_520)
R_cam_540=R_cam_560×(R_ref_540/R_ref_560)
G_cam_540=G_cam_560×(G_ref_540/G_ref_560)
R_cam_570=R_cam_600×(R_ref_570/R_ref_600)
R_cam_590=R_cam_600×(R_ref_590/R_ref_600)
G_cam_590=G_cam_600×(G_ref_590/G_ref_600)
R_cam_610=R_cam_600×(R_ref_610/R_ref_600)
R_cam_630=b
Wherein, when following a<R_cam_620, b=a
During following a >=R_cam_620, b=R_cam_620
a=α×R_cam_620+β×R_cam_640
R_cam_670=R_cam_660×(R_ref_670/R_ref_660)
R_cam_680=R_ref_680
R_cam_700=R_ref_700
G_cam_700=G_ref_700
B_cam_700=B_ref_700
Can know from (formula 2),, directly use reference data about the little corresponding relative spectral sensitivity data of interpolation wavelength of deviation of the relative spectral sensitivity characteristic that causes with the deviation of the spectral transmission of IR light cutoff filter mirror.In addition; About the bigger corresponding relative spectral sensitivity data of interpolation wavelength of deviation ratio of the relative spectral sensitivity characteristic that causes with the deviation of the spectral transmission of IR light cutoff filter mirror, obtain according to the relative spectral sensitivity data and the ratio of immediate reference data.
Relative therewith, as shown in Figure 9, the relative spectral sensitivity data of the R composition of the king-sized wavelength 630 of deviation [nm] of the relative spectral sensitivity characteristic that causes about the deviation of the spectral transmission of IR light cutoff filter mirror use predetermined interpolation formula to obtain.The method of obtaining to the relative spectral sensitivity data of the R composition of this wavelength 630 [nm] describes.
In following explanation, the relative spectral sensitivity data of each wavelength of R composition are expressed as H (x).Here, x representes the value of wavelength.At this moment, to the IR light cutoff filter mirror of the infrared external reflection type of various spectral transmission characteristics, obtain the value of H (620)/H (640) and the value of H (630)/H (640).And, with H (620)/H (640) be set at transverse axis, H (630)/H (640) is set at the longitudinal axis and processes curve chart.At this moment, can know according to applicant's simulation result and can access curve chart shown in Figure 10.Shown in figure 10, the relation of the value of the value of H (620)/H (640) and H (630)/H (640) is a linear relationship.Orthoscopic shown in Figure 10 can be represented as follows.
H (630)/H (640)=α * (H (620)/H (640))+β (formula 3)
If find the solution (formula 3), then can access the relation of following (formula 4) about H (630).
H (630)=α * H (620)+β * H (640) (formula 4)
At the interpolation formula shown in (formula 4) with corresponding at " a " shown in (formula 2).If the relative spectral sensitivity data of the wavelength 620 [nm]~640 [nm] of characteristic TYP, characteristic MIN and characteristic MAX are known respectively, then can obtain alpha, the β of (formula 3) here.That is,, then can obtain alpha, β if the R11 of Fig. 9, R12, R13, R21, R22, R23, R31, R32, these 9 points of R33 are known.Under the situation of the example of Fig. 8, α=0.83, β=0.19.
According to (formula 4) discussed above, can obtain relative spectral sensitivity data to 630 [nm] of the IR light cutoff filter mirror of the infrared external reflection type of any characteristic.In addition, as also illustrating in (formula 2), be under the situation more than the R_cam_620 in the value of " a ", the value of R_cam_630 is restricted to the value of R_cam_620.As shown in Figure 8, in the relative spectral sensitivity characteristic of R composition, the relative spectral sensitivity data of wavelength 620 [nm] are littler than the relative spectral sensitivity data of wavelength 630 [nm] usually.Therefore, be under the situation more than the R_cam_620 in the value of " a ", do not use this moment " a " value and use the value of R_cam_620.
After as above that kind is obtained the relative spectral sensitivity performance data corresponding with each interpolation wavelength of wavelength 380 [nm]~wavelength 700 [nm]; The spline interpolation of the relative spectral sensitivity data of relative spectral sensitivity data and the interpolation wavelength among step S7s obtained of PC 28 through using the wavelength in step S5, obtain obtains the relative spectral sensitivity performance data (step S8) of every camera system parts at a distance from wavelength 1 [nm].Here, the result of spline interpolation be the value of relative spectral sensitivity data less than 0 situation under, be 0 with the relative spectral sensitivity data limit of this wavelength.Result in spline interpolation shown in Figure 11.Here; Figure 11 (a) shows the spectral sensitivity performance data of the R composition of camera system parts; Figure 11 (b) shows the spectral sensitivity performance data of the G composition of camera system parts, and Figure 11 (c) shows the spectral sensitivity performance data of the B composition of camera system parts.In addition, the relative spectral sensitivity data of the point drawn of the black circle of usefulness of each figure specific wavelength representing to obtain through actual measurement.On the other hand, the relative spectral sensitivity data of the point drawn of the white circle of usefulness of each figure interpolation wavelength representing to obtain through interpolation processing.
In addition; In the judgement of step S6; At IR light cutoff filter mirror 12 is under the situation of INFRARED ABSORPTION type; The spline interpolation of the relative spectral sensitivity data of PC28 through using 7 kinds of wavelength in step S5, obtaining obtains the relative spectral sensitivity performance data (step S9) of the camera system parts of per 1 [nm] wavelength.Here, the result of spline interpolation be the value of relative spectral sensitivity data less than 0 situation under, be 0 with the relative spectral sensitivity data limit of this wavelength.In addition, about the scope of wavelength 620 [nm]~640 [nm], obtain relative spectral sensitivity data through linear interpolation.
After that kind calculated the relative spectral sensitivity performance data whole as the camera system parts as previously discussed, PC 28 calculated the corrected value (step S10) of white balance according to each light source.And, the PC 28 special color correction value of calculating about color of object (step S11).Through the calculating of these corrected values, finish a series of processing of Fig. 5.Here, be used for calculating the corrected value of white balance and the method for color correction value, for example can use No. 4460717 disclosed method of communique of japanese according to relative spectral sensitivity performance data.Therefore, omit its detailed description here.
As above illustrated; According to this execution mode; When calculating the relative spectral sensitivity performance data of using to the white balance correction of the camera system parts of the IR light cutoff filter mirror that is provided with the infrared external reflection type and color correction; Use in the relative spectral sensitivity data that go out according to the color signal data computation, be the relative spectral sensitivity data of wavelength 620 [nm] as the specific wavelength of short wavelength side and be the relative spectral sensitivity data of wavelength 640 [nm] as the specific wavelength of long wavelength side with respect to wavelength 630 [nm] with respect to wavelength 630 [nm], calculate that to become big wavelength be the relative spectral sensitivity data of the wavelength 630 [nm] of interpolation object carrying out the linear interpolation time error.Can know that there are linear relationship in the value of H (620)/H (640) and the value of H (630)/H (640); Therefore can also be according to the relative spectral sensitivity data of 620 [nm] and the relative spectral sensitivity data of wavelength 640 [nm], the wavelength that correctly calculates between it is the relative spectral sensitivity data of wavelength 630 [nm].Thus, can also carry out correct color adjustment for the digital camera 26 of camera system parts with the IR light cutoff filter mirror that is provided with the infrared external reflection type.In addition, to the INFRARED ABSORPTION type, also can with likewise carried out the adjustment of correct color in the past.
In addition, through as table 1, setting the interpolation wavelength being suitable for spline interpolation, if the IR light cutoff filter mirror of infrared external reflection type, then can only calculate the correct spectral sensitivity performance data of each color component with spline interpolation.At this moment, need not make up spline interpolation and linear interpolation, its result can realize reduction in processing time.
Here; In this execution mode; IR light cutoff filter mirror about the INFRARED ABSORPTION type; Combination spline interpolation and linear interpolation are calculated the spectral sensitivity performance data, if still likewise obtain the relative spectral sensitivity data of interpolation wavelength with the IR light cutoff filter mirror of infrared external reflection type, then can also only calculate the spectral sensitivity performance data with spline interpolation.At this moment, the relative spectral sensitivity data of representative camera system parts that need to be provided with the IR light cutoff filter mirror of INFRARED ABSORPTION type store among the PC 28 as reference data in advance.
In addition, in this execution mode, in order to obtain α, the β of (formula 4), use the relative spectral sensitivity data of 3 kinds of representative camera system parts of the IR light cutoff filter mirror that is respectively arranged with characteristic TYP, characteristic MIN and characteristic MAX to process the curve chart of Figure 10.As long as there is linear relationship in the value of the value of H (620)/H (640) and H (630)/H (640), therefore 2 curve charts that just can process Figure 10 of minimum drafting.That is,, not necessarily need obtain being respectively arranged with 3 kinds of relative spectral sensitivity data whole of the IR light cutoff filter mirror of characteristic TYP, characteristic MIN and characteristic MAX in order to obtain α, β.That is, as long as obtain any at least two among characteristic TYP, characteristic MIN and the characteristic MAX.Otherwise, thereby also can obtain α, β with the curve chart that comes up more correctly to process Figure 10 through drawing at 4.
According to above execution mode the present invention has been described, but has the invention is not restricted to above-mentioned execution mode, certainly in the scope of aim of the present invention, carried out various distortion and application.
And above-mentioned execution mode has comprised the invention in various stages, can extract various inventions through the appropriate combination of disclosed a plurality of inscapes.For example, though from all inscapes shown in the execution mode the several inscapes of deletion, can solve above-mentioned problem, and obtain under the situation of above-mentioned effect, deleted structure after this inscape and also can be used as invention and extract.