KR20070019743A - Imaging system - Google Patents

Abstract

In a photographing system for photographing a subject, color information detecting means (2) for detecting color information of the subject, color image capturing means (1) for photographing a color image of the subject, and the color information detecting means; Color correction means (3) for performing color correction of the color image picked up by the color image pickup means from the corresponding positional information of the color image pickup means is provided, enabling high-precision color correction.

Subject, color information, color correction, spectral filter, RGB image memory, colorimeter

Description

Shooting system {IMAGING SYSTEM}

The present invention relates to a photographing system that performs color correction of an input image using spectral spectral information of a subject.

Background Art Conventionally, color management is performed in many fields such as the industrial field, the food field, and the medical field. For example, in the industrial field, color management with respect to the color of the manufactured product is performed, and colorimeters, such as a spectrometer and a colorimeter, are used for checking whether the product is finished to the color within a specification. In the medical field, for example, color management of the color of the skin is performed in dermatology. Digital cameras are often used to record changes in the color of the skin.

In recent years, digital cameras have become increasingly high in size and inexpensive, and with this, the field of use in color management is also expanding. For example, digital cameras are also used in the dental field.

The digital camera has an advantage of easily acquiring an image of the affected part and confirming the image immediately after the image is taken. On the other hand, since the accuracy of color correction is low, the color of the captured image is different each time the image is taken, even for the same subject. There is a problem. The accuracy of color correction in a digital camera is lowered by various causes. In particular, the effect of the reduction in the detection accuracy of the white balance on the accuracy of the color correction is large.

Therefore, Japanese Unexamined Patent Application Publication No. 2003-125422 (hereinafter referred to as Document 1) proposes to improve the correction accuracy of white balance. In this proposal, the correction accuracy of the white balance is improved by using the information of the colorimetric sensor when the digital camera is photographed. That is, Document 1 corrects the signal value of the digital camera based on the RGB value of the obtained colorimetric sensor by providing the colorimetric sensor in a direction substantially the same as the area photographed by the digital camera. In this case, the RGB values of the image data photographed with the digital camera are averaged for the entire RGB screen and compared with the colorimetric sensor.

By the way, in a dermatology and dental medical field, there is a high demand for acquiring accurate color only in the affected part of the image. However, in Document 1, since the purpose is to simply adjust the white balance of the entire screen, accurate color cannot be obtained for the affected part.

For example, in the medical field of dermatology, it is necessary to grasp multiple changes without overlapping the date and time, since it is necessary to grasp the temporal changes such as inflammation of the skin. In this case, photographing each time under the same background is almost impossible at the actual medical scene. When the background image of the affected part is changed in this manner, the white balance correction coefficient for obtaining the optimum white balance is also changed. That is, in this case, even if the same affected part is photographed under the same lighting conditions, the RGB values of the captured images are different for each image.

In addition, even if the background image can be fixed, it is difficult for a digital camera to obtain RGB values conforming to the CIE RGB color system, that is, RGB values according to the characteristics of the human eye. It is difficult to detect the color with the precision of.

This invention is made | formed in view of such a problem, and an object of this invention is to provide the imaging system which can perform highly accurate color correction with respect to a picked-up image.

<Start of invention>

Means for solving the problem

An imaging system according to claim 1 of the present invention is an imaging system for photographing a subject, comprising: color information detecting means for detecting color information of the subject, color image imaging means for capturing a color image of the subject, And color correction means for performing color correction of the color image picked up by the color image pickup means from the corresponding positional information of the color information detection means and the color image pickup means.

In the present invention, the color image capturing means photographs the color image of the subject, and the color information detecting means detects the color information of the subject. From the corresponding position information of the color information detecting means and the color image capturing means, the position in the color image of the detected color information is obtained, and for this corresponding position, color correction is performed with high accuracy by performing color correction on the color image using the color information. Obtained color image.

1 is a block diagram showing a photographing system according to a first embodiment of the present invention.

FIG. 2 is an explanatory diagram showing an appearance when the photographing system of FIG. 1 is applied to a digital camera. FIG.

3 is a block diagram showing a specific configuration of the digital camera 13 and spectrometer 10 of FIG. 1.

FIG. 4 is a block diagram showing a specific configuration of the color correction unit 3 in FIG. 3.

5 is an explanatory diagram showing a display example on the finder 11;

6 is an explanatory diagram for explaining a relationship between a camera position and a subject;

7 is a block diagram showing another example of a color correction unit.

8 is an explanatory diagram for explaining the display of the image display unit 7;

9 is a block diagram illustrating another example of a colorimeter.

10 is a flowchart for explaining the calculation of positional information.

Fig. 11 is a block diagram showing a second embodiment of the present invention.

12 is a block diagram illustrating a modification of the second embodiment.

Fig. 13 is an explanatory diagram showing a third embodiment of the present invention.

FIG. 14 is a block diagram showing a specific configuration of the image processing apparatus 202 in FIG. 13.

15 is an explanatory diagram showing a modification of the third embodiment.

Explanatory drawing which shows the modification of 3rd Embodiment.

17 is an explanatory diagram showing a fourth embodiment of the present invention.

18 is an explanatory diagram showing a fifth embodiment of the present invention.

19 is an explanatory diagram illustrating a configuration of a color separation filter 230.

20 is an explanatory diagram for explaining a characteristic of an imaging band.

FIG. 21 is a block diagram showing the circuit configuration of the interior of the digital camera 229. FIG.

22 is an explanatory diagram for explaining a corresponding position;

FIG. 23 is a block diagram showing a specific configuration of the color correction unit 244 in FIG. 21.

24 is an explanatory diagram showing a variable wavelength filter 237 using a liquid crystal or the like.

Fig. 25 is a block diagram showing the sixth embodiment of the present invention.

FIG. 26 is an explanatory diagram showing a configuration of a spectral filter 54 in FIG. 25.

27 is an explanatory diagram for explaining the operation dial 8;

FIG. 28 is an explanatory diagram showing an example in which the shooting directions and angles of view of the digital camera 245 and the multi-band camera 50 are matched.

29 is an explanatory diagram for explaining camera shake correction;

30 is a block diagram showing the configuration of a misalignment correction unit.

Fig. 31 is a block diagram showing the seventh embodiment of the present invention.

32 is a block diagram showing a specific circuit configuration of an image processing unit.

33 is a block diagram showing a specific configuration of the corresponding position calculating unit 107 in FIG. 32.

34 is an explanatory diagram showing an input image of the correspondence position calculation unit 107.

35 is an explanatory diagram for explaining each shooting mode;

36 is an explanatory diagram for explaining the operation of the embodiment;

Fig. 37 is a block diagram showing another example of application using the image processing unit 269 that uses a colorimetric image as the image processing unit.

FIG. 38 is an explanatory diagram showing an eighth embodiment of the present invention; FIG.

<Best mode for carrying out the invention>

EMBODIMENT OF THE INVENTION Hereinafter, embodiment of this invention is described in detail with reference to drawings. 1 is a block diagram showing a photographing system according to a first embodiment of the present invention.

In FIG. 1, the photographing system has a color image pickup unit 1 and a color information detection unit 2. The color image capturing unit 1 is constituted by, for example, a digital camera, and picks up an object (not shown), and outputs a color image such as an RGB three primary color image to the color correcting unit 3, for example.

The color information detection unit 2 detects color information at a predetermined position of a part of the subject captured by the color image pickup unit 1 and outputs the detected color information to the color correction unit 3. . The color correcting unit 3 is also inputted with corresponding positional information indicating which position in the color image from the color image capturing unit 1 corresponds to the color information detected by the color information detecting unit 2.

The color correction unit 3 corrects the information of the corresponding position in the color image by the color information based on the corresponding position information, and outputs it as a corrected color image.

FIG. 2 is an explanatory diagram showing an appearance when the photographing system of FIG. 1 is applied to a digital camera.

In this embodiment, the digital camera 13 which acquires RGB information as information of a color image is employ | adopted. A spectrometer (hereinafter referred to as a colorimeter) 10 as a colorimeter for detecting a spectrum as color information is attached to this digital camera 13. 2 shows only the main components of the digital camera. That is, the digital camera 13 is comprised by the imaging lens 4, the RGB color imaging element 5, the image processing part 6, the image display part 7, and the operation dial 8. In the case of the digital camera 13, a connecting portion 9 for attaching the spectrometer 10 is provided, and the connecting portion 9 attaches the spectrometer 10 like a normal strobe. The spectrometer 10 is a main component of the finder 11 and the angle sensor 12.

FIG. 3 is a block diagram showing a specific configuration of the digital camera 13 and spectrometer 10 of FIG. 1.

Reference numeral 14 denotes a subject to be photographed, and FIG. 3 illustrates an example in which the subject 14 is a human arm. Reference numeral 15 denotes a target portion, for example, an affected portion (inflammatory portion) in the arm. The digital camera 13 forms an image of the subject on the RGB color image pickup device 5 by the photographing lens 16. The signal processing unit 17 is an analog processing circuit that performs gain correction, offset correction, and the like. Reference numeral 18 denotes an AD converter, and reference numeral 19 denotes an RGB image memory which is a storage unit of an RGB image.

The colorimeter 10 is comprised by the spectroscopic detection part 25 and the camera attachment part 26, and the spectroscopic detection part 25 rotates up, down, left, and right with respect to the camera attachment part 26. As shown in FIG. Reference numeral 22 denotes a photographing lens of the spectrometer 10, and the luminous flux of the subject 14 is sent to the spectrometer 24 and the finder 11 through the half mirror 23. The angle sensor 12 detects a rotation angle of the spectroscopic detector 25 and outputs angle information. The spectrometer 24 spectra the incident light from the half mirror 23 and outputs spectral information.

The angle information from the angle sensor 12 and the spectrum information from the spectrometer 24 are provided and stored in the angle data memory 28 or the colorimetric data memory 27 in the digital camera 13, respectively.

The corresponding position detection unit 21 in the image processing unit 6 of the digital camera 13 uses a colorimeter based on the angle information obtained from the angle sensor 12, the angle of view information of the photographing lens 16, and the distance information to the subject. The position where the measurement position on the subject (10) is in the photographed RGB image is calculated. Corresponding positional information is provided to the color correction unit 3 as two-dimensional coordinate information (Cx, Cy). Reference numeral 20 denotes an image storage unit, and reference numeral 7 denotes an image display unit, which stores and displays RGB images corrected by the color correction unit 3, respectively.

FIG. 4 is a block diagram showing a specific configuration of the color correcting section 3 in FIG.

Reference numeral 29 denotes an image cropping unit for cutting out an image from the RGB image memory 19 based on the corresponding positional information (Cx, Cy), reference numeral 30 denotes a data average unit for calculating the average of the cut-out data, and reference numeral 31 Denotes a spectrum estimating section for performing spectral estimation from the averaged data, and reference numeral 32 denotes a correction coefficient calculating section for calculating a correction coefficient C (λ). Reference numeral 33 is a subject spectrum estimation unit for estimating the spectrum of each position of the subject 14 based on the RGB signal stored in the RGB image memory 19, and reference numeral 34 is a signal correction unit. Reference numeral 35 is an RGB converter for converting from spectral signals to RGB.

Next, the effect | action of embodiment comprised in this way is demonstrated with reference to FIG. In this embodiment, the imaging in dermatology will be described as an example. 5 is an explanatory diagram illustrating a display example on the finder 11. 6 is an explanatory diagram for explaining a relationship between a camera position and a subject.

First, at the time of imaging, the digital camera 13 is installed on a camera fixing device not shown, such as a tripod. While sitting on a chair or the like, the patient places the affected part (in this case, a part of the arm) on the desk, and fixes it so as to face the shooting direction of the digital camera 13 so as not to move.

An operator such as a doctor or a nurse controls the framing of the subject 14 to be photographed by manipulating a handle of a zoom or a tripod of the digital camera 13 (not shown). For example, it is assumed that the entire arm including the affected part is photographed. In this case, the affected part is not necessarily located at the center of the screen of the digital camera 13. When the framing is determined, the affected part is next positioned at the center of the screen while looking at the finder 11 of the colorimeter 10.

In the finder 11, as shown in FIG. 5, the measurement direction of the colorimeter 10 can be straightened with respect to the subject 14 by fitting the circular part in a center to an affected part. In this manner, when the digital camera 13 and the colorimeter 10 are ready for shooting, shooting is performed, and the image data of the photographed subject image is transferred to the RGB image memory 19, and the spectral data is the colorimetric data. It is stored in the memory 27.

The relationship between the camera position at the time of photography and the subject 14 is as shown in FIG. That is, the angle of view α of the digital camera 13, the distance information L from the AF information to the subject 14 converted, the angles θ, φ of the colorimeter, and the digital camera 13 and the side. From the baseline length B of the color system 10, the position of the object of interest (the image of the attention part 15) on the RGB image can be calculated. The correspondence position calculation unit 21 calculates the correspondence position as two-dimensional coordinate values Cx and Cy by calculation and outputs it to the color correction unit 3.

The color correction unit 3 cuts out the rectangular region centered on the corresponding position of the subject image stored in the RGB image memory 19 based on the calculated two-dimensional coordinate values Cx and Cy. The size of the rectangular area is, for example, 16 x 16 pixels. The average value (Rave, Gave, Bave) of all the pixels is obtained by the data averaging section 30 for the image signal of this rectangular area. The spectrum estimating unit 31 estimates the spectral signal S1 (λ) from the average values Rave, Gave and Bave by, for example, the method disclosed in Japanese Patent Laid-Open No. 11-085952. Next, the correction coefficient calculation unit 32 calculates the correction coefficient C (λ) by the following equation 1 using the spectrum information S2 (λ) stored in the colorimetric data memory 27.

On the other hand, from the RGB image memory 19, image data is sequentially read out for each pixel, and the subject spectrum estimation unit 33 is sequentially converted into a spectral signal. Then, in the signal correcting section 34, the correction coefficient C (?) Calculated by the correcting coefficient calculating section 32 is multiplied to correct the signal value. The corrected spectrum signal value is converted into an RGB value by the RGB converter 35, and a corrected R'G'B 'signal as a corrected color image is output. This correction R'G'B 'signal is sent to the image storage unit 20 and the image display unit 7, for example.

Thus, according to this embodiment, since the RGB image obtained by imaging is correct | amended based on the spectral data acquired by the colorimeter installed separately, the highly accurate color correction is possible. In the calculation of the correction coefficient, since the predetermined area of the RGB image corresponding to the measurement position of the colorimeter is accurately detected, the accuracy of the correction coefficient is very high.

In the present embodiment, the RGB data is converted once into spectral data at the time of correction. However, as shown in FIG. The correction coefficient may be obtained as a coefficient corresponding to the RGB signal, and the coefficient may be multiplied by the RGB image data. In this case, the object spectrum estimation unit and the RGB conversion unit become unnecessary, and the computation amount can be greatly reduced.

In addition, as shown in FIG. 8, the image display unit 7 of the digital camera may display the corresponding position of the colorimeter by superimposing marks such as crosses. This mark position is displayed based on Cx and Cy calculated | required by the correspondence position calculation part 21. FIG. The operator can perform imaging by moving the colorimeter 10 up, down, left, and right while looking at this mark so as to align the mark position on the affected part, which is the target portion 15. Since the corresponding position can be confirmed on the screen, the position alignment of the corresponding position can be performed accurately.

In addition, as shown in FIG. 9, a laser pointer 36 may be provided in the colorimeter 10 to obtain a corresponding position. In this case, when the position of the colorimeter 10 is aligned, the colorimeter of the colorimeter 10 is matched to the affected part (the attention part 15) of the subject by the finder 11 as described above. And light is irradiated from the laser pointer 36 at the time of imaging | photography by the digital camera 13, and the image which the laser pointer 36 picked up is image | photographed. Next, the image to which the laser pointer 36 was not irradiated is image | photographed. In the correspondence position calculator 21, as shown in Fig. 10, the difference between the image irradiated by the laser pointer 36 and the image not irradiated is detected, and the correspondence position is calculated using a point with a large difference value.

FIG. 11 is a block diagram showing a specific configuration of the digital camera 13 'and the spectrometer 10 as related to the second embodiment of the present invention. In Fig. 11, the same components as those in Fig. 3 are denoted by the same reference numerals and description thereof will be omitted.

In the first embodiment, the colorimeter is moved left and right and up and down to detect the angles θ and φ so as to detect a corresponding position with the RGB image. In this embodiment, the photographing direction of the colorimeter is controlled at a position aimed at the digital camera. Characterized in that.

As shown in FIG. 11, unlike the first embodiment, the present embodiment includes a corresponding angle calculator 40 and a rotation motor 41. The spectroscopic detection part 25 is comprised so that it may only move up and down with respect to the camera attachment part 26 '. In the digital camera 13 ', the attentional part 15 is always captured in the center of the imaging range of the camera. Then, in the corresponding angle calculator 40, the angle at which the spectral detector 25 captures the target portion 15 is calculated from the distance information to the subject 14 or the angle of view of the camera, and rotated so as to be at this angle. The motor 41 is configured to be controlled.

In the embodiment configured in this manner, at the time of shooting, first, the digital camera 13 'is substantially aligned with the subject 1 so that the affected part (the main portion 15) of the subject 14 is located at the center of the shooting screen. Adjust the camera position. Thereafter, when the shutter button (not shown) is pressed halfway, AF operation is performed, and the distance to the subject 14 is measured. Based on this information, the correspondence angle calculation part 40 calculates the angle (phi) which the imaging direction of the colorimeter 10 turns into the target part 15 (circular part) of the subject 14. And while using the information of the angle sensor 12, the spectral detection part 25 is rotated by the rotating motor 41, and the angle is stopped in the position which becomes this angle (phi). Information at which the angle is at a predetermined angle is transmitted to the digital camera 13 'side, and a mark or the like indicating that the image can be taken is displayed on the image display unit 7. After confirming the display of this mark, the photographer performs shooting while holding the shutter button completely down. In this way, an RGB image and spectral data at approximately the same time are recorded. The subsequent processing is almost the same as in the first embodiment, but as the corresponding positional information used in the image cropping unit 29, a value indicating the coordinate of the center of the screen is provided.

Thus, in this embodiment, since the direction of a colorimeter changes automatically with the information of a photography distance, it is not necessary for a photographer to perform position alignment of a colorimeter, and it can take photography very simply. In addition, since photographing is performed by displaying on the image display unit whether or not the direction of the colorimeter is changed and confirming, the relationship between the RGB image and the photographing range of the colorimeter can be accurately defined.

In addition, although this confirmation was made to display a specific mark in an image display part, it may transmit by sound and may turn on lamps, such as LED. In the case where the affected part is taken out of the center of the screen and photographed using the focus lock of the digital camera, the rotation angle of the camera may be detected to rotate the colorimeter to the left and right.

12 shows a modification of this embodiment. The mirror 23 of the colorimeter 10 has a rotating structure, and can move to a broken line position. When the mirror 23 is moved to this broken line position, the light beam from the white plate 200 enters the colorimeter 10 and the illumination spectrum around the digital camera 3 'can be detected. By using the illumination spectrum information detected in this way, it is possible to detect accurate color information of the subject 14. As a detailed detection method, the method disclosed by Unexamined-Japanese-Patent No. 11-085952 should just be employ | adopted. At the time of imaging, together with the information of the digital camera 13 ', the spectrum information of the attention part 15 and the illumination spectrum around the digital camera 3' are measured, and based on these information, The correct color is estimated.

FIG. 13 and FIG. 14 relate to a third embodiment of the present invention, and FIG. 13 is an explanatory diagram showing an appearance of the apparatus. This embodiment shows an example in which a colorimeter and a digital camera can be attached separately by attaching the digital camera to a tripod or the like.

In Fig. 13, reference numeral 201 denotes a tripod to which both the colorimeter 10 and the digital camera 13 "can be attached. The colorimeter 10 and the digital camera 13" are respectively an image processing apparatus 202. Is connected to. The image processing device 202 is a control device configured by a personal computer or the like.

FIG. 14 is a block diagram showing a specific configuration of the image processing apparatus 202 in FIG. 13.

In Fig. 14, reference numeral 204 denotes an external device controller, for example, a controller such as USB or RS-232C. Reference numeral 205 denotes data input I / F. Spectrum information is input from the colorimeter 10, and RGB image data is input from the digital camera 13 ". Spectrum acquired by the data input I / F 205. The information and the RGB image data are provided and stored in the colorimetric data memory 209 or the RGB image memory 210, respectively.

The target position designation unit 206 designates which position on the RGB image the color point of the colorimeter 10 is located. The color correction unit 212 performs color correction on the RGB image data based on the spectrum information. The color reproduction processing unit 207 performs color correction again on the RGB image corrected by the color correction unit 212 using the profile information of the image display unit 208. The image storage unit 213 stores the RGB image data corrected by the color correction unit 212 or the color reproduction unit 207. The CPU 211 controls the entire image processing apparatus 202.

In the above-described embodiment, the digital camera 13 "is photographed first by the control of the image processing apparatus 202, and the color measurement by the colorimeter 10 is performed next. Digital camera 13" The RGB image data from and the spectral information from the colorimeter 10 are stored in the RGB image memory 210 or the colorimetric data memory 209, respectively.

The target position designation unit 206 displays the photographed RGB image on the image display unit 208. While photographing the display by the image display part 208, the photographer designates the color point in the colorimeter 10 using the screen position indicating device which is not shown, such as a mouse. Corresponding positional information (Cx, Cy) based on angle information, angle of view information, distance information to the subject, etc. from the colorimeter 10 and the digital camera 13 "is provided to the color correction unit 212 (not shown). The color correcting unit 212 corrects the color of the RGB image data based on the output of the colorimeter 10 in the region based on the corresponding position information in the RGB image.

Thus, in this embodiment, both of the digital camera 13 "and the colorimeter 10 can use a commercially available thing as it is, and a high precision color correction can be performed easily with a simple structure.

In addition, as shown in FIG. 15, the digital camera 13 "and the colorimeter 10 are connected by the signal line 203 so that communication can be carried out, so that photographing by the digital camera 13" and color measurement by the colorimeter 10 can be performed. In addition, the data of the colorimeter 10 can be supplied to the image processing apparatus 202 via the digital camera 13 ", and the system can be simplified by reducing the number of signal lines.

16 shows a modification of the third embodiment. In the modification of Fig. 16, the lighted hood 220 is attached to the digital camera 13 ". The lighted hood 220 includes a lighting device 221 and a colorimeter. 10 is fixed and attached, and when shooting, the tip of the hood 220 is brought into contact with the subject 14 to be photographed, and the photograph is taken at the center of the digital camera 13 ". The colorimetric point of the colorimeter 10 is also set in the position of the point P which exists.

According to such a structure, the center position of the photographing screen of the digital camera 13 "can be measured simply by the colorimeter 10 only by pressing the exclusive hood 220 firmly on the subject 14. Correspondence position can always be set fixedly, and a very simple and stable shooting | photography can be performed.

It is explanatory drawing which shows 4th Embodiment of this invention. In this embodiment, the digital camera and the colorimeter are not separately configured, but the imaging system including the colorimeter is configured inside the digital camera.

As shown in FIG. 17, the half mirror 215 and the spectral detection part 216 are provided in the digital camera 214 in this embodiment. The half mirror 215 guides a part of the luminous flux of an unillustrated subject (center subject of the screen of the digital camera) on the optical axis to the spectroscopic detector 216. The half mirror 215 is rotated in the direction of the arrow in FIG. 17 at the time of imaging of the RGB color imaging element 5 to guide the luminous flux of the subject to the RGB color imaging element 5.

In the embodiment configured in this way, first, when the shutter button (not shown) is pressed halfway, the focus is adjusted to the center position of the screen, and then the spectrum of the subject at the center of the screen is measured by the action of the spectroscopic detector 216. Next, when the shutter button is fully pressed, the mirror 215 is rotated, the luminous flux of the subject is incident on the RGB color imaging element 5, and imaging of the RGB image is performed. The other processing is the same as that of the first embodiment.

Thus, in this embodiment, since the spectroscopic detection part 216 is provided in the inside of a camera, and is not comprised separately like each said embodiment, since the same optical system and imaging element are used, it is very easy to use. . Also, by always setting the center position of the screen as the colorimetric point, the corresponding position detection does not fail, and stable colorimetric is possible.

In addition, in this embodiment, although the spectral detection part 216 detects only the point of an optical axis, it is equipped with the some spectral detection part 216 corresponding to a some focus detection position, for example, and switches these according to a focus position. It is clear that you can use.

18 to 23 show a fifth embodiment of the present invention, and FIG. 18 is an explanatory diagram showing the appearance of the apparatus. This embodiment describes an example of using a multi-band camera instead of a colorimeter.

In this embodiment, as shown in FIG. 18, the color separation filter 230 for multiband photography is provided just before the normal digital camera 229. FIG. 19 is an explanatory diagram illustrating a configuration of the color separation filter 230. The color separation filter 230 is comprised by the filter turret 238 which has the filter A, the filter B, and the filter C, and the filter holding part 239. The filter turret 238 is held rotatably in the filter holder 239. FIG. 19A illustrates a filter turret 238 constituting the color separation filter 230, and FIG. 19B illustrates a filter holding unit 239 constituting the color separation filter 230. have.

FIG. 20 is an explanatory diagram for explaining the characteristics of the imaging band, and FIG. 20A is a graph showing the spectral sensitivity characteristics of the RGB color imaging element 5, FIGS. 20B and 20C. Is a graph showing the characteristics of the filters A and B of the color separation filter 230, respectively.

The spectral transmission characteristics of the filters A and B are peaks of the spectral sensitivity of each of the RGB color imaging elements 5 shown in FIG. 20A as shown in FIGS. 20B and 20C. It is a characteristic of dividing a position, and 6-band photography | photography can be performed by switching the filter A and the filter B and image | photographing. In addition, the filter C is through, enabling normal RGB imaging. As the filters A and B, not only an interference filter but also a wavelength variable filter can be adopted.

In addition, this filter holding part 239 has the filter rotation part 234, and can rotate the filter turret 238 directly by manual. In addition, the lens holding part 236 allows the filter holding part 239 to be directly attached to the photographing lens 4 of the digital camera 229. In addition, a filter ID window 235 is provided in the filter holding unit 239, and what kind of filter is the filter currently disposed immediately before the photographing lens 4 by the filter ID window 235. It is a configuration that can be confirmed with the naked eye.

21 is a block diagram showing the circuit configuration of the digital camera 229. In addition, in FIG. 21, the same code | symbol is attached | subjected to the same component as FIG. 3, and description is abbreviate | omitted.

In Fig. 21, reference numeral 52 denotes a multi-band image memory in which an RGB image photographed by the filter A and the filter B is stored as a six-band multi-band image. Reference numeral 240 denotes a switching unit that switches between storage destinations of the multi-band image and the RGB image, and switching is performed in accordance with the designated mode of the shooting mode switching unit 242.

Shooting mode is made into two types of "RGB mode" and "multiband mode". Reference numeral 241 denotes a corresponding position designation unit, which designates a subject position in the RGB image and a subject position in the multi-band image. In the case of this embodiment, since a multi-band image consists of two types of RGB images, each RGB image is displayed on the image display part 7 one by one (total 6 images), and the RGB by the operation dial 8 is carried out. Specify the corresponding position with the image. FIG. 22 is an explanatory diagram for explaining a corresponding position, in which FIG. 22A shows an RGB color image, and FIG. 22B shows a multiband image.

FIG. 23 is a block diagram showing a specific configuration of the color correction unit 244 in FIG. 21. The color correction unit 244 differs from the above embodiment in that it includes two signal cutting units 29 and 60, data average units 30 and 61, and spectrum estimation units 31 and 62. By this structure, the color correction part 244 detects the spectrum of the corresponding position of a multi-band image, and performs color correction.

In the embodiment comprised in this way, at the time of imaging | photography, the "multi-band mode" is specified first, and photography is performed by setting filter A. FIG. Next, shooting is performed by setting filter B manually. The image picked up by the filters A and B is stored in the multi-band image memory 52 (Fig. 23). Next, the "RGB mode" is designated, photographing is performed by selecting the filter C, and the photographed image data is stored in the RGB image memory 19.

The color correction unit 244 receives a multi-band image from the multi-band image memory 52, and the corresponding position information (the signal cutting unit 60, the data average unit 61, and the spectrum estimating unit 62) is used. Obtain spectral information S2 (λ) at the position corresponding to Cx2, Cy2. In addition, the color correction unit 244 inputs an RGB color image from the RGB image memory 19, and in the signal cutting unit 29, the data average unit 30, and the spectrum estimation unit 31, corresponding position information ( The spectrum information of the position corresponding to Cx1 and Cy1) is acquired.

The correction coefficient calculation unit 32 calculates the correction coefficient C (λ) based on the above equation (1). The subsequent operation is the same as in the first embodiment.

As described above, in the present embodiment, color correction of the RGB image can be performed at a very low cost by using a color separation filter that can be rotated manually. In addition, the correspondence position of the image photographed by the color separation filter is set manually by using the operation dial. Therefore, even when the camera is moved at the time of shooting the filters A, B, and C due to camera shake or the like. You can certainly specify the corresponding position. In addition, it is clear that instead of the color separation filter, a variable wavelength filter 237 using a liquid crystal or the like may be used as shown in FIG. 24.

In addition, in this embodiment, although the operation of the color separation filter 230 did not perform the communication with the digital camera 229 completely at all manually, the filter rotation operation and filter ID detection by the instruction | indication on the digital camera 229 side. May be performed. Alternatively, it is natural that such a filter may be used as an imaging lens.

25 to 30 are related to the sixth embodiment of the present invention, and FIG. 25 is a block diagram showing a specific configuration. This embodiment also shows an example of using a multi-band camera. In addition, in FIG. 25, the same code | symbol is attached | subjected to the same component as FIG. 21, and description is abbreviate | omitted.

In this embodiment, the multi-band camera 50 is provided on the digital camera 245. The multi-band camera 50 is comprised by the imaging lens 53, the spectral filter 54, the rotating motor 59, the monochrome sensor 55, the signal processing part 57, and the A / D converter 58. As shown in FIG.

FIG. 26 is an explanatory diagram showing a configuration of the spectral filter 54 in FIG. 25. As shown in FIG. 26, the spectral filter 54 is comprised from two or more color filters 54a, 54b, ... which have different spectral transmission characteristics. In the example of FIG. 26, although it is a case of eight filters, the number is not limited to eight. The photographing control unit 60 controls the focus of the photographing lens 16, the aperture, the electronic shutter speed of the monochrome sensor 56, and the like.

In addition, the digital camera 245 is a position shift correction unit for correcting the position shift of the multi-band image based on the hand shake information of the multi-band image memory 52, the corresponding position designation unit 241, and the image sensor 243. 161 is provided. The target position designation unit 241 detects the corresponding position of the target portion 15 (the affected part) of the subject 14 from the images photographed by the digital camera 245 and the multi-band camera 50.

Next, operation | movement of embodiment comprised in this way is demonstrated.

To photograph the subject 14, the subject 14 faces the photographic lens 16 of the video camera, and the angle of view and the photographing position are determined by the operation dial 8 or the like. When the shutter button (not shown) is pressed halfway by the photographer, the AE and AF control operations of the digital camera 245 are started. Information by this control is transmitted to the multi-band camera 50, and the photographing control section 60 sets the focus position of the photographing lens 53 to the subject distance in accordance with the AF information. In addition, the shutter speed of the monochrome sensor 56 and the aperture value of the photographing lens 53 are set according to the AE information. In this setting, since the shutter speed values are set differently so as to obtain proper exposure for each of the color filters 54a, 54b, ... of the filter 54, it is possible to shoot with good SN.

When the shutter button is fully pressed, shooting starts, and the image signal picked up by the RGB color image pickup device 5 is stored in the RGB signal memory 19. In addition, in the multi-band camera 50, the filter 54 rotates and imaging | photography using different filter 54a, 54b, ... is performed. The position shift correction unit 161 corrects the position shift of the multi-band image based on the camera shake information from the camera shake sensor 243, and sequentially stores the image of the position shift corrected in the multi-band image memory 52.

Next, using the operation dial 8, the subject return position included in the photographed RGB color image and the multi-band image is designated. That is, each image is displayed on the image display unit 7, and the designated cursor is superimposed on the display image for display.

27 is an explanatory diagram for illustrating the operation dial 8. As shown in Fig. 27, the operation dial 8 is configured to include up, down, left, and right arrow keys and a determined key in the center, and the designated cursor moves up, down, left, and right on the display image in response to the operation of the arrow keys. It is comprised so that it may move, and the position of a affected part is determined corresponding to the position of the image of the designation cursor in the timing which operated the confirmation key. This designation operation is performed on the RGB color image and the multi-band image, and respective corresponding positions are obtained. The positions corresponding to the RGB color images are Cx1 and Cy1, and the positions corresponding to the multi-band images are Cy1 and Cy2.

The structure of the color correction part 244 is the same as that of FIG. 23, and color correction is performed by operation similar to the said embodiment.

As described above, in the present embodiment, since the RGB image is corrected based on the spectrum data calculated from the multi-band camera 50, highly accurate color correction is possible. In addition, in this embodiment, although the number of pixels was not specified in particular, it is thought that it is about 400,000 pixels, for example, considering 5 million pixels for the digital camera 245, sensitivity etc. for the multi-band camera 50. do. In this case, although high-precision color information can be acquired by the multiband camera 50, sufficient resolution is not obtained, but the digital camera 245 obtains a high resolution image. An image obtained by fusing the high resolution image of the digital camera 245 and the high-precision color information of the multi-band camera 50 is obtained, so that an image of very high quality can be obtained.

In addition, since the multi-band camera 50 of the present embodiment has a filter rotation type surface sequential type, deviation occurs in each spectral image due to hand shake or the like, but hand shake information due to a hand shake sensor or the like in the digital camera 245. Since the deviation between the spectroscopic images is corrected based on the corresponding position, the corresponding position can be obtained more accurately.

In addition, although the multi-band camera 50 of the rotary filter type | mold like FIG. 26 was used in this embodiment, it is not limited to this, Of course, you may use a liquid-crystal wavelength variable filter etc.

In addition, although the target position designation part and the color correction part are provided in a digital camera, you may carry out using a computing processing apparatus other than a digital camera, for example, a personal computer. In the present embodiment, the multi-band camera 50 is configured to be directly connected to the digital camera 245. Alternatively, the multi-band camera 50 may be a separate body or a signal may be exchanged by wireless or the like.

As shown in Fig. 28, by providing the optical path dividing means 246 to match the shooting direction and angle of view of the digital camera 245 and the multi-band camera 50, the designation of the corresponding position becomes very simple.

In addition, although the information of the camera shake sensor is used as the camera shake information, the amount of positional deviation between the images of the multi-band image may be calculated by calculation and corrected. Further, the image information may be taken using an RGB color image, which is, for example, as illustrated in FIG. 29, and the shooting timing of each spectroscopic image of the multi-band camera 50 and the digital camera ( By aligning the shooting timing of 245, the positional shift can be detected from two consecutive RGB images, and the spectral image can be corrected to the image position of? 1 using this information. The correlation calculation unit 247 as shown in FIG. 30 detects the positional shift amount between the RGB images, and based on this, the position shift correction unit 248 corrects the position of the multi-band image. The RGB image has a higher resolution, and the position detection accuracy obtained as a result of the correlation calculation can be performed with higher accuracy than in the case obtained from the multi-band camera 50, thereby making it possible to perform a good shift correction.

31 to 37 show a seventh embodiment of the present invention. FIG. 31 is a block diagram showing a specific configuration of the camera side, and FIG. 32 is a block diagram showing a specific circuit configuration of an image processing unit. This embodiment is applied to the illumination type multi-band camera described in the specification of Japanese Patent Application No. 2002-218863 filed by the present applicant first, and is suitable when the photographing target is a tooth and a face including the same.

In FIG. 31, the photographing system is constituted by the multi-band camera 69, the charging unit 72, and the image processing unit 68.

The multi-band camera 69 is further configured by the illumination unit 70, the imaging unit 73, and the control unit 71. The lighting unit 70 shown by a thick line is attached to the front end side of the multi-band camera 69 so that attachment and detachment are possible, and the lighting unit contact 77 receives the control unit 71 and a signal, supply of power, etc. This is to be done. In addition, although not shown, it may be fixed without being detached.

The lighting unit 70 includes LED lighting units 70a and 70b composed of a plurality of types of LEDs having different spectral characteristics of emitted light, an illumination optical system 74 for illuminating this to a subject, and an LED memory in which information of LEDs is stored. 75 is comprised by the temperature sensor 76 for measuring the temperature of LED vicinity. In addition, as LED lighting part 70a, 70b, for example, in this embodiment, it consists of 28 LED in total which arrange | positioned four 7 types of LED, respectively. The center wavelength of each LED is 450 nm, 465 nm, 505 nm, 525 nm, 575 nm, 605 nm, and 630 nm, respectively. In addition, the illumination optical system 74 is for irradiating LED light to the object surface (surface of the camera side of the color table 110 in FIG. 31), and is comprised so that LED light may be irradiated substantially uniformly.

The imaging unit 73 is comprised by the imaging lens 16, the RGB color imaging element 5, the signal processing part 17 which performs analog processing which performs gain correction, offset correction, etc., and the AD converter 18. As shown in FIG. The focus lever 79 is for changing the focus by manual, and the position detection contact 80 of the focus lever 79 is also provided.

The camera control CPU 81 in the control unit 71 is a CPU for performing camera control, which is connected to the local bus 82 and the LCD controller 87, and controls the imaging unit 73. And a composite output terminal 85 for outputting a color image signal captured by the imaging unit 73 to an external monitor.

The LED driver 83 is for controlling the light emission of the LED lighting units 70a and 70b, and the data I / F 84 stores the contents of the LED memory 75 and the temperature sensor 76 of the lighting unit 70. Interface for receiving information. The communication I / F controller 97 is a controller for controlling communication I / F such as USB2, for example, and reference numeral 98 is a communication I / F connection contact for the connection.

The lithium battery 99 is for supplying power to the entire multi-band camera 69 and is connected to a charging contact 100 which is a contact for charging. The image memory 89 primarily stores the image data photographed by the imaging unit 73.

In the present embodiment, the LED lighting units 70a and 70b use seven kinds of LEDs, and the image memory 89 has a capacity capable of storing at least seven kinds of spectroscopic images and one RGB color image. have. The LCD monitor 86 is a monitor for displaying an image being shot with a camera or a shot image.

In addition, the LCD monitor 86 is configured to display an image superimposed with an image pattern stored in the overlay memory 88 as necessary. As an image pattern, it is a horizontal line which image | photographs the whole horizontally, for example, the cross line which intersects this. The operation unit I / F 90 transmits and receives a signal between an operation button disposed in the multiband camera 69 and an output unit not shown for information transmission.

As the operation button, operations such as changing the image data displayed on the imaging mode switching switch 91, the shutter button 92, and the LCD monitor 86 that switch between general RGB shooting and multi-band shooting can be performed. Viewer control button 93 and the like. The power LED 94 functions as an output unit for information transmission, and is for informing the photographer of the state of the multi-band camera 69. In addition, a battery LED 95 for informing the state of the battery, an alarm buzzer 96 for informing a danger during shooting, and the like are also configured on the rear side of the multi-band camera 69.

The relationship between the lighting of these LEDs 94-96 and each operation condition is as follows, for example.

Power LED

Green lighting: shooting ready OK

Blinking green: Preparing for shooting (initial warming, etc.)

Red flashing: Battery is charging

Battery LED

Green lighting: battery capacity is enough

Steady amber: Low battery capacity (need to charge)

Steady red: Very low battery capacity (needs to charge)

Alarm buzzer

Seedling: The image data you shot is invalid

The charging unit 72 includes a color table 110 for calibrating the multi-band camera 69 and a micro for checking whether the multi-band camera 69 is mounted at the normal position in the charging unit 72. A power supply switch 102 for turning on / off the power supply of the charging unit, the power supply lamp 103 for turning on / off in conjunction with the power supply switch 102, the multi-band It is comprised by the mounting lamp 104 which lights up when the camera 69 is mounted in a normal position.

The charging unit 72 is, for example, a desk type, and the multi-band camera 69 is mounted at a predetermined position of the charging unit 72, whereby the multi-camera 69 receives the multi-contact through the charging contact 100. The band camera 69 can be supplied with electric power.

The mounting lamp 104 lights green when the charging unit 72 is mounted at the normal position of the multi-band camera 69, and blinks red when not mounted. In addition, the charging unit 72 is provided with a power supply connection connector 105 so that the AC adapter 106 is connected. Then, when the charge capacity of the lithium battery 99 decreases and the yellow or the enemy of the battery LED 95 lights up, the lithium battery 99 is placed on the charging unit 72 when the multi-band camera 69 is placed on the charging unit 72. It is comprised so that charge may be performed.

As shown in FIG. 32, the image processing unit 68 has a color correction unit 250 having a structure substantially similar to that of the color correction unit 244 of FIG. 23. In the present embodiment, the image processing unit 68 includes a corresponding position calculating unit 107. In each of the embodiments described above, the detection of the correspondence point (correspondence position) is performed by manual operation. In this embodiment, the correspondence point detection is automatically performed.

33 is a block diagram showing a specific configuration of the corresponding position calculating unit 107 in FIG. 32. 34 is explanatory drawing which shows the input image of the correspondence position calculation part 107, FIG. 34 (a) shows a multi-band image, and FIG. 34 (b) shows an RGB image.

As shown in FIG. 33, the correspondence position calculation unit 107 includes a luminance converter 108 for extracting a luminance signal from the multi-band image of FIG. 34, and a center for extracting an area thereof near the center of the screen. The detection unit 109, the image reduction unit 112 for reducing the extracted center tooth image, and the template matching unit 113 for detecting the corresponding position on the extracted RGB color image.

As shown in FIG. 32, the image processing unit 68 includes a multi-band image memory 52, an RGB image memory 19, a color correcting unit 250, and a color correcting unit in addition to the corresponding position calculating unit 107. It has a color reproduction processing unit 207 and an image storage unit 213 to which the R'G'B 'image signal from 250 is supplied. Each function is the same as that of each said embodiment. The calibration unit 253 in the color correcting unit 250 is configured to calibrate a multi-band image using the color table image stored in the color table image memory 251 and the dark current image stored in the dark current image memory 252. have.

Next, operation | movement of embodiment comprised in this way is demonstrated with reference to FIG. 35 and FIG.

In this embodiment, it has three imaging modes. Each shooting mode will be described with reference to FIG. 35. This embodiment uses the whitening (bleaching) and denture construction in a dental clinic as an example.

As the photographing mode, as shown in Fig. 35A, the face photographing which is the photographing of the entire face, the entire jaw photographing which is the photographing of the entire upper and lower portions shown in FIG. 35B, and FIG. There are three types of dental imaging in which one or two imaging thereof are shown. Facial shooting and full jaw shooting are shooting as RGB images, and teeth shooting is shooting as a multiband image. This embodiment correct | amends the color of the RGB image obtained by facial imaging or whole-jaw imaging from the multi-band image obtained by tooth imaging.

(RGB shooting)

The photographer lifts the multi-band camera 69 and removes it from the charging unit 72 to set the shooting mode to "RGB mode". In the RGB color imaging element 5, photographing is sequentially performed, and the image is displayed on the LCD monitor 86. FIG. At this time, the LED lighting units 70a and 70b are turned off. The photographer (dentist or dental hygienist) adjusts the position to the subject (face or entire jaw) while looking at the image on the LCD monitor 86 and then focuses using the focus lever 79. At this time, the camera control CPU 81 controls the electronic shutter speed of the RGB color imaging element 5 so as to obtain proper exposure. The image photographed when the shutter button is pressed is stored in the image memory 89. At this time, incidental information such as an RGB image mode is also stored.

Next, the photographer mounts the multi-band camera 69 on the charging unit 72. In this case, the mounting lamp 104 is turned on, and the captured RGB image is transferred to and stored in the RGB image memory 19 of the image processing unit 68.

(Multi band shooting)

Next, the photographer lifts the multi-band camera 69, removes it from the charging unit 72, and sets the shooting mode to "side color mode." As a result, in the LED lighting units 70a and 70b, all seven kinds of LEDs are turned on, and photographing is sequentially performed in the RGB color imaging device 5, and the image is displayed on the LCD monitor 86. FIG. In addition, a contact cap 260 (see FIG. 36) is attached to the lighting unit 70, so that the photographer (dentist or dental hygienist) adjusts the position of a specific tooth while looking at an image on the LCD monitor 86. Use () to adjust the focus.

In this case, as shown in FIG. 36, the contact cap 260 is in contact with the tooth 261 to be imaged, and position fixing to some extent is performed. When the desired positional alignment is performed, the shutter button is pressed by the photographer, and multi-band imaging is performed. In this example, the LED lighting units 70a and 70b light up seven kinds of LEDs sequentially, and the image data of the predetermined one color among the RGB images photographed at each lighting is stored in the image memory 89. In this case,

450 nm (λ1) → B image

465nm (λ2) → B image

505 nm (λ3)-> G image

525 nm (λ 4) → G image

575 nm (λ5) → G image

605 nm (λ 6) → R image

630 nm (λ7) → R image

As described above, the image of the color selected from the RGB image corresponding to the center wavelength of the LED is stored in the image memory 89 as a multi-band image. In addition, the camera control CPU 81 controls the irradiation time of LED, the irradiation intensity, the electronic shutter speed of the imaging device, and the like so that the imaging of each wavelength is performed at the time of imaging. In addition, when the temperature change is severe during this shooting, an alarm buzzer sounds and a warning occurs.

When the photographing is finished, the contact cap is removed. Next, when the multi-band camera 69 is placed on the charging unit 72, the mounting lamp 104 is turned on, and the calibration image is measured. At this time, unless the contact cap is removed, the multi-band camera 69 cannot be mounted on the charging unit 72. That is, the LED of the same wavelength as the LED used for photographing is sequentially turned on to photograph the color table 110, and the photographed image is stored in the image memory 89 as a color table image. Next, photographing is performed in a state where the LED is not lit at all (under dark), and the image memory 89 is stored as a dark current image.

Next, the photographed multi-band image, color table image, and dark current image are all transferred to the image processing unit 68, and the color table image and the dark current image are stored in the color table image memory 251 or the dark current image memory 252, respectively. The subject image is stored in the multi-band image memory 52. The calibration unit 253,

M '(λ) = (M (λ) -D (λ)) / W (λ)

M (λ): Subject image

D (λ): dark current image

W (λ): Color image

M '(λ): Calibrated subject image

The phosphorus operation is performed to correct the dark current of the RGB color imaging element 5 and the amount of light deterioration and wavelength shift of the LED lighting units 70a and 70b. In particular, since the amount of emitted light changes due to temperature change, it is very effective to calibrate the LED according to the use temperature to improve the accuracy. The operation after the calibration process is the same as in the above embodiment. In this way, high-precision color correction can be performed on the RGB image.

In addition, in this embodiment, since the correspondence position of a multi-band image and an RGB image is automatically calculated, complicated operation | movement, such as specifying a correspondence position manually, is unnecessary. In addition, the multi-band camera 69 can be operated cableless with a battery, and the usability is remarkably improved. In addition, since correction is performed by the color table, deterioration and fluctuation of the LED and the image pickup device can be corrected, and highly accurate color measurement can be realized.

The color table 110 is incorporated in a cradle which also serves as a charging function, and the user does not have to perform complicated operations for calibration. In addition, by the lighting of the mounting lamp, an operation error in the transmission of the image data can be reduced, and reliable data transmission is possible. In addition, the state of charge can always be grasped | ascertained by the battery lamp of a main body. In addition, the sensor is equipped with a temperature sensor and a warning buzzer is used to warn the user when a temperature change occurs at the time of photographing the teeth or when the temperature difference is large at the time of photographing the teeth and during calibration. It is possible.

In addition, it is obvious that the image processing unit can be configured by a normal personal computer or the like, and in this case, for example, the color correction unit may be realized by software.

In addition, when the main body is detached from the charging unit 72 and is not returned to the charging unit 72 for some time after the measurement, the user may forget it, and may sound an alarm buzzer or give a warning.

In addition, the color table is expected to deteriorate with time. In particular, there exists a possibility of the influence of light, contamination by dust, etc. As a method of preventing this, a shutter may be provided between the color table and the lighting unit, and the shutter may be closed when the multi-band camera is lifted up so that external light or dust may not enter.

Fig. 37 is a block diagram showing another example of application using the image processing unit 269 using the side color image as the image processing unit.

Reference numeral 254 is a chromaticity calculator for obtaining the XYZ value of each image position from the calibrated subject image, and reference numeral 256 is a shade number calculator for calculating the shade number which is the number of the crown color table from the obtained XYZ value. The shade number calculator 256 compares the obtained XYZ value with the XYZ values of the shade guides of the companies stored in the shade number database 270 to obtain a shade number. Reference numeral 255 is an RGB image calculation unit for obtaining RGB image data, and reference numeral 257 is a storage unit. Reference numeral 258 denotes a corrected image creating unit for correcting color variations in the image display unit 7, and the color-corrected image is displayed on the image display unit 7. By the color correction part 272 comprised in this way, the shade number of a tooth is correctly determined from a multi-band image, and the color accurate to a tooth is displayed on the image display part 7.

38 is an explanatory diagram showing an eighth embodiment of the present invention.

As described above, the color table deteriorates due to various factors. In addition, the actual color table has some variation from the beginning. In the case of use in a dental clinic, there is no problem as long as it is a single system. However, when there are three sets of imaging systems, for example, as shown in FIG. In particular, since the calibration is performed based on the color table data, if the color table itself is changed, different measurement results are obtained for each multi-band camera even if the same teeth are measured. Therefore, in the present embodiment, a color table characteristic memory in which the spectral reflectance of the color table is stored is provided in each charging unit, and during calibration, the spectral reflectance is used to correct again.

In FIG. 38, the imaging systems 264A-264C similar to 7th Embodiment are provided in the dental clinic, for example. The imaging system 264A-264C is equipped with the multiband camera 265A-265C of the structure similar to the multiband camera 69, and the charging unit 262A-262C of the structure similar to the charging unit 72, respectively. have. The charging unit 262A to 262C is provided with color table characteristic memories 263A to 263C, respectively.

In the example of FIG. 38, the multiband cameras 265A to 265C are connected to the microcomputer 266 constituting a common image processing unit for these three imaging systems 264A to 264C. In addition, the microcomputer 266 is connected to a microcomputer (not shown) of the dental laboratory 268 via the Internet 267, and also to a microcomputer (not shown) of the data management center 271 via the Internet 267. Connected.

In the calibration process by the microcomputer 266,

M '(λ) = (M (λ) -D (λ)) / W (λ) * S (λ)

M (λ): Subject image

D (λ): dark current image

W (λ): Color image

S (λ): Spectral Reflectance of Color Table

M '(λ): Calibrated subject image

Phosphorus calculation is performed, and the variation of each color table is corrected. This enables the camera to be compatible with a plurality of systems. This correction is also effective for exchanging data between, for example, a dental office and a dental laboratory.

In addition, when the color table becomes dirty or discolored for some reason, it is effective to allow the color table to be replaced. When the color table is replaced, the color table is mailed to the dental clinic from the data management center 271. And in dental clinic, color table is changed. An ID number is described in the color table, and according to the number, the spectroscopic reflectance data of the color table is automatically transmitted from the data management center 271 to the dental clinic (broken line in FIG. 32), and the respective charging units 262A to 262C are used. The data may be written into the color table characteristic memories 263A to 263C.

Although not shown, an identification code may be set in the color table to automatically recognize the ID number in the charging unit. Of course, as a means, a barcode system, a wireless tag system, etc. may be sufficient.

By updating the data online, the user does not have to perform complicated operations and the convenience is improved. In addition, the necessity of replacing the color table may automatically issue a warning message in accordance with the installation time, the displacement of the signal value with the installation time, and the like. In addition, this warning can be notified to the data management center 261 via the Internet, and the data management center 271 can contact the user by telephone or the like from this notification information to prompt the exchange of color tables. , Stable coloration can be performed at all times.

Claims (41)

In a shooting system for shooting a subject, Color information detecting means for detecting color information of the subject; Color image pickup means for shooting a color image of the subject; Color correction means for performing color correction of the color image picked up by the color image pickup means from the corresponding positional information of the color information detection means and the color image pickup means; Photographing system comprising a. The method of claim 1, And the color information detecting means acquires more spectral information than the color image capturing means. The method of claim 1, And the color information detecting means is constituted by a spectrophotometer for detecting spectral information. The method of claim 1, And the color information detecting means is constituted by a color measurement system for detecting chromaticity information. The method of claim 1, And the color information detecting means has an attachment portion that enables attachment to the color image pickup means. The method of claim 5, And the data is transmitted and received between the color information detection means and the color image pickup means through the attachment portion. The method of claim 1, The color information detecting means is configured such that the direction of the measurement is variable by manual or control from the color image capturing means. The method of claim 1, The color image pickup means includes image display means, and the measurement direction of the color information detection means can be displayed on the image display means. The method of claim 1, And the color information detecting means comprises an active measuring position indicating means. The method of claim 3, And the color information detecting means is configured to detect the spectrum information of the subject and also to detect the illumination spectrum information around the color image capturing means. The method of claim 1, The color information detecting means is constituted separately from the color image capturing means, and each signal is transmitted and received by wire or wirelessly. The method of claim 1, The photographing system, characterized in that the measurement by the color information detecting means and the photographing by the color image capturing means are performed at about the same time. The method of claim 1, The color information detecting means is built in the color image capturing means. The method of claim 13, And the color image imaging means has a half mirror, and is configured such that one light beam is guided to the color information detecting means. The method of claim 1, The color information detecting means is constituted by a multispectral camera capable of acquiring a spectroscopic image of four bands or more. The method of claim 15, The multispectral camera is provided with a plurality of spectroscopic filters, and is configured to be capable of changing the spectroscopic filter by manual or control from the color image pickup means. The method of claim 16, The multispectral camera is configured to allow shooting in a through state without passing through the spectral filter. The method of claim 16, The spectroscopic filter is constituted by an interference filter or a tunable filter. The method of claim 15, The multi-spectral camera is configured to perform shooting in conjunction with the color image pickup means, and shooting conditions are set using the shooting information of the color image pickup means. The method of claim 15, The image of each band photographed by the said multispectral camera is based on the image information image | photographed by the said color image pick-up means, The image | video position system characterized by the above-mentioned. The method of claim 1, And the color information detecting means and the color image capturing means use the same optical system and the image pickup device. The method of claim 21, And a mode changing means for switching the mode of detection of color information and imaging of a color image. The method of claim 22, And a mode change by the mode change means is automatically performed from focus information of the color image pickup means. The method of claim 21, And calibration means for calibrating the detection result of the color information detection means based on the imaging result of the color table. The method of claim 21, And a corresponding position detecting section for automatically detecting a corresponding position of an image picked up by said color information detecting means and an image picked up by said color image picking up means. A multispectral camera unit capable of photographing both a multiband image and a color image; A charging unit for charging the multi spectrum camera unit; An image processing unit which processes the image signal of the multi spectrum camera unit Photographing system comprising a. The method of claim 26, The multi spectrum camera unit includes a control unit and an illumination unit, And the illumination unit is detachable. The method of claim 26, The multi-spectral camera unit includes an image display unit. The method of claim 27, And the illumination unit includes a light source having different spectral characteristics of four or more colors, and irradiates the four or more colors of illumination light sequentially or simultaneously when capturing the multi-band image. The method of claim 26, The multi-spectral camera unit is provided with a shooting mode switching unit, And the shooting mode switching unit switches shooting of the multi-band image and the color image. The method of claim 26, The charging unit includes a color table used for calibration of the multi-band image. The method of claim 31, wherein And the image processing unit further includes calibration means for calibrating the multi-band image based on an imaging result of the color table. The method of claim 31, wherein The charging unit further includes a characteristic data storage section for storing characteristic data corresponding to the color table. The method of claim 33, wherein The characteristic data storage section is characterized in that the characteristic data corresponding to the ID number attached to the color table is input from the outside via a predetermined communication line. The method of claim 31, wherein Detecting means for detecting deterioration of the color table; And an output means for outputting a detection result by the detection means. The method of claim 26, And the charging unit and the multi-spectral camera unit have contacts for transmitting and receiving data to each other. The method of claim 26, The charging unit includes a mounting confirmation lamp for the multi-spectrum camera unit, And said mounting confirmation lamp lights when said multi-spectrum camera unit is mounted at a regular position of said charging unit. The method of claim 26, The charging unit has a data transmission means, And the data transmission means automatically transmits data from the multi spectrum camera unit to the image processing unit when the multi spectrum camera unit is mounted at a regular position of the charging unit. The method of claim 26, The image processing unit includes an information storage unit for storing information related to the shade number; And a shade number determination unit that determines the shade number from the multi-band image based on the information stored in the information storage unit. The method of claim 26, And the multi-spectral camera unit performs color image photographing for face photographing or full jaw photographing, and multiband photographing for photographing teeth. The method of claim 40, And the image processing unit performs color correction of the face image or the entire jaw imaging based on the tooth image photographed in multi-bands.

Images