JP2014236421A - Camera apparatus and imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a camera apparatus and an imaging method capable of allowing a user to check the possibility of an estimated color on a displayed image data.SOLUTION: A color estimation part 204 determines whether an imaged subject 10 corresponds to one kind color or two or more kinds of color candidates. When one kind color corresponds, a display data for displaying the subject 10 with a first display method is generate. When two or more kinds of color candidates correspond, a display data for displaying the subject 10 with a second display method different from the first display method is generated.

Description

  The present invention relates to a camera device and an imaging method for imaging a subject by irradiating the subject with invisible light.

  2. Description of the Related Art Conventionally, night vision cameras that capture and color-display a subject irradiated with infrared light, which is a type of invisible light, are known. Since such night vision cameras cannot obtain color information, they are generally displayed in a single color such as monochrome, but irradiate a subject with infrared light of a plurality of different wavelengths, It is known that color estimation is performed using the reflection characteristics of wavelengths to display a subject in color (see Patent Document 1).

JP 2011-050049 A

  However, when illuminating a subject with invisible light and estimating the color of the subject using its reflection characteristics, the reflectance actually depends on the influence of ambient light or noise inside the camera device. An error may occur. Furthermore, in the reflection characteristics, there are an area where a probable estimated color can be determined even if there is some error, and an area where there is a high possibility that the estimated color will be erroneous even if there is a slight error, and the latter area includes an error. When color estimation is performed based on the reflectance, the estimated color inevitably differs from the color in the visible region. As a result, the image data to be displayed and output has an area of an estimated color that is likely to be erroneous and an area of an estimated color that is likely to be incorrect, but the user is certain which area is uncertain and which area is uncertain. There was a problem that it was not possible to grasp.

  An object of the present invention is to provide a camera device and an imaging method that allow a user to confirm whether or not an estimated color is likely from an image data displayed.

  A camera device according to an aspect of the present invention is a camera device that irradiates non-visible light and images the irradiated subject, and emits non-visible light having a plurality of different wavelengths to irradiate the subject. And a color estimation unit that generates display data by estimating the color of image data obtained by imaging the irradiated subject, and the color estimation unit is configured to determine the color information to be estimated according to the likelihood of the color information to be estimated. A configuration is adopted in which display data having a display area generated by one display method and a display area generated by a second display method different from the first method is generated.

  An imaging method according to an aspect of the present invention is an imaging method in a camera device that irradiates invisible light and images an irradiated subject, and emits invisible light having a plurality of different wavelengths, An irradiation step for irradiating a subject, and a color estimation step for generating display data by estimating a color of image data obtained by imaging the irradiated subject. In the color estimation step, confirmation of color information to be estimated is performed. Depending on the likelihood, display data having a display area generated by the first display method and a display area generated by a second display method different from the first method is generated.

  According to the present invention, the user can confirm whether or not the estimated color is likely from the displayed image data.

The perspective view which shows the external appearance of the camera apparatus which concerns on Embodiment 1 of this invention. 1 is a block diagram showing a configuration of a camera device according to Embodiment 1 of the present invention. Diagram showing reflection characteristics for two different colors Conceptual diagram of the color estimation table for color 1 and color 2 based on the reflection characteristics shown in FIG. The flowchart which shows operation | movement of the imaging part shown in FIG. The figure which shows the case where a luminance value is represented by 10 bits. The block diagram which shows the structure of the camera apparatus which concerns on Embodiment 2 of this invention. The flowchart which shows operation | movement of the camera apparatus shown in FIG. Diagram showing colors that can be estimated when using ultraviolet light in addition to infrared light

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that, in the embodiment, the same reference numerals are given to configurations having the same functions, and duplicate descriptions are omitted. The embodiments can be used with each other as long as they do not contradict each other.

(Embodiment 1)
<Configuration of camera device>
FIG. 1 explains the configuration of a camera apparatus 100 according to Embodiment 1 of the present invention, using FIG. 1 and FIG. In FIG. 2, the subject 10 and the monitor 250 are also described in addition to the camera device 100.

  As shown in FIG. 1, the camera device 100 includes a first emission unit 102, a second emission unit 103, and a third emission unit 104 that emit invisible light with different wavelengths toward a subject. It arrange | positions so that the imaging lens 201A may be surrounded. Here, the imaging lens 201A is a component of the imaging optical unit 201 shown in FIG. Note that the arrangement pattern of the first emission unit 102, the second emission unit 103, and the third emission unit 104 is not particularly limited in the present embodiment. The blocks may be divided into three blocks or may be alternately arranged one by one.

  In this specific example, a protective filter 320 that transmits invisible light is provided outside the first emission unit 102, the second emission unit 103, and the third emission unit 104. In addition, a cover 310 that protrudes toward the light emission side and surrounds the periphery of the protective filter 320 is provided at the emission port of the invisible light. The protection filter 320 is a component of the illumination optical unit 105 shown in FIG.

  As illustrated in FIG. 2, the camera device 100 includes a control unit 101, an irradiation unit 150, and an imaging unit 200.

  The irradiation unit 150 sequentially irradiates the subject 10 with invisible light having wavelengths λ11 to λ13 (each wavelength is different) with a time shifted for each wavelength.

  The imaging unit 200 images the subject 10 irradiated with invisible light.

  The control unit 101 controls the emission of invisible light from the irradiation unit 150. Control by the control unit 101 for each wavelength in the irradiation unit 150 is called irradiation control. At this time, a signal including irradiation control information output from the control unit 101 to the irradiation unit 150 for each wavelength is referred to as an irradiation control signal. The irradiation unit 150 emits each invisible light having wavelengths λ11 to λ13 according to the irradiation control signal. Here, the invisible light is infrared light or ultraviolet light.

<Configuration of irradiation unit>
The structure of the irradiation part 150 in Embodiment 1 of this invention is demonstrated using FIG. The irradiation unit 150 mainly includes a first emission unit 102, a second emission unit 103, a third emission unit 104, and an illumination optical unit 105. The first emission unit 102 to the third emission unit 104 are light sources for irradiating the subject 10, and hence the first emission unit 102 to the third emission unit 104 are referred to as “light sources” in the following. It may be written.

  The first emission unit 102, the second emission unit 103, and the third emission unit 104 emit invisible light having different wavelengths λ11, λ12, and λ13, respectively, according to the irradiation control signal of the control unit 101. Invisible light is emitted intermittently at different wavelengths for each wavelength. The first emitting unit 102, the second emitting unit 103, and the third emitting unit 104 are, for example, light emitting diodes (LEDs). Here, an LED is used as a light source, but the light source is not limited to an LED, and light having a desired wavelength such as light emitted from a phosphor excited by a laser, laser, or LED, a high-pressure mercury lamp, or the like. Any light source that emits light can be applied.

  The illumination optical unit 105 subjects the invisible light emitted from the first emitting unit 102, the invisible light emitted from the second emitting unit 103, or the invisible light emitted from the third emitting unit 104 to the subject. Irradiate toward 10. The illumination optical unit 105 has a lens for irradiating the subject 10 with invisible light. The invisible light emitted from the illumination optical unit 105 is efficiently guided toward the subject 10 by using a lens. Note that the camera device 100 of the present invention can irradiate the subject 10 with invisible light emitted from the illumination optical unit 105 without a lens, so the lens of the illumination optical unit 105 may be omitted.

  In the present embodiment, the diffusing element that diffuses the invisible light from the first emission unit 102 to the third emission unit 104 is used as the first emission unit 102 to the third emission unit 104 and the subject 10. By providing in the optical path between, the light intensity of the invisible light that irradiates the subject 10 can be made uniform over a wide range. A diffusion element having a general configuration such as a diffractive type or a refractive type can be used without any limitation.

  Further, the illumination optical unit 105 may not be common to the first emission unit 102 to the third emission unit 104, and is provided separately for the first emission unit 102 to the third emission unit 104. May be. In that case, the camera apparatus 100 can design each illumination optical unit optimally with respect to the wavelengths of the first emission unit 102 to the third emission unit 104, and can provide uniform light intensity over a wider range. The invisible light which has can be irradiated.

<Configuration of imaging unit>
The configuration of the imaging unit 200 according to Embodiment 1 of the present invention will be described with reference to FIG. The imaging unit 200 mainly includes an imaging optical unit 201, a sensor unit 202, a data processing unit 203, and an image recognition unit 204.

  The imaging optical unit 201 has a condensing lens (not shown), collects the reflected light reflected by the subject 10 with the irradiated invisible light, and outputs it to the sensor unit 202. The condensing lens focuses the reflected light from the subject 10 onto the sensor unit 202, thereby forming an image of the subject 10 on the sensor unit 202. The condenser lens is an imaging lens that is generally used in camera devices.

  The sensor unit 202 includes a light receiving element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor), receives the reflected light from the subject 10 collected by the imaging optical unit 201, and images the subject 10. The received light is converted into an electrical signal. The electrical signal converted by the sensor unit 202 is output from the sensor unit 202 to the data processing unit 203 as imaging data.

  The sensor unit 202 receives sensor control from the control unit 101. At this time, a signal including sensor control information input from the control unit 101 to the sensor unit 202 is referred to as a sensor control signal. For example, the sensor control signal includes timing information when the first emission unit 102 to the third emission unit 104 irradiate the subject 10. Accordingly, since the sensor unit 202 can surely know which wavelength the reflected light reflected by the subject 10 is, the each of the first emission unit 102 to the third emission unit 104. It is possible to reliably separate electrical signals having wavelengths.

  The data processing unit 203 acquires the imaging data output from the sensor unit 202, and performs predetermined image processing such as gain adjustment and exposure adjustment on the acquired imaging data. Thereby, an image captured with invisible light emitted from the first emitting unit 102, invisible light emitted from the second emitting unit 103, or invisible light emitted from the third emitting unit 104 Generate each data. The data processing unit 203 outputs the generated image data to the color estimation unit 204.

  The data processing unit 203 receives data processing control from the control unit 101. At this time, a signal including data processing control information input from the control unit 101 to the data processing unit 203 is referred to as a data processing control signal. The data processing control signal indicates whether the imaging data output from the sensor unit 202 is imaging data corresponding to invisible light having a wavelength emitted from any of the first emission unit 102 to the third emission unit 104. It is used to confirm and perform appropriate processing.

  In addition, it goes without saying that the data processing unit 203 can simultaneously receive data processing control signal information from the imaging data output from the sensor unit 202.

  The color estimation unit 204 obtains a calculation result by predetermined calculation using the three luminances of the subject 10 based on the image data of λ11 to λ13 output from the data processing unit 203. The color estimation unit 204 includes a color estimation table in which the obtained result and color information are associated as parameters, and performs color estimation using the color estimation table. The color estimation unit 204 generates display data for the subject 10 based on the luminance and color estimation results of the subject 10, and outputs the generated display data to the monitor 250.

  Further, when it is determined that there are two or more types of color candidates in a specific cell or area of the subject 10 at the time of estimation described later, the color estimation unit 204 changes the display method of the area.

  The color estimation unit 204 receives color estimation control from the control unit 101. At this time, a signal including color estimation processing control information input from the control unit 101 to the color estimation unit 204 is referred to as a color estimation control signal. Whether the color estimation control signal is the image data corresponding to the invisible light having the wavelength emitted from any of the first emission unit 102 to the third emission unit 104 of the image data output from the data processing unit 203 It is used to confirm the above and perform appropriate processing.

  Needless to say, the color estimation unit 204 can also receive information on the color estimation control signal from the image data output from the data processing unit 203 at the same time.

  The monitor 250 may be provided in the camera apparatus 100, but may be connected to the camera apparatus via a communication network so as to be communicable.

  In the present embodiment, the camera device 100 is configured as a single device. However, the camera device 100 is connected via a communication network except for the irradiation of non-visible light to the subject and the image of the irradiated subject. The present invention can also be realized by a personal computer provided with an application for performing image recognition processing and color estimation processing of the present embodiment, and a dedicated set-top box.

<Principle of color estimation>
Here, the principle of color estimation in the color estimation unit 204 will be described with reference to FIGS.

  FIG. 3 shows the reflection characteristics of two colors (color 1 and color 2) in a certain subject in the visible region and the infrared region, and FIG. 4 shows colors 1 and 2 based on the reflection properties shown in FIG. The conceptual diagram of the color estimation table is shown. In FIG. 3, the horizontal axis indicates the wavelength, and the vertical axis indicates the reflectance.

  FIG. 3 shows the reflection characteristics for two different colors (Color 1 and Color 2). As shown in FIG. 3, it is assumed that λ11, λ12, and λ13 are used as different wavelengths of invisible light. Theoretically, the reflectances of the three wavelengths are not all the same, but in reality, the reflectance is the influence of disturbance light, or the electrical signal converted by the sensor unit 202 inside the apparatus is the data processing unit 203. An error may occur in the data based on the detected reflectance due to the influence of noise during transmission.

  Therefore, for the purpose of absorbing the above error, as shown in FIG. 4, in the color estimation table of the present embodiment, the reflectance is in the range of 31% to 39% as in the B line of λ12. A plurality of colors of color 1 and color 2 are assigned.

  By using such a color estimation table, the color estimation unit 204 is, for example, color 2 if the reflectance of λ11 is 20%, the reflectance of λ12 is 40%, and the reflectance of λ13 is 60%. Assuming one color. On the other hand, if the reflectance of λ11 is 20%, the reflectance of λ12 is 34%, and the reflectance of λ13 is 60%, it is estimated that there are two color candidates, assuming that there can be color 1 and color 2. Here, for convenience of explanation, examples of color 1 and color 2 are shown, but the number of colors and the number set as color candidates are not limited to two.

<Operation of imaging unit>
Next, the operation of the imaging unit 200 described above will be described with reference to FIG.

  In step (hereinafter abbreviated as “ST”) 301, the imaging optical unit 201 condenses the reflected light of the irradiated invisible light reflected by the subject 10 for each wavelength.

  In ST302, the sensor unit 202 receives the reflected light from the subject 10 collected by the imaging optical unit 201, images the subject 10, and converts the received light into an electrical signal (imaging data).

  In ST303, the data processing unit 203 generates image data captured with invisible light of each wavelength by performing predetermined image processing such as gain adjustment and exposure adjustment on the captured data.

  In ST304, the color estimation unit 204 shows the color of the subject 10 based on the image data of λ11 to λ13 output from the data processing unit 203, based on the luminance representing the reflectance as described above, as shown in FIG. Color estimation is performed using a color estimation table as described above. If two or more color candidates exist for a certain cell or area as a result of color estimation (ST304: YES), the process proceeds to ST306. On the other hand, if the result of color estimation is one kind of color (ST304: NO), the process proceeds to ST305.

  In ST305, the color estimation unit 204 estimates one type of color corresponding to the subject 10 based on the spectrum of the image data, and generates display data for displaying the subject 10 by the first display method. .

  On the other hand, in ST306, the color estimation unit 204 generates display data for displaying the subject 10 by a second display method different from the first display method in ST305.

  As the first display method and the second display method, the following methods can be considered.

  First, as a first display method, the subject 10 corresponding to one type of color is displayed in color, and as the second display method, the subject 10 corresponding to two or more types of color candidates is displayed in black and white. The black and white display may be a display method that allows the user to distinguish from the normal color display that is the first display method, such as blinking display.

  In addition, when the data is displayed in black and white as the final display data and the user gives an instruction via an instruction means such as a mouse on the area displayed by the first display method, the color of the indicated location is displayed as text (for example, "Red"). Similarly, when an instruction is given by the user on the area displayed by the second display method, a plurality of colors are displayed as text (for example, “blue or green”).

  The first display method and the second display method are not limited to the above-described display examples because it is only necessary to display the image data displayed on the monitor 250 so that the user can be identified.

  Finally, in ST307, the display data is synthesized by combining the display data created by the first display method of ST305 and the display data created by the second display method of ST306. It is output to the monitor 250 as a frame.

  As described above, according to the first embodiment, when two or more color candidates correspond to the subject 10, the second display method is different from the first display method when one color corresponds. By displaying the subject 10, it is possible to display an image that reduces user misrecognition.

  In the present embodiment, the color estimation unit 204 uses the color estimation table as illustrated in FIG. 4 to determine whether the estimated color is one or more. However, the color estimation unit 204 determines the likelihood of the estimated color based on the luminance value of each cell in the screen based on the image data obtained from the wavelengths λ11 to λ13. Also good. For example, as shown in FIG. 6, when the luminance value is represented by 10 bits, the luminance value 0 corresponds to black, the luminance value 1023 corresponds to white, and the luminance values 1 to 1022 correspond to gray. However, when the luminance value is small, only ambiguous color estimation may be possible due to the influence of noise (luminance value of about 20). For this reason, when the luminance value is equal to or lower than the predetermined value, the display data can be generated by the second display method different from the first display method.

(Embodiment 2)
<Configuration of camera device>
The configuration of camera device 400 according to Embodiment 2 of the present invention will be described with reference to FIG.

  The camera device 400 includes an irradiation unit 150, an imaging unit 200, a distance measuring sensor 401, and a control unit 402.

  A camera device 400 shown in FIG. 7 has a distance measuring sensor 401 and a control unit 402 instead of the control unit 101, as compared with the camera device 100 according to the first embodiment shown in FIG.

  The distance measuring sensor 401 detects the reflected light reflected by the subject 10, calculates the distance to the subject 10 according to the intensity of the detected reflected light, and outputs the calculated distance to the control unit 402. The distance measuring sensor 401 constitutes the measuring means of the present invention.

  The control unit 402 determines a display method based on the distance between the camera device 400 and the subject 10 output from the distance measuring sensor 401, and outputs the determined display method to the color estimation unit 204. Specifically, the control unit 402 determines the first display method when the distance to the subject 10 is less than a predetermined value, and differs from the first display method when the distance to the subject 10 is equal to or greater than the predetermined value. The second display method is determined. Thereby, it is possible to reduce the user's misrecognition without performing the color estimation or the erroneous color estimation that is performed on the subject 10 that is located far from the target of the ambiguous color estimation. Further, the control unit 402 controls the emission of invisible light from the irradiation unit 150.

<Operation of camera device>
Next, distance measurement and imaging operations of the camera device 400 described above will be described with reference to FIG. However, in FIG. 6, the same reference numerals as those in FIG.

  In ST501, the distance measuring sensor 401 detects the reflected light reflected by the subject 10, and calculates the distance between the camera device 400 (the distance measuring sensor 401) and the subject 10 according to the detected intensity of the reflected light. Since the purpose is to measure the distance between the camera device 400 and the subject 10, the distance measuring means is not limited to the distance measuring sensor 401, and a stereo camera method or a TOF (Time Of Fright) method is used. It is also possible to use what you have done.

  In ST502, the control unit 402 determines whether or not the distance to the subject 10 is equal to or greater than a predetermined value. If the distance is equal to or greater than the predetermined value (ST502: YES), the control unit 402 proceeds to ST306 and is less than the predetermined value (ST502: YES). (ST502: NO), the process proceeds to ST305.

  As described above, according to the second embodiment, the display data can be changed according to the distance between the camera device 400 and the subject 10, and the user can grasp the accuracy of the estimated color.

  In each of the above-described embodiments, the case where infrared light is used as a light source has been described. However, more colors can be estimated by using ultraviolet light in addition to infrared light. For example, as shown in FIG. 9, white, yellow, and red have similar reflection characteristics in the infrared region, and it is difficult to estimate these colors using only infrared light, but ultraviolet light ( By using (UV), white, red and yellow can be estimated.

  The camera device and the imaging method according to the present invention are suitable for irradiating a subject with invisible light having a plurality of different wavelengths and imaging the irradiated subject.

201A Imaging lens 310 Cover 320 Protective filter 10 Subject 100, 400 Camera device 101, 402 Control unit 102 First emitting unit 103 Second emitting unit 104 Third emitting unit 105 Illumination optical unit 150 Irradiating unit 200 Imaging unit 201 Imaging unit 201 Optical unit 202 Sensor unit 203 Data processing unit 204 Color estimation unit 250 Monitor 401 Distance sensor

Claims (10)

A camera device that irradiates invisible light and images the irradiated subject,
An irradiation unit that emits invisible light having a plurality of different wavelengths and irradiates the subject;
A color estimation unit that estimates display color of image data obtained by imaging the irradiated subject and generates display data;
With
The color estimation unit includes display data having a display area generated by the first display method and a display area generated by a second display method different from the first method, depending on the accuracy of the color information to be estimated. Camera device to generate.   The color estimation unit generates display data in an area corresponding to one estimated color by the first display method, and generates display data in an area corresponding to a plurality of estimated colors by the second display method. Item 2. The camera device according to Item 1. The color estimation unit has a color estimation table of values and color information based on luminance values of captured image data,
The camera apparatus according to claim 2, wherein the color estimation table associates a plurality of pieces of color information with a value based on a certain luminance value.   2. The camera device according to claim 1, wherein when the luminance value of the captured image data is equal to or less than a predetermined value, the color estimation unit generates display data for the area by the second display method. A distance measuring unit for measuring the distance to the subject;
The camera device according to claim 1, wherein the color estimation unit generates display data in the area by the second display method when the distance to the subject is a predetermined value or more. The first display method displays the subject in color,
The second display method displays the subject in black and white.
The camera device according to claim 1. The first display method displays the subject in color,
The second display method blinks and displays the subject by a color candidate of the subject.
The camera device according to claim 1.   The color estimation unit generates the display data using black and white data, and the area generated by the first display method displays one estimated color as text, and the area generated by the second display method. The camera device according to claim 1, wherein the plurality of color candidates are displayed as text.   The camera device according to claim 1, wherein the invisible light is infrared light and ultraviolet light. An imaging method in a camera device that irradiates invisible light and images an illuminated subject,
Irradiating the subject by emitting invisible light having a plurality of different wavelengths; and
A color estimating step of generating display data by estimating the color of image data obtained by imaging the irradiated object;
Have
In the color estimation step, a display having a display area generated by the first display method and a display area generated by a second display method different from the first display method depending on the certainty of the estimated color information. An imaging method for generating data.