JP2010178111A - Imaging device and television door intercom device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To avoid the dazzling of light irradiated to an object to be photographed at photographing even if obtaining an imaged image of a color of the object to be photographed in a dark place, related to an imaging device and a television door intercom device. <P>SOLUTION: The imaging device 9 includes an infrared light source unit 9a for photography which lights up the subject to be photographed, a visible light source unit 9b for photography which lights up the subject to be photographed, and an imaging unit 9c which photographs the subject to be photographed, and the imaging unit 9c is configured to photograph the subject to be photographed lit up with infrared light from the infrared light source unit 9a for photography and visible light from the visible light source unit 9b for photography in combination, and outputs a color video signal based on a plurality of color components and an infrared component obtained by photographing the subject to be photographed. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging device and a television door phone device that can capture a color image by photographing a subject.

  Conventionally, the captured image obtained by the camera installed in the child machine installed at the entrance is displayed on the monitor of the master unit installed in the room, and the telephone inside the room is talked with There has been proposed a TV door phone device in which a resident can check a captured image of a visitor.

In a conventional TV door phone device, when a call button of a slave unit is pressed by a visitor at night, the visitor is illuminated with visible light and the illuminated visitor is photographed with a camera. In addition, the conventional TV door phone device detects the illuminance around the camera and adjusts the amount of visible light according to the detected illuminance (see, for example, Patent Document 1).
JP 2000-224573 A

  In the above-described conventional TV door phone device, when a photographed subject is photographed by a camera to obtain a color captured image, the brightness necessary for photographing becomes insufficient as the surroundings become dark, such as at night, in order to compensate for this insufficient luminance. In addition, there is a problem that the amount of visible light that illuminates the subject is increased, that is, the light that is illuminated for the subject is dazzling.

  On the other hand, it is conceivable to illuminate infrared light that does not feel dazzling for the subject to obtain a luminance component necessary for photographing the subject even in the dark. However, since the wavelength of the infrared light is outside the visible region, the color information is It cannot be obtained, and only a monochrome image can be obtained as a captured image.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to prevent light illuminated by a subject from being dazzled even when a color captured image of the subject is obtained in a dark place.

  In order to achieve this object, an imaging apparatus of the present invention includes an imaging infrared light source unit that illuminates a subject, a visible light source unit that illuminates the subject, and an imaging unit that shoots the subject. Based on a plurality of color components and infrared components obtained by photographing a subject illuminated with both infrared light from a photographing infrared light source unit and visible light from a photographing visible light source unit. Thus, a color video signal is output. With such a configuration, the intended purpose is achieved.

  The television door phone apparatus of the present invention includes a slave unit having the above-described imaging device, and a display device that is electrically connected to the slave unit and displays a color video signal obtained by photographing a visitor by the imaging device. And a base unit having With such a configuration, the intended purpose is achieved.

  As described above, the imaging apparatus of the present invention includes the imaging infrared light source unit that illuminates the subject, the imaging visible light source unit that illuminates the subject, and the imaging unit that captures the subject. A color image based on a plurality of color components and infrared components obtained by photographing a subject illuminated with both infrared light from an external light source and visible light from a visible light source for photographing. Since the signal is output, it is possible to obtain a clear color video signal so that the light illuminated for the subject at the time of shooting is not dazzled. That is, by illuminating the infrared light from the imaging infrared light source unit in addition to the visible light illumination from the imaging visible light source unit, the luminance component of the captured image is increased by the light reflected from the subject, thereby The luminance component necessary for the captured image is obtained by reducing the amount of visible light by an amount corresponding to the excessive luminance component of the captured image. This reduces the amount of visible light that feels dazzling than when not illuminating the infrared light that does not feel dazzling, and illuminates the subject, so that the light illuminated for the subject can be made less dazzling. .

  The television door phone apparatus of the present invention includes a slave unit having the above-described imaging device, and a display device that is electrically connected to the slave unit and displays a color video signal obtained by photographing a visitor by the imaging device. The brightness required for the visitor to illuminate the illuminated light even when checking the color captured image of the visitor in a dark place such as at night on a display device. Ingredients can be secured.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment)
With reference to FIGS. 1-10, the television door phone apparatus in embodiment of this invention is demonstrated. Here, a TV door phone device that can check a visitor by a color captured image will be described as an example.

  1 is a schematic configuration diagram of a television door phone device 1 according to an embodiment of the present invention, FIG. 2 is a circuit block diagram of the television door phone device 1, FIG. 3 is a front view of a master unit 3 of the television door phone device 1, and FIG. Is a front view of the handset 2 of the television doorphone device 1, FIG. 5 is a diagram for explaining a brightness detection unit 9d of the imaging unit 9c in the television doorphone device 1, and FIG. 6 is an imaging unit 9c in the television doorphone device 1. FIG. 7 is a block diagram of the color separation filter 21 of the imaging unit 9c in the television door phone apparatus 1. FIG. 8 is a characteristic diagram showing the light transmission characteristics of the color separation filter 21 shown in FIG. FIG. 10 is a diagram for explaining the saturation detection unit 24 of the imaging unit 9c in the television door phone device 1, and FIG. 10 is a diagram for explaining the contrast detection unit 25 of the imaging unit 9c in the television door phone device 1.

  As shown in FIG. 1, the television door phone apparatus 1 is comprised from the subunit | mobile_unit 2 and the main | base station 3, and the subunit | mobile_unit 2 and the main | base station 3 are electrically connected via the communication line. And the subunit | mobile_unit 2 is each installed in the entrance, and the main | base station 3 is each installed in the living room. Thereby, the visitor 4 can talk with the resident 5 via the subunit | mobile_unit 2 in a front door, and the main | base station 3 in a living room.

  First, the configuration of the slave unit 2 will be described. As shown in FIG. 2, the handset 2 includes a call button 6, a handset control section 7, a handset communication section 8, and an imaging device 9.

  The call button 6 is a button that is pressed by the finger of the visitor 4, and when pressed by the finger, notifies the handset controller 7 of a press signal. The call button 6 is provided on the lower front side of the child device body 2a.

  The subunit | mobile_unit control part 7 controls the subunit | mobile_unit 2 whole. When receiving the notification indicating that the call button 6 has been pressed by the visitor 4, the slave unit control unit 7 transmits a call notification to the master unit 3 and activates the slave unit call unit 8 and the imaging device 9. Further, the operations of the slave unit call unit 8 and the imaging device 9 are terminated by a response end signal from the master unit 3.

  The slave unit call unit 8 includes a microphone (hereinafter referred to as “microphone”) 8a, a speaker 8b, and a call interface (hereinafter referred to as “call I / F”) 8c, and is provided on the front surface of the slave unit body 2a. ing. The microphone 8a outputs the voice of the visitor 4 as a voice signal. The speaker 8b outputs the audio signal from the parent device 3 as audio. The call I / F 8c performs voice input / output with the parent device 3.

  The imaging device 9 is operated by the slave control unit 7 to photograph the visitor 4, and a color difference signal and a luminance signal, which are color video signals, are transmitted via a video interface (hereinafter referred to as “video I / F”) 9e. To the base unit 3. The detailed configuration of the imaging device 9 will be described later.

  Next, the configuration of base unit 3 will be described. As shown in FIG. 2, the base unit 3 includes an operation button 10, a base unit control unit 11, a base unit call unit 12, and a display device 13.

  The operation button 10 is a response button used when the resident 5 in the room calls the visitor 4, and is connected to the parent device control unit 11.

  The parent device control unit 11 has a function of performing overall control of the entire parent device 3. Base unit control unit 11 operates base unit call unit 12 and display device 13 in response to a call notification from handset 2. As a result, when the call button 6 is pressed, voice signals can be input / output between the slave unit call unit 8 and the base unit call unit 12 via the call I / F 8c and the call I / F 12c, which will be described later. . In addition, the base unit control unit 11 has a function of causing the base unit call unit 12 and the display device 13 to be stopped by a signal from the operation button 10 that is pressed when the resident 5 finishes the call with the visitor 4. I have.

  The base phone call unit 12 includes a microphone 12a, a speaker 12b, and a call I / F 12c. The microphone 12a outputs the voice of the resident 5 as a voice signal. The speaker 12b outputs the sound signal from the child device 2 as sound. The call I / F 12c performs input / output of audio signals with the slave unit 2.

  The display device 13 includes a video I / F 13a and a liquid crystal display panel 13b. The display device 13 receives the color video signal from the slave unit 2 through the video I / F 13a, and displays a color captured image on the liquid crystal display panel 13b based on the color difference signal and the luminance signal of the input color video signal.

  In addition, as shown in FIG. 3, the operation button 10 of the main | base station 3 is provided in the front lower side of the main | base station main body 3a. Further, the microphone 12a and the speaker 12b of the base unit call unit 12 are provided at the front center of the base unit main body 3a, that is, above the operation buttons 10. The display device 13 is provided on the upper front side of the main body 3a.

  Next, when the configuration of the television door phone device 1 is understood, details of the imaging device 9 that is a feature of the present embodiment will be described.

  In the TV door phone apparatus 1, when the visitor 4 is photographed by the imaging device 9 of the slave unit 2 and the captured image of the visitor 4 is confirmed by the liquid crystal display panel 13 b of the master unit 3, the necessary brightness is reduced as the surroundings become dark, such as at night. Becomes insufficient and the captured image becomes dark and the visibility deteriorates. Therefore, in order to compensate for the insufficient brightness in the television door phone device 1, the visitor 4 is illuminated and photographed with visible light.

However, if the amount of visible light is increased to compensate for insufficient brightness as the surroundings become darker, the light illuminated for the visitor 4 becomes dazzling. For example, the luminance of the visible light source required for appropriately photographing the visitor 4 standing about 1 m away from the handset 2 whose light emission area of the photographing light source unit 9b is 2 cm ² is 5000 cd / mm. It is experimentally determined that it is m ² (luminous intensity 1 cd = 5000 cd / m ² × 2 cm ² ). On the other hand, when the background luminance is 50 cd / m ² and the visitor 4 is illuminated and photographed, it is experimentally required that the luminance at which the user begins to feel dazzling is 3500 to 5000 cd / m ² (for example, The glare evaluation value for feeling dazzling was set to 2.5 or more). Furthermore, the pupil of the visitor 4 is opened in a dark place as compared with a bright place, and it is felt dazzling even at the same brightness.

  Therefore, the imaging device 9 shoots the light illuminated by the visitor 4 so as not to be dazzled even when obtaining a color captured image of the visitor 4 in a dark place. That is, the imaging device 9 is configured to illuminate the visitor 4 with visible light and infrared light when photographing the visitor 4.

With this configuration, for example, the luminance of visible light is set to 3000 cd / m ² which is not dazzling, and the luminance of the captured image obtained by the imaging device 9 is thereby reduced by infrared light illumination. Here, the brightness of the appropriate visible light is 5000 cd / ^{m 2,} to illuminate by setting the light quantity of the infrared light by corresponding to the luminance (2000cd / ^{m 2)} minutes to insufficient amount of weakened visible light. Infrared light does not cause any light and dark sensations to the naked eye, so that it can be prevented from being dazzling for the visitors 4.

  Specifically, as shown in FIG. 2, the imaging device 9 photographs the infrared light source unit 9 a for illuminating the visitor 4, the visible light source unit 9 b for illuminating the visitor 4, and the visitor 4. An image pickup unit 9c that performs image detection, a brightness detection unit 9d that detects ambient brightness, a light amount control unit 9f that controls light amounts of the imaging infrared light source unit 9a and the imaging visible light source unit 9b, and a video I / F 9e. And.

  The imaging infrared light source unit 9a is composed of, for example, an infrared light emitting diode (for example, a peak wavelength of 810 to 950 nm). Further, the photographing visible light source unit 9b is composed of, for example, a white light emitting diode. A white light-emitting diode is a superposition of a plurality of light beams with different wavelengths, combining light-emitting diodes of three colors (red, green, and blue), producing a blue light-emitting diode and a yellow component. A combination with a fluorescent material is used.

  The imaging unit 9c was obtained by photographing the visitor 4 and the visitor 4 that were illuminated with the infrared light from the photographing infrared light source unit 9a and the visible light from the photographing visible light source unit 9b. A plurality of color signals and infrared signals are combined and a color video signal is output to the master unit 3 via the video I / F 9e. Details of the color signal processing of the imaging unit 9c will be described later.

  The light amount control unit 9f controls the light amount of infrared light from the photographing infrared light source unit 9a and the light amount of visible light from the photographing visible light source unit 9b, respectively. Thereby, it is possible to appropriately control the photographing infrared light source unit 9a and the photographing visible light source unit 9b so that the light illuminated for the visitor 4 is not dazzled, and obtain the luminance necessary for photographing. Can be. That is, the luminance component of the captured image is increased by the light reflected from the visitor 4 by illuminating the infrared light from the photographing infrared light source unit 9a in addition to the visible light illumination from the photographing visible light source unit 9b. Thus, the light amount control unit 9f obtains a luminance component necessary for the captured image by reducing the amount of visible light by an amount corresponding to the excessive luminance component of the captured image. Thereby, since the amount of visible light that feels dazzling is reduced to illuminate the subject as compared with the case where infrared light that does not feel dazzling is not used in combination, the subject does not feel dazzling. If the brightness of the installation location of the slave unit 2 does not change and is constant, the light amounts of the photographing infrared light source unit 9a and the photographing visible light source unit 9b may be fixed with appropriate light amounts.

  Further, as shown in FIG. 4, the handset 2 is provided with a call button 6 that is pressed down by the finger of the visitor 4 on the lower front side of the handset main body 2a, and the brightness detector 9d is moved from the position of the call button 6. Is also provided on the upper side. Thereby, since the light detected by the brightness detection unit 9d is not blocked by the finger or hand of the visitor 4, the brightness detection accuracy is improved. Since the brightness detection unit 9d is composed of an illuminance sensor and directly detects brightness, the brightness detection unit 9d is provided above the position of the call button 6 to prevent light from being blocked. Increases accuracy.

  The photographing infrared light source unit 9 a and the photographing visible light source unit 9 b are provided above the position of the call button 6. Thereby, since the light detected by the brightness detection unit 9d is not blocked by the finger or hand of the visitor 4, the brightness detection accuracy can be increased.

  In addition, the infrared illumination direction of the photographing infrared light source unit 9a and the visible light illumination direction of the photographing visible light source unit 9b are set in the same direction. Thereby, the shadow which arises with the illumination direction of the light illuminated by the uneven | corrugated | grooved part of the visitor's 4 face part is made the same, and the influence is suppressed.

  The brightness detection unit 9d includes an illuminance sensor. The illuminance sensor detects ambient brightness (for example, illuminance) and notifies the detected light intensity to the light amount control unit 9f. The light amount control unit 9f receives the notification of the illuminance value detected by the brightness detection unit 9d, and controls the light amount of the infrared light from the photographing infrared light source unit 9a based on the illuminance value. For example, as illustrated in FIG. 5, the light amount control unit 9 f has a table value (for example, a curve in FIG. 5) that is set in advance according to the surrounding brightness (illuminance value) being lower than the brightness setting reference value La. Based on A), the amount of infrared light from the infrared light source for photographing 9a is increased to increase the luminance component in the captured image. As a result, the brightness required for shooting is ensured even when the surroundings become dark, and the amount of infrared light that does not cause any light and darkness is increased, so that the amount of illumination light is appropriately controlled so that the illumination light is not dazzled for the visitor 4 To do. That is, if the ambient brightness is lower than the brightness setting reference value La, the amount of infrared light that is not dazzling is increased to compensate for the insufficient luminance, and the luminance component required in the captured image is secured.

  Next, color signal processing of the imaging unit 9c will be described. As shown in FIG. 6, the imaging unit 9 c includes a lens unit 20, a color separation filter 21, a light receiving element 22, a color signal processing unit 23, a saturation detection unit 24, and a contrast detection unit 25. Yes.

  The lens unit 20 is a lens group formed by combining a single lens or a plurality of lenses, and forms an image of a subject on the light receiving surface of the light receiving element 22 via the color separation filter 21.

  The color separation filter 21 is provided in front of the light receiving surface of the light receiving element 22, and transmits a red component (R), a green component (G), and a blue component (B) of visible light, and an infrared component ( A plurality of filters that transmit only Ir) light are arranged on the same plane.

  For example, the color separation filter 21 transmits only the red component (R) light, the red filter 21a, the green filter (b) that transmits only the green component (G) light, and the blue component (B) only. A blue filter 21c and an infrared filter 21d that transmits only infrared component (Ir) light are provided, and the minimum unit is 2 × 2 as shown in FIG. Each filter is arranged such that the red filter 21a and the blue filter 21c are in an oblique positional relationship, and the green filter 21b and the infrared filter 21d are arranged in an oblique positional relationship.

  This color separation filter 21 exhibits the light transmission characteristics shown in FIG. That is, although there are some overlaps in the wavelengths of the filters that transmit visible light, there is only one peak wavelength within the visible light range that maximizes light transmission. The infrared filter 21d transmits only the infrared region.

  The light receiving element 22 uses an imaging device such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and red components (R signals) from pixels corresponding to the filters of the color separation filter 21. ), The green component is a green signal (G signal), and the blue component is a blue signal (B signal), and primary color signals (R, G, B) are output.

  Next, the color signal processing unit 23 includes a luminance / color difference conversion unit 23a and a luminance synthesis unit 23b. The luminance / color difference conversion unit 23a converts each signal of the primary color signals (R, G, B) into a luminance signal and a color difference signal (for example, Cr signal, Cb signal). The luminance combining unit 23b outputs a luminance combined signal obtained by combining the luminance signal and the infrared signal. By using the luminance composite signal and the color difference signal as a color video signal, it is possible to output a color video signal that is close to the sense of hue that vision has. That is, visible light and infrared light have different color regions where light is reflected. Thus, if the luminance composite signal and the color difference signal are used, a necessary luminance component can be secured for the visitor 4 while suppressing glare of light, and only the infrared signal is used instead of the luminance composite signal. Compared to the case, the color of the color video signal can be made closer to a natural one.

  The luminance / color difference conversion unit 23a can be calculated using a known conversion formula. For example, if the luminance signal is Y, the red signal is R, the green signal is G, and the blue signal is B, the luminance signal Y is Y = 0.30 × R + 0.59 × G + 0.11 × B, and the color difference signal ( Cb, Cr) can be calculated as Cb = 0.564 × (B−Y) and Cr = 0.713 × (R−Y). In addition, although the example which used the thing of SDTV as said color matrix was demonstrated, it is not limited to this. Other color matrices such as Y, Pb, Pr for HDTV may be used.

  In addition, the luminance synthesis unit 23b adds the luminance signal and the infrared signal at a predetermined ratio (for example, 1: 1) using an adder. Note that the luminance signal and the infrared signal may be added at a ratio of 1: 0 or 0: 1, that is, one of the luminance signal and the infrared signal may be selected.

  The color signal processing unit 23 includes a saturation detection unit 24. The saturation detection unit 24 detects the saturation from the color difference signal in the luminance / color difference conversion unit 23a, and the detected saturation value is used as the light amount control unit 9f. Notify The light amount control unit 9f receives the notification of the saturation value detected by the saturation detection unit 24, and controls the amount of visible light from the photographing visible light source unit 9b based on the saturation value. For example, as shown in FIG. 9, the light quantity control unit 9f is based on a table value (for example, a curve B in FIG. 9) set in advance in accordance with the saturation value being lower than the saturation setting reference value Sa. The amount of visible light from the photographic visible light source unit 9b is increased to improve the saturation. Thereby, the color of the picked-up image is sharpened, and the visibility can be enhanced such that the resident 5 can easily identify the visitor 4.

  The color signal processing unit 23 includes a contrast detection unit 25. The contrast detection unit 25 detects a contrast value from the luminance signal in the luminance / color difference conversion unit 23a, and notifies the light amount control unit 9f of the detected contrast value. . The contrast detection unit 25 includes an edge amount detection unit (not shown) configured by a high-pass filter and an edge amount accumulation unit (not shown). The edge amount accumulation unit is an image detected by the edge amount detection unit. The edge amount in the image is accumulated, and the accumulated edge amount accumulation value is output as a contrast value to the light amount control unit 9f. As the luminance difference between the bright part and the dark part increases, the value of the edge amount cumulative value increases, that is, the contrast is high.

  The light amount control unit 9f receives the notification of the contrast value detected by the contrast detection unit 25, and controls the amount of infrared light from the imaging infrared light source unit 9a based on the contrast value. For example, as shown in FIG. 10, the light amount control unit 9f is used for photographing based on a table value (for example, a curve B in FIG. 10) set in advance according to the contrast value being lower than the contrast setting reference value Ca. The amount of infrared light from the infrared light source unit 9a is increased to increase the contrast. Thereby, the bright part and the dark part of the captured image are sharpened, and the visibility can be improved, for example, the resident 5 can easily identify the visitor 4.

  With the above configuration, the imaging unit 9c can output a clear color video signal with high saturation and contrast to the parent device 3 even in a dark shooting environment.

  Next, the operation of the TV door phone device 1 will be described with reference to FIG. FIG. 11 is a flowchart showing the operation of the television door phone apparatus 1 according to the embodiment of the present invention.

  As shown in FIG. 11, the visitor 4 presses the call button 6 when arriving at the front door. When the call button 6 of the handset 2 is pressed (S100), the TV door phone apparatus 1 activates the illuminance sensor of the brightness detection unit 9d and detects the brightness around the handset 2 (S102).

  Next, the television door phone apparatus 1 illuminates the visitor 4 with the visible light of the photographing visible light source unit 9b by the light amount control unit 9f, and the photographing infrared light source unit according to the illuminance detected by the brightness detecting unit 9d. The amount of infrared light illuminated from 9a is set based on a preset table value, and the visitor 4 is illuminated with both infrared light and visible light (S104).

  Next, the television door phone apparatus 1 activates the image capturing unit 9c of the image capturing apparatus 9 to photograph the visitor 4 (S106).

  Next, the television door phone apparatus 1 detects the saturation value from the color difference signal in the captured image obtained by photographing by the imaging unit 9c (S108), and whether or not the saturation value is equal to or less than the saturation setting reference value Sa. Is determined (S110). When the saturation value is equal to or less than the saturation setting reference value Sa, the amount of visible light is increased based on the table value so that the color component increases as the saturation value becomes lower than the saturation setting reference value Sa. (S112). That is, the TV door phone apparatus 1 increases the drive current of the white light emitting diode of the visible light source unit 9b for photographing based on the table value in accordance with the saturation value lower than the saturation setting reference value Sa by the light amount control unit 9f. Increase the amount of visible light. Thereby, for example, the amount of visible light illuminated on the face of the visitor 4 increases, and the visible light reflected from the face of the visitor 4 increases to increase the color component, so that the color becomes vivid.

  Next, the TV door phone apparatus 1 detects a contrast value from the luminance signal output from the luminance / color difference conversion unit 23a (S114), and determines whether or not the contrast value is equal to or less than a contrast setting reference value Ca (S116). . If the contrast value is less than or equal to the contrast setting reference value Ca, the amount of infrared light is increased based on the table value in order to increase the luminance component (S118). That is, the TV door phone apparatus 1 increases the drive current of the infrared light emitting diode of the infrared light source for photographing 9a based on the table value in accordance with the contrast value lower than the contrast setting reference value Ca by the light amount control unit 9f. Increase the amount of infrared light. This increases the amount of infrared light that illuminates the face of the visitor 4, thereby increasing the amount of infrared light reflected from the face of the visitor 4. And the contrast of the color video signal can be increased.

  In this way, the TV door phone apparatus 1 appropriately controls the light amounts of the photographing infrared light source unit 9a and the photographing visible light source unit 9b by the light amount control unit 9f, and the image pickup unit 9c of the slave unit 2 has saturation and contrast. A high and clear color video signal is output to the main unit 3.

  Next, the TV door phone apparatus 1 receives the color video signal output from the handset 2 by the base unit 3, and displays the color image on the liquid crystal display panel 13b of the base unit 3 based on the color difference signal and the luminance signal of the color video signal. Display the captured image. Furthermore, the TV door phone apparatus 1 operates the base unit call unit 12 and the display unit 13 in response to a call notification from the handset 2, and thereby, when the call button 6 is pressed, the handset call unit 8 and the base unit call unit 12 Voice signals can be input and output between them, and a call can be made (S120).

  Thereby, the resident 5 can talk with the visitor 4 while confirming the captured image of the visitor 4 by the liquid crystal display panel 13b. Note that the TV door phone apparatus 1 causes the base unit call unit 12 and the display unit 13 to be connected again by a signal from the operation button 10 pressed by the base unit control unit 11 when the resident 5 finishes the call with the visitor 4. Stop.

  As described above, according to the present embodiment, the imaging device 9 includes the imaging infrared light source unit 9 a that illuminates the visitor 4, the imaging visible light source unit 9 b that illuminates the visitor 4, and the visitor 4. The imaging unit 9c shoots the visitor 4 in which the infrared light from the imaging infrared light source unit 9a and the visible light from the imaging visible light source unit 9b are illuminated and visited. A color video signal is output based on a plurality of color signals and infrared signals obtained by photographing the person 4.

  With such a configuration, it is possible to obtain a clear color video signal so that the light illuminated for the visitor 4 is not dazzled when photographing in a dark place. That is, the luminance component of the captured image is increased by the light reflected from the visitor 4 by illuminating the infrared light from the photographing infrared light source unit 9a in addition to the visible light illumination from the photographing visible light source unit 9b. Thus, the luminance component necessary for the captured image is obtained by reducing the amount of visible light by an amount corresponding to the luminance component of the captured image that is excessive. Thereby, the amount of visible light that feels dazzling for the visitor 4 can be reduced by the combined illumination of infrared light that does not feel dazzling, and the light that is illuminated for the visitor 4 can be prevented from being dazzling. .

  In addition, the television door phone apparatus 1 of the present embodiment includes a slave unit 2 having the above-described imaging device 9 and a color obtained by photographing the visitor 4 with the imaging device 9 while being electrically connected to the slave unit 2. And a master unit 3 having a display device 13 for displaying a video signal.

  With such a configuration, even when a color captured image of a visitor 4 in a dark place such as at night is confirmed on the display device 13, a luminance component required so that the light illuminated by the visitor 4 is not dazzled. Can be secured.

  In the present embodiment, an example in which an illuminance sensor is used as the brightness detection unit 9d has been described. However, a brightness estimation unit 26 may be used instead of the brightness detection unit 9d. That is, as shown in FIG. 12, the brightness estimation unit 26 accumulates the luminance value in the captured image obtained by illuminating the visitor 4 with the visible light from the imaging visible light source unit 9 b, and the imaging A visible infrared light combined luminance value obtained by accumulating luminance values in a captured image obtained by using both the visible light from the visible light source unit 9b and the infrared light from the photographing infrared light source unit 9a. The ambient brightness is estimated based on the ratio (luminance component ratio) between the visible light luminance value and the visible infrared light combined luminance value. Then, the brightness estimation unit 26 outputs the estimated brightness value to the light amount control unit 9f.

  For example, the brightness estimation value L, the visible light luminance value P, and the visible infrared light combined luminance value Q are defined as L = Q ÷ (P + Q). According to this definition, the closer the brightness estimation value is to “0.5”, the brighter the surroundings (the higher the brightness). Conversely, the closer the estimated brightness value is to “1.0”, the darker the surroundings (the lower the brightness). That is, the brighter the surroundings, the smaller the change in the luminance signal due to turning on / off the infrared light, so the estimated brightness value approaches “0.5”, and the darker the surroundings, the luminance signal due to turning on / off the infrared light. Therefore, the estimated brightness value approaches “1.0”.

  In this way, a table value (for example, the curve D in FIG. 13) in which the brightness and the brightness estimated value are associated with each other is experimentally obtained in advance, and the brightness is estimated based on this table value. The light amount control unit 9f controls the amount of infrared light from the imaging infrared light source unit 9a based on the estimated brightness value output from the brightness estimation unit 26. That is, the light amount control unit 9f is based on a table value (for example, the curve A in FIG. 5) set in advance according to the brightness notified from the brightness estimation value becoming darker than the brightness setting reference value La. The amount of infrared light illuminated from the photographing infrared light source unit 9a is increased. Thus, by providing the brightness estimation unit 26 instead of the brightness detection unit 9d, the illuminance sensor can be eliminated.

  The configuration of the color separation filter 21 is not limited to this. For example, as shown in FIG. 14, a color separation filter 30 having a two-band transmission characteristic that transmits each color component region and the infrared region is used for each filter. The color separation filter 30 transmits the red / infrared filter 30a that transmits not only the red component (R) but also the infrared component (Ir), and the infrared component (Ir) light as well as the green component (G). Transmitting green / infrared filter 30b, blue / infrared filter 30c transmitting not only blue component (B) but also infrared component (Ir) light, and red transmitting only infrared component (Ir) light An outer filter 30d, and the minimum unit is 2 × 2. With such a configuration, compared to the color separation filter 21, the color separation filter 30 can quadruple the size of the region that transmits infrared light, and the amount of infrared light received by the light receiving element 22 can be increased. . As a result, the luminance component can be easily detected by the imaging device 9 even in a dark place, and an image with high contrast and good visibility can be obtained. When this color separation filter 30 is used, since each color signal of the primary color signal includes an infrared component, a primary color signal extraction unit that subtracts the infrared signal (Ir) from each color signal is provided at the subsequent stage of the light receiving element 22, and each primary color signal is obtained. Extract. Thereby, a color video signal with high saturation can be obtained.

  Further, as shown in FIG. 15, a color separation filter 31 having a two-band transmission characteristic that transmits each color component region and the infrared region may be used for each filter. The color separation filter 31 transmits not only the red component (R) but also the infrared component (Ir) light, and the red / infrared filter 31a that transmits not only the green component (G) but also the infrared component (Ir) light. A green / infrared filter 31b that transmits light and a blue / infrared filter 31c that transmits light of not only a blue component (B) but also an infrared component (Ir) are included, and the minimum unit is 2 × 2. . With such a configuration, compared to the color separation filter 21, the color separation filter 31 can quadruple the size of the region that transmits infrared light, and the amount of infrared light received by the light receiving element 22 can be increased. .

  When this color separation filter 31 is used, as shown in FIG. 16, the color signal processing unit 27 has a luminance / color difference conversion unit 27a, and the luminance / color difference conversion unit 27a is a mixed color signal that is a primary color signal on which an infrared component is superimposed. The color signal (R + Ir, G + Ir, B + Ir) is converted into a luminance signal and a color difference signal (for example, Cr signal, Cb signal). As a result, since the luminance signal output from the luminance / color difference conversion unit 27a includes an infrared component, a captured image with high contrast can be obtained, and the face of the visitor 4 can be detected even when the image is taken in a dark place. Easy to do. By the way, if the luminance signal and the color difference signal obtained by the conversion by the luminance / color difference conversion unit 27a are output as they are as a color video signal, the color becomes pale. That is, since each color signal includes an infrared component, the color difference signals (Cr, Cb) have a lighter hue as the infrared component is raised. Therefore, in the present embodiment, a color difference correction unit 27b that increases the saturation of the color difference signal is provided, and the color difference correction unit 27b inputs the color difference signal and outputs a corrected color difference signal with increased saturation. By outputting the luminance signal and the corrected color difference signal as a color video signal, it is possible to obtain a picked-up image with a deeper hue and to improve the visibility of the picked-up image. When the color separation filter 31 is used, the saturation detection unit 24 may detect the saturation from the corrected color difference signal of the color difference correction unit 27b, and notify the light amount control unit 9f of the detected saturation value. . Thereby, since the influence of the infrared component is removed from the corrected color difference signal, the saturation can be detected in a state close to a natural hue, and the hue of the captured image can be made appropriate.

  In the present embodiment, the imaging infrared light source unit 9a and the imaging visible light source unit 9b are provided in the imaging device 9 and attached in advance to the slave unit body 2a. The visible light source unit 9b may be detachable so that it can be attached later as an optional light source. In this case, when the optional light source is attached, an interlocking operation between the optional light source and the imaging unit 9c is performed. In addition, the external infrared light source unit 9a and the visible light source unit 9b are electrically connected to the light amount control unit 9f, and the light amount control unit 9f controls the light amounts of infrared light and visible light. May be controlled.

  In the present embodiment, the TV door phone device 1 has been described. However, since a clear color image can be obtained even in a dark place, a photographing device (for example, a surveillance camera, a digital camera, a digital movie, It can also be applied to mobile phones.

  As described above, the present invention includes a photographing infrared light source unit that illuminates a subject, a photographing visible light source unit that illuminates the subject, and an imaging unit that photographs the subject, and the imaging unit is a photographing infrared light source unit. Shooting a subject that is illuminated with both infrared light from the visible light source and visible light from the photographing light source unit, and output a color video signal based on multiple color components and infrared components obtained by photographing the subject With this configuration, it is possible to obtain a clear color video signal so that the light illuminated for the subject is not dazzled during shooting.

  That is, in addition to the illumination of visible light from the imaging visible light source unit, the luminance component reflected from the subject is increased by illuminating the infrared light from the imaging infrared light source unit, and thereby an excess luminance component Only the amount of visible light is reduced to obtain the necessary luminance component.

  This makes it possible to illuminate the subject by reducing the amount of visible light that feels dazzling than when not illuminating infrared light that does not feel glare, and so that the light illuminated for the subject is not dazzled It is useful for imaging devices, TV door phone devices, surveillance cameras, digital cameras, digital movies, mobile phones, etc.

Schematic configuration diagram of a television door phone device in an embodiment of the present invention Circuit block diagram of the TV door phone device Front view of the main unit of the TV door phone device Front view of the slave unit of the TV door phone device The figure explaining the brightness detection part of the imaging part in the television door phone apparatus Block diagram of the imaging unit in the TV door phone device Configuration diagram of the color separation filter of the imaging unit in the TV door phone device FIG. 7 is a characteristic diagram showing the light transmission characteristics of the color separation filter shown in FIG. The figure explaining the saturation detection part of the imaging part in the television door phone apparatus in the embodiment of the present invention The figure explaining the contrast detection part of the imaging part in the television door phone apparatus Flow chart showing the operation of the TV door phone device Block diagram of the brightness control system in the imaging unit of the TV door phone device The figure explaining the brightness estimation part of the imaging part in the television door phone apparatus The block diagram which shows the other example of the color separation filter of the television door phone apparatus The block diagram which shows the further another example of the color separation filter of the television door phone apparatus The block diagram which shows the other example of the imaging part in the television door phone apparatus

DESCRIPTION OF SYMBOLS 1 TV door phone apparatus 2 Child machine 2a Child machine main body 3 Parent machine 3a Parent machine main body 4 Visitor 5 Resident 6 Call button 7 Child machine control part 8 Child machine call part 8a, 12a Microphone 8b, 12b Speaker 8c, 12c Call I / F
DESCRIPTION OF SYMBOLS 9 Imaging device 9a Infrared light source part for imaging | photography 9b Visible light source part for imaging | photography 9c Imaging part 9d Brightness detection part 9e, 13a Image | video I / F
9f Light intensity control unit 10 Operation button 11 Base unit control unit 12 Base unit call unit 13 Display device 13b Liquid crystal display panel 20 Lens unit 21, 30, 31 Color separation filter 22 Light receiving element 23, 27 Color signal processing unit 23a, 27a Luminance color difference Conversion unit 23b Luminance synthesis unit 24 Saturation detection unit 25 Contrast detection unit 26 Brightness estimation unit 27b Color difference correction unit

Claims (9)

An infrared light source for photographing that illuminates the subject;
A visible light source for photographing that illuminates the subject;
An imaging unit for photographing the subject,
The imaging unit shoots the subject illuminated with infrared light from the photographing infrared light source unit and visible light from the photographing visible light source unit, and a plurality of colors obtained by photographing the subject. An image pickup apparatus configured to output a color video signal based on a component and an infrared component. The imaging unit
The lens part,
A color separation filter that separates incident light incident through the lens unit into a plurality of color components and infrared components;
A light receiving element that receives the incident light through the color separation filter and outputs a plurality of color signals corresponding to the plurality of color components and an infrared signal corresponding to the infrared component;
A luminance color difference conversion unit that converts the plurality of color signals output from the light receiving element into a color difference signal and a luminance signal;
A luminance synthesis unit that outputs a luminance synthesis signal obtained by synthesizing the luminance signal and the infrared signal;
2. The imaging apparatus according to claim 1, wherein the color difference signal output from the luminance / color difference conversion unit and the luminance synthesis signal output from the luminance synthesis unit are output as the color video signal. . The imaging unit
The lens part,
A color separation filter that separates incident light incident through the lens unit into a plurality of color components each including an infrared component;
A light receiving element that receives the incident light through the color separation filter and outputs a plurality of color signals on which the infrared components are superimposed;
A luminance color difference conversion unit that converts the plurality of color signals output from the light receiving element into a color difference signal and a luminance signal;
A color difference correction unit that outputs a correction color difference signal in which the saturation of the color difference signal output from the luminance color difference conversion unit is increased,
2. The imaging apparatus according to claim 1, wherein the luminance signal output from the luminance / color difference conversion unit and the corrected color difference signal output from the color difference correction unit are output as the color video signal. . The light quantity control part which controls the light quantity of the infrared light from the said infrared light source part for imaging | photography, and the light quantity of the visible light from the said visible light source part for imaging | photography are provided, respectively. The imaging device according to any one of the above. Provide a brightness detector to detect the ambient brightness,
The light amount control unit increases the amount of infrared light from the photographing infrared light source unit as the ambient brightness detected by the brightness detection unit becomes darker than a brightness setting reference value. The imaging apparatus according to claim 4, wherein the imaging apparatus is configured to be configured. A saturation detector for detecting a saturation value from the color difference signal in the captured image is provided,
The light amount control unit increases the amount of visible light from the visible light source unit for photographing in response to the saturation value detected by the saturation detection unit being lower than a saturation setting reference value. The imaging apparatus according to claim 4, wherein A contrast detection unit for detecting a contrast value from the luminance signal in the captured image;
The light amount control unit is configured to increase the amount of infrared light from the photographing infrared light source unit in response to the contrast value detected by the contrast detection unit being lower than a contrast setting reference value. The imaging apparatus according to claim 4. A brightness estimation unit that estimates ambient brightness and a light amount control unit that controls the amount of infrared light from the imaging infrared light source unit are provided,
The brightness estimation unit includes a visible light luminance value obtained by accumulating values of the luminance signal in a captured image obtained by illuminating the subject with visible light from the photographing visible light source unit, and the photographing visible light source unit. And the visible infrared light combined luminance value obtained by accumulating the luminance signal values in the captured image obtained by combined illumination of the visible light from the infrared light source and the infrared light from the imaging infrared light source unit. Estimating the brightness of the surroundings based on the ratio of the light luminance value and the visible infrared light combined luminance value,
The light amount control unit increases the amount of infrared light from the photographing infrared light source unit as the ambient brightness estimated by the brightness estimation unit becomes darker than a brightness setting reference value. The imaging apparatus according to claim 2, wherein the imaging apparatus is configured to be configured to be configured. A handset having the imaging device according to any one of claims 1 to 8,
A television door phone apparatus comprising: a master unit electrically connected to the slave unit and having a display device for displaying a color video signal obtained by photographing a visitor by the imaging device.

Images