JP6794795B2 - Imaging device, imaging method, program - Google Patents

Description

The present invention relates to an imaging technique, and more particularly to an imaging device, an imaging method, and a program for imaging by infrared rays.

When the voltage of the battery built in the camera drops in a low temperature state, the camera may not be able to take a picture. In addition, the liquid crystal display device built into the camera may disappear in a low temperature state. Therefore, a temperature sensor and a heater are arranged in each part of a mechanism or the like that cannot exert its function at a low temperature or in the vicinity of a power source, and when the temperature of each part is lower than the set temperature, heating is performed by the heater (for example, Patent Document 1). reference).

Japanese Unexamined Patent Publication No. 11-338025

In a low temperature state, the functions of the lens and the image sensor are less likely to be exhibited. In particular, since these parts are arranged in a place where it is easy to get cold, such as near the lens cover of the housing, they are often separated from the place where the heater is installed.

The present invention has been made in view of these circumstances, and an object of the present invention is to provide a technique capable of imaging in various states.

In order to solve the above problems, the image pickup apparatus of the present invention has an infrared projection unit that emits infrared rays, an image pickup unit that captures an image, and an infrared cut filter unit that reduces infrared rays incident on the image pickup unit. Infrared projection state determination that controls the infrared projection by the infrared projection unit, controls the insertion of the infrared cut filter unit, and acquires the value used to determine the state of the infrared projection unit. a value acquisition unit, Ru comprising a. Based on the value acquired by the infrared projection state judgment value acquisition unit, the control unit either disables the infrared cut filter unit while making the infrared projection non-infrared light, or inserts it into the infrared projection unit. while projecting infrared decide to insert the infrared cutoff filter unit.

Another aspect of the present invention is an imaging method. In this method, the infrared rays acquired in the step of acquiring the infrared light projection state determination value, the step of acquiring the user setting information by the user, and the state in which the image pickup unit takes an image while the infrared light projecting unit projects infrared light. Based on the light projection state determination value and user setting information, the infrared cut filter unit that reduces the infrared rays incident on the imaging unit is used, and the infrared cut filter unit is used while making the infrared light projection unit non-infrared rays. The step includes a step of deciding whether to insert the infrared cut filter unit while projecting infrared rays onto the infrared light projecting unit .

It should be noted that any combination of the above components and the conversion of the expression of the present invention between methods, devices, systems, recording media, computer programs and the like are also effective as aspects of the present invention.

According to the present invention, imaging in various states can be performed.

It is a figure which shows the structure of the image pickup apparatus which concerns on embodiment of this invention. It is a figure which shows the data structure of the table stored in the control part of FIG. It is a flowchart which shows the imaging procedure by the imaging apparatus of FIG.

Before explaining the present invention in detail, first, an outline will be given. Examples of the present invention relate to an imaging device used for a surveillance camera or the like. The guaranteed operation temperature of the imaging device used as an outdoor surveillance camera is very wide, and there are some that guarantee the operation even at minus several tens of degrees. An image pickup device that can be used even in such a cold region generally has a built-in temperature sensor, and operates a heat source circuit that becomes a heater when the temperature drops below a certain temperature. The image pickup apparatus is also provided with a mechanism for operating a fan for diffusing heat. As described above, among the image pickup devices, the components that are difficult to operate at low temperatures are often lenses and image sensors. Since these parts are located in a cold place such as near the lens cover of the housing, they are generally separated from the place where the built-in heater is installed. Therefore, heating by heaters and fans is not efficient for these components. On the other hand, it is not realistic to arrange the heater in the vicinity of the lens cover of the housing which is easy for the user to see in order to warm these parts because the appearance of the image pickup apparatus is deteriorated.

The image pickup apparatus has a function of performing infrared imaging in order to enable imaging in a dark case such as at night. When performing infrared imaging, infrared light is generally projected. The infrared projection unit for projecting infrared rays is generally arranged in the vicinity of the lens and the image pickup element, and is warmed by heat generation during the projection. Therefore, the infrared projector can be used instead of the heater. However, when infrared rays are projected, the image quality may be adversely affected. For example, in the case of outdoor monitoring in a heavy snowfall area, when infrared rays are projected, the infrared rays entering the image pickup apparatus become too strong due to reflection by snow. In this case, the image quality is deteriorated so that the image is overexposed or the stereoscopic effect is significantly reduced. That is, the image quality tends to deteriorate when the emitted infrared rays are strongly emitted.

In order to suppress deterioration of image quality even in such a state, the image apparatus according to the present embodiment inserts an infrared cut filter unit when infrared rays are projected as a heater to perform imaging by infrared rays. That is, usually, the infrared cut filter portion to be removed is inserted in order to reduce the intensity of the reflected infrared rays. As a result, the influence of infrared rays is reduced by the infrared cut filter unit while being warmed by infrared light projection.

FIG. 1 shows the configuration of the image pickup apparatus 100 according to the embodiment of the present invention. The imaging device 100 includes an imaging state determination value acquisition unit 10, an infrared projection state determination value acquisition unit 12, a user setting information acquisition unit 14, a control unit 16, an imaging unit 20, an infrared projection unit 22, and an infrared cut filter unit 24. Including. Here, a surveillance camera installed outdoors is assumed as the image pickup device 100.

The image pickup unit 20 is configured to include the above-mentioned lens and image pickup device. Such lenses and image sensors are generally difficult to operate at low temperatures. The imaging unit 20 can capture a color image with visible light and a black-and-white image with infrared rays. Here, the imaging mode for capturing an image with visible light is called a visible light imaging mode, and the imaging mode for capturing an image with infrared light is called an infrared imaging mode. The switching of the imaging mode in the imaging unit 20 is performed by the control from the control unit 16.

The infrared light projecting unit 22 projects infrared rays in the imaging direction of the imaging unit 20. The infrared light projecting unit 22 is arranged near the lens cover of the housing of the image pickup device 100, that is, near the image pickup unit 20. The infrared projection state in the infrared projection unit 22 includes two states, a projection state and a non-projection state. The switching of the infrared projection state in the infrared projection unit 22 is performed by control from the control unit 16. The infrared light projecting unit 22 is composed of parts that easily generate heat, and generates heat in the light projecting state to warm the surroundings.

The infrared cut filter unit 24 reduces the infrared rays imaged by the image pickup unit 20, that is, the infrared rays incident on the image pickup unit 20. The infrared cut filter unit 24 is divided into an inserted state in which the infrared rays are inserted in front of the imaging unit 20 to reduce the infrared rays incident on the imaging unit 20 and an infrared rays removed from the front of the imaging unit 20 and incident on the imaging unit 20. Includes two non-inserted states that do not affect it. The non-inserted state is also called the removed state. The state switching in the infrared cut filter unit 24 is performed by the control from the control unit 16.

The image pickup state determination value acquisition unit 10 acquires a value used when determining the image pickup state of the image pickup unit 20, that is, the image pickup mode of the image pickup unit 20. Here, an example of the value acquired by the imaging state determination value acquisition unit 10 is the degree of brightness. In that case, the image pickup state determination value acquisition unit 10 corresponds to the brightness sensor. The image pickup state determination value acquisition unit 10 senses the brightness around the image pickup device 100. The imaging state determination value acquisition unit 10 outputs the detected degree of brightness to the control unit 16.

The infrared projection state determination value acquisition unit 12 acquires a value used when the control unit 16 determines the state of the infrared projection unit 22. Here, an example of the value acquired by the infrared projection state determination value acquisition unit 12 is the temperature. In that case, the infrared projection state determination value acquisition unit 12 corresponds to the temperature sensor. The infrared projection state determination value acquisition unit 12 senses the temperature of the image pickup device 100 itself or the vicinity of the image pickup device 100. The infrared projection state determination value acquisition unit 12 outputs the sensed temperature to the control unit 16.

The user setting information acquisition unit 14 provides information indicating whether or not the image quality captured by the imaging unit 20 is adversely affected when infrared rays are projected by the infrared projection unit 22 via an interface that can be operated by the user (hereinafter, "User setting information") is obtained from the user. As the user setting information, either "adverse effect" when the image quality is adversely affected or "no adverse effect" when the image quality is not adversely affected is set. For example, in a state where infrared rays are projected by the infrared projection unit 22, the user visually recognizes the image captured by the imaging unit 20 to determine whether or not there is an adverse effect. The determination result is reflected in the user setting information. The user setting information acquisition unit 14 outputs the acquired user setting information to the control unit 16.

The control unit 16 is based on the degree of brightness input from the imaging state determination value acquisition unit 10, the temperature input from the infrared projection state determination value acquisition unit 12, and the user setting information input from the user setting information acquisition unit 14. , The image pickup unit 20, the infrared projection unit 22, and the infrared cut filter unit 24 are controlled. In order to execute this control, the control unit 16 uses the table shown in FIG. FIG. 2 shows the data structure of the table stored in the control unit 16. The control unit 16 executes the control described in "control" according to the content described in "input". Here, the threshold value for the degree of brightness is a fixed value according to the brightness at which the imaging mode of the imaging unit 20 should be switched from the visible light imaging mode to the infrared imaging mode. Further, the threshold value for the temperature is a fixed value according to the temperature at which the infrared light projecting unit 22 is placed in the light projecting state to warm the surroundings.

When the degree of brightness is equal to or higher than the threshold value and the temperature is equal to or higher than the threshold value (cases 1 and 2), the control unit 16 sets the imaging unit 20 to the visible light imaging mode and sets the infrared projection unit 22 to the visible light imaging mode. The light is not projected and the infrared cut filter unit 24 is inserted. In these cases, the setting contents of the user setting information do not affect the control contents. When the degree of brightness is equal to or higher than the threshold value and the temperature is lower than the threshold value (cases 3 and 4), the control unit 16 sets the imaging unit 20 to the visible light imaging mode and the infrared projection unit 22. Is projected, and the infrared cut filter unit 24 is inserted. Even in these cases, the setting contents of the user setting information do not affect the control contents.

When the degree of brightness is below the threshold value, the temperature is above the threshold value, and the user setting information has no adverse effect (Case 5), the control unit 16 sets the image pickup unit 20 to the infrared image pickup mode. The infrared light projecting unit 22 is projected, and the infrared cut filter unit 24 is not inserted. When the degree of brightness is below the threshold value, the temperature is above the threshold value, and the user setting information is adversely affected (Case 6), the control unit 16 sets the image pickup unit 20 to the infrared image pickup mode. The infrared light projecting unit 22 is non-projected, and the infrared cut filter unit 24 is not inserted.

When the degree of brightness is below the threshold value, the temperature is below the threshold value, and the user setting information has no adverse effect (case 7), the control unit 16 sets the image pickup unit 20 to the infrared imaging mode. , The infrared light projecting unit 22 is projected, and the infrared cut filter unit 24 is not inserted. When the degree of brightness is below the threshold value, the temperature is below the threshold value, and the user setting information is adversely affected (Case 8), the control unit 16 sets the image pickup unit 20 to the infrared imaging mode. , The infrared light projecting unit 22 is projected, and the infrared cut filter unit 24 is inserted.

That is, in the case 8, the control unit 16 projects infrared rays by the infrared light projecting unit 22, and inserts the infrared cut filter unit 24. Further, in the case 7 or the case 8, the control unit 16 determines whether or not to insert the infrared cut filter unit 24 based on the user setting information acquired by the user setting information acquisition unit 14.

Further, in the case 6 or the case 8, the control unit 16 either disables the infrared cut filter unit 24 while causing the infrared projection unit 22 to non-infrared light based on the temperature, or the infrared projection unit. It is determined whether to insert the infrared cut filter unit 24 while projecting infrared light onto 22. When case 5 or case 7 is included in this, the control unit 16 projects infrared rays to the infrared light projecting unit 22 regardless of the temperature as long as the user setting information acquired by the user setting information acquisition unit 14 has no adverse effect. It is decided to not insert the infrared cut filter unit 24 while allowing the infrared cut filter unit 24 to be inserted. Further, the control unit 16 inserts the infrared cut filter unit 24 when the image pickup unit 20 is imaged with visible light depending on the degree of brightness.

Hereinafter, an example of specific processing in the image pickup apparatus 100 will be shown.
(1) The user installs the image pickup apparatus 100.
When executing outdoor monitoring in a heavy snowfall area, the user sets "user setting information" to "has an adverse effect" in the user setting information acquisition unit 14.
(2) The user operates an imaging start button (not shown) to start imaging by the imaging device 100. After the imaging is started, the control unit 16 periodically executes the above-described processing. At the start, it is assumed that the degree of brightness is above the threshold and the temperature is above the threshold (Case 2). In this case, the control unit 16 controls the imaging unit 20 to be in the visible light imaging mode, the infrared projection unit 22 to be non-illuminated, and the infrared cut filter unit 24 to be inserted.

(3) From daytime to night as time passes, the degree of brightness becomes lower than the threshold value (Case 6). In this case, the control unit 16 controls so that the image pickup unit 20 is set to the infrared image pickup mode, the infrared light projection unit 22 is left as non-light projection, and the infrared cut filter unit 24 is not inserted.
(4) The temperature drops below the threshold value from night to midnight as time passes (Case 8). In this case, the control unit 16 controls the infrared projection unit 22 to remain in the infrared imaging mode, the infrared projection unit 22 to emit light, and the infrared cut filter unit 24 to be inserted.

When the intensity of infrared rays incident on the imaging unit 20 is reduced more than necessary due to the insertion of the infrared cut filter unit 24, it is generally used for long-time exposure or digital gain of DSP (Digital Signal Processor). May be complemented by processing that tends to avoid use.

This configuration can be realized by the CPU, memory, and other LSIs of any computer in terms of hardware, and by programs loaded in memory in terms of software, but here it is realized by cooperation between them. It depicts a functional block to be done. Therefore, it will be understood by those skilled in the art that these functional blocks can be realized in various ways by hardware only, software only, or a combination thereof.

The operation of the image pickup apparatus 100 with the above configuration will be described. FIG. 3 is a flowchart showing an imaging procedure by the imaging device 100. When the brightness is equal to or higher than the threshold value (Y in S10), the control unit 16 sets the imaging unit 20 to the visible light imaging mode (S12). When the temperature is equal to or higher than the threshold value (Y in S14), the control unit 16 determines the non-illumination of the infrared projection unit 22 (S16). When the temperature is below the threshold value (N in S14), the control unit 16 determines the projection of the infrared projection unit 22 (S18). The control unit 16 determines the insertion of the infrared cut filter unit 24 (S20).

When the brightness is below the threshold value (N in S10), the control unit 16 sets the imaging unit 20 to the infrared imaging mode (S22). When the temperature is equal to or higher than the threshold value (Y in S24) and no adverse effect is set (Y in S26), the control unit 16 determines the projection of the infrared projection unit 22 (S28). When no adverse effect is set (N in S26), the control unit 16 determines the non-illumination of the infrared projection unit 22 (S30). The control unit 16 determines that the infrared cut filter unit 24 is not inserted (S36).

When the temperature is below the threshold value (N in S24), the control unit 16 determines the projection of the infrared projection unit 22 (S32). When the setting for no adverse effect is made (Y in S34), the control unit 16 determines that the infrared cut filter unit 24 is not inserted (S36). When no adverse effect is set (N in S34), the control unit 16 determines the insertion of the infrared cut filter unit 24 (S38).

According to this embodiment, since the infrared cut filter unit is inserted while the infrared light projecting unit emits infrared rays, the image quality deteriorates even if the infrared rays are strongly reflected when performing infrared imaging in a cold state. Can be suppressed. Further, since the deterioration of the image quality is suppressed even if the reflection of infrared rays is strong, the deterioration of the image quality can be suppressed even in the imaging in various states. Further, since it is determined whether or not to insert the infrared cut filter unit based on the user setting information, it is possible to set whether or not the image quality is deteriorated due to strong infrared reflection.

In addition, when the brightness is below the threshold value and the temperature is above the threshold value, the infrared cut filter unit is not inserted while making the infrared light projection non-infrared light depending on the user setting information, so that the power consumption is consumed. Can be reduced. Further, if the temperature is lower than the threshold value, infrared rays are projected onto the infrared projection unit, and whether or not to insert the infrared cut filter unit is determined based on the information set by the user, so that the influence of infrared reflection is obtained. It is possible to warm the image pickup unit while reducing the number of images. In addition, if the influence of infrared reflection is small, the infrared cut filter unit is not inserted while projecting infrared rays to the infrared projection unit regardless of the temperature, based on the user setting information, so infrared imaging is executed. it can. Further, when performing visible light imaging, since the infrared cut filter unit is inserted, the influence of infrared rays can be reduced.

The present invention has been described above based on examples. This embodiment is an example, and it is understood by those skilled in the art that various modifications are possible for each of these components and combinations of each processing process, and that such modifications are also within the scope of the present invention. ..

In this embodiment, the infrared projection state determination value acquisition unit 12 acquires the temperature as a value used when the control unit 16 determines the state of the infrared projection unit 22. However, the present invention is not limited to this, and for example, the infrared projection state determination value acquisition unit 12 may acquire a value other than the temperature. One example is the remaining battery level when the image pickup apparatus 100 is driven by a battery. The control unit 16 determines the processing when the remaining battery level is equal to or higher than the threshold value and the temperature is lower than the threshold value, and when the remaining battery level is lower than the threshold value, the temperature is thresholded. Determine what to do if it is greater than or equal to the value. According to this modification, the degree of freedom of configuration can be improved.

In this embodiment, the user setting information acquisition unit 14 acquires information as user setting information that has or has no adverse effect. However, the present invention is not limited to this, and for example, the user setting information acquisition unit 14 may be omitted. In that case, the control unit 16 determines the processing when there is an adverse effect. According to this modification, the configuration can be simplified.

In this embodiment, the imaging unit 20 can capture a color image with visible light and a black and white image with infrared rays. However, the present invention is not limited to this, and for example, the imaging unit 20 may perform imaging by means other than infrared rays. In that case, instead of the infrared cut filter unit 24, an optical filter unit having a wavelength corresponding to the light used for imaging is used. According to this modification, the degree of freedom of configuration can be improved.

10 Imaging state judgment value acquisition unit, 12 Infrared projection status determination value acquisition unit, 14 User setting information acquisition unit, 16 Control unit, 20 Imaging unit, 22 Infrared projection unit, 24 Infrared cut filter unit, 100 Imaging device.

Claims (5)

Infrared projector that emits infrared rays and
An imaging unit that captures images and
An infrared cut filter unit that reduces infrared rays incident on the imaging unit, and
A control unit that controls the infrared projection by the infrared projection unit and controls the insertion of the infrared cut filter unit.
An infrared projection state determination value acquisition unit that acquires a value used for determining the state of the infrared projection unit, and an infrared projection state determination value acquisition unit.
With
Based on the value acquired by the infrared projection state determination value acquisition unit, the control unit either makes the infrared projection unit non-infrared and does not insert the infrared cut filter unit. An imaging device characterized in that it is determined whether to insert the infrared cut filter unit while projecting infrared rays onto the infrared projection unit. It also has a user setting information acquisition unit that acquires user setting information by the user.
Based on the user setting information acquired by the user setting information acquisition unit, the control unit causes the infrared projection unit to project infrared rays regardless of the value acquired by the infrared projection state determination value acquisition unit. The imaging device according to claim 1, wherein the infrared cut filter unit is determined not to be inserted. The imaging device according to claim 1 or 2, wherein the value acquired by the infrared projection state determination value acquisition unit is temperature. Steps to acquire the infrared projection state judgment value and
Steps to get user setting information by the user,
An infrared cut filter that reduces infrared rays incident on the imaging unit based on the acquired infrared projection state determination value and user setting information while the infrared projection unit projects infrared rays while the imaging unit captures images. Whether the infrared cut filter unit is not inserted while the infrared ray is not projected into the infrared ray projecting unit, or the infrared ray cutting filter unit is inserted while the infrared ray is projected onto the infrared ray projecting unit. And the steps to decide
An imaging method comprising. Steps to acquire the infrared projection state judgment value and
Steps to get user setting information by the user,
An infrared cut filter that reduces infrared rays incident on the imaging unit based on the acquired infrared projection state determination value and user setting information while the infrared projection unit projects infrared rays while the imaging unit captures images. Whether the infrared cut filter unit is not inserted while the infrared ray is not projected into the infrared ray projecting unit, or the infrared ray cutting filter unit is inserted while the infrared ray is projected onto the infrared ray projecting unit. A program that lets the computer perform the steps to determine and.

Images