JP5404250B2 - Imaging system - Google Patents

Description

  The present invention relates to a lens device having a wiper, and an imaging system for photographing a subject via the lens device.

  2. Description of the Related Art Conventionally, a wiper device that removes water droplets and dust adhering to the glass on the front surface of an image pickup device using an in-vehicle camera or an outdoor camera pan head with a wiper is known. Among systems using these wiper devices, there is also known an example in which wiper control and imaging device control are linked. For example, Patent Document 1 discloses an example of an in-vehicle camera system that does not capture an image while the wiper is operating so as not to acquire a video with a sense of incongruity when the wiper enters the angle of view of the imaging device. Patent Document 2 discloses an example of an in-vehicle camera system that estimates an external weather condition from an operating environment of a wiper and adjusts an aperture or a shutter so that the amount of light is optimal for obtaining information necessary for the in-vehicle camera. It is disclosed.

JP-A-8-72641 JP-A-8-240833

  However, in the conventional technique disclosed in Patent Document 1 described above, an image acquired during the wiper operation is discontinuous, and thus an important image may not be captured. Further, in the prior art disclosed in the above-mentioned Patent Document 2, the wiper operation is a means for estimating the weather. The conditions are not met, and the acquired video is uncomfortable. Further, since the amount of light changes when the wiper blocks the angle of view of the image pickup apparatus, the acquired image is also uncomfortable.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an imaging system that makes it possible to acquire an image without a sense of incongruity even when a wiper is in operation.

In order to achieve the above object, an imaging system according to the present invention is arranged on a subject side of the lens device, a camera device having an imaging device, a lens device that includes an aperture and guides light from the subject to the imaging device. A wiper, and an adjustment function for reducing a change in brightness of a photographed image output from the image sensor, wherein the lens device has a zoom function, and the wiper has a zoom function according to a zoom position of the lens device. Whether or not to stop the adjustment function during operation is switched .

  The lens device of the present invention is a lens device that can be attached to a camera device having an image sensor and guides light from a subject to the image sensor, and includes a diaphragm, a wiper disposed on the subject side of the lens device, And an adjustment function for reducing a change in brightness of a captured image output from the image sensor, and a zoom function, and the wiper is operated during the operation of the wiper according to the zoom position of the lens device. It is characterized by switching whether or not to stop the adjustment function.

  A lens apparatus according to another aspect of the present invention is a lens apparatus that includes a lens, a diaphragm, and a wiper disposed on a subject side of the lens, and guides light from the subject to an image sensor, the image sensor An adjustment function for adjusting the aperture diameter of the diaphragm based on the amount of light incident on the aperture is provided, and the adjustment function is stopped when the wiper is operating.

  A lens apparatus according to a further aspect of the present invention is a lens apparatus that includes a lens, a diaphragm, and a wiper disposed on a subject side of the lens, and that guides light from the subject to an image sensor. It has an adjustment function for adjusting the aperture diameter of the diaphragm based on the amount of incident light, the lens device has a zoom function, and when the zoom position of the lens device is on the wide-angle side from a threshold value, The adjustment function is stopped during operation of the wiper, and when the zoom position of the lens device is on the telephoto side from the threshold value, adjustment is performed by the adjustment function even during operation of the wiper. And

  An imaging system according to a further aspect of the present invention includes a camera device having an imaging device, a lens device that includes a diaphragm and guides light from a subject to the imaging device, and a wiper disposed on the subject side of the lens device. An adjustment function for reducing a change in brightness of a captured image output from the image sensor, and a control function for controlling an aperture diameter of the diaphragm independently of the adjustment function, the control function being The aperture diameter of the diaphragm is widened according to the timing when the wiper blade of the wiper passes through the effective diameter of the lens device, and the adjustment function is stopped when the wiper is operating. Features.

  An imaging system according to a further aspect of the present invention includes a camera device having an imaging device, a lens device that includes a diaphragm and guides light from a subject to the imaging device, and a wiper disposed on the subject side of the lens device. An adjustment function for reducing a change in brightness of a captured image output from the image sensor; and a control function for controlling the aperture diameter of the diaphragm or the gain of the image sensor independently of the adjustment function; The control function increases the aperture diameter of the diaphragm according to the timing when the wiper blade of the wiper passes within the effective diameter of the lens device, or increases the gain of the imaging device. The lens device has a zoom function, and when the zoom position of the lens device is on the wide angle side from the threshold value, the adjustment function is stopped while the wiper is in operation, The zoom position of the lens device when the telephoto side than the threshold value, performs adjustment by the adjustment function even during operation of the wiper, characterized in that.

  ADVANTAGE OF THE INVENTION According to this invention, even if the wiper is in operation, the imaging system which made it possible to acquire a video without a sense of incongruity can be provided.

It is a block diagram of the reference example of the imaging system which has a wiper . It is an example of the acquisition image | video of the state which is not operating the wiper of a reference example . It is an example of the acquisition image | video while operating the wiper of a reference example . It is a flowchart of a reference example . 1 is a block diagram of Example 1. FIG. 6 is an example of an acquired video in a state where the wiper according to the first exemplary embodiment is not operated. It is an example of the acquisition image | video during operation | movement of the wiper of Example 1. FIG. 3 is a flowchart of the first embodiment. (A) is an example of a graph showing the timing when the wiper blade of Example 1 passes within the range of the effective aperture of the lens and the blocking area, and (b) is an example of a graph showing the aperture amount of Example 1. . 10 is a flowchart of Example 2 . (A) is an example of a graph showing the timing and area where the wiper blade of Example 2 passes within the effective aperture of the lens, and (b) is a change in aperture amount, camera gain, and shutter speed of Example 2. It is an example of the graph showing a timing.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a block diagram illustrating a general configuration of an imaging system having a wiper .

Hereinafter, with reference to the block diagram of FIG. 1, it will be described a reference example of configuration of an imaging system having a wiper.

A camera (camera device) 1 and a lens (lens device) 2 for acquiring an image are protected from rain or dust from the outside by a windshield 3. A wiper 4 is attached to the windshield 3 in order to remove adhering water droplets and dust and to ensure a photographing field of view. The wiper 4 is preferably in contact with the surface of the windshield 3 (the surface opposite to the lens 2) (may be non-contact while stopped), but when the windshield 3 is not present, the object side of the lens apparatus The lens 2 may be configured to be in contact with the surface (most object side surface). The wiper 4 is often used in an in-vehicle camera system (or a lens device used therefor), an outdoor camera pan head system (or a lens device used therefor), etc., and this reference example is also used in such a system (device). ) Is desirable.

  When the operator operates the wiper 4, a wiper operation command is transmitted to the CPU 6 by operating the wiper switch of the operation device 5. The CPU 6 controls the driving / stopping of the wiper motor 4 a via the wiper control unit 7 so that the wiper blade 4 b removes water droplets and dust from the windshield 3.

  Further, the CPU 6 controls the camera 1 via the camera control unit 8. The camera 1 is provided with an automatic iris adjustment (auto iris) function (automatic iris adjustment means, automatic iris adjustment mechanism) that adjusts the amount of light of an acquired image by automatically adjusting the iris of the lens. The CPU 6 can control the stop and operation of the automatic aperture adjustment function of the camera 1 via the camera control unit 8. Here, the automatic aperture adjustment function (automatic aperture adjustment means) reduces (suppresses) changes in the amount of light (brightness and brightness) of the acquired video (change in the brightness of the video output from the image sensor). And a function of adjusting (changing) the aperture diameter of the diaphragm. Therefore, when adjusting the brightness (light quantity) of a captured image (video output from the image sensor), the diaphragm in the lens device may be adjusted, or the gain of the image sensor may be adjusted.

  Here, if the wiper 4 is operated while the camera 1 is shooting an image of the subject as shown in FIG. 2, the image to be taken is an image including the wiper blade 4b as shown in FIG. Become. At this time, if the automatic aperture adjustment function of the camera 1 is in an activated state, the amount of light of the image is reduced by the wiper blade 4b blocking a part of the angle of view of the photographed image. The lens 2 is operated in the direction to open the aperture. For this reason, an appropriate amount of light is exceeded in an area other than the wiper blade, and the image becomes white. In addition, since it takes time to adjust the light amount to an appropriate amount, the image becomes brighter than the appropriate brightness for a while even after the wiper has deviated from the angle of view of the acquired image. Here, the brightness (light quantity) of the captured image is the result (light quantity obtained) of detecting the light incident on the image sensor. However, the present invention is not limited to this, and the image is taken in the lens 2 and the camera 1. The detection result of the light amount sensor provided separately from the element may be used.

Hereinafter, the processing flow of the CPU 6 in the reference example of the automatic aperture adjustment of the camera 1 during the operation of the wiper will be described with reference to the flowchart of FIG.

  When the CPU 6 receives a wiper operation command from the operation device 5 (S11), it confirms whether or not the automatic aperture adjustment function of the camera 1 is in an operating state (S12). If the automatic aperture adjustment function of the camera 1 is in the stopped state, only the wiper operation is performed as usual without controlling the camera 1 (S17). If the automatic aperture adjustment function of the camera 1 is in the activated state, the automatic aperture adjustment function of the camera 1 is first stopped (S13). Thereafter, the wiper operation is started (S14), and after the wiper operation is completed (S15), the automatic iris adjustment function is returned to the operating state (S16).

  As described above, during the operation of the wiper, the automatic aperture adjustment function of the camera 1 is stopped, so that the unnecessary operation by the automatic aperture adjustment function due to the change in the amount of light caused by the wiper blocking the angle of view of the acquired video is performed. Can be prevented.

As a system derived from this reference example, the functions of the wiper control unit 7 and the camera control unit 8 may be performed by the CPU 6 together. Further, the lens 2 may recognize that the wiper 4 is in operation, and if it is in operation, the control command from the camera 1 may be ignored and the aperture amount may be fixed.

Hereinafter, the configuration according to the first embodiment of the imaging system of the present invention will be described with reference to FIG. 5, the same block elements as those in the reference example of FIG. In FIG. 5, a lens control unit 9 is added as compared with FIG.

The CPU 6 controls the wiper 4 via the wiper control unit 7 in response to a command from the operating device. Further, the CPU 6 can adjust the aperture amount when the automatic aperture adjustment is stopped, in addition to the automatic aperture adjustment function operation / stop switching control, via the camera control unit 8. Further, the CPU 6 can acquire the zoom control of the lens (lens device having a zoom function) 2 and the current zoom position information via the lens control unit 9. Here, the imaging system of the first embodiment may not have the automatic aperture adjustment function itself.

Here, the way the wiper blade 4 b is reflected in the image when the wiper 4 is operated differs depending on the zoom position of the lens 2. For example, when the zoom position of the lens 2 is on the wide angle side with respect to a certain threshold value, as described in the above reference example , when the wiper 4 is operated in a state where an image as shown in FIG. 2 is acquired. As shown in FIG. 3, the wiper blade 4b is clearly reflected in the image. On the other hand, when the wiper 4 is operated in a state where the zoom position of the lens 2 is set to the telephoto side with respect to a certain threshold as shown in FIG. 6, the image acquired as shown in FIG. 7 becomes dark overall. . This is because the area of the wiper blade 4b is smaller than the effective diameter of the lens 2 and thus an image can be acquired, but the amount of light is reduced. Here, the threshold value is a focal length at which the lens 2 is located, a position of a zooming group (a group that moves when zooming is not shown) included in the lens 2, or an operation of an operation unit (not shown) that performs a zooming operation. This is a history or a value obtained by calculation using these.

A processing flow of the CPU 6 according to the first embodiment of the present invention will be described with reference to a flowchart of FIG.

Similar to the reference example , when the CPU 6 receives a wiper operation command from the operation device 5 (S31), the CPU 6 checks whether the automatic aperture adjustment function of the camera 1 is in an activated state (S32), and the automatic aperture adjustment function is in an activated state. If it is, stop (S33). Further, the zoom position information of the lens 2 is acquired from the lens control unit 9 (S34), and is compared with a preset threshold value (S35). Here, if the current zoom position is on the wide-angle side from the threshold value, the wiper is operated without adjusting (changing or controlling) the aperture amount (aperture diameter, aperture blade operation amount) (S40). . On the other hand, if the zoom position is on the telephoto side from the threshold value, the aperture amount with respect to the time from the start of the wiper operation is calculated (S36). In the calculation of the aperture amount, first, as shown in FIG. 9A, the timing when the wiper blade passes through the range of the effective aperture of the lens (within the effective diameter) with respect to the time from the start of the wiper operation and the area to be blocked Is calculated in advance. This area is determined from the position of the wiper blade estimated from the wiper blade structure such as the shape and attachment position of the wiper blade and the driving speed of the wiper motor. From this area, the amount of change in the amount of light is calculated, and the amount of aperture is calculated. The aperture amount is the same as the amount of change in the amount of light, and the amount of change in the amount of light due to changes in the amount of aperture depending on the current lens zoom position, current aperture amount, and lens model. To reduce (change in brightness). Thereafter, the operation of the wiper is started (S37), and as shown in FIG. 9B, the aperture is opened (expanded) or closed in accordance with the timing when the wiper blade passes through the range of the effective aperture of the lens and the blocking area. Adjustment is made so that the brightness of the acquired video is constant by operating in the (squeezing) direction (S38). When the wiper is operated while adjusting and the wiper operation is completed (S39), it is confirmed whether the automatic iris adjustment function is changed from the operating state to the stopped state (S41). The state is returned (S42). Here, the adjustment (control) of the brightness of the image performed by opening (expanding) the aperture in step S38 is independent of the adjustment performed based on the output of the image sensor as in the automatic aperture adjustment function. (Control). This adjustment function (control function) is a function mainly possessed by the CPU 6, but is not limited to this, and other CPUs in the imaging system, the lens 2, the camera 1, etc. are separated from the CPU 6. It may be performed by the arranged CPU.

  As described above, by adjusting the aperture amount of the lens during the wiper operation according to the zoom position, it is possible to prevent the acquired image during the wiper operation from being an uncomfortable image due to a change in the amount of light.

  As a method derived from the present embodiment, when the wiper is reciprocated or operated a plurality of times, the processing from S36 to S39 is repeated. Further, instead of estimating the position of the wiper blade from the driving speed, a position may be detected by mounting a potentiometer or an encoder.

The second embodiment of the present invention will be described below.

The configuration of the apparatus is the same as that of the first embodiment shown in FIG. 5, and the camera 1 controls at least one of the camera gain and the shutter speed from the camera control unit 8 in addition to the operations described in the first embodiment. It shall be possible.

  Here, when the zoom position of the lens 2 is on the telephoto side, there is a limit to the diameter of the front lens, and therefore a sufficient amount of light may not be obtained even if the aperture is opened due to a phenomenon generally called F drop. is there. In this case, even if the aperture is opened to the maximum during the wiper operation, a sufficient amount of light cannot be obtained, and the image acquired from the camera 1 becomes a dark image only during the wiper operation.

The processing flow of the CPU 6 in the second embodiment of the present invention will be described based on the flowchart of FIG. FIG. 10 describes changes in the processing from S36 to S39 in the flowchart of FIG. 8, and other processing is the same as that of the first embodiment.

  If the zoom position of the lens is on the telephoto side from the threshold, the aperture amount with respect to the time from the start of the wiper operation is calculated (S50). It is determined whether or not the light quantity of the image can be kept constant by adjusting only the aperture amount (S51). If the light quantity to be photographed can be kept constant by the adjustment by the diaphragm, the process proceeds to S54. If the amount of light of the image to be shot cannot be kept constant by the adjustment with the aperture, the process proceeds to S52, and as shown in FIG. 11B, the gain of the camera is increased or the shutter is released when the adjustment with the aperture reaches a certain level or more. It is determined to reduce the speed (S52). By recalculating the aperture amount accordingly (S53), the aperture amount, camera gain, and shutter speed are determined so that the brightness of the image is constant, and the process proceeds to S54. In S54, the operation of the wiper is started, the aperture amount is adjusted while the wiper is operated, and switching is performed when it is necessary to switch the camera gain and the shutter speed (S55).

  As described above, when the wiper is operating, the brightness of the video to be shot is kept constant by switching the camera gain and shutter speed as well as adjusting the aperture, even when adjusting the aperture is not sufficient. Can be.

As a method derived from the present embodiment, the adjustment may be performed by giving priority to the camera gain and the shutter speed instead of giving priority to the aperture amount as described above. In addition, the priority operation may be changed according to the setting and the shooting environment. In addition, if priority is given to the image quality of the video, only the aperture amount is adjusted, and if priority is given to keeping the brightness constant, the gain and shutter speed should also be changed. The processing described in the first embodiment and the processing described in the second embodiment may be selectable. The change of the camera gain and the shutter speed is not limited to once, and may be changed a plurality of times as necessary.

As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.
In the first or second embodiment, the camera 1, the lens 2, and the wiper control unit 7 are electrically connected via the CPU 6 and described as an example of the photographing system capable of transmitting and receiving signals. It is not limited to this configuration. For example, even in an imaging system composed of a lens device and a camera device, the effect of the present invention can be achieved by controlling the aperture, shutter speed, and camera gain so that the brightness of the image is constant during the operation of the wiper. Can be obtained. Furthermore, a lens device that receives light from a subject via a wiper can also be controlled by controlling the aperture so that the brightness of the image is kept constant (the change in brightness is reduced) during operation of the wiper. Note that the effect can be obtained. In these cases, the presence / absence of the operation of the wiper device can be determined by a signal from the wiper device which is an external device, image processing of the captured image, input by the user (input by the operation unit), and the like.

1 Camera 2 Lens 3 Windshield 4 Wiper 4a Wiper Motor 4b Wiper Blade 5 Controller 6 CPU
7 Wiper control unit 8 Camera control unit

Claims (10)

A camera device having an image sensor;
A lens device that includes an aperture and guides light from the subject to the imaging device;
A wiper disposed on the subject side of the lens device;
In an imaging system comprising:
It has an adjustment function to reduce the change in brightness of the captured image output from the image sensor,
The lens device has a zoom function,
Switching whether or not to stop the adjustment function during operation of the wiper according to the zoom position of the lens device ;
An imaging system characterized by that. During pre Symbol lens device wide-angle side than the zoom position is the threshold value of, during operation of the wiper stops the adjustment function,
When the zoom position of the lens device is on the telephoto side from the threshold value, the adjustment by the adjustment function is performed even when the wiper is in operation.
The imaging system according to claim 1 .   The imaging system according to claim 1, wherein the adjustment function includes at least one of a function of adjusting an aperture diameter of the diaphragm and a function of adjusting a gain of the imaging element.   A lens device that can be attached to a camera device having an image sensor and guides light from a subject to the image sensor,
  An aperture and a wiper disposed on the subject side of the lens device;
  Furthermore, an adjustment function for reducing a change in brightness of a captured image output from the image sensor, and a zoom function,
  Depending on the zoom position of the lens device, whether to stop the adjustment function while the wiper is operating is switched.
A lens device.   When the zoom position of the lens device is on the wide angle side from the threshold value, the adjustment function is stopped while the wiper is operating,
When the zoom position of the lens device is on the telephoto side from the threshold value, the adjustment by the adjustment function is performed even when the wiper is in operation.
The lens apparatus according to claim 4. A lens device that includes a lens, a diaphragm, and a wiper disposed on a subject side of the lens, and guides light from the subject to an image sensor;
Based on the amount of light incident on the image sensor, it has an adjustment function to adjust the aperture diameter of the diaphragm,
When the wiper is operating, the adjustment function is stopped.
A lens device. A lens device that includes a lens, a diaphragm, and a wiper disposed on a subject side of the lens, and guides light from the subject to an image sensor;
Based on the amount of light incident on the image sensor, it has an adjustment function to adjust the aperture diameter of the diaphragm,
The lens device has a zoom function,
When the zoom position of the lens device is on the wide angle side from the threshold value, the adjustment function is stopped while the wiper is operating,
When the zoom position of the lens device is on the telephoto side from the threshold value, the adjustment by the adjustment function is performed even when the wiper is in operation.
A lens device. Independent of the adjustment function, a control function for controlling the aperture diameter of the diaphragm,
The lens apparatus according to claim 6, wherein the control function widens an aperture diameter of the diaphragm according to a timing at which a wiper blade of the wiper passes within an effective diameter of the lens.   A camera device having an image sensor;
  A lens device that includes an aperture and guides light from the subject to the imaging device;
  A wiper disposed on the subject side of the lens device;
In an imaging system comprising:
  An adjustment function for reducing a change in brightness of a captured image output from the image sensor; and a control function for controlling an aperture diameter of the diaphragm independently of the adjustment function;
  The control function widens the aperture diameter of the diaphragm according to the timing when the wiper blade of the wiper passes within the effective diameter of the lens device,
When the wiper is operating, the adjustment function is stopped.
An imaging system characterized by that.   A camera device having an image sensor;
  A lens device that includes an aperture and guides light from the subject to the imaging device;
  A wiper disposed on the subject side of the lens device;
In an imaging system comprising:
  An adjustment function that reduces a change in brightness of a captured image output from the image sensor; and a control function that controls an aperture diameter of the diaphragm or a gain of the image sensor independently of the adjustment function. An imaging system,
  The control function widens the aperture diameter of the diaphragm or increases the gain of the image sensor according to the timing when the wiper blade of the wiper passes within the effective diameter of the lens device,
  The lens device has a zoom function,
  When the zoom position of the lens device is on the wide angle side from the threshold value, the adjustment function is stopped while the wiper is operating, and when the zoom position of the lens device is on the telephoto side from the threshold value, the wiper is stopped. Even during operation, the adjustment by the adjustment function is performed.
An imaging system characterized by that.

Images