JP2016178523A - Imaging apparatus, imaging method, program, vehicle control system, and vehicle - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent degradation in object recognition performance with a simple configuration under such a state that flickers occur.SOLUTION: The present invention comprises: two CMOS sensors for imaging a predetermined region; a distance calculation part 60 for calculating a distance to an object on the basis of image data imaged by the CMOS sensor; a flicker detection part 70 for detecting flickers from the two image data; and a timing control part 80 for controlling to correct imaging timing of the CMOS sensor when a shift occurs in luminance unevenness in a predetermined direction by flickers between flickers detected from image data imaged by the two CMOS sensors.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an imaging device, an imaging method, a program, a vehicle control system, and a vehicle.

  Conventionally, an object recognition technique for recognizing an object such as a vehicle or a pedestrian in front of a driver using an imaging device such as a stereo camera mounted in the vehicle and calculating a distance (distance information) to the object is known. It has been.

  A collision accident or the like can be prevented by performing a warning to the driver or brake control of the vehicle based on the recognition result and distance information by the object recognition technology. Therefore, in the object recognition technology, it is necessary to avoid outputting an erroneous recognition result or distance information that may lead to an erroneous warning to the driver or unnecessary brake control.

  One of the image sensors used in such a stereo camera is a rolling shutter type CMOS (Complementary Metal-Oxide Semiconductor) sensor. This rolling shutter type CMOS sensor performs line-by-line exposure. Further, for example, illumination such as a non-inverter fluorescent lamp or a discharge lamp such as a mercury lamp repeatedly flickers according to the light source frequency. When the exposure time of the CMOS sensor as described above is not adapted to a light source frequency such as a fluorescent lamp, an image captured under illumination such as a fluorescent lamp has a horizontal interval at a vertical interval corresponding to this blinking cycle. Black stripes appear in the direction. Further, when the light source frequency is not synchronized with the frame rate, the flickering position on the frame follows the frame, and thus flickers appearing such that dark horizontal stripes move vertically.

  In a stereo camera including two image capturing units, when the occurrence of flicker in the two captured images captured by the respective image capturing units is shifted, the comparison matching performance of the two captured images decreases, and the stereo camera The object recognition performance as a camera is degraded. In view of this, there has been disclosed a technique for detecting the presence or absence of flicker in a captured image and generating an image obtained by removing flicker components from the captured image based on the detected flicker frequency information (see, for example, Patent Document 1).

  However, in the technique disclosed in Patent Document 1 described above, a frequency conversion block such as a Fourier transform is required, and the circuit is implemented by a logic circuit such as a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC). There is a problem that a large circuit scale is required.

  The present invention has been made in view of the above, and has an imaging device, an imaging method, a program, a vehicle control system, and a simple configuration that prevent deterioration of object recognition performance even in a state where flicker occurs. The purpose is to obtain a vehicle.

  In order to solve the above-described problems and achieve the object, the present invention calculates a distance to an object based on two imaging units that image a predetermined area and image data captured by the two imaging units. A difference in luminance change state in a predetermined direction due to the flicker is generated between the distance calculation unit for detecting the flicker, the flicker detecting unit for detecting flicker from the two image data, and the flicker detected from the two image data. A timing control unit that corrects and controls the imaging timing of the imaging unit.

  According to the present invention, it is possible to prevent a decrease in object recognition performance with a simple configuration even in a state where flicker occurs.

FIG. 1 is a diagram illustrating an automobile equipped with a stereo camera according to an embodiment. FIG. 2 is a schematic view of a stereo camera. FIG. 3 is a hardware configuration diagram of the stereo camera according to the embodiment. FIG. 4 is a diagram illustrating a functional configuration of the stereo camera according to the embodiment. FIG. 5 is a diagram illustrating a state in which an object to be measured is imaged by the left and right camera units. FIG. 6 is a diagram illustrating an example of image data in which flicker occurs. FIG. 7 is a flowchart illustrating a flow of imaging timing correction control processing in the stereo camera according to the embodiment. FIG. 8 is a diagram illustrating an automobile equipped with a vehicle control system including the stereo camera according to the embodiment.

  Hereinafter, embodiments of an imaging device, an imaging method, a program, a vehicle control system, and a vehicle will be described in detail with reference to the accompanying drawings. In the following embodiment, an example in which a stereo camera provided with a CMOS sensor (imaging device) is applied to an imaging device and attached to a vehicle such as an automobile is shown.

  The CMOS sensor (imaging device) is an XY address type sensor, and reads image data with a rolling shutter. A case where a subject is imaged under illumination of a light source such as a fluorescent lamp that is directly lit by a commercial AC power source and blinks at a predetermined frequency using such an image sensor will be described. If the exposure time of the image sensor is remarkably shorter than the light emission period when imaging, luminance unevenness in the vertical direction occurs in each frame of image data. Further, when the imaging frame rate and the light emission period of the light source are different, the state of luminance unevenness in the vertical direction changes, and luminance flicker (so-called fluorescent lamp flicker) occurs in the time direction. This is because a rolling shutter cannot expose all pixels at the same timing, unlike a global shutter, against a periodically flickering light source.

  For example, when a stereo camera such as that described above is mounted on a vehicle and captured, fluorescent light flickers in the image data captured while traveling or parked due to light from a fluorescent light leaking from a store such as a shopping street or a gas station. May occur.

  In addition, even when a subject is imaged under illumination by a sodium lamp used not only in a fluorescent lamp but also in an outdoor lamp or a tunnel, flicker may occur in the captured image data. Specifically, for example, when a vehicle equipped with a stereo camera is imaged under illumination in the tunnel while traveling in the tunnel, flicker may occur in the captured image data. Further, for example, when the vehicle is imaged under an outdoor light while traveling near a road light at night, flicker may occur in the captured image data. In addition, the outdoor lamp etc. in which the sodium lamp is utilized are also lit by a commercial AC power source.

  In such a state, when performing recognition processing of the same object by block matching using image data captured by a stereo camera including two cameras, a deviation occurs in the flicker occurrence state in the two captured images. If there is, there is a possibility that the performance of the object recognition process is lowered.

  Therefore, in the stereo camera according to the present embodiment, when flicker is detected from the image data captured by the two cameras, the state of the flicker detected in each image data is analyzed, and the two based on the flicker state are analyzed. By controlling the imaging timing of the two cameras, adverse effects due to flicker during object recognition processing are reduced.

  First, the overall configuration of the present embodiment will be described. FIG. 1 is a diagram illustrating an automobile equipped with a stereo camera according to an embodiment. The automobile equipped with the stereo camera according to the present embodiment is an example of a vehicle. FIG. 1A is a schematic diagram illustrating a side surface of an automobile, and FIG. 1B is a schematic diagram illustrating a front surface of the automobile. FIG. 2 is a schematic view of a stereo camera.

  As shown in FIGS. 1A and 1B, a stereo camera 100 according to the present embodiment includes a camera unit 1 and a camera unit 2. And the camera part 1 and the camera part 2 are installed so that the scene ahead of the advancing direction of a motor vehicle can be imaged. As shown in FIG. 2, the stereo camera 100 includes a main body unit 3 and a pair of cylindrical camera units 1 and 2 provided for the main body unit 3.

  FIG. 3 is a hardware configuration diagram of the stereo camera according to the embodiment. As shown in FIG. 3, the stereo camera 100 according to the embodiment includes a central processing unit (CPU) 102, a read only memory (ROM) 103, a random access memory (RAM) 104, camera units 1 and 2, and a communication I. / F (interface) 106 is provided, and is connected via a bus line 108.

  The CPU 102 performs overall control of the stereo camera 100. The ROM 103 stores programs and various data used in processing executed under the control of the CPU 102. The RAM 104 temporarily stores data and the like used for processing executed under the control of the CPU 102. The communication I / F 106 exchanges various data with an external device or the like.

  The camera units 1 and 2 are images of a subject and are examples of an imaging unit. In the present embodiment, the subject indicates a predetermined area such as an object to be measured or outside the vehicle. As shown in FIG. 3, the camera unit 1 has a lens 11 and a CMOS sensor 12, and the camera unit 2 has a lens 21 and a CMOS sensor 22.

  The lenses 11 and 21 are examples of optical elements that form an optical image of a subject on the CMOS sensors 12 and 22.

  The CMOS sensors 12 and 22 are an example of an image sensor that photoelectrically converts an imaged optical image and outputs an electrical signal. Then, the output analog electric signal is converted into a digital electric signal to be image data. The camera units 1 and 2 including the lenses 11 and 21 and the CMOS sensors 12 and 22 respectively capture an object in front (predetermined area) of an automobile (vehicle) to which the stereo camera 100 is attached, for example. Generate image data.

  Further, in the stereo camera 100, since the left and right camera units 1 and 2 are arranged at a predetermined distance, the imaging positions on the left and right CMOS sensors 12 and 22 are different even if the same subject is imaged ( (See FIG. 5).

  FIG. 4 is a diagram illustrating a functional configuration of the stereo camera according to the embodiment. Stereo camera 100 includes image acquisition units 10 and 20, luminance image acquisition unit 30, parallax image calculation unit 40, object recognition processing unit 50, distance calculation unit 60, flicker detection unit 70, and timing control unit 80. And mainly.

  Each of the image acquisition units 10 and 20 captures a subject with one and the other of two cameras constituting a stereo camera, and acquires image data. The image acquisition units 10 and 20 are realized by, for example, the CMOS sensors 12 and 22 in FIG.

  The luminance image acquisition unit 30 acquires a luminance image from the image data acquired by the image acquisition units 10 and 20. The luminance image and a later-described parallax image are substantially synchronized in time, and the coordinates in the image correspond to each other.

  The parallax image calculation unit 40 calculates a parallax image from the image data acquired by the image acquisition units 10 and 20. The parallax image calculation unit 40 extracts blocks corresponding to the same object from the left and right image data obtained by capturing the same object (subject) by pattern matching between the block-divided images, and obtains a parallax image from the matched blocks. ing. Further, the parallax image calculation unit 40 calculates the parallax d (see FIG. 5) based on the amount of pixel shift at the image forming position in the image acquisition units 10 and 20 with respect to the same object to be measured.

  The object recognition processing unit 50 recognizes an object such as a vehicle from the two luminance images acquired by the luminance image acquisition unit 30. As an object recognition method, a dictionary of block images for pattern recognition of a vehicle or the like is created and stored in advance, and recognition processing is performed by matching with a stored block image.

  The distance calculation unit 60 calculates the distance to the object (subject) that is the measurement target based on the recognition processing result (recognition result) by the object recognition processing unit 50 and the parallax d calculated by the parallax image calculation unit 40. .

  Here, a method of calculating the distance to the object will be described with reference to FIG. FIG. 5 is a diagram illustrating a state in which the measurement target object O is being imaged by the left and right camera units. As shown in FIG. 5, the camera unit 1 includes a lens 11 and a CMOS sensor 12, and the camera unit 2 includes a lens 21 and a CMOS sensor 22.

  “F” shown in FIG. 5 is the focal length of the camera units 1 and 2. “B” is the distance between the camera unit 1 and the camera unit 2 (the distance between the center of the lens 11 and the center of the lens 21). “Z” is the distance between the camera units 1 and 2 and the object O, and is the distance between the viewpoint and the measurement target (object).

  The camera units 1 and 2 image the same object O from physically different positions. For this reason, when the image G1 captured by the camera unit 1 and the image G2 captured by the camera unit 2 are compared, a pixel shift occurs between the images G1 and G2. The amount of pixel shift between the images G1 and G2 is parallax “d”.

When each distance is defined as described in FIG. 5, the following ratio is established.
Z: B = Z + f: B + d (ratio)

Then, from the above ratio, the following equation is derived.
Z = Bf / d (formula)
The distance calculation unit 60 can calculate the distance (Z) to the object by the above formula. That is, the distance calculation unit 60 can calculate the distance to the object based on the distance between the camera unit 1 and the camera unit 2, the focal lengths of the camera units 1 and 2, and the parallax.

  Returning to FIG. 4, when the flicker detection unit 70 acquires two image data captured by the CMOS sensors 12 and 22 of the camera units 1 and 2, the flicker detection unit 70 detects flicker from the two image data. A known method can be used to detect flicker, and is described in, for example, Japanese Patent Application Laid-Open No. 2012-10306.

  Here, details of the flicker will be described. As described above, when the same subject (object) is imaged by the two CMOS sensors 12 and 22 under illumination such as a fluorescent lamp, flicker may occur in the two output image data. In addition, the two CMOS sensors 12 and 22 are controlled so as to capture images at the same timing, but are not always captured at the same timing. In such a case, the CMOS sensors 12 and 22 output two image data in which flickers having different luminance unevenness in the vertical direction are generated.

  FIG. 6 is a diagram illustrating an example of image data in which flicker occurs. FIG. 6A shows image data captured by the CMOS sensor 12 of the camera unit 1. FIG. 6B shows image data captured by the CMOS sensor 22 of the camera unit 2.

  In the image data of FIGS. 6A and 6B, the luminance unevenness in the vertical direction, which is flicker, occurs, and the position changes in the vertical direction with time. Specifically, luminance unevenness 12a to 12d occurs in FIG. 6A, and luminance unevenness 22a to 22d occurs in FIG. 6B.

  And when the imaging start timing of the CMOS sensors 12 and 22 of the camera units 1 and 2 is shifted, as shown in FIGS. 6A and 6B, the vertical directions of the luminance unevenness 12a to 12d and the luminance unevenness 22a to 22d Deviation occurs at the position of. That is, in the stereo camera 100, as long as the photographing timings of the CMOS sensors 12 and 22 of the camera units 1 and 2 are not at the same time, even if the same subject is imaged, as shown in FIGS. In some cases, an image with a deviation in luminance unevenness is captured.

  Returning to FIG. 4, the timing control unit 80 causes a deviation in luminance unevenness in the vertical direction (predetermined direction) due to flicker between the flickers detected from the two image data captured by the CMOS sensors 12 and 22. In this case, the imaging timing of the camera unit 2 is corrected and controlled. Luminance unevenness is an example of a change state of luminance.

  Judgment as to whether or not there is a deviation in the luminance unevenness in the vertical direction due to flicker in the two image data is performed as follows. First, the timing control unit 80 calculates an average value of luminance for each horizontal line (a line intersecting a predetermined direction) for each of the two image data, and stores them all in the storage unit 90 realized by the RAM 104. To do. The average luminance value is stored for the number of lines.

  Next, the timing control unit 80 calculates a difference value of the average luminance value for each line of the two image data from the average luminance value for the number of lines. There are combinations of this difference value for the number of lines.

  Then, the timing control unit 80 determines whether or not the peak value that is the difference value having the largest difference among the calculated difference values for the number of lines is equal to or greater than a predetermined threshold value. When the peak value is less than the threshold, the timing control unit 80 determines that there is no deviation in luminance unevenness because the deviation in luminance unevenness can be overlooked, and determines (fixes) the imaging timing.

  On the other hand, when the peak value is equal to or greater than the threshold value, the timing control unit 80 determines that the luminance unevenness has shifted, and corrects and controls the imaging timing of the CMOS sensor 22 of the camera unit 2 based on the timing control signal. Here, the timing control unit 80 corrects and controls the imaging timing for the CMOS sensor 22 of the camera unit 2 among the camera units 1 and 2, but corrects the imaging timing for the CMOS sensor 12 of the camera unit 1. It is good also as composition to do. In addition, the timing control unit 80 corrects and controls the imaging timing of the CMOS sensor 22 of the camera unit 2 by the correction amount for one line period.

  The timing control unit 80 corrects and controls the imaging timing of the CMOS sensor 22 of the camera unit 2, and then flicker is detected again from the two image data by the flicker detection unit 70, resulting in deviation in luminance unevenness between the two image data. If it is, the imaging timing of the CMOS sensor 22 of the camera unit 2 is corrected and controlled again.

  As a specific example, it is assumed that the size of each image output from the CMOS sensors 12 and 22 is VGA (640 × 480). The timing control unit 80 calculates an average value of luminance for each of 480 lines in each image data, and stores the average value of 480 luminances in the storage unit 90. Next, the timing control unit 80 calculates a difference value between the stored average values of 480 luminances.

  Then, the timing control unit 80 determines whether or not the peak value having the largest difference among the 480 difference values is equal to or greater than a predetermined threshold value. When the peak value increases and becomes equal to or greater than the threshold value, it is determined that there is a shift in vertical luminance unevenness due to flicker of image data captured by the CMOS sensors 12 and 22. On the other hand, when the peak value becomes smaller and less than the threshold value, the deviation of luminance unevenness in the vertical direction due to flicker is overlooked, and it is determined that no deviation occurs.

  If the peak value is equal to or greater than the threshold value, and it is determined that there is a deviation in vertical luminance unevenness due to flicker, the timing control unit 80 determines the imaging timing of the CMOS sensor 22 by one line period based on the timing control signal. Delay. The timing controller 80 then performs the same process again after delaying the imaging timing by one line period. Note that the timing control unit 80 may perform correction control to advance the imaging timing by one line period.

  When this process is repeated and the timing control unit 80 determines that there is no deviation in the luminance unevenness in the vertical direction due to flicker, the imaging timing is fixed (fixed) and operates with the set value until the power is turned off. to continue.

  Next, imaging timing correction control processing in the stereo camera 100 according to the present embodiment will be described. FIG. 7 is a flowchart illustrating a flow of imaging timing correction control processing in the stereo camera according to the embodiment. FIG. 7 illustrates a case where the size of each image output from the CMOS sensors 12 and 22 is VGA (640 × 480), as in the above example.

  First, when the flicker detection unit 70 acquires one frame of image data from the CMOS sensors 12 and 22 (step S100), the flicker detection unit 70 determines whether or not flicker is detected from the two image data (step S102). If no flicker is detected (step S102: No), the process returns to step S100 and the process is repeated.

  On the other hand, when flicker is detected (step S102: Yes), the timing control unit 80 calculates an average value of luminance for each line for the image data output from the CMOS sensor 12, and stores the average value in the storage unit 90. (Step S104a). Then, the timing control unit 80 stores the average value of luminance for 480 lines in the storage unit 90 (step S106a).

  Similarly, the timing control unit 80 calculates an average value of luminance for each line for the image data output from the CMOS sensor 22, and stores the average value in the storage unit 90 (step S104b). Then, the timing control unit 80 stores the average luminance value for 480 lines in the storage unit 90 (step S106b).

  Next, the timing control unit 80 calculates a difference value for each line from the average value of 480 luminances (step S108). Then, the timing control unit 80 determines whether or not the peak value of the 480 difference values is equal to or greater than a predetermined threshold (step S110).

  When the peak value of the difference value is less than the threshold value (step S110: No), the imaging timing of the CMOS sensor 22 is fixed (fixed) (step S112). On the other hand, when the peak value of the difference value is equal to or greater than the threshold value (step S110: Yes), correction control is performed to delay the imaging timing of the CMOS sensor 22 by one line period based on the timing control signal (step S114). Return to and repeat the process.

  As described above, in the stereo camera 100 according to the present embodiment, the flicker is detected from the two image data captured by the CMOS sensors 12 and 22 of the camera units 1 and 2, and the flicker detected from the two image data, respectively. In the meantime, when it is determined that there is a deviation in the luminance unevenness in the vertical direction due to flicker, the imaging timing of the camera unit 2 is corrected and controlled. As a result, the flicker generation states output from the two CMOS sensors 12 and 22 constituting the stereo camera 100 can be brought as close as possible, and the object recognition performance can be prevented from being lowered with a simple configuration.

  Next, the vehicle control system 200 including the stereo camera 100 of the above-described embodiment will be described. FIG. 8 is a diagram illustrating an automobile equipped with a vehicle control system including the stereo camera according to the embodiment. An automobile is an example of a vehicle as described above. FIG. 8A is a side view of an automobile equipped with the vehicle control system, and FIG. 8B is a front view of the automobile equipped with the vehicle control system.

  As shown in FIGS. 8A and 8B, the automobile 300 includes a vehicle control system 200. The vehicle control system 200 includes a stereo camera 100 installed in a passenger compartment that is a living room space, a control device 6, a steering wheel 7, and a brake pedal 8.

  As described above, the stereo camera 100 includes the camera unit 1 and the camera unit 2, and the camera unit 1 and the camera unit 2 are installed so as to capture a scene in front of the traveling direction of the automobile. . For example, the stereo camera 100 is installed in the vicinity of the rearview mirror inside the front window of the automobile 300 as shown in FIG.

  The control device 6 executes various vehicle controls based on the distance from the stereo camera 100 to the subject obtained based on the parallax image data received from the stereo camera 100. As an example of vehicle control, the control device 6 executes steering control for avoiding an obstacle by controlling a steering system (control target) including the steering wheel 7 based on image data of a parallax image received from the stereo camera 100. To do. Further, as an example of vehicle control, the control device 6 controls the brake pedal 8 (control target) based on the image data of the parallax image received from the stereo camera 100 to perform brake control or the like for decelerating and stopping the automobile 300. Run.

  As in the vehicle control system 200 including the stereo camera 100 and the control device 6 described above, vehicle control such as steering control or brake control is executed, so that the driving safety of the automobile 300 can be improved.

  Note that, as described above, the stereo camera 100 captures an image of the front of the automobile 300, but is not limited thereto. That is, the stereo camera 100 may be installed so as to capture the rear or side of the automobile 300. In this case, the stereo camera 100 can detect the position of a succeeding vehicle behind the automobile 100 or another vehicle that translates laterally. And the control apparatus 6 can detect the danger at the time of the lane change of the motor vehicle 300, or at the time of lane merge, etc., and can perform the above-mentioned vehicle control. Further, when the control device 6 determines that there is a risk of collision based on the parallax image of the obstacle behind the vehicle 300 detected by the stereo camera 100 in the back operation when the vehicle 300 is parked or the like, The vehicle control described above can be executed.

  Note that the program executed by the stereo camera of the present embodiment is provided by being incorporated in advance in a ROM or the like. The program executed by the stereo camera of the present embodiment is a file in an installable format or an executable format, and is a computer such as a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk). You may comprise so that it may record and provide on a readable recording medium.

  Furthermore, the program executed by the stereo camera of the present embodiment may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The program executed by the stereo camera of the present embodiment may be provided or distributed via a network such as the Internet.

  The program executed by the stereo camera of the present embodiment includes a module configuration including the above-described units (luminance image acquisition unit, parallax image calculation unit, object recognition processing unit, distance calculation unit, flicker detection unit, timing control unit). As actual hardware, a CPU (processor) reads out and executes a program executed by the stereo camera from the ROM, and the respective units are loaded onto the main storage device. The above-described units are the main storage device. It is supposed to be generated above. In addition, for example, some or all of the functions of the above-described units may be realized by a dedicated hardware circuit.

DESCRIPTION OF SYMBOLS 1, 2 Camera part 3 Main body part 6 Control apparatus 7 Steering wheel 8 Brake pedal 11, 21 Lens 12, 22 CMOS sensor 30 Luminance image acquisition part 40 Parallax image calculation part 50 Object recognition process part 60 Distance calculation part 70 Flicker detection part 80 Timing control unit 90 storage unit 100 stereo camera 200 vehicle control system 300 automobile (vehicle)

JP 2013-51523 A

Claims (9)

Two imaging units for imaging a predetermined area;
A distance calculating unit that calculates a distance to an object based on image data captured by the two imaging units;
A flicker detection unit for detecting flicker from the image data;
A timing control unit that corrects and controls the imaging timing of the imaging unit when there is a shift in the luminance change state in a predetermined direction due to the flicker between the flickers detected from the image data captured by the two imaging units. An imaging device comprising:   The timing control unit calculates an average value of luminance for each line intersecting the predetermined direction for each of image data captured by the two imaging units, and calculates a difference value for each line of the calculated average value. When the difference value having the largest difference among the difference values for the calculated number of lines is equal to or greater than a predetermined threshold value, it is determined that a deviation occurs in the change state of the brightness, and the imaging unit The imaging apparatus according to claim 1, wherein the imaging timing is corrected and controlled.   The imaging apparatus according to claim 2, wherein the timing control unit corrects and controls imaging timing for any one of the two imaging units.   The imaging apparatus according to claim 3, wherein the timing control unit corrects and controls imaging timing of the imaging unit by a correction amount for one line period.   After the timing control unit corrects and controls the imaging timing of the imaging unit, flicker is detected again from the image data, and a shift occurs in the luminance change state of the image data captured by the two imaging units. The imaging apparatus according to claim 4, wherein when it is, the imaging timing of the imaging unit is corrected and controlled again. In an imaging method executed in an imaging device including two imaging units,
A distance calculating step for calculating a distance to the object based on the image data captured by the two imaging units;
A flicker detection step for detecting flicker from the two image data;
A timing control step of correcting and controlling the imaging timing of the imaging unit when there is a deviation in the luminance change state in a predetermined direction due to the flicker between the flickers respectively detected from the two image data . A distance calculating step for calculating the distance to the object based on the image data captured by the two imaging units;
A flicker detection step for detecting flicker from the two image data;
A timing control step of correcting and controlling the imaging timing of the imaging unit when there is a deviation in the luminance change state in a predetermined direction due to the flicker between the flickers detected from the two image data,
A program that causes a computer to execute. The imaging device according to any one of claims 1 to 5,
A vehicle control system comprising: a control device that controls a vehicle according to a distance from the imaging device calculated by the imaging device to the object.   A vehicle equipped with the vehicle control system according to claim 8.

Images