JP2013147114A - Surrounding environment acquisition device and suspension control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To quickly acquire a road surface state forward of a vehicle in a road surface state detection device.SOLUTION: A lot of time is required for performing processing on all imaging devices corresponding to a subject to be captured in an imaging region SR to form images. When a vehicle body is in a reference attitude, processing is performed on imaging devices belonging to a reference region R0. When the vehicle body is inclined forward, processing is performed on imaging devices belonging to braking regions Ru, Rua. When the vehicle body is inclined backward, processing is performed on imaging devices belonging to driving regions Rd, Rda. As a result, the time required for forming images can be shortened, and the road surface state can be quickly acquired as compared with a case where processing is always performed on all the imaging devices belonging to the imaging region SR.

Description

  The present invention relates to a surrounding environment acquisition device that acquires an environment around a vehicle based on an image captured and formed by an imaging device.

In the road surface state detection device described in Patent Document 1, a lattice-shaped laser beam is irradiated by an irradiation body, and a lattice-shaped pattern is imaged by a camera. Then, the captured image is processed, and the road surface unevenness state is detected based on the distortion of the grid.
However, Patent Document 1 does not describe that the imaging region and the processing region are determined based on the state of the vehicle.

JP 2008-217267 A

  An object of the present invention is to improve a surrounding environment acquisition device, for example, to quickly detect an environment around a vehicle.

Means and effects for solving the problem

In the surrounding environment acquisition device according to the present invention, at least one of the imaging region and the processing region of the imaging device is determined based on the state of the vehicle.
For example, in the case where the imaging device is a CCD camera, when an object to be imaged determined by the imaging area is imaged, the image is formed on a large number of imaging elements (CCDs) via a lens to form an optical image. Is done. Then, photoelectric conversion is performed in each of a large number of imaging elements, and the converted electrical signal is read and processed, thereby forming an image corresponding to the object to be imaged. The object to be imaged is composed of a large number of pixels corresponding to a large number of image sensors.
However, it takes a long time if processing is performed for all of a large number of image sensors corresponding to the object to be imaged.
On the other hand, depending on the state of the vehicle, there may be a case where it is preferable that at least one of the regions is wide or a narrow region may be obtained in order to acquire the surrounding environment. Even if the imaging region or the processing region is small, there may be a case where the surrounding environment can be favorably acquired by moving at least one of the regions.
Therefore, if at least one area can be enlarged or reduced or moved based on the state of the vehicle, the time required to acquire the environment can be obtained as much as possible while acquiring the surrounding environment satisfactorily. Can be shortened.
The surrounding environment includes the presence / absence of an object in at least a part of the front, side, and rear of the vehicle, the shape of the object, the road surface condition, and the like.
In addition, the surrounding environment acquisition device (a) acquires the presence / absence of an object ahead of the host vehicle, the relative speed between the host vehicle and the preceding vehicle, and the like, and controls the driving state (acceleration, deceleration) of the vehicle. Devices (follow-up control devices, anti-collision devices), (b) preview control that acquires the condition of the road surface ahead of the host vehicle and controls the suspension of the controlled wheel, (c) objects behind the host vehicle, road surface A parking assist device that assists the driver's parking operation, (d) an approach notification device that acquires the presence or absence of an object around the corner of the host vehicle, the shape of the object, etc., and notifies the driver Can be applied to.

Patentable invention

In the following, the invention recognized as being able to be claimed in the present application will be described.
(1) A periphery that is attached to a vehicle body and includes an imaging device that images an object to be imaged determined by an imaging region and forms an image, and acquires an environment around the vehicle based on the formed image An environment acquisition device,
The imaging apparatus includes an image forming unit that performs processing on an imaging element corresponding to the imaging target object and belongs to a processing region to form an image,
The surrounding environment acquisition apparatus includes an area determination unit that determines at least one of the imaging area and the processing area based on a state of the vehicle.
The state of the vehicle can be represented by the running state of the vehicle, the posture of the vehicle, the operation state of the device mounted on the vehicle, the operation state of the operation member, the state of the road surface, etc. . The traveling state of the vehicle may be determined based on the operating state of the device mounted on the vehicle, the operating state of the operation member, or may be determined based on the state of the road surface on which the vehicle travels. Further, the posture of the vehicle is often determined by the state of the vehicle.
When at least one of the imaging region and the processing region is determined, and (a) when processing is performed for all of the imaging elements belonging to the determined imaging region, (b) of the determined imaging regions When processing is performed for an image sensor belonging to the determined processing area, (c) processing may be performed for an image sensor belonging to the determined processing area among predetermined imaging areas.
The area determination unit may be provided inside the imaging apparatus or outside the imaging apparatus. When provided outside, information representing the region determined by the region determination unit is supplied to the imaging device, and the imaging device performs imaging or processing in the determined region. When the area determination unit is included in the imaging apparatus, information indicating the state of the vehicle is supplied to the imaging apparatus, and the area is determined.
(2) The surrounding environment acquisition device according to (1), wherein the region determination unit includes an image processing region determination unit that determines a processing region of the image forming unit based on a state of the vehicle.
The imaging device may or may not be able to change the imaging area, and in any case, the processing for the imaging elements belonging to the processing area determined by the image processing area determination unit is performed. Done.
(3) The imaging device cannot change its imaging region, and the image forming unit has an imaging element belonging to a processing region determined by the image processing region determination unit of the imaging region. The surrounding environment acquisition device according to item (2), including a partial processing unit that performs processing.
If the imaging area cannot be changed, the process is performed based on the processing area determined by the image processing area determination unit.
(4) The imaging device includes an imaging region changing unit capable of changing an imaging region thereof, and the surrounding environment acquisition device controls the imaging region changing unit, whereby the imaging region is determined by the region determining unit. The surrounding environment acquisition apparatus according to any one of (1) to (3), including an imaging area control unit that controls the determined area.
The change of the imaging region corresponds to at least one of a change of the angle of view and a change of the direction of the lens.
(5) An area obtained by moving the at least one area based on the state of the vehicle, the area determining section moving at least one area previously determined while keeping the area the same. (B) means for determining an area obtained by enlargement or reduction, and (c) means for determining an area obtained by changing the shape. The surrounding environment acquisition device according to any one of items 4).
One or more of moving, expanding / reducing, changing shape (for example, changing a rectangular area to a trapezoidal area), etc. while maintaining the area In combination, at least one region is determined. Hereinafter, at least one of movement, enlargement, reduction, and shape change of an area is referred to as an area change.
Further, at least one of the previously determined areas is a current area, and may be a reference area described later.
(6) The region determination unit includes a reference state time region determination unit that determines the at least one region as a reference region when the vehicle is in a reference state that is in a predetermined setting range. The surrounding environment acquisition device according to any one of items 1) to (5).
The reference state of the vehicle can be, for example, a state in which the vehicle is traveling substantially straight on a substantially flat road surface at a substantially constant speed. That is, the absolute value of the tilt angle in the front-rear direction of the vehicle body is equal to or less than the set pitch angle (the absolute value of acceleration in the front-rear direction is equal to or less than G before and after setting), and the absolute value of the lateral tilt angle is equal to or less than the set roll angle ( The absolute value of the lateral acceleration can be set to a state equal to or less than the set lateral G). The set longitudinal G can be a value determined based on the longitudinal acceleration and deceleration generated by driving and braking performed during normal traveling, and the set lateral G is a value determined based on the lateral acceleration generated by normal turning. can do.
The reference area is desired even if the vertical line of the lens of the imaging device changes in the front-rear direction and the left-right direction due to, for example, a change in the posture of the vehicle body within the range of the reference state of the vehicle, a change in the unevenness of the road surface, etc. That is, it is possible to obtain an area where the surrounding environment can be obtained.
(7) Area determination at the time of front / rear inclination in which the area determination unit determines the at least one area when the inclination angle in the front / rear direction of the vehicle body is equal to or larger than a set angle as an area in which the reference area is changed in the front / rear direction. The surrounding environment acquisition device according to item (6) including a section.
The imaging device is mounted on the front portion of the vehicle in a posture capable of imaging the front of the vehicle, and the environment in front of the vehicle is acquired by the surrounding environment acquisition device. When the vehicle body is tilted in the front-rear direction, the position where the vertical line of the lens of the imaging device hits the front object to be imaged is shifted in the front-rear direction from the position when the vehicle is in the reference state. Therefore, even if the posture is changed by changing the imaging region in the front-rear direction, or changing the processing region in a direction corresponding to the front-rear direction of the imaging region (hereinafter sometimes referred to as the front-rear direction), The surrounding environment can be detected well.
At least one of the regions may be a region obtained by changing the reference region to one of the front and the rear, or a region obtained by changing both the front and the rear. The front and rear are respectively a direction far from the vehicle and a direction close to the vehicle.
(8) The surrounding environment acquisition apparatus according to (7), wherein the forward / backward tilt area determination unit includes means for making the forward change amount Δsu of the reference area smaller than the backward change amount Δsd.
By the perspective method, on the far side (front side) from the vehicle and the side close to the vehicle (rear side), the object to be imaged looks smaller on the far side than on the near side. Therefore, if the amount of change to the far side is made smaller than the amount of change to the near side, the difference between the change amount to the far side and the change amount to the near side of the object to be imaged can be reduced.
(9) A turning time region determining unit that determines the at least one region when the value representing the turning state of the vehicle is greater than or equal to a set value as a region in which the reference region is changed in the left-right direction. The surrounding environment acquisition device according to any one of (6) to (8).
When the imaging device is mounted in the front part of the vehicle in a posture capable of imaging the front of the vehicle, the environment in front of the vehicle is acquired by the surrounding environment acquisition device. Centrifugal force acts during turning, and the vehicle body is inclined to the outside of the turning. As a result, the position where the vertical line of the lens of the image capturing apparatus hits the object to be imaged is shifted laterally (left and right) from the position in the reference state. Therefore, if at least one of the areas is an area obtained by changing the reference area in the horizontal direction, the surrounding environment can be obtained satisfactorily.
(10) The imaging device is provided at a position of the vehicle body corresponding to the left front wheel and the right front wheel of the vehicle, and the reference regions of the two imaging devices have widths in the left-right direction, The surrounding environment acquisition device according to any one of (6) to (9), wherein the area corresponds to a width of the left front wheel and the right front wheel.
If the reference area is narrowed, the image processing time in the reference state of the vehicle can be shortened, and the surrounding environment can be acquired quickly. For example, when the surrounding environment acquired by the surrounding environment acquisition apparatus is used for preview control, the road surface state of the tire width may be acquired.
(11) The surrounding environment acquisition device includes an irradiation device that irradiates a marker, and the reference region for the imaging region is within the imaging region during a predetermined set time during travel of the vehicle. The surrounding environment acquisition device according to any one of items (6) to (10), wherein a ratio in which the marker is positioned is a minimum region in which the setting ratio is set.
(12) The surrounding environment acquisition device includes an irradiation device that irradiates a marker, and the reference region for the processing region is formed by the image forming unit during a predetermined set time during traveling of the vehicle. The surrounding environment acquisition device according to any one of items (6) to (11), wherein a ratio in which the image representing the marker is included in the set image is a minimum region in which the setting ratio is set.
In the surrounding environment acquisition device, the surrounding environment is acquired based on the position, shape, and the like of the marker image in the image corresponding to the object to be imaged. Therefore, the reference area of the imaging area is determined so that the ratio of the marker located in the imaging area becomes the setting ratio, and the processing area so that the ratio of the marker image included in the formed image becomes the setting ratio. It is desirable that the reference region of
The marker may have a spot shape, a lattice shape, or a plurality of parallel lines.
The setting ratio can be a value between 0.6 and 0.9. Desirably, it can be a value between 0.7 and 0.85, and more desirably, it can be a value between 0.75 and 0.8.
(13) The surrounding environment acquisition device according to any one of (1) to (12), wherein the surrounding environment acquisition device includes an attitude detection device that acquires the state of the vehicle based on an attitude of the vehicle body. apparatus.
(14) The surroundings according to any one of (1) to (13), wherein the surrounding environment acquisition device includes a traveling state detection device that acquires the state of the vehicle based on the traveling state of the vehicle. Environment acquisition device.
(15) The surrounding environment acquisition device detects the state of the vehicle based on at least one of an operation state of a driving operation member provided in the vehicle and an operation state of an in-vehicle device provided in the vehicle. The surrounding environment acquisition device according to any one of items (1) to (14), including an operation / operation state detection device.
For example, when the accelerator opening is greater than or equal to a set opening as the accelerator operating member is operated, a driving force greater than a set value is applied to the vehicle (driving wheel) by the driving device, and the longitudinal acceleration is set to It is considered to be in a larger state. Moreover, it exists in the attitude | position inclined in the front-back direction (backward inclination attitude | position), and the inclination angle is larger than a setting pitch angle.
When the operation stroke of the brake operation member is equal to or greater than the set stroke, the braking force greater than the set value is applied to the vehicle by the braking device, and the deceleration is greater than before and after the set G (the absolute value of the negative acceleration is set). It is thought that it is larger than front and rear G). Moreover, it is in a forward tilting posture, and the tilt angle is larger than the set pitch angle.
When the absolute value of the operation angle of the steering operation member is larger than the set steering angle, centrifugal force acts on the vehicle, and the lateral acceleration becomes larger than the set lateral G. Moreover, it exists in the attitude | position inclined in the horizontal direction, and the inclination angle is larger than a setting roll angle.
The longitudinal acceleration can be detected by a longitudinal G sensor. In addition, the inclination angle in the front-rear direction can be acquired based on a pitch rate sensor, or can be acquired based on front-side and rear-wheel sprung displacements.
Further, the fact that the vehicle is in a turning state can also be acquired based on the detection value of the yaw rate sensor and the detection value of the front wheel steering angle sensor, and the inclination angle in the horizontal direction can be acquired based on the detection value of the roll rate sensor. You can also.
(16) The surrounding environment acquisition device includes a road surface state acquisition unit that acquires the state of the vehicle based on a state of a road surface on which the vehicle exists. The ambient environment acquisition device described.
Whether the road surface on which the vehicle is traveling is a bad road or a good road can be acquired via the navigation device. Since the change in the posture of the vehicle body is larger when the road is rough than when the road is good, at least one area can be widened.
(17) including the surrounding environment acquisition device according to any one of (1) to (16), and based on the surrounding environment acquired by the surrounding environment acquisition device, A suspension control device for controlling a suspension,
The surrounding environment acquisition device is a road surface state detection device that detects a state of a road surface in front of the vehicle,
The suspension control device includes a preview control unit that controls the suspension of the wheel to be controlled located behind the portion of the road surface where the state is detected based on the road surface state detected by the road surface state detection device. A suspension control apparatus characterized by the above.
When the suspension of the rear controlled wheel is controlled based on the road surface state acquired by the surrounding environment acquisition device, it is highly necessary to quickly and accurately acquire the road surface state. On the other hand, if at least one of the imaging region and the processing region is determined based on the state of the vehicle, the road surface state can be acquired quickly and accurately, which is suitable for preview control. .
(18) The surrounding environment acquisition device according to any one of (1) to (16) is included, and the traveling state of the vehicle is determined based on the surrounding environment acquired by the surrounding environment acquisition device. A running state control device for controlling,
The travel state control device, wherein the region determination unit includes a control dependence determination unit that determines the at least one region based on control of the travel state control device.
Driving state control includes forward vehicle following control, emergency brake assist control, parking assist control, anti-collision control, suspension control, etc., and the environment is acquired for the necessary area based on the purpose of each control. .
(19) An image processing apparatus that forms an image by performing processing on an image sensor corresponding to an object to be imaged imaged through a lens and belonging to a processing region,
An image processing apparatus comprising: a processing region determining unit that determines the processing region based on an orientation of the lens.
The present invention can be widely applied to image processing apparatuses. If the orientation of the lens relative to the object to be imaged changes, a desired image may not be obtained. However, if the processing area is determined accordingly, the desired image can be acquired quickly. .
In the image processing apparatus described in this section, it is possible to employ the characteristics relating to the determination of the image processing area among the technical characteristics described in the sections (1) to (18).
(20) An imaging apparatus control apparatus that controls an imaging apparatus that images an object to be imaged determined by an imaging area and forms an image,
The imaging apparatus includes an image forming unit that performs processing on an imaging element corresponding to the imaging target object and belongs to a processing region to form an image,
The imaging apparatus control apparatus includes an area determination unit that determines at least one of the imaging area and the processing area based on a state of the vehicle.
The imaging device control apparatus described in this section can employ the characteristics relating to the determination of the image processing area among the technical characteristics described in the sections (1) to (19).

1 is a diagram conceptually illustrating an entire vehicle on which a suspension control device according to a first embodiment is mounted. FIG. The suspension control device includes a road surface state detection device as a surrounding environment acquisition device. (a) It is a top view of the said vehicle. (b) It is a figure which shows notionally the said suspension control apparatus. It is a side view of the said vehicle, and is a figure for demonstrating the irradiation apparatus contained in the said road surface state detection apparatus, the attachment position of an imaging device, and an attachment angle. (a) It is a figure which shows an appropriate attachment state. (b) It is a figure which shows an improper attachment state. It is a figure which shows the relationship between the wavelength of the light contained in sunlight, and energy. (a) It is a figure which shows the state of the sunlight which reaches the earth. (b) It is a map showing the gain determination table which is the relationship between the latitude in which a vehicle exists, and the gain of the said irradiation apparatus. (a) It is a figure which shows notionally the structure of the said irradiation apparatus. (b) It is a flowchart showing the irradiation apparatus control program memorize | stored in the memory | storage part of suspension ECU of the said suspension control apparatus. (c) It is a flowchart showing the laser beam output program memorize | stored in the memory | storage part of the marker output control part of the said irradiation apparatus. It is a figure for demonstrating the detection principle of the road surface state in the said road surface state detection apparatus. (a) It is a figure which shows the optical axis of the irradiation apparatus in case the attitude | position of a vehicle is in a reference | standard attitude | position, and the vertical axis | shaft of a camera. (b) It is a figure which shows the position of the marker seen from a camera when a laser beam hits the point P, and the position of the marker image in the formed image. (c) It is a figure which shows the position of the marker seen from a camera when a laser beam hits the point P1, and the position of the marker image in the formed image. (d) It is a figure which shows the position of the marker seen from a camera when a laser beam hits the point P2, and the position of the marker image in the formed image. (a) A map representing a WD determination table representing the relationship between WD (working distance) and the diameter of the marker image, and (b) a map representing a ratio determining table representing the relationship between WD and ratio k. In the above road surface state detection device, for explaining the detection principle of the road surface state when the mounting height from the road surface of the irradiation device, the camera, and the mounting angle change due to the displacement of the upper part of the spring and the inclination in the front-rear direction. FIG. (a) It is a flowchart showing the road surface state detection program memorize | stored in the memory | storage part of the said suspension ECU. (b) It is a flowchart showing the image formation program memorize | stored in the memory | storage part of the image formation part of the said camera. It is a flowchart showing the preview control program memorize | stored in the memory | storage part of the said suspension ECU. (a) It is a figure which shows notionally the structure of the said camera. (b) It is a figure which shows the imaging area by the said camera. (c) It is a figure which shows the magnitude | size of the image corresponding to the to-be-photographed target object decided by the said imaging area. It is a figure which shows the (a) imaging region in case a vehicle exists in a reference attitude. (b) It is a figure which shows a process area | region. (a) It is a figure which shows the position of the marker when a vehicle exists in the attitude | position inclined in the front-back direction. (b) It is a figure which shows the process area | region in the case of a forward leaning attitude | position. (c) It is a figure which shows the process area | region in the case of being in a back leaning posture. (a) It is a figure which shows the position of the marker when the vehicle is turning. (b) It is a figure which shows the process area | region at the time of right turn. (c) It is a figure which shows the process area | region at the time of left turn. It is a flowchart showing a part (processing area determination) of the said road surface state detection program. (a) It is the figure which showed the state from which the area of a marker image changes, when the irradiation apparatus of the said road surface state detection apparatus and the lens of a camera become dirty. (b) It is a figure which shows the normal range of an area. It is a figure which shows the distortion of the shape of the marker image produced when the lens of the said irradiation apparatus or a camera becomes dirty. It is a figure which shows the state from which the value relevant to a color changes, when the lens of the said irradiation apparatus or a camera becomes dirty. It is a flowchart showing the dirt detection program memorize | stored in the memory | storage part of the said suspension ECU. (a) It is a figure which shows the content of the determinant used for detecting the structure of the sprung displacement acquisition part contained in the suspension control apparatus based on Example 2, and a sprung displacement. (b) It is a figure which shows the structure of the observer used in order to acquire a sprung displacement. It is a figure which shows the spot shape of the laser beam irradiated from the irradiation apparatus contained in the suspension control apparatus which concerns on Example 3. FIG. (a) It is a flowchart showing the irradiation apparatus control program memorize | stored in the memory | storage part of suspension ECU of the suspension control apparatus which concerns on Example 4. FIG. (b) A map showing another gain determination table stored in the storage unit of the suspension ECU. It is a flowchart showing a part of road surface condition detection program memorize | stored in the memory | storage part of suspension ECU of the suspension control apparatus which concerns on Example 5 (processing area determination). FIG. 10 is a diagram illustrating a structure of an imaging device included in a suspension control device according to a sixth embodiment. (a) It is a flowchart showing the road surface state detection program memorize | stored in the memory | storage part of suspension ECU of the said suspension control apparatus. (b) It is a flowchart showing the image formation program memorize | stored in the memory | storage part of the image formation part of the said imaging device. It is a flowchart showing a part of the said road surface state detection program (imaging area determination). It is a figure which shows the imaging region when the said road surface state detection program is performed. (a) It is a figure which shows the imaging area at the time of braking. (b) It is a figure which shows the imaging area at the time of a drive. (c) It is a figure which shows the imaging area at the time of right turn. (d) It is a figure which shows the imaging region at the time of left turn.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, a suspension control apparatus according to an embodiment of the present invention will be described in detail with reference to the drawings. The suspension control device includes a surrounding environment acquisition device that is an embodiment of the present invention.
The suspension control device performs preview control on the suspension of the front and rear wheels of the vehicle based on the road surface state detected by the road surface state detection device, and the road surface state detection device detects the road surface state ahead of the front wheels of the vehicle. Is done.
In the road surface state detection device, a marker is irradiated, and a road surface including the marker is imaged to form an image. Then, the state of the road surface is detected based on the formed image. The marker may be spot-shaped light, lattice-shaped light, or the like.

  The road surface condition detection apparatus according to the first embodiment includes road surface image acquisition units 11L and R provided corresponding to the left and right front wheels 10FL and FR of the vehicle, respectively, as shown in FIG. The road surface image acquisition units 11L, R detect the state of the road surface in front of the front wheels 10FL, FR of the vehicle, and have the same structure. As shown in FIG. 1, the road surface image acquisition units 11L and 11R respectively (i) Irradiation devices 12L and 12R that irradiate a marker (in FIG. 1, the irradiation device 12L is described, and the description of the irradiation device 12R is omitted). And (ii) cameras 14L and 14R as imaging devices that image at least the marker irradiated from the irradiation device 12L (12R) (the camera 14L is shown in FIG. 1, and the description of the camera 14R is omitted) Including. The irradiation devices 12L and 12R and the cameras 14L and 14R are attached to the front surface of the vehicle body 18 (for example, near the bumper) at positions separated from each other in the vertical direction.

As shown in FIG. 6A, the irradiation device 12 includes a light source 12p, an amplifier 12a, a lens 12r, a dirt removal device 12c, a marker output control unit 12e, and the like, and a circular (perfect circle) spot laser as a marker. Irradiate light. The diameter of the spot is larger than the first set value and smaller than the second set value.
The intensity of the laser beam output from the light source 12p is amplified with a gain determined by the amplifier 12a, and irradiated forward through the lens 12r. The dirt removing device 12c (cleaner) removes dirt from the lens 12r. The marker output control unit 12e mainly includes a computer and controls the light source 12p, the amplifier 12a, the dirt removing device 12c, and the like.

The camera 14 is a CCD (Charge Coupled Device) camera, and as shown in FIG. 12A, a lens 14r, a filter 14f, a CCD 14s as an image sensor, an image forming unit 14d, a dirt removing device 14c, and a color evaluation device. Including 14m. An object to be imaged such as a marker is imaged on the CCD 14s through the lens 14r to obtain an optical image. In each CCD 14s, the light signal is converted into an electrical signal and supplied to the image forming unit 14d. Hereinafter, in this specification, “CCD 14s” may represent each of the image sensors or may represent the entire number of image sensors. In the image forming unit 14d, processing is performed based on each electrical signal of the CCD 14s belonging to the processing area, and an image corresponding to at least a part determined by the processing area of the object to be imaged is formed. The filter 14f is a bandpass filter and allows at least the passage of the laser light emitted from the irradiation device 12. The dirt removing device 14c removes dirt from the lens 14r, and the color evaluation device 14m is a device that evaluates the color of the formed image, and changes the color of the image to RGB (red, green, blue). It has a function of obtaining each value by analyzing and obtaining each value of HSV (hue, saturation, brightness). The area (processing area) of the CCD 14s that is processed in the image forming unit 14d is determined by the suspension control device 20 as described later.
The camera 14 is capable of imaging an object to be imaged in the imaging area, but since the band filter 14f is provided, the imaged object to be imaged has a wavelength that is allowed to pass by the band filter 14f. Determined by the range. The range of wavelengths allowed to pass by the band-pass filter 14f is set to a range including the wavelength of the laser light irradiated by the irradiation device 12 as described above.
The camera 14 is attached in a posture in which the lens 14r faces the front of the vehicle, and images an object to be imaged (at least the marker M) in the imaging region SR surrounded by a broken line as shown in FIG. The captured image J corresponding to the imaging region SR is composed of (Na × Nb) (for example, 1.92 million) pixels as shown in FIG.
The camera 14 may be a camera using CMOS (Complementary Metal-Oxide Semiconductor).

As shown in FIG. 1, the suspension control device 20 includes suspensions 22FL and FR for left and right front wheels 10FL and FR (illustration of the suspension 22FR is omitted), suspensions 25RL and RR for left and right rear wheels 24RL and RR (illustration of a suspension 25RR). Is omitted).
The suspensions 22FL, FR, 25RL, and RR include springs 26FL, FR, RL, and RR, shock absorbers 27FL, FR, RL, and RR that are provided in parallel with each other between the unsprung portion and the unsprung portion. Includes force control devices 28FL, FR, RL, RR.
The vertical force control devices 28FL, FR, RL, RR can control the vertical force acting between the unsprung portion and the unsprung portion by controlling the elastic force of a stabilizer bar (not shown), for example. can do. The vertical force may be an elastic force proportional to the displacement or a damping force proportional to the displacement speed.
The actuator may be a damping force control device that controls the damping force acting between the unsprung portion and the unsprung portion by controlling the damping coefficient of the shock absorber 27.
Hereinafter, in the present specification, when it is necessary to clarify the corresponding wheel position for the vertical force control device, the suspension, etc., the subscripts FL, FR, RL, RR, the right side and the left side indicating the wheel position are indicated. In some cases, subscripts R and L are used, and when it is not necessary to clarify the wheel position, the subscripts may be given without subscripts.

The suspension control device 20 includes a computer and a suspension ECU 30 as a main body. The suspension ECU 30 is connected to a steering ECU 34, a brake ECU 36, an ECU 38 such as an engine, a navigation device 39, etc. via a CAN (Car Area Network) 32. A steering angle sensor 40 for detecting the steering angle of the steering wheel is connected to the steering ECU 34, and an operation stroke sensor 42 for detecting an operation stroke of a brake operation member (not shown) and the wheels 10FL, FR, 24RL are connected to the brake ECU 36. A wheel speed sensor 43 and the like for detecting the rotational speed of RR are connected, and an accelerator opening sensor 44 and the like for detecting the opening of an accelerator operation member (not shown) are connected to the ECU 38 and the like. In the brake ECU 36, the traveling speed V of the vehicle is obtained based on the rotational speeds of the front and rear wheels 10FL, FR, 24RL, and RR. The navigation device 39 includes a communication device (not shown), and acquires information on the current position, information on the weather, and the like.
The suspension ECU 30 receives information indicating the steering angle of the steering wheel, information indicating the operation stroke of the brake operation member, information indicating the vehicle speed, information indicating the opening of the accelerator operation member, and information regarding the position where the vehicle exists via the CAN 32. Etc. can be obtained.

The suspension ECU 30 is provided corresponding to each of the wheels 10FL, FR, 24RL, RR, and detects the acceleration in the vertical direction of the spring top and the distance between the spring bottom and the spring top. A vehicle height sensor 52 (also referred to as a stroke sensor) for detecting the vehicle height, a longitudinal G sensor 54 for detecting the longitudinal acceleration of the vehicle, a lateral G sensor 56 for detecting the lateral acceleration, and the like are connected. In addition, the vertical force control device 28, the irradiation device 12, the camera 14, the notification device 58 and the like are connected.
The notification device 58 notifies that when a system abnormality (for example, contamination of the irradiation device 12 or the camera 14) is detected. The notification device 58 may include a speech synthesis / output device that synthesizes and outputs speech, or may include a display that displays information.
The suspension control device 20 conceptually includes an irradiation device control unit 60, a road surface state detection unit 62, a sprung displacement acquisition unit 64, and a preview control unit 66 as shown in FIG. It can be considered to include the determination unit 68, the dirt detection unit 70, and the like.

<Installation of the road surface image acquisition unit 11>
The irradiation device 12 and the camera 14 are provided below the irradiation device 12 as shown in FIGS. Further, the irradiation device 12 and the camera 14 are each provided in a posture inclined with respect to the vehicle body (spring top) 18. That is, with respect to a line A (hereinafter referred to as a road surface normal) A perpendicular to the reference road surface, a laser beam irradiation direction (hereinafter simply referred to as an optical axis) B of the irradiation device 12 and a line perpendicular to the lens of the camera 14 (Hereinafter, abbreviated as the vertical line of the camera 14) C is attached in an inclined posture. When the angles formed by the road surface normal A, the optical axis B, and the vertical line C of the camera 14 are θb and θc, respectively, the inclination angles θb and θc are larger than 0 and 90 ° (π / 2). The values are smaller and different from each other.
0 <θb <90 °, 0 <θc <90 °
θb ≠ θc
If the optical axis B and the vertical axis C of the camera 14 are parallel, the imaging position of the marker irradiated by the irradiation device 12 (relative position of the marker M in the imaging region SR with respect to the reference point 0s). ) Is the same whether the road surface is flat or uneven (the marker M is positioned on the reference point 0s). In other words, the relative position corresponding to the reference point 0j of the image G representing the marker in the captured image J (hereinafter abbreviated as the marker image) is the same (the marker image G is located on the reference point 0j).
On the other hand, when the optical axis B and the vertical axis C of the camera 14 are not parallel, the relative position of the marker M with respect to the reference point 0s in the imaging region SR, that is, the captured image, based on the unevenness of the road surface. The relative position of the marker image G at J with respect to the reference point 0j changes. For this reason, it is possible to detect the unevenness of the road surface better than when the relative position does not change.
The reference road surface is a road surface that passes through the grounding point of the front wheel 10 and the grounding point of the rear wheel 24 and is assumed to be flat. The road surface normal A is a line perpendicular to the reference road surface.

Moreover, an example of the attachment height and the attachment angle of the vehicle body 18 of the irradiation apparatus 12 and the camera 14 is shown by the solid line in FIG. The mounting height is the height Zb, Zc from the reference road surface, and the mounting angle is the angle θb, θc formed by the road surface normal A, the optical axis B, and the vertical axis C of the camera 14.
In this case, as indicated by the two-dot chain line, even when the vehicle body 18 is inclined in the front-rear direction at the set angle θst, the road surface having a predetermined shape (for example, the shape of the road surface gradient θr) is used. It can be detected.
The road surface gradient θr can be, for example, the maximum gradient that can suppress the vibration of the vehicle body 18 by the suspension control device 20, or the maximum gradient of the road surface on which the vehicle travels. Further, the set angle θst of the tilt angle in the front-rear direction of the vehicle body 18 can be, for example, the maximum tilt angle that can occur during travel of the vehicle (when a large driving force is applied).
The tilt angle in the front-rear direction refers to the rotation angle around the axis that passes through the center of gravity of the vehicle and extends in the width direction, and the tilt angle in the lateral direction refers to the center of gravity of the vehicle in the front-rear direction. The rotation angle around the extending axis.

On the other hand, when the irradiation device 12 and the camera 14 are mounted in the state (mounting height, mounting angle) indicated by the solid line in FIG. 3B, the vehicle as shown by the two-dot chain line in FIG. Is inclined in the front-rear direction at the set angle θst, the road surface state with the gradient θr cannot be detected.
Therefore, in this embodiment, the irradiation device 12 and the camera 14 are attached to the vehicle body 18 in the relative positional relationship indicated by the solid line in FIG. 3A, and the camera 14 when the vehicle body 18 is inclined at the set angle θs. The angle (θxc−θst) formed between the vertical line C and the reference road surface is larger than the road surface gradient θr. In other words, the smaller the angle (θxc−θst) formed between the vertical line C of the camera 14 and the reference road surface and the angle (θxb−θst) formed between the optical axis B of the irradiation device 12 and the reference road surface, the road surface is smaller. It is attached in a state where it is larger than the gradient θr, so that the marker M is always irradiated on the road surface, and the road surface including the marker M is imaged.
The angles θxc and θxb are angles formed by the vertical line C and the optical axis B of the camera 14 and the reference road surface when the vehicle body 18 is in the reference posture, respectively. The reference posture refers to a posture within a predetermined range and a substantially horizontal posture. That is, it refers to an attitude in which the tilt angle in the front-rear direction is within the set range and the tilt angle in the horizontal direction is within the set range.

From the above circumstances, the irradiation device 12 and the imaging device 14 are configured such that the angle θxc formed between the vertical line C of the camera 14 and the reference road surface when the vehicle body 18 is in the reference posture, and the inclination angle (set angle) of the vehicle body 18 in the front-rear direction. In the case of θst and road surface gradient θr, the formula θxc−θst> θr
As a result, even if the vehicle body 18 is tilted in the front-rear direction at the set angle θst, it is possible to detect the road surface state with the gradient θr. .
Further, since the angle θxc is expressed by (π / 2−θc), the above equation is
π / 2> θc + θst + θr
It can be expressed as.

Note that it is not essential to attach the camera 14 below the irradiation device 12, and the camera 14 may be provided above the irradiation device 12. In that case, the condition is that the following expression is satisfied.
θxb−θst> θr
π / 2> θb + θst + θr

<Control of irradiation apparatus 12>
The wavelength of the laser beam irradiated by the irradiation device 12 can be one of the wavelengths near 750 nm, 900 nm, 1100 nm, 1400 nm, and 1800 nm.
FIG. 4 shows a spectrum (broken line) of sunlight outside the atmosphere and a spectrum (solid line) of sunlight on the ground surface when sunlight is incident on the ground surface at an inclination of 42 °. As shown in FIG. 4, sunlight includes light in a wide range of wavelengths such as infrared rays, visible light, and ultraviolet rays, but the above wavelengths (near 750 nm, 900 nm, 1100 nm, 1400 nm, 1800 nm). Light is easily absorbed in the atmosphere by carbon dioxide, water vapor, etc., and difficult to reach the earth's surface.
That is, in the light having the above-described wavelength, the energy reduction amount by passing through the atmosphere is greater than the set reduction amount. For this reason, the energy (one aspect representing the intensity of sunlight) on the ground surface of the light having the above wavelength is equal to or less than the set value.
Therefore, if the laser light emitted from the irradiation device 12 has a wavelength that is difficult to reach the above-described ground surface (for example, around 750 nm), the laser light emitted by the irradiation device 12 is less likely to be affected by sunlight. Therefore, the marker M can be distinguished from sunlight and can be imaged well.
In the case where laser light having a wavelength of 750 nm is emitted from the irradiation device 12, the bandpass filter 14f in the camera 14 is allowed to pass light in a wavelength range including 750 nm. . Thereby, even if the marker M is not visible light (even if it is infrared rays or ultraviolet rays), it becomes possible to image.

Further, the intensity of the laser light irradiated by the irradiation device 12 is determined based on the latitude on the earth where the vehicle exists.
As shown in Fig. 5 (a), the energy of sunlight that reaches the earth's surface is smaller when the distance of the passing atmosphere (the amount of the atmosphere that sunlight is in contact with, called air mass) is longer than when it is short. Become. Therefore, when the latitude is high, the energy of sunlight reaching the ground surface is smaller than when the latitude is low.
On the other hand, if the laser light emitted by the irradiation device 12 is weaker than sunlight, the camera 14 may not be able to capture the marker M separately from sunlight, so it is desirable to increase the intensity of the laser light. Increasing the intensity of this causes another problem that the amount of energy consumption increases. Moreover, when sunlight is weak, the necessity for increasing the intensity of laser light is low.
Therefore, as shown in FIG. 5B, when the latitude is high, the gain is made smaller than when the latitude is low, and the intensity of the irradiated laser light is reduced.
Thus, when the energy of sunlight is large (sunlight is strong), the gain is increased, and the intensity of the irradiated laser light is made larger than that of sunlight, so the S / N ratio (signal power with respect to disturbance power). , That is, the ratio of the intensity of the laser light to the intensity of sunlight), and the camera 14 can distinguish the sunlight from the sunlight and image it well.
Further, when the energy of sunlight is small (sunlight is weak), the gain is reduced to such an extent that the laser light can be detected separately from sunlight, so that the marker M can be imaged well and consumed. The amount of energy can be reduced. In the present embodiment, a gain determination table represented by the map of FIG. 5B is stored in advance in the storage unit of the suspension ECU 30.

An irradiation apparatus control program for controlling the irradiation apparatus 12 is represented by the flowchart of FIG. The irradiation device control program is executed at predetermined time intervals.
In step 1 (hereinafter abbreviated as S1. The same applies to other steps), the latitude at which the vehicle currently exists is acquired based on information from the navigation device 39. In S2, the gain is determined in accordance with the gain determination table shown in FIG. 5B, and in S3, information representing the determined gain is supplied to the irradiation device 12.
In the irradiation apparatus 12, the laser beam output program represented by the flowchart of FIG. 6C is executed at predetermined time intervals.
In S4, information representing the gain from the suspension ECU 30 is read. In S5, the laser light emitted from the laser light source 12p is amplified by the gain and output.

In the present embodiment, the irradiation device control unit 60 is configured by a portion that stores the irradiation device control program of the suspension ECU 30, a portion that executes the program, a portion that acquires information from the navigation device 39, and the like. In the irradiation device control unit 60, an output level determination unit is configured by a portion for storing S1 and S2 of the irradiation device control program, a portion for execution, and the like. The output level determining unit is also a latitude-based level determining unit and a strength-based level determining unit. In addition, a latitude detecting unit and an intensity detecting unit are configured by a part that acquires information from the navigation device 39 of the suspension ECU 30. Furthermore, the camera 14 corresponds to an irradiation light detection device.
The navigation device 39 can also be considered as a component of the irradiation device control unit 60, the latitude detection unit, and the intensity detection unit.

The control of the irradiation device 12 is not limited to the case where the laser beam is captured by the camera 14, but can also be applied to a road surface state detection device including a light receiving unit that receives the laser beam reflected on the road surface.
Further, the present invention is not limited to the road surface state detection device, and the laser beam irradiated to the irradiation object is imaged by the camera 14 or the laser beam reflected by the irradiation object is received to surround the irradiation device 12 (camera 14). The present invention can also be applied to a surrounding environment acquisition device that detects the shape of an object in the area.
Furthermore, the control of the irradiation device 12 can be widely applied when it is necessary to distinguish the light emitted from the irradiation device 12 from sunlight without being combined with the light receiving unit and the camera 14.
Moreover, in the said Example, although the irradiation apparatus 12 was controlled based on the instruction | command of suspension ECU30, it is not essential to do so. The laser light output control unit 12e can determine the gain and output the laser light amplified with the gain. In that case, information relating to the latitude is supplied to the laser light output controller 12e.
Furthermore, the wavelength of the laser light emitted from the irradiation device 12 can be infrared rays of 1500 nm or more. This is because the energy reaching the infrared surface of 1500 nm or more is small.

<Detection of road surface condition>
[Detection principle]
As shown in FIG. 7A, the angle θb formed by the road surface normal A and the optical axis B, the angle θc formed by the road surface normal A and the vertical axis C of the camera 14, the mounting height of the irradiation device 12 and the camera 14 The optical axis B intersects with the vertical axis C of the camera 14 at a point P (detection target portion) ahead of the irradiation device 12 by a distance Lp (hereinafter referred to as a preview distance) on the reference road surface. Designed to do.
Thus, in a state where the optical axis B and the vertical axis C of the camera 14 intersect at the point P on the reference road surface, the reference point 0s of the imaging region SR of the camera 14 is obtained as shown in FIG. A marker (spot light) M0 is located. That is, the marker image G0 is positioned at the reference point 0j of the captured image J formed by the camera 14, and the road surface height Zr of the detection target portion P (the height from the reference road surface to the detection target portion P is referred to below). , The same). The reference point 0s is a point through which the vertical line C of the camera 14 passes, and the reference point 0j is a point corresponding to the reference point 0s on the captured image J.

As shown in FIG. 7A, when there is a projection 80 indicated by a broken line, the laser light emitted from the irradiation device 12 hits the point P1 on the road surface, but the vertical line C of the camera 14 is light at the point P1. Do not intersect axis B. Therefore, as shown in FIG. 7C, in the imaging region SR, the marker M1 has deviated from the reference point 0s in the X + direction (a direction far from the vehicle with respect to the vertical line C of the camera 14 and further forward). Located at a point. That is, the marker image G1 is located at a point that is Δx1 away from the reference point 0j in the captured image J1 in the X + direction. The deviation Δx1 (expressed by the number of pixels) from the reference point 0j is proportional to the distance Δh1 between the vertical line C of the camera 14 and the point P1.
Further, the road surface height Zr1 of the point P1 can be obtained according to the equation (1) using the distance Δh1.
Zr1 = Δh1 · cos θb / sin (θc−θb) (1)
In the equation (1), since the proportionality constant {cos θb / sin (θc−θb)} is a constant value, it can be seen that the road surface height Zr1 is proportional to the distance Δh1. Further, it is desirable that the proportionality coefficient {cos θb / sin (θc−θb)} is larger. When the proportionality coefficient is large, the change in the road surface height Zr with respect to the change in Δh can be made larger than when the proportionality coefficient is small, and the change in the road surface height Zr can be obtained with high accuracy. As described above, the inclination angles θb and θc of the optical axis B and the vertical line C of the camera 14 with respect to the road surface normal A are set so that the proportionality coefficient becomes large.

As shown in FIG. 7 (a), if there is a concave portion 82 indicated by the alternate long and short dash line, the laser beam hits at a point P2 on the road surface. Therefore, as shown in FIG. It is located at a point deviated from the reference point 0s in the X-direction (closer to the vehicle with respect to the vertical line C of the camera 14 and further rearward). Further, the marker image G2 is located at a position shifted by Δx2 in the X-direction from the reference point 0j of the captured image J2. The road surface height Zr2 in this case can be obtained according to the following equation.
Zr2 = Δh2 · cos θb / sin (θc−θb)
In (1), it is obtained by substituting (Δh2) instead of Δh1, but Δh2 is a negative value (Δh2 <0), and the road surface height Zr2 of the recess is a negative value (Zr2 <0). .

[Consideration of working distance]
On the other hand, the relationship between the distance Δh between the detection target part P and the vertical line C of the camera 14 and the length Δx between the reference point 0j on the image J and the marker image G is as follows: It is determined by the distance to the detection target part P (see FIG. 7: referred to as working distance; hereinafter referred to as WD).
As shown in FIG. 8A, due to the characteristics of the lens 14r of the camera 14, the WD is short even if the size of the spot (marker) formed by irradiating the road surface with laser light is the same. Is larger than the marker image G on the image J (for example, it can be expressed by the diameter φ of the image G and can be referred to as a spot diameter) (WDa> WDb, φa <φb). As shown in FIG. 8B, the ratio k (= Δh / Δx) of the actual distance Δh to the length Δx on the image J is small (ka> kb). The ratio k can be considered as a ratio between each of the pixels constituting the image J and the actual size of the portion of the object to be imaged corresponding to the pixel.
The WD determination table represented by the map of FIG. 8A and the coefficient determination table represented by the map of FIG. 8B are created in advance and stored in the storage unit of the suspension ECU 30.

In this embodiment, the diameter φ of the marker image G in the image J is obtained. Then, the actual WD is obtained from the diameter φ and the WD determination table in FIG. 8A, and the ratio k is obtained from the WD and the ratio determination table in FIG. 8B. Then, the distance Δx between the reference point 0j on the image J and the marker image G is obtained, and the actual distance Δh is obtained by multiplying by the ratio k.
Thus, the actual WD is detected, the ratio k is obtained, and the distance Δh is obtained, so that the road surface height Zr can be accurately obtained.

Depending on the relative positional relationship between the irradiation device 12 and the camera 14, there may be a small change in WD. In this case, the value of the ratio k may be constant. On the other hand, when the change in WD is large, it is desirable to obtain the ratio k and obtain Δh based on the ratio k.
Further, when the irradiation device 12 or the like receives the laser beam reflected on the road surface and can detect the distance between the irradiation device 12 and the irradiation point P on the road surface, the value can be used. The WD need not be obtained based on the size of the marker image G.

[Consideration of the posture of the vehicle body 18]
[1] Road surface height Due to a change in the posture of the vehicle body 18 during traveling, the mounting heights Zb and Zc of the irradiation device 12 and the camera 14, the optical axis B, the vertical line C of the camera 14 and the road surface normal A The angles (mounting angles) θb and θc formed by the angle change. If the mounting height and the mounting angle change, the optical axis B and the vertical axis C of the camera 14 may not intersect on the reference road surface as shown in FIG.
For example, consider a case where the laser light emitted by the irradiation device 12 hits the point P on the road surface of the protrusion 84 represented by a broken line. The marker M is imaged by the camera 14, and the captured image J is formed. In the captured image J, the distance Δh is obtained based on the position of the marker image G, and the height Zr ′ of the point P from the reference road surface is obtained according to the equation (2).
Zr ′ = Δh · cos θb ₀ / sin (θc ₀ −θb ₀ ) + cos θc ₀ · cos θb ₀
× (Zc ₀ tanθc ₀ −Zb ₀ tanθb ₀ −Lc ₀ ) / sin (θc ₀ −θb ₀ ) (2)
Specifically, as shown in FIG. 9, the road surface height Zr ′ at the point P is the sum of the partial height Zr1 ′ and the partial height Zr2 ′ (= Zr1 ′ + Zr2 ′), and the partial height Zr1 ′. Can be determined according to the following equation:
Zr1 ′ = Δh · cos θb ₀ / sin (θc ₀ −θb ₀ )
The partial height Zr2 ′ is obtained according to the following equation using the distance Lx in the front-rear direction between the intersection of the reference road surface, the optical axis B, and the intersection of the vertical axis C of the camera 14.
Zr2 ′ = Lx / (tan θc ₀ −tan θb ₀ )
Further, as shown in FIG. 9, the distance Lx is expressed by the following equation using a distance ΔL between the irradiation device 12 and the camera 14 in the front-rear direction.
Lx = Zc ₀ tanθc ₀ −Zb ₀ tanθb ₀ −ΔL
Substituting this Lx into the above equation yields the following equation.
_{Zr2 '= (Zc 0 tanθc 0} -Zb 0 tanθb 0 -Lc 0) / (tanθc 0 -tanθb 0)
Further, (tanθc ₀ -tanθb _{0) is, {sin (θc 0 -θb 0} ) / cosθc 0 cosθb 0} because it is, substituting the above equation is represented by the second term Zr2 'is (2) I understand that
_{Zr2 '= cosθc 0 · cosθb 0} × (Zc 0 tanθc 0 -Zb 0 tanθb 0 -Lc 0)
/ Sin (θc ₀ −θb ₀ )
Also, the displacements ΔZu from the mounting heights Zb ₀ and Zc ₀ when the vehicle body 18 is in the reference posture (hereinafter referred to as reference mounting heights) Zb and Zc after the posture change.
ΔZu = Zb ₀ −Zb = Zc ₀ −Zc
Can be the displacement xu of the unsprung parts (vehicle body 18) of the left and right front wheels 10FL, FR, or the average value of the displacements of the four wheels 10FL, FR, 24RL, RR (ΔZu = xu).
Further, the mounting angles θb ₀ and θc ₀ , the change angles Δθ from the mounting angles (hereinafter referred to as reference mounting angles) θb and θc when the vehicle body 18 is in the reference posture.
Δθ = θb ₀ −θb≈θc ₀ −θc
Can be considered to be θs (Δθ = θs), which is the inclination angle of the vehicle body 18 in the front-rear direction {the inclination angle in the front-rear direction from the reference posture of the vehicle body and can be referred to as the pitch angle}.

For example, the pitch angle θs of the vehicle body is obtained on the basis of the displacement x _uf of the front-wheel-side sprung, the displacement x _ur of the rear-spring-side sprung, and the wheel base Lr. The mounting angles θb ₀ and θc ₀ with respect to the road surface normal A of the optical axis B after the posture change and the vertical line C of the camera 14 can be obtained.
θ = sin ⁻¹ {(x _uf −x _ur ) / Lr}
θb ₀ = θb + θs
θc ₀ = θc + θs
The displacement xu of the sprung portion can be obtained by integrating the detection value of the sprung vertical acceleration sensor 50 by the second order.
Note that the pitch angle θs can also be obtained based on a detected value provided with a pitch rate sensor.

Thus, the road surface height Zr of the detection target part P is an aspect of the road surface state. Further, based on a plurality of road surface heights Zr obtained at intervals from each other, the shape of the road surface unevenness and the gradient in the case of a slope (which is one aspect of the road surface state) can also be obtained.
Further, since the road surface state is acquired based on the actual posture of the vehicle body 18, it can be accurately acquired as compared with the case where the road surface state is acquired without being based on the actual posture.

[2] Preview distance The preview distance is a distance in the front-rear direction between the detection target part P on the road surface and the control target wheel (the front wheel 10 or the rear wheel 24) for preview control. The preview distance includes the first distance Lp, which is the distance in the front-rear direction between the detection target part P and the irradiation device 12 (or the camera 14), and the irradiation device 12 and the control target wheel (front wheel 10, rear wheel). It is the sum of the second distance (Lf, Lf + Lr), which is the distance in the front-rear direction between the wheel 24). Lf is the distance in the front-rear direction between the ground point of the front wheel 10 and the lens 12r of the irradiation device 12.
Here, as shown in FIG. 7, the first distance Lp is obtained according to the following expression when the vehicle is in the reference posture on the reference road surface.
Lp = Zb · tan θb = Zc · tan θc−ΔL
However, as shown in FIGS. 7 and 9, the first distance Lp varies depending on the unevenness of the road surface, the mounting positions of the irradiation device 12 and the imaging device 14, the mounting angle, etc. (Lp1, Lp2, Lp ′).
And the 1st distance Lp 'in FIG. 9 is calculated | required according to Formula (3).
Lp ′ = Zb ₀ · tan θb ₀ −Zr ′ · tan θb ₀ (3)
The value obtained by the equation (2) is substituted into the road surface height Zr ′.
From the equation (3), it can be seen that the first distance Lp is acquired based on the actual posture of the vehicle body and the road surface height of the detection target portion P.
If the second distance (Lf, Lf + Lr) is a constant value and the first distance Lp is acquired, as shown in FIG. 1, the preview distance { (Lp + Lf), (Lp + Lf + Lr)} is acquired.
The first distance Lp and the preview distance are obtained for the left wheels 10FL and 24RL and the right wheels 10FR and 24RR, respectively.
Further, the second distance (Lf, Lf + Lr) can be a predetermined constant value, or can be a value determined based on the inclination angle θs of the vehicle body 18 in the front-rear direction.

<Preview control>
When the preview distance is obtained, times Tf and Tr (hereinafter sometimes referred to as margin time) obtained by dividing the preview distance by the vehicle speed V are obtained. The margin times Tf and Tr are the time until the front wheel 10 and the rear wheel 24 pass through the detection target part P, and are the times when the control command value can be created.
In the preview control, the control command value is output at a timing at which the actuator 28 can suppress the vibration caused by the road surface condition as the front wheel 10 and the rear wheel 24 pass through the detection target portion P. . When the operation delay of the actuator 28 is small, the control command value may be output when the allowance times Tf and Tr have elapsed. However, when the operation delay is large, the delay time ΔT before the allowance time, that is, It is desirable to output the control command value when the times (Tf−ΔT) and (Tr−ΔT) have elapsed.
As described above, in the present embodiment, since the preview distance is accurately obtained, the distance between the controlled wheel and the detection target part P can be accurately obtained. Further, the control command value is acquired based on the road surface height Zr, road surface gradient dZr, etc. of the detection target part P, but the preview control is good because the road surface height Zr, road surface gradient dZr, etc. are accurately obtained. Thus, vibration of the vehicle body 18 can be satisfactorily suppressed.

The road surface state detection program represented by the flowchart in FIG. 10A is executed at predetermined time intervals.
In S11, the actual sprung displacement xu and the inclination angle θs of the vehicle body are obtained. In S12, the actual mounting heights Zb ₀ , Zc ₀ , the optical axis B, and the vertical axis C of the camera 14 are determined. The actual mounting angles θb ₀ and θc ₀ are obtained. In S13, a processing area is determined and output to the camera 14 as described later. In S14, an image formed by the camera 14 (referred to as a partial image because it is a part of the captured image) is acquired. In S15, the size φ of the marker image G on the partial image is obtained, and the WD is obtained. And the ratio k is determined. In S16, in the partial image, the length Δx between the marker image G and the reference point 0j is obtained, and the distance Δh is obtained by multiplying by the ratio k. In S17, Δh, Zb ₀ , Zc ₀ , θb ₀ , and θc ₀ are substituted into Equation (2) to obtain the road surface height Zr ′. In S18, substitution into Equation (3) is performed. A first distance Lp ′ is determined.
When the vehicle body 18 is in the reference posture, Zb ₀ , Zc ₀ , θb ₀ , and θc ₀ are the reference attachment heights Zb and Zc and the reference attachment angles θb and θc, respectively.

The image forming program represented by the flowchart of FIG. 10B is executed each time laser light as a marker is output by the irradiation device 12 in the camera 14.
In S21, an object to be imaged (including the marker M) determined by the imaging region SR is imaged. Thereby, an optical image is formed in the CCD 14s, and the optical signal is converted into an electric signal. In S22, information regarding the processing area is acquired, and in S23, the electrical signal of the CCD 14s in the processing area is processed to form an image. The image formed here is a part of the captured image J. Further, the formed partial image is supplied to the suspension ECU 30 (S14).

The preview control program represented by the flowchart of FIG. 11 is executed at predetermined time intervals.
In S25, the preview distance Lpf (= Lp + Lf) for the front wheel 10 and the preview distance Lpr (= Lp + Lf + Lr) for the rear wheel 24 are obtained. In S26, margin times Tf and Tr are obtained by dividing the preview distances Lpf and Lpr by the vehicle speed V. Further, in S27, the vibration of the upper part of the spring (vehicle body 18) generated when the wheels 10, 24 pass the portion of the road surface height Zr 'can be suppressed based on the road surface height Zr', the road surface gradient dZr ', and the like. A target vertical force (corresponding to the control command value) is obtained. In S28, when the time (Tf−ΔT) elapses, the control command values to the actuators 28FL, FR of the front wheels 10FL, FR are output, and when the time (Tr−ΔT) elapses, the rear wheels 24RL, RR. The control command value to the actuators 28RL and RR is output.

As described above, in the present embodiment, the road surface state detection is performed by the part that stores the road surface state detection program represented by the flowchart of FIG. Part 62 is configured. The road surface state detection unit 62 is also a posture-dependent road surface state detection unit, an attachment height dependency detection unit, an attachment angle dependency detection unit, and a WD dependency detection unit. In addition, the actuator 28, the part that stores the preview control program shown in the flowchart of FIG. 11 of the suspension ECU 30, the part that executes it, the part that stores S17 and 18 of the road surface condition detection program shown in the flowchart of FIG. The preview control unit 66 is configured by the parts to be performed. Of these, the preview distance acquisition unit is configured by the part that stores S18 and S25, the part that executes S18, and the like.
Further, a sprung displacement acquisition unit 64 is configured by the sprung vertical G sensor 50, the part that stores S11 of the suspension ECU 30, and the part that executes it, and a part of the sprung vertical G sensor 50, S12 (determining the mounting height). The mounting height acquisition unit is configured by a part that stores (part), a part that executes the part, and the like. Further, a part of the sprung vertical G sensor 50, S11 (part for obtaining the inclination angle of the vehicle body 18), a part for executing the part, etc. constitute a vehicle body inclination angle detection unit. A part for storing the part for obtaining the attachment angle based on the inclination angle, a part for executing the part, and the like constitute an attachment angle acquisition unit.
Furthermore, a WD acquisition unit is configured by a part that stores S15 of the suspension ECU 30, a part that executes S15, and the like.

<Determination of processing area>
The camera 14 captures an object to be imaged determined by the imaging region SR as shown in FIG. 12 (b), but as shown in FIG. 12 (c), a marker is used for the captured image J corresponding to the imaging region SR. Image G is very small. Further, the number of pixels constituting the captured image J is large (in this embodiment, Na × Nb), and it takes a long time to process all the CCDs 14s in the imaging region SR.
On the other hand, in preview control, until the front wheel 10 passes through the detection target part P, the road surface state of the detection target part P must be detected and a control command value must be created, and the image can be quickly displayed. Need to form.
On the other hand, when the road surface is flat and the vehicle body 18 is in the reference posture, the marker M is in the vicinity of the predetermined reference point 0s in the imaging region RS as shown in FIG. Should be located at.
Further, at the time of braking, that is, when the vehicle is in a forward leaning posture, the marker Mu is positioned at a point shifted in the X + direction (forward in the front-rear direction of the vehicle) from the reference point 0s as shown in FIG. During driving, that is, when the vehicle is in a tilted posture, it is positioned (Md) at a point shifted in the X-direction (backward in the front-rear direction of the vehicle).
Further, during turning, the markers Mr and Ml are located at points shifted from the reference point 0s in the Y direction (lateral direction of the vehicle) as shown in FIG. 15 (a). Since the vehicle body 18 is tilted outward due to centrifugal force, the optical axis B of the irradiation device 12 is located on the outer side of the rotation with respect to the vertical line C of the camera 14, and therefore the marker M is shifted outward from the reference point 0s.
Although not shown in the figure, the mounting angle θc of the camera 14 changes when a change in posture in the front-rear direction or a change in posture in the horizontal direction occurs. Change. Further, at the time of turning, the vehicle body 18 moves in the vertical direction as it tilts in the lateral direction, so that the markers Mr and Ml are actually shifted in the X + and X− directions.

Thus, due to the change in the posture of the vehicle body 18, the position of the marker M when the road surface is flat deviates from the reference point 0s. Then, with this point as the center, the position of the marker moves in the X direction and the Y direction in accordance with a change in road surface unevenness, a change in driving condition in the normal range, and the like. Therefore, in the present embodiment, the processing region is determined so that the marker M is positioned inside even if the marker M is shifted in the X direction or the Y direction with the marker (Mu, Md, Mr, Ml) as the center. Is done.
For example, when the vehicle is in the reference posture, the processing area is set as the reference area Ro as shown in FIG. The reference area Ro is a part of the imaging area SR, and the partial image JRo corresponding to the reference area Ro is a part of the captured image J.
For example, the reference region Ro may have a length dy in the Y direction (corresponding to the width direction of the vehicle) (which can be expressed by the number of pixels) dy slightly longer than the tire width of the front wheels 10 and the rear wheels 24. The length dx in the X direction (corresponding to the front-rear direction) is included in the reference region Ro even if the marker M moves in the X direction due to acceleration and deceleration during normal traveling, and is determined in advance. The length of the road surface can be detected. In this way, if the reference area Ro is made as narrow as possible, the processing time (image formation time) in the reference posture can be shortened.

When a braking force equal to or greater than the set value is applied, or when the deceleration is greater than the set value, the reference area Ro is set to Δqu in the X + direction as indicated by the one-dot chain line in FIG. It is possible to make the region Ru moved only by the region Ru, or as shown by the broken line, the reference region Ro can be made a region Rua widened by a region corresponding to Δqu. Further, when the processing is performed for the braking time regions Ru and Rua, partial images JRu and JRua are obtained. The partial images JRu and JRua include a marker image Gu and a reference point 0j.
In FIG. 14B, the broken line and the alternate long and short dash line are drawn in order to clarify the difference between the reference region Ro and the braking time regions Ru and Rua. The reference region Ro is referred to as changing the reference region Ro by moving both of the reference region Ro to the braking time region Ru and expanding the reference region Ro to the braking time region Rua. The same applies to FIGS. 14 (c), 15 (b), and (c).

When a driving force exceeding the set value is applied, or when the acceleration is greater than the set value, the reference region Ro is moved by Δqd in the X-direction as indicated by the alternate long and short dash line in FIG. The driving time region Rd can be used, or, as indicated by the broken line, the driving time region Rda can be made wide by a region corresponding to Δqd in the X-direction. Further, when the processing is performed on the driving time regions Rd and Rda, partial images JRd and JRda including the marker image Gd and the reference point 0j are obtained.
In the present embodiment, as shown in FIG. 14A, the far side (X +) is closer to the near side (X−) than the near side (X−) by the perspective method even if the distance in the front-rear direction is the same. The length is shortened. Therefore, if the change width Δqu when determining the braking time region is made smaller than the change width Δqd when determining the driving time region (Δqu <Δqd), the area on the road surface corresponding to the change width is made substantially the same. Can do.

When the steering angle Φ of the steering wheel in the right direction is larger than the set angle, or when the lateral acceleration applied in the left direction (outward of turning) is larger than the set value, a one-dot chain line in FIG. As described above, the reference region Ro is a right turn region Rr moved by Δqr in the Y-direction (left direction, that is, outward of the turn), or an area corresponding to Δqr in the Y-direction as indicated by a broken line. It is possible to make the region Rra when turning right just widened. When processing is performed for the right-turn regions Rr and Rra, partial images JRr and JRra including the marker image Gr and the reference point 0j are obtained.
When the steering angle Φ in the left direction is larger than the set angle, or when the lateral acceleration applied in the right direction is larger than the set value, as indicated by the one-dot chain line in FIG. The left turn area R1 can be used, or, as indicated by the broken line, the left turn area Rla can be expanded in the Y + direction by an area corresponding to Δql. When the processing is performed for the left turning regions Rl and Rla, the partial images JRl and JRla including the marker image Gl and the reference point 0j are obtained.
The partial image JR includes the reference point 0j because it is necessary to obtain the length Δx between the marker image G and the reference point 0j.
In addition, the traveling state of the vehicle can be acquired based on information indicating the accelerator opening obtained through the CAN 32, the stroke of the brake operation member, the magnitude of the steering angle of the steering wheel, the front / rear G sensor 54, and the lateral G sensor. Or obtained based on 56 detection values. Furthermore, a pitch rate sensor, a yaw rate sensor, a rudder angle sensor, a roll rate sensor, and the like can be provided and acquired based on these detection values.

The processing area determination routine (S13) represented by the flowchart of FIG. 16 is executed at predetermined time intervals.
In S41 to 43, whether or not the accelerator opening A is larger than the set value Ath (whether the driving force is larger than the set value), or whether the operation stroke BS of the brake pedal is larger than the set stroke BSth (the braking force is It is determined whether or not the absolute value | Φ | of the steering angle Φ of the steering wheel is greater than the set angle Φth. If all the determination results are NO, in S44, the processing area is set as the reference area Ro.
On the other hand, if the accelerator opening A is larger than the set value Ath, in S45, the reference region Ro is changed by Δqd in the X-direction and determined as the drive time region (Rd, Rda). On the other hand, if the brake operation stroke BS is larger than the set stroke BSth, the reference area Ro is changed by Δcu in the X + direction in S46 and determined as the braking time area (Ru, Rua).
Further, when the absolute value | Φ | of the steering angle of the steering wheel is larger than the set angle Φth, the turning direction is determined based on the sign of the steering angle Φ. In S47, it is determined whether or not the vehicle is turning right. When turning right, the processing area is determined as the right turning area (Rr, Rra) in S48, and the reference area Ro is in the Y-direction. Δqr is changed. When turning left, in S49, the left turning region (Rl, Rla) is determined (the reference region Ro is changed by Δql in the Y + direction).
When S45 and 46 are executed, it is determined in S50 whether or not the absolute value | Φ | of the steering angle is larger than the set angle Φth. If the angle is equal to or smaller than the set angle Φth, the determination is no and the processing area determined in S45 and 46 is set. On the other hand, when it is larger than the set angle Φth, S47 to 49 are executed. Since it is changed in S45, 46 and also in S48, 49, the reference region Ro is changed in both the X and Y directions.
Further, when the processing area is enlarged from the reference area Ro (Rua, Rda, Rra, Rla), the processing area is reduced when S44 is executed after the execution of S45, 46, 48, 49. become.
Thus, if the processing area is changed based on the running state, the marker image G can be recognized well (the road surface state can be detected well), and the processing time can be shortened. it can. Further, since the road surface state is detected using spot-like markers, the processing region can be narrowed, and the processing time can be shortened accordingly.

It should be noted that the change amounts Δqu and Δqd of the braking time region Ru (Rua) and the driving time region Rd (Rda) with respect to the reference region Ro can be made larger when the absolute values of the front and rear G are large than when they are small. The same applies to the turning region. When the absolute value of the lateral G is large, the change amounts Δqr and Δql can be made larger than when the absolute value is small.
In the present embodiment, the case where the processing region R has a rectangular shape has been described. However, the processing region R may have a trapezoidal shape. Based on the perspective method, when the processing area is trapezoidal, the imaging area can be a rectangular area.
Further, the processing area R can be changed between a rectangular area and a trapezoidal area.
Further, the reference area Ro stores the position of the marker M in the imaging area SR of the camera 14 when the vehicle travels within a predetermined set time, and the reference area Ro can be determined accordingly. For example, it may be a minimum area including 80% of the stored marker M (which may be a value between 60% and 90%).
Further, the direction of change of the processing area from the reference area is determined by the relative positional relationship between the irradiation device 12 and the camera 14. For example, when the camera 14 is above the irradiation device 12, it is desirable to change to the X-direction during braking, and it is desirable to change to the Y + direction when turning right.
Further, when the vehicle is traveling on a slope, the processing area can be changed to the X + direction (the far side). This is because a far road surface state can be detected.
Moreover, it is not essential to change the processing area. It can always be a region of a certain size and position.

In the present embodiment, the front / rear G sensor 54, the lateral G sensor 56, and the suspension ECU 30 that stores and executes S13 of the road surface condition detection program represented by the flowchart of FIG. 10 (represented by the flowchart of FIG. 16). The area determination unit 68 is configured by a part for storing an image processing area determination routine, a part for executing the routine, a part for acquiring an accelerator opening, an operation stroke, a steering angle, and the like. The region determination unit is also a processing region determination unit. In addition, the part for storing and executing S41, 42, 45, and 46 of the processing area determination routine includes a part for executing the forward / backward tilt area determining unit, and the part for storing and executing S43, 47 to 49. The turning time region determining unit is configured, and the reference state determining region determining unit is configured by the portion that stores S44, the portion that executes S44, and the like. These may constitute means for moving the previously determined area and means for enlarging or reducing.
Further, a portion for acquiring the accelerator opening, operation stroke, steering angle, etc. of the suspension ECU 30, the front / rear G sensor 54, the lateral G sensor 56, etc. constitute an attitude detection device and a traveling state detection device.
The accelerator opening sensor 44, the operation stroke sensor 42, the steering angle sensor 40, and the like can also be considered as components of the attitude detection device, the travel state detection device, and the region determination unit.

In addition, the area | region determination part 68 which concerns on a present Example is applicable not only when imaging the marker M but when imaging the object around a vehicle. For example, the present invention can be applied to a surrounding environment acquisition device that does not include the irradiation device 12.
Further, the present invention can be applied to determining the processing area of the camera 14 when detecting a forward object in a collision prevention control device, a forward vehicle tracking control device, or the like. In this case, the camera 14 can be shared in the collision prevention control, the forward vehicle follow-up control, and the preview control (road surface state detection), and the processing area is changed according to the control (purpose of use of the camera 14). It can also be done. The present invention can also be applied to a parking assist control device, in which case an object behind the vehicle is detected.

Furthermore, the road surface state detection unit can also be used to detect the road surface state on the rear and side of the vehicle.
Further, (i) a plurality of irradiation devices 12 are provided, (ii) the irradiation devices 12 include a plurality of light sources, and a plurality of spot-shaped laser beams are irradiated, or (iii) the irradiation devices 12 are latticed. It is also possible to irradiate a laser beam having a shape (or mesh shape).
Furthermore, the road surface state detection method is not limited to the method in the above embodiment. For example, it is possible to acquire a change state of road surface unevenness based on a change in WD when the posture of the vehicle body 18 is constant. When the WD is short, it is considered that there is a convex portion, and when the WD is long, it is considered that there is a concave portion. As described above, the uneven state of the road surface can also be acquired based on the change in WD. When the posture of the vehicle body 18 is changed, if the WD when the posture of the vehicle body 18 is assumed to be constant is obtained, the uneven state can be obtained in the same way.
In the above embodiment, the first distance Lp of the actual preview distance is obtained each time, but the amount of change from the previous value of the first distance and the vehicle body 18 is in the reference posture. It is also possible to obtain a difference from the first distance (reference first distance). When the change in the vehicle speed V is small, the amount of change in the first distance and the difference from the reference first distance are obtained, and if the difference in the margin time is acquired based on that, the control is performed according to the difference in the margin time. The output timing of the command value can be shifted.
Further, when the optical axis B and the vertical axis C of the camera 14 are mounted apart from each other in the lateral direction of the vehicle body 18, it is possible to detect the uneven state in the road surface width (left-right direction) direction. For example, the posture of the vehicle body can be controlled based on a change in the road surface state in the width direction. Further, when turning, the vehicle body 18 is inclined in the horizontal direction, and the optical axis B and the vertical axis C of the camera 14 are shifted in the horizontal direction. Can get both.

<Detection of dirt>
The detection of dirt on the irradiation device 12 and the camera 14 will be described.
When the lens 12r of the irradiation device 12 and the lens 14r of the camera 14 are soiled, (a) the area β of the marker image G deviates from the range determined by the shape of the road surface and the posture of the vehicle body 18, and the road surface is uneven and changes in posture. Change more than the accompanying change. In addition, (b) the marker image G may be distorted. Furthermore, (c) the value related to the color of the marker image G is out of the range determined due to the influence of sunlight, illumination, headlights of oncoming vehicles, etc., or changes more than the change due to these influences. To do. Since the image formed in the camera 14 as described above is supplied to the suspension ECU 30, the suspension ECU 30 detects dirt. In addition, the value related to the color of the marker image is acquired by the color evaluation device 14c of the camera 14 and supplied to the suspension ECU 30.
Specifically, as shown in FIG. 17A, when neither the lens 12r of the irradiation device 12 nor the range 14r of the camera 14 is dirty, the marker image G0 has an area of β, whereas the dirt is When attached to the lens 14r of the camera 14 or attached to the lens 12r of the irradiation device 12, the area β of the marker image Gs may be reduced (βs <β0). Due to the dirt and cloudiness of the lens 14r of the camera 14, the contour β of the marker image GL may be blurred or irregularly reflected, resulting in an increase in the area β (βL> β0). In addition, water droplets may adhere to the lens 14r, and the size of the marker image G may change.
On the other hand, the area β of the marker image G changes as the road surface unevenness and the posture of the vehicle body 18 change. Therefore, when the area β of the marker image G changes more than the change due to the road surface unevenness, the change in the posture of the vehicle body 18 or the like, or as shown in FIG. When deviating from the determined range β (βtha to βthb) {too large (Gb), too small (Gs)}, it is detected that the lens 12r of the irradiation device 12 and the lens 14r of the camera 14 are dirty. The

  As shown in FIG. 18, when water droplets adhere to the lens 14r of the camera 14 or the lens 12r of the irradiation device 12, the shape of the marker image Gy may be distorted due to this. Specifically, while the spot shape of the laser beam is a perfect circle and the marker image G whose roundness γ is higher than the set value γth should be obtained, the roundness γ of the marker image Gy is It may be lower than the set value γth. Therefore, when the roundness γ of the marker image G is equal to or less than the set value γth, it can be detected that the irradiation device 12 and the camera 14 are dirty.

As shown in FIG. 19, due to the contamination of the lens 12r of the irradiation device 12, the color of the irradiated laser light changes, and the color or the like of the marker image Gc (various values related to the color, such as RGB , The value of HGV (hereinafter the same). Further, the color or the like of the marker image Gc may change due to the dirt on the lens 14r of the camera 14. In the color evaluation device 14m, the color of the image is decomposed into RGB (red, green, blue), and respective values are acquired. Further, HSV (hue, saturation, brightness) is evaluated, and each evaluation value is acquired. For example, when the color of the marker image Gc is red, hue: H ≦ 0.08, H ≧ 0.9, saturation: S ≧ 0.15, brightness: V ≧ 0.1 is set as a normal range. be able to.
Therefore, based on the value related to the color, an abnormality such as the color of the marker image G can be acquired, and based on this, the contamination of the camera 14 and the irradiation device 12 can be detected.
In this embodiment, the color and the like of the marker image G when the irradiation device 12 and the camera 14 are normal and not dirty are acquired in advance, and the presence / absence of sunlight, the presence / absence of illumination, the color of illumination, and the head Taking into account the presence or absence of light or the like, a range of colors or the like of the marker image G is acquired, and a range of values related to these colors when not dirty is stored. Then, when the value related to the color of the actual marker image G is out of the range, it is detected as dirty.
In this embodiment, when dirt is detected, this is notified and the dirt removing devices 12c and 14c are operated.

The stain detection program represented by the flowchart of FIG. 20 is executed at predetermined time intervals.
In S50, the area β of the marker image G (which can be expressed by the number of pixels occupied by the image G) is acquired, and in S51, whether or not it is within the set range (βtha <β <βthb). It is determined whether or not the absolute value | Δβ | of the change amount Δβ of the area β from the detection value (for example, the previous detection value or the detection value several times before) is larger than the set value Δβth. When the determination of S51 is YES and the determination of S52 is NO, the area β of the marker image G is a normal size, but the determination of S51 is NO, or the determination of S52 is YES. Since the area β has an abnormal size, the abnormality flag 1 is set in S53.
Next, in S54, the roundness γ is acquired. In S55, it is determined whether the roundness γ is higher than the set value γth. When the roundness γ is higher than the set value γt, the shape is normal, but when it is equal to or less than the set value γth, the abnormality flag 2 is set in S56.
Next, in S57, values (RGB value, HGV value) related to the color are acquired, and in S58 and 59, it is determined whether or not the RGB and HSV values are within the normal range. If at least one value is not within the normal range, the abnormality flag 3 is set in S60. When all the values are within the normal range, the abnormality flag 3 is not set.
In S61, it is determined whether or not two or more of the abnormality flags 1, 2, and 3 are set. If two or more are set, it is detected that there is dirt, and this is notified in S62. In S63, an operation command for the dirt removing devices 12c and 14c is output to at least one of the irradiation device 12 and the camera 14. Accordingly, at least one of the dirt removing device 12c and the dirt removing device 14c corresponding to the irradiation device 12 and the camera 14 is operated.
For example, both the dirt removing devices 12c and 14c can be operated simultaneously, or can be operated one by one in a predetermined order. Moreover, since the camera 14 is attached below the irradiation device 12 of the vehicle body 18, it is considered that the camera 14 is more easily soiled. Therefore, the dirt removing device 14c of the camera 14 can be operated with priority.
On the other hand, when one or less of the abnormality flags 1, 2, and 3 is set, it is determined that the state is normal in S64.

As described above, in this embodiment, since the presence / absence of dirt is evaluated based on the three evaluation methods, the presence / absence of dirt can be accurately detected.
In addition, when two or more of the three abnormality flags are set, it is determined that it is dirty, and in the case of one, it is not detected. Therefore, it can be accurately detected whether or not it is dirty.
Further, the presence / absence of contamination is determined based on the area, shape, color, etc. of the marker image G. As described above, since the spot diameter is irradiated with the laser beam smaller than the second set value, the marker is irradiated. The number of pixels occupied by the image G is small. Therefore, the time required to determine the presence or absence of dirt can be shortened.

In the above embodiment, the abnormality flag 3 is set when at least one of the RGB value and the HVS value is not within the setting range. It is also possible to set the abnormality flag 3 when the above values are not within the normal range.
In addition, when two or more of the abnormality flags 1, 2, and 3 are set, it is not detected that it is dirty, but when it is set at least one, it is detected that it is dirty. It can also be made.
Furthermore, when a predetermined specific flag or a specific combination of the abnormal flags 1, 2, and 3 is set, it can be detected that the flag is dirty. For example, when both the abnormality flags 1 and 2 are set, it is detected that it is dirty, or when the abnormality flag 3 is set, the abnormality flags 1 and 2 are not set. Even if it is dirty, it can be detected.
Further, it is not necessary to be based on all three evaluation methods, and one or two of these evaluation methods can be executed.
Furthermore, when the camera 14 and the irradiation device 12 are determined to be more easily soiled, it is possible to detect that the more easily soiled is soiled. For example, when the camera 14 is provided in the passenger compartment, it is determined that the lens 12r of the irradiation device 12 is dirty, or the camera 14 is attached below the vehicle body 18 from the irradiation device 12. Therefore, it can be determined that the lens 14r of the camera 14 is dirty.

Moreover, it is not limited to dirt, In these cases, it can also be detected as abnormal. This is because there may be an abnormality in the irradiation device 12, the camera 14, the suspension control device 20, and the like.
Furthermore, evaluation values such as the color of the marker image G can be acquired in relation to the contamination of the irradiation device 12, the contamination of the camera 14, the abnormality of the irradiation device 12, the abnormality of the camera 14, and the like. For example, based on the actual evaluation value, it is possible to acquire the location of the dirt, the cause of the abnormality, and the like.
Further, in the evaluation based on the area β of the marker image G, the abnormality flag 1 can be set when the change ratio (Δβ / β) of the area β is equal to or larger than the set ratio.
Furthermore, the present invention can be similarly applied when a grid-like or mesh-like marker is irradiated.
Further, the present invention is not limited to the case of detecting the front road surface state, but can also be applied to a vehicle surrounding environment acquisition device that detects the environment of the side and rear of the vehicle.
Furthermore, when an abnormality is detected, it is not essential to perform both the operation of the dirt removing devices 12c and 14c and the notification, and only one of them may be performed.
It is not essential to provide one or more of the dirt detection unit 70, the notification device 58, and the dirt removal devices 12c and 14c.

In the present embodiment, the image forming unit 14d, the color evaluation device 14c, the part for storing the dirt detection program represented by the flowchart of FIG. The dirt detection unit 70 is also a marker-based abnormality detection unit. Moreover, an area-based abnormality detection unit is configured by a portion that stores S50 to 53 of the marker-based abnormality detection unit, a portion that executes S50 to 53, and the like, and a shape-based abnormality detection unit that includes a portion that stores S54 to 56 and a portion that executes S54-56 The color-related value-based abnormality detection unit is configured by the part that stores S57 to 60, the part that executes S57-60, and the like.
Further, the part for storing S63, the part for executing S63, and the like constitute a dirt removing device control unit. Furthermore, the laser light source 12p is also a laser light irradiation part and a spot light irradiation part.

The unsprung displacement can also be obtained using observer theory. If the observer is used, the sprung displacement can be obtained more accurately.
Consider the one-wheel model shown in FIG. The mass m ₂ and displacement x _{2 of} the unsprung portion (vehicle body 18), the mass m ₁ and the displacement x _{1 of} the unsprung portion (wheels 10, 24, etc.), and the suspensions 22 and 25 provided between the unsprung portion and the unsprung portion. The spring constant of the spring 26 is k ₂ , the damping coefficient of the shock absorber 27 is c ₂ , the road surface input is x ₀ , the tire spring constant is k ₁ , and the force applied by the vertical force control device 28 (control force). Let it be Fact.
In this model, the expression m ₂ x ₂ ″ (t) + c ₂ {x ₂ (t) ′ − x ₁ (t) ′} + k ₂ {x ₂ (t) −x ₁ (t)}
= -Fact (t) (4)
m ₁ x ₁ "(t)
= C ₂ {x ₂ (t) ′ − x ₁ (t) ′} + k ₂ {x ₂ (t) −x ₁ (t)}
−k ₁ {x ₁ (t) −x ₀ (t)} + Fact (t) (5)
Is established. In the equations (4) and (5), “′” represents the first derivative and “” ”represents the second derivative.
For example, from equation (4), the force Fact (t) applied by the vertical force control device 28 by the preview control is expressed as follows:
Fact (t) = c ₂ · x ₀ (t) ′ + k ₂ · x ₀ (t)
Then, m ₂ x ₂ ″ (t) is only the excitation force accompanying the deformation of the tire. And if the excitation force accompanying the deformation of the tire is very small and can be ignored, theoretically The road surface input transmitted to the spring is zero.

Further, when the total of the force F _R when the roll is generated, the force F _P when the pitch is generated, and the force F _A applied when the articulation occurs is Fw (t), the following motion Equation (4) holds.
m ₂ x ₂ ″ (t) + c ₂ {x ₂ (t) ′ − x ₁ (t) ′} + k ₂ {x ₂ (t) −x ₁ (t)}
= Fw (t) -Fact (t) (6)
Fw (t) = F _R (t) + F _P (t) + F _A (t)
The roll inertia force applied to each wheel during a left turn (when a roll is generated) is as follows. A _R is the lateral acceleration, h _RF and h _Rr are the vertical distances between the center of gravity of the vehicle and the roll center on the front wheel side and the rear wheel side, and T _f and Tr are the front wheel side and the rear wheel side, respectively. The tread.
F _R-FL (t) = (m _2−FL + m _2−FR ) A _R (t) h _Rf / T _f
F _R-FR (t) = − (m _2−FL + m _2−FR ) A _R (t) h _Rf / T _f
F _R-RL (t) = (m _2−RL + m _2−RR ) A _R (t) h _Rr / T _r
F _R−RR (t) = − (m _2−RL + m _2−RR ) A _R (t) h _Rr / T _r
The pitch inertia force applied to each wheel during acceleration (when a pitch occurs) is as follows. _Ap is the longitudinal acceleration, h _PR and h _PL are the distances between the center of gravity of the vehicle and the pitch center of the right and left wheels, L _L and L _R are the left front wheel 10FL and the rear wheel 24RL. The distance in the front-rear direction (wheel base) between the front wheel 10RL on the right side and the distance in the front-rear direction between the rear wheel 24RL.
F _P-FL (t) = (m _2−FL + m _2−RL ) A _P (t) h _PL / L _L
FP-FR (t) = (m2 _-FR + m2 _-RR ) _AP (t) _hPR / _LR
F _P-RL (t) = − (m _2−FL + m _2−RL ) A _P (t) h _PL / L _L
FP-RR (t) =-(m2 _-FR + m2 _-RR ) _AP (t) _hPR / _LR
The torsional reaction force applied to each wheel when articulation occurs is as follows. Let Kt be the torsional rigidity of the spring top. Further, the warp amount x _2w (t) of the sprung portion is
x _2w (t) = x _2−FL (t) −x _2−FR (t) −x _2−RL (t) + x _2−RR (t)
It is defined as
F _A-FL (t) = − x _2w (t) Kt / T _f
F _A-FR (t) = x _2w (t) Kt / T _f
F _A-RL (t) = − x _2w (t) Kt / T _r
F _A-RR (t) = x _2w (t) Kt / T _r

And input
u (t) = [Fact (t) Fw (t)] ^T
And the state variable x (t) is
x (t) = [x ₂ (t) x ₂ (t) ′ x ₁ (t) x ₁ (t) ′] ^T
And the disturbance input w (t) is w (t) = x ₀ (t)
And the output y (t) is
y (t) = x ₂ (t) "
(5) and (6) represent the state equation x (t) ′ = Ax (t) + Bu (t) + Ew (t)
y (t) = Cx (t) + Du (t) (7)
It can be expressed as
In the above equation, matrices A, B, C, D, and E are represented by equations (8) to (12) in FIG.

Further, when the observer model in FIG. 21B is configured with the state variable x (t) and the estimated values x * (t) and y (t) * of the output y (t), the state equation is expressed by the following equation: x (t) ′ * = Ax (t) * + Bu (t) + L {y (t) −y (t) *}
y (t) * = Cx (t) * + Du (t) (13)
It is represented by The matrix L is an observer gain matrix, and the expression L = [l ₁ l ₂ l ₃ l ₄ ]
It is represented by
L {y (t) −y (t) *} is used to correct the modeling error by feeding back the output error as a correction value, and the error {x (t) −x (t) *} of the state variable is corrected. Can be small. The output error equation is obtained from the equations (7) and (13): ε (t) ′ = (A−LC) ε (t) + Ew (t) (14)
It can be expressed as Also, in equation (14), if w (t) = 0 is integrated,
ε (t) = ε (0) exp {(A-LC) t}
Is obtained. From this equation, it is clear that the error can be converged.
As described above, the estimated value x (t) * of the state variable is obtained using the observer, and the sprung displacement x ₂ (t) is obtained.
In the present embodiment, the sprung displacement acquisition unit 64 is configured by a portion of the suspension ECU 30 that acquires the displacement x ₂ (= xu) of the sprung portion using the observer theory.

The spot shape of the laser light emitted from the irradiation device 12 may not be circular. For example, as shown in FIG. 22, the spot shape is a square (marker Ms) or a diamond (marker Mh). And so on.
As described above, when the laser beam having a square or rhombus spot shape is irradiated, the size (for example, width) is larger than that when the laser beam having a circular spot shape is irradiated. Can be acquired accurately, and the WD acquisition accuracy can be improved.

The gain in the irradiation device 12 can be determined based on the time of the day. For example, as shown in FIG. 23B, the gain can be increased between 8:00 and 17:00, and the gain can be decreased between 17:00 and 24:00, and between 0:00 and 8:00. The gain may be small while the solar altitude is low and the energy reaching the ground is small.
The irradiation apparatus control program represented by the flowchart of FIG. 23 (a) is executed at predetermined time intervals.
In S1 ′, the time is acquired from the timer of the suspension ECU 30, and in S2 ′, the gain is determined according to the gain determination table of FIG. 23 (b). In S3 ′, information representing the gain is output to the irradiation device 12.
In this way, when the solar altitude is high during the day, the gain is determined to be a large value, and when the solar altitude is low, the value is determined to be a small value, so that the amount of energy consumption can be reduced.
Further, the gain can be determined based on the season (summer, winter, etc.) or can be determined based on the weather (sunny, cloudy, etc.). In addition, the gain can be determined based on two or more of latitude, time, season, and weather. In this case, the output level of the laser beam can be controlled more finely, and energy consumption can be reduced. Can be achieved.
In the present embodiment, a portion that stores S1 ′ of the suspension ECU 30 and a portion that executes S1 ′ constitute an intensity detecting portion, and a portion that stores S2 ′ and a portion that executes S2 ′ constitute a strength-dependent level determining portion.

In the case where the gain is determined based on the time, the time when the gain is determined to be a large value is not limited to 8:00 to 17:00. The time zone in which the gain is determined to be a large value can be determined as appropriate (for example, based on the region, season, etc.).
Also, the gain can be changed in two or more steps.

The processing area can be determined according to a processing area determination routine represented by the flowchart of FIG.
In S71, it is determined whether or not the absolute value | Gx | of the longitudinal acceleration Gx is larger than a set value Gxth. That is, it is determined whether deceleration or acceleration greater than the set value Gxth has occurred due to braking or driving. If the absolute value | Gx | of the longitudinal acceleration is larger than the set value Gxth, in S72, the reference region Ro is defined as a region acting upon the longitudinal force (reference region Ro + Δqd + Δqu) expanded in both the X + and X− directions. In S73, it is determined whether or not the absolute value | Gy | of the lateral acceleration Gy is larger than the set value Gyth. It is determined whether or not a lateral acceleration greater than the set value Gyth has been generated by turning rightward or leftward. When the absolute value | Gy | of the lateral acceleration is larger than the set value Gyth, in S74, the reference region Ro is expanded in both directions of Y + and Y− to be a lateral force acting region (reference region Ro + Δqr + Δql).
If it is neither of these, the reference region Ro is set in S75.

  As described above, when the longitudinal force (or lateral force) is applied, the reference region Ro is expanded in both the forward direction and the backward direction (or the left direction and the right direction). Even if the vehicle body 18 vibrates in the front-rear direction (or left-right direction) due to force (or left-right direction force), the marker image G can be obtained satisfactorily and the road surface state can be obtained satisfactorily. it can.

When the camera 14 can change the imaging area, the imaging area can be determined based on the posture of the vehicle body 18.
As shown in FIG. 25, the camera 100 includes an imaging region changing unit 14g in addition to a lens 14r, a filter 14f, a CCD 14s, an image forming unit 14d, a dirt removing device 14c, and a color evaluation device 14m.
Further, the road surface condition detection program represented by the flowchart of FIG. 26 (a) is executed at predetermined time intervals. Steps that are executed in the same manner as the road surface condition detection program shown in the flowchart of FIG. 10 are assigned the same step numbers.
In S <b> 81, the imaging area is determined and output to the camera 100. In S11 and 12, the posture of the vehicle body 18 is detected, the mounting height and mounting angle of the irradiation device 12 and the camera 100 are acquired, and in S14, the image formed in the camera 100 is acquired. Then, after S15, the process is executed in the same manner as in the road surface condition detection program of FIG.
The imaging region determination routine in S81 is represented by the flowchart in FIG.
When the vehicle body 18 is in the reference posture, in S44 ′, the imaging region is set as a reference imaging region SRo (see FIG. 28). For example, the reference imaging area SRo may be set to a value between 80% (70% to 90%) of the marker M in the imaging area Sr of the camera 14 when the vehicle travels within a predetermined set time. )) Can be made the smallest area.
If the accelerator opening A is larger than the set opening Ath, the reference imaging area SRo is changed in the X-direction in S45 ′ as shown in FIG. 28 (a), and the driving imaging areas SRd, SRda Is done.
When the operation stroke BS of the brake operation member is larger than the set stroke BSth, the reference imaging area SRo is changed in the X + direction as shown in FIG. 28 (b) in S46 ′, and the braking imaging areas SRu and SRua are changed. It is determined.
Then, when turning right, in S48 ', the direction is changed to the Y-direction as shown in FIG. 28 (c) and determined as the right-turn imaging regions SRr and SRra. As shown in FIG. 28 (d), the direction is changed to the Y + direction, and the left-turn imaging regions SRl and SRla are determined.

In the camera 100, the image forming program represented by the flowchart of FIG. 26B is executed every time the laser beam is irradiated from the irradiation device 12.
In S85 and 86, the imaging area is read, and the angle of view, the direction of the camera 14r, and the like are controlled accordingly. Thereafter, in S87, imaging is performed, and in S88, an image determined by the imaging area is formed and supplied to the suspension ECU 30.
As described above, even when the imaging region is determined based on the posture of the vehicle body 18, the processing time can be shortened while accurately detecting the road surface state, as in the above-described embodiment.
In the present embodiment, the part of the suspension ECU 30 that stores the imaging region determination routine represented by the flowchart of FIG. 27, the part that executes the routine, and the part that stores S81 of the road surface condition detection program represented by the flowchart of FIG. The imaging region control unit is configured by the part to be executed.
In addition, the image forming unit is configured by a part that stores S81 and S88, a part that executes S81, and S88.

Although the above embodiments have been described, two or more of these embodiments can be executed in combination.
Further, the present invention can be carried out in a mode in which various changes and improvements are made based on the knowledge of those skilled in the art, in addition to the modes described above.

  DESCRIPTION OF SYMBOLS 11: Road surface image acquisition part 12: Irradiation apparatus 12p: Light source 12a: Amplifier 12c: Dirt removal apparatus 12e: Laser beam output part 14, 100: Camera 14f: Filter 14s: CCD 14d: Image formation part 14m: Color etc. evaluation apparatus 14c : Dirt removing device 14g: Imaging region changing unit 22: Suspension 27: Shock absorber 28: Vertical force control device 39: Navigation device 50: Spring top and bottom G sensor 58: Notification device 60: Irradiation device control unit 62: Road surface state detection unit 64: Sprung displacement acquisition unit 66: Preview control unit 68: Area determination unit 70: Dirt detection unit

Claims (8)

An ambient environment acquisition device that includes an imaging device that is attached to a vehicle body and images an object to be imaged determined by an imaging region and forms an image, and acquires an environment around the vehicle based on the formed image Because
The imaging apparatus includes an image forming unit that performs processing on an imaging element corresponding to the imaging target object and belongs to a processing region to form an image,
The surrounding environment acquisition apparatus includes an area determination unit that determines at least one of the imaging area and the processing area based on a state of the vehicle.   The surrounding environment acquisition apparatus according to claim 1, wherein the region determination unit includes an image processing region determination unit that determines the processing region of the image forming unit based on a state of the vehicle.   The imaging device includes an imaging region changing unit capable of changing an imaging region thereof, and the surrounding environment acquisition device determines the imaging region by the region determining unit by controlling the imaging region changing unit. The surrounding environment acquisition apparatus of Claim 1 or 2 containing the imaging area control part controlled to an area | region.   The reference state region determining unit that determines the at least one region as a reference region when the vehicle is in a reference state in which the vehicle is in a predetermined set range. 4. The surrounding environment acquisition device according to any one of 3   The region determination unit includes a front / rear inclination region determination unit that determines the at least one region when the vehicle body has a front-rear direction tilt angle equal to or greater than a set angle as a region in which the reference region is changed in the front-rear direction. The surrounding environment acquisition apparatus of Claim 4.   The region determining unit includes a turning region determining unit that determines the at least one region when the value representing the turning state of the vehicle is equal to or greater than a set value as a region in which the reference region is changed in the left-right direction. Item 6. The surrounding environment acquisition device according to Item 4 or 5.   The surrounding environment acquisition device according to any one of claims 1 to 6, wherein the surrounding environment acquisition device includes an attitude detection device that acquires a state of the vehicle based on an attitude of the vehicle body. A suspension control device including the surrounding environment acquisition device according to any one of claims 1 to 7, wherein the suspension control device controls suspension of a wheel of the vehicle based on the surrounding environment acquired by the surrounding environment acquisition device. Because
The surrounding environment acquisition device is a road surface state detection device that detects a state of a road surface in front of the vehicle,
The suspension control device includes a preview control unit that controls the suspension of the wheel to be controlled located behind the portion of the road surface where the state is detected based on the road surface state detected by the road surface state detection device. A suspension control apparatus characterized by the above.

Images