JP4884806B2 - Vehicle perimeter monitoring system - Google Patents

Description

  The present invention relates to a system for monitoring the periphery of a vehicle.

In order to avoid contact between the vehicle and an object such as a pedestrian or motorcycle, a technology has been proposed that informs the driver of the presence of an object that is likely to come into contact with the vehicle based on the video captured by the in-vehicle camera. (For example, see Patent Document 1). Further, a technique for controlling the behavior of a vehicle so as to avoid contact with an object according to a determination result that the possibility of contact with the object is high is known.
Japanese Patent Laid-Open No. 2001-006096, paragraphs 0017 to 0053, FIG.

  However, among a plurality of objects around the vehicle, an object that has been determined to have a low possibility of contact with the vehicle may suddenly change its state in order to avoid contact with other objects. . In this case, it is determined that there is a high possibility that the object is in contact with the vehicle, the presence of the object is suddenly notified to the driver, or the vehicle behavior changes suddenly, which may cause stress on the driver's mind and body. There is.

  Therefore, in the case where there are a plurality of objects in the vicinity of the vehicle, the present invention takes into consideration the correlation between the objects, etc., and determines the presence of an object that may come into contact with the vehicle at an early stage, and takes appropriate measures It is an object of the present invention to provide a system for monitoring the periphery of a vehicle so that it can be taken.

A vehicle periphery monitoring system according to a first aspect of the present invention is a system for monitoring the periphery of a vehicle, and measures the positions of a plurality of objects in the vicinity of the vehicle in a time series based on an image captured by an in-vehicle imaging device. A first processing unit that predicts a primary state of each object based on a time-series measurement position of each object, and a correlation between the primary state of each object predicted by the first processing unit. Predicting a secondary state of some or all of the plurality of objects based on the second state, determining a level of possibility of contact between the vehicle and the object based on the second state of the object, and the determination result (Hereinafter referred to as “secondary determination result” as appropriate) and a second processing unit that controls the operation of the in-vehicle device, and the second processing unit avoids contact of the first object with the second object. Whether or not there is a course change or overtaking for When the second state of the first object is predicted and the course change or overtaking to avoid contact with the second object is predicted as the second state of the first object, the vehicle and the first object are in contact with each other. It is characterized in that it is determined that there is a high possibility of being .

  According to the vehicle periphery monitoring system of the first aspect of the invention, the primary state of each object is predicted based on the video captured by the in-vehicle imaging device. The “state” of the object is specified by its “position”, “speed (including relative speed with respect to the vehicle (speed includes size and direction))”, and the like. Furthermore, some or all of the secondary states of the plurality of objects are predicted based on the correlation between the primary states of the objects. Further, the level of the possibility of contact between the vehicle and the object is determined based on the secondary state of the object, and the operation of the in-vehicle device is controlled according to the determination result (secondary determination result).

As a result, when there are a plurality of objects around the vehicle, the in-vehicle device is quickly determined according to the level of possibility of contact between the vehicle and the object, which is determined in consideration of the correlation of the primary state of the object in the future. The operation can be controlled. For example, if there is an object that has a low possibility of contact with the vehicle at this stage but is expected to have a high possibility of contact with the vehicle in view of the correlation with other objects in the future, avoiding contact with this object In view of the above, the operation of the in-vehicle device can be appropriately controlled. Specifically, in view of the possibility that the first object may change its course in front of the vehicle in order to avoid contact with the second object or to overtake the second object, It is determined (or predicted) that the second object is overtaken, and the in-vehicle device can be appropriately controlled according to the determination result.

  Therefore, a sudden change in the operation of the in-vehicle device is suppressed, and a situation in which extra stress is given to the driver can be avoided.

The vehicle periphery monitoring system according to a second aspect is the vehicle periphery monitoring system according to the first aspect , wherein the second processing unit adds the correlation between the primary states of the first object and the second object to the vehicle. Based on the distance between the first object and the second object or the distance between the first object and the second object, whether the first object changes the course or overtakes the second object. Is predicted as the secondary state.

When an object has a spatial margin around it, it is likely that the course will be changed in the direction of the margin in order to overtake another object, etc. The possibilities are different. According to the vehicle periphery monitoring system of the second invention, in view of this point, not only the primary prediction state of the first and second objects, but also the distance between the first or second object and the vehicle, or the distance between the objects. Based on this, it is determined (or predicted) whether or not to change the course so that the first object passes the second object. Accordingly, the in-vehicle device can be appropriately controlled in accordance with the determination result regarding the possibility of contact between the vehicle and the object in consideration of the future correlation between the first and second objects.

The vehicle periphery monitoring system according to a third aspect of the present invention is the vehicle periphery monitoring system according to the first aspect, wherein the vehicle and each object can contact each other based on the primary state predicted by the first processing unit for each object. It is characterized by determining the level of the property, and controlling the operation of the in-vehicle device according to the determination result (hereinafter referred to as “primary determination result” as appropriate).

According to the vehicle periphery monitoring system of the third aspect of the invention, the level of possibility of contact between the vehicle and each object is determined based on the primary state. Further, not only the operation of the in-vehicle device is controlled according to the secondary determination result as described above, but also the operation of the in-vehicle device can be controlled according to the determination result (primary determination result).

Vehicle environment monitoring system of the fourth invention, in the vehicle periphery monitoring system of the third aspect of the present invention, the form in which the second processing unit differs from the control mode of operation of the vehicle equipment based on the primary determination result by the first processing unit Then, the operation of the same in-vehicle device is controlled based on the secondary determination result, or the operation of the in-vehicle device different from the in-vehicle device whose operation is controlled by the first processing unit is controlled based on the secondary determination result. It is characterized by doing.

  The reliability of the primary determination result based on the primary state predicted based on the time-series measurement position of each object is the secondary based on the secondary state further predicted (or estimated) based on the primary state. Generally, it is often higher than the reliability of the determination result. For this reason, according to the vehicle periphery monitoring system of the third aspect of the invention, the operation of the in-vehicle device can be controlled according to the reliability of the determination result regarding the level of possibility of contact between the vehicle and the object.

The vehicle periphery monitoring system according to a fifth aspect of the present invention is the vehicle periphery monitoring system according to the first aspect, wherein the second processing unit is highly likely to come into contact with the object based on the secondary state of the object. When the determination is made, the second information emphasizing the presence of the object is output to an in-vehicle information output device.

According to the vehicle periphery monitoring system of the fifth invention, when there are a plurality of objects around the vehicle, it is determined that the possibility of contact between the vehicle and the object is high in consideration of the correlation of the primary state of the object in the future. The presence of the detected object can be promptly recognized by the driver through the “second information” output from the information output device (on-vehicle device). For example, if there is an object that has a low possibility of contact with the vehicle at this stage, but has been determined (or expected) to have a high possibility of contact with the vehicle in view of the correlation with other objects in the future, this object The driver can be recognized early on. Therefore, the presence of an object that is highly likely to come into contact with the vehicle is abruptly notified, and a situation in which extra stress is given to the driver can be avoided.

The vehicle periphery monitoring system according to a sixth aspect of the present invention is the vehicle periphery monitoring system according to the third aspect , wherein the first processing unit is highly likely to come into contact with the object based on the primary state of the object. When the determination is made, the first information emphasizing the presence of the object is output to an in-vehicle information output device.

According to the vehicle periphery monitoring system of the sixth aspect of the present invention, the presence of an object determined to have a high possibility of contact between the vehicle and each object based on the primary state is output from the information output device (on-vehicle device). The driver can be recognized through the “first information”.

The vehicle periphery monitoring system according to a seventh aspect is the vehicle periphery monitoring system according to the sixth aspect , wherein the second processing unit is highly likely to contact the object based on the secondary state of the object. When the determination is made, the second information emphasizing the presence of the object is output to an in-vehicle information output device in a form different from the output form of the first information by the first processing unit.

According to the vehicle periphery monitoring system of the seventh aspect of the invention, the primary and secondary determinations are made in view of the fact that the reliability of the primary determination result is generally higher than the reliability of the secondary determination result as described above. The output forms of the first and second information corresponding to each result are differentiated. This makes it possible for the driver to recognize how reliable the determination result regarding the possibility that the vehicle whose presence is emphasized by the first and second information is in contact with the vehicle is sufficient.

The vehicle periphery monitoring system according to an eighth aspect of the present invention is the vehicle periphery monitoring system according to the first aspect, wherein the second processing unit controls the behavior of the vehicle based on the secondary determination result.

According to the vehicle periphery monitoring system of the eighth aspect of the present invention, when there are a plurality of objects around the vehicle, the determination regarding the level of possibility of contact between the vehicle and the object in consideration of the correlation of the primary state of the object in the future. Depending on the result, the in-vehicle device can control the operation of the vehicle at an early stage. For example, if there is an object that has a low possibility of contact with the vehicle at this stage, but has been determined (or expected) to have a high possibility of contact with the vehicle in view of the correlation with other objects in the future, this object The operation of the vehicle can be controlled early so that contact with the vehicle can be avoided. Accordingly, it is possible to avoid a situation in which the vehicle operation suddenly changes according to the presence of an object that is highly likely to come into contact with the vehicle, and an extra stress is given to the driver.

The vehicle periphery monitoring system according to a ninth aspect is characterized in that, in the vehicle periphery monitoring system according to the third aspect , the first processing unit controls the behavior of the vehicle based on the primary determination result.

According to the vehicle periphery monitoring system of the ninth aspect of the present invention, the vehicle operation can be controlled by the in-vehicle device according to the primary determination result.

A vehicle periphery monitoring system according to a tenth aspect of the present invention is the vehicle periphery monitoring system according to the ninth aspect , wherein the second processing unit is different from a control mode of the behavior of the vehicle based on the primary determination result by the first processing unit. Then, the behavior of the vehicle is controlled based on the secondary determination result.

According to the vehicle periphery monitoring system of the tenth aspect of the invention, the primary and secondary determinations are made in view of the fact that the reliability of the primary determination result is generally higher than the reliability of the secondary determination result as described above. The vehicle operation control mode corresponding to each result is differentiated. Accordingly, the vehicle operation is appropriately controlled by the in-vehicle device so that the contact with the object can be avoided according to the reliability of the primary and secondary determination results regarding the possibility that the vehicle and the object are in contact with each other. Can be made.

The vehicle periphery monitoring system according to an eleventh aspect of the invention is the vehicle periphery monitoring system according to the first aspect of the invention, wherein the second processing unit is added to the correlation of the primary states of the objects predicted by the first processing unit, The secondary state of each object is predicted based on a distance between the vehicle and each object or a distance between objects.

According to the vehicle periphery monitoring system of the eleventh invention, in view of this point, the state of each object is determined based not only on the correlation of the primary state of each object but also on the distance between each object and the vehicle or the distance between the objects. is expected. This is because an object has a high possibility of abruptly changing its state, such as changing the course in a direction with a margin when there is a margin around the object. As a result, in-vehicle devices can be appropriately controlled according to the possibility of contact between the vehicle and the object in consideration of the positional relationship between the objects or between the object and the vehicle in addition to the correlation between the objects in the future. .

A vehicle periphery monitoring system according to a twelfth aspect of the present invention is the vehicle periphery monitoring system according to the first aspect of the present invention, based on the correlation of the kth order state of each object predicted by the kth processing unit (k = 2, 3,...). Predicts a part or all of the k + 1 order states of the plurality of objects, determines the possibility of contact between the vehicle and the object based on the k + 1 order state of the object, and according to the determination result And a k + 1 th processing unit for controlling the operation of the in-vehicle device.

According to the vehicle periphery monitoring system of the twelfth aspect , the possibility of contact between the vehicle and the object is evaluated based on the predicted state of the object that is higher than the second order. Accordingly, the in-vehicle device can be appropriately controlled according to the possibility of contact between the vehicle and the object, taking into account the correlation between the states of the objects in the relatively distant future.

  An embodiment of a vehicle periphery monitoring system of the present invention will be described with reference to the drawings. As shown in FIG. 1, a vehicle periphery monitoring system 10 and a navigation system (hereinafter referred to as “navigation system”) 20 are mounted on the vehicle 1. A pair of left and right infrared cameras 102 are disposed at the front portion of the vehicle 1 substantially symmetrically with respect to the center in the vehicle width direction. The optical axes of the two infrared cameras 102 are adjusted so that the height from the road surface is equal and parallel to each other.

  A HUD (Head Up Display) 122 is arranged on the front window of the vehicle 1 so as not to obstruct the driver's view. On the HUD 122, an image (image) in front of the vehicle 1 acquired through the infrared camera 102 is displayed. As shown in FIG. 2, the vehicle 1 includes a yaw rate sensor 104 that outputs a signal corresponding to the yaw rate, a speed sensor 106 that outputs a signal corresponding to the speed, and an output of the direction indicator. Various sensors such as a direction indicator sensor 108 that outputs a corresponding signal are mounted.

  The navigation system 20 includes a CPU, a ROM, a memory such as a RAM, a signal input circuit, a signal output circuit, and the like. The navigation system 20 sets a route to the destination set by the user, and displays this route on the navigation display 202 arranged on the console of the vehicle 1. In addition, the navigation system 20 causes the navigation display 202 to display an icon or the like indicating the traveling direction of the vehicle 1 according to the current position of the vehicle 1 measured by GPS and the output of the yaw rate sensor 104.

  The vehicle periphery monitoring system 10 is stored in a computer (comprised of a CPU, ROM, RAM, signal input circuit, signal output circuit, etc.) mounted on the vehicle 1, a memory, etc., and has various functions in the computer. It is comprised by the "vehicle periphery monitoring program" of this invention to provide. The vehicle periphery monitoring program may be stored in the memory of the in-vehicle computer from the beginning, but a part or all of it is downloaded from a predetermined server at an arbitrary timing such as when a request from the driver or the in-vehicle computer is received. May be. As shown in FIG. 2, the vehicle periphery monitoring system 10 includes a first processing unit 11 and a second processing unit 12.

  The first processing unit 11 sequentially measures the positions of a plurality of objects around the vehicle 1 based on the video captured by the infrared camera 102. Further, the first processing unit 11 predicts the “primary state” of each object based on the time-series measurement position of each object. Furthermore, the 1st process part 11 determines the high or low possibility of contacting with the vehicle 1 of each object based on this primary state. Then, the first processing unit 11 causes the HUD 122 to display first information indicating the presence of an object that is likely to contact the vehicle 1 in view of the primary state.

  The second processing unit 12 predicts the “secondary state” of each object based on the correlation of the primary state of each object predicted by the first processing unit 11. Moreover, the 2nd process part 12 determines the high or low possibility of contacting with the vehicle of each object based on this secondary state. Then, the second processing unit 12 causes the HUD 122 to display second information indicating the presence of an object that is likely to contact the vehicle in view of the secondary state.

  The time series measurement position of each object, the predicted primary state and secondary state of each object, the determination result about the level of possibility of contact between the vehicle and each object, and the like are as follows. The processing unit 12 appropriately stores (stores) the data in a memory (not shown) and reads the data from the memory.

  Functions of the vehicle periphery monitoring system 10 having the above-described configuration will be described with reference to FIGS.

  First, the first processing unit 11 executes “first processing” (S11 in FIG. 3).

  The first processing unit 11 measures the real space position of the object included in the video based on the video captured by the pair of infrared cameras 102 (S111 in FIG. 3). As shown in FIG. 1, the real space position is a coordinate system in which the midpoint of the mounting position of the pair of cameras 102 is the origin O, and the horizontal, vertical, and front-back directions are the X, Y, and Z axes, respectively. Means the position in.

  The first processing unit 11 calculates a relative velocity vector of each object with respect to the vehicle 1 based on the time-series measurement position of each object stored in the memory (S112 in FIG. 3). Further, the first processing unit 11 predicts a state in which the calculated relative velocity vector of the object is maintained as it is as the “primary state” of the object (FIG. 3 / S113).

Moreover, the 1st process part 11 determines the level of the contact possibility of the vehicle 1 and each object based on the primary state of each object (FIG. 3 / S114). And when the 1st process part 11 determines with possibility that the vehicle 1 and an object will contact (FIG. 3 / S114 ... YES), it is shown by FIG.6 (c) as 1st information which shows this object. As shown, the orange first frame f ₁ surrounding the object is displayed on the HUD 122 (FIG. 3 / S115).

  Note that the first information may be output from a speaker (not shown) such as “beep”. Further, an icon indicating the position of the object may be displayed on the navigation display 202 as the first information together with an icon indicating the course and position of the vehicle 1.

  The measurement method of the real space position of the object, the determination method of the identity of each object, the calculation method of the relative velocity vector of the object, the determination method of the level of possibility of contact between the vehicle 1 and the object in view of the primary state, etc. Detailed descriptions are described in Patent Document 1 (Japanese Patent Laid-Open No. 2001-6096), Japanese Patent Laid-Open No. 2003-157498, and the like. Therefore, here, detailed description thereof will be omitted, and only a method for determining contact possibility will be briefly described.

As shown in FIG. 4, the product (v _s × T) of the relative speed v _s of the object q such as a two-wheeled vehicle with respect to the vehicle 1 and the margin time T rather than the triangular area A _{0 that} can be monitored by the infrared camera 102. A triangular area (alarm determination area) that is as low as possible is defined. Among the triangular regions, a first region (approaching determination region) A ₁ having a width in the X direction centered on the Z axis of α + 2β (α: vehicle width, β: margin width) and the first region A ₁ The left and right second areas (intrusion determination areas) A _2L and A _2R are defined.

Then, and when the object q is in the first area A _1, there object q is in the second area A ₂ of the left and right, predicted that intruding to the 1A ₁ region in view of the relative velocity vector v _s If it is determined, it is determined that there is a high possibility that the object q and the vehicle 1 are in contact with each other.

  Subsequently, the second processing unit 12 executes “second processing” (S12 in FIG. 3).

The second processing unit 12 predicts the “secondary state” of each object based on the correlation of the primary state of each object predicted by the first processing unit 11 and stored in the memory (FIG. 3 / S121). ). For example, consider a situation in which the vehicle 1, the first object q ₁ and the second object q ₂ are traveling in the Z direction at speeds v ₀ , v ₁ and v ₂ , respectively. If the following requirements 1 to 5 in this situation is met, the first object q ₁ is able to heading change to overtake the second object q ₂ are predicted in the first object q ₁ as the "second state". Incidentally, if the requirements 1 to 5 are satisfied, the second object q ₂ is able to heading change to avoid collision of the first object q ₁ is predicted as "second state" of the second object q ₂ Also good.

(Requirement 1) The vehicle speed in the Z direction is higher than the speeds of the first object q ₁ and the second object q ₂ to some extent.

(Requirement 2) Of the first object q ₁ and the second object q ₂ , the speed of the rear object is somewhat higher than the speed of the front object.

(Requirement 3) The first object q ₁ and the second object q ₂ are both in front of the vehicle 1 and close to some extent in the X and Z directions. For example, both the first object q ₁ and the second object q ₂ are located in the second region A ₂ (see FIG. 4).

(Requirement 4) The distance between the first object q ₁ and the second object q _{2 in} the X direction is within a range where the possibility that the two objects come into contact with each other when the Z coordinates of both the objects are the same. For example, both the first object q ₁ and the second object q ₂ are located in the second region A ₂ on the left and right sides.

(Requirement 5) The rear object of the first object q ₁ and the second object q ₂ and the vehicle 1 are separated to some extent in the Z direction. It should be noted that the criterion for determining the requirement satisfaction can be variably set according to the relative speed between the vehicle 1 and the rear object.

Moreover, the 2nd process part 12 determines the level of possibility that the vehicle 1 and each object will contact based on the secondary state of each object (FIG. 3 / S122). For example, if the first object q ₁ is able to heading change to overtake second object q ₂ is predicted as "second state" of the first object q _1, the vehicle 1 is possible contact between the first object q ₁ It is determined that the property q ₁ is high. Also, if the second object q ₂ is able to heading change to avoid collision of the first object q ₁ is predicted as "second state" of the second object q _2, the vehicle 1 and the second object q ₂ It is determined that the contact possibility q ₁ is high.

If the second processing unit 12 determines that there is a high possibility that the vehicle and the object are in contact with each other in view of the secondary state (FIG. 3 / S122... YES), the second processing unit 12 uses the object as second information indicating the presence of the object. the second frame f ₂ yellow surrounding the display in HUD122 (Figure 3 / S123).

  In addition, as the second information, a voice such as “beep” shorter than the first information may be output from the speaker. Further, an icon indicating the position of the object may be displayed on the navigation display 202 as the second information together with an icon indicating the course and position of the vehicle 1.

As an example, as shown in FIG. 5, the first object q ₁ travels at the speed v ₁ (<v ₀ ) on the front left side of the vehicle 1 traveling in the Z direction at the speed v ₀ , and the first object q the second object q ₂ prior to ₁ consider the situation where traveling at a speed v ₂ (<v _1). In this situation, since the first object q ₁ overtakes the second object q ₂ , the course may be changed as indicated by the broken line in FIG.

In this situation, when it is determined that the first object q ₁ and the second object q ₂ are both less likely to contact the vehicle 1 in view of the primary and secondary states (FIG. 3 / S114... NO, S122. NO), the HUD 122 simply displays the first object q ₁ and the second object q ₂ as shown in FIG.

On the other hand, the first object q ₁ is determined to have a low possibility of contact with the vehicle 1 in view of the primary state (FIG. 3 / S114... NO), and in contact with the vehicle 1 in view of the secondary state. If it is determined that the possibility is low (S122... YES), the yellow second frame (S122... YES) highlights the presence of the first object q ₁ by surrounding the first object q ₁ as shown in FIG. drawing white frame) f ₂ is displayed as "second information".

Then, when the first object q ₁ has actually heading change to the left as indicated by a broken line in FIG. 5, the first object q ₁ is a high possibility of contact between the vehicle 1 in view of the primary state If it is determined (FIG. 3 / S114... YES), the HUD 122 surrounds the first object q ₁ as shown in FIG. The middle black frame) f ₁ is displayed as “first information”.

According to the vehicle periphery monitoring system 10 of the present invention that exhibits the above functions, the possibility of contact with the vehicle 1 is low in view of the primary state of the object, while the contact with the vehicle 1 is possible in view of the secondary state of the object. When the performance is high, the first frame f ₁ (first information) is not displayed on the HUD 122, but the second frame f ₂ (second information) is output (see FIG. 6B). That is, although the possibility of contact with the vehicle 1 is low at this stage, the possibility of contact with the vehicle 1 is high in view of the correlation of the primary state (requirements 1 and 2) with the second object q ₂ in the future. The driver can be informed of the presence of the first object q ₁ that is expected to be.

  Therefore, when there are a plurality of objects in the vicinity of the vehicle 1, it is possible to notify the driver of the presence of an object that is likely to come into contact with the vehicle 1 in consideration of the correlation between the objects in the future. When an image as shown in FIG. 6B is displayed on the HUD 122 and then an image as shown in FIG. 6C is displayed, the image is displayed on the HUD 122 in FIG. 6C. Compared with the case where an image like this is displayed suddenly, the driver can recognize the presence of the object at an early stage, thereby significantly reducing the stress on the driver.

  In addition to the correlation of the primary states of each object (requirements 1 and 2), based on the distance between each object and the vehicle (requirement 3) and the distance between the objects (requirements 4 and 5), Is predicted. This is because in view of the point that there is a high possibility of abruptly changing the state, such as changing the course in the direction where there is a margin when the object has a spatial margin around it. Thus, in addition to the correlation between objects in the future, the driver can be informed early of the existence of an object that is likely to come into contact with the vehicle 1 in consideration of the positional relationship between the objects or the object and the vehicle. (See FIG. 6B).

Further, the colors of the first frame f ₁ (see FIG. 6C) and the second frame f ₂ (see FIG. 6B) displayed on the HUD 122 are differentiated. The possibility that the vehicle 1 and the object whose presence is indicated by the first frame f ₁ based on the primary state predicted based on the time-series measurement position of each object further depends on the primary state. In general, the probability that the vehicle 1 is in contact with an object whose presence is indicated by the second frame f ₂ based on the predicted secondary state is often high. For this reason, it is possible to allow the driver to identify how high the possibility that the vehicle 1 is in contact with the object whose presence is indicated by the frame, and to prompt the driver to take appropriate attention to the object.

  In the above embodiment, the first information is output according to the primary determination result that the vehicle 1 based on the primary state of the object is likely to contact the object (FIG. 3 / S114 YES). , S115, FIG. 6 (c)), as another embodiment, an ECU, a brake mechanism, and a steering mechanism that control the vehicle behavior of the vehicle 1 so that contact with this object can be avoided according to the primary determination result It may be controlled by an in-vehicle device such as.

  In the above embodiment, the second information is output according to the secondary determination result that the vehicle 1 based on the secondary state of the object is likely to contact the object (FIG. 3 / S122... YES) , S123, FIG. 6 (b)), as another embodiment, an ECU, a brake mechanism, and a steering mechanism that control the vehicle behavior of the vehicle 1 so as to avoid contact with this object according to the secondary determination result It may be controlled by a vehicle-mounted device such as a mechanism. Further, the behavior control mode of the vehicle 1 according to the primary determination result and the behavior control mode of the vehicle 1 according to the secondary determination result may be differentiated.

  Further, depending on each of the primary and secondary determination results, the operation of any on-vehicle device may be controlled such that the direction of the on-vehicle light is directed to a region where an object exists (light swivel control). Furthermore, the illumination form represented by the brightness of the light according to the primary determination result and the illumination form by the light according to the secondary determination result may be differentiated.

  Further, as an imaging device, a CCD camera or the like that detects visible light and near infrared light may be employed instead of the infrared camera 102 that detects far infrared light.

  Further, the vehicle periphery monitoring system 10 predicts the tertiary state of each object based on the correlation of the secondary state of each object predicted by the second processing unit 12, and the vehicle based on the tertiary state for each object. A third processing unit that determines whether or not there is a possibility of contact with the vehicle 1 and displays on the HUD 122 or the like third information indicating the presence of an object that is highly likely to contact the vehicle 1 in view of the tertiary state; Also good. Similarly, the vehicle periphery monitoring system 10 may include a further processing unit (a fourth processing unit, a fifth processing unit, or the like) that predicts the state of a higher-order object.

  Thereby, the level of the possibility of contact between the vehicle 1 and the object is evaluated based on the predicted state of the object higher than the second order. Accordingly, it is possible to notify the driver of the existence of an object that may come into contact with the vehicle 1 in consideration of the correlation between the states of objects in a relatively distant future.

1 is a configuration example diagram of a vehicle periphery monitoring system according to the present invention. 1 is a configuration example diagram of a vehicle periphery monitoring system according to the present invention. The function illustration figure of the vehicle periphery monitoring system of this invention. The function illustration figure of the vehicle periphery monitoring system of this invention. The function illustration figure of the vehicle periphery monitoring system of this invention. The function illustration figure of the vehicle periphery monitoring system of this invention.

DESCRIPTION OF SYMBOLS 1 ... Vehicle, 10 ... Vehicle periphery monitoring system, 102 ... Infrared camera (imaging device), 104 ... Yaw rate sensor, 106 ... Speed sensor, 108 ... Direction indicator sensor, 11 ... 1st process part, 111 ... 1st memory | storage part 112, second storage unit, 12 second processing unit, 122 HUD (information output device), 20 navigation system, 202 navigation display (information output device).

Claims (12)

A system for monitoring the surroundings of a vehicle,
The positions of a plurality of objects around the vehicle are measured in time series based on the video captured by the in-vehicle imaging device, and the primary state of each object is determined based on the time-series measurement positions of the objects. A first processing unit that predicts
Based on the correlation of the primary state of each object predicted by the first processing unit, predicts some or all secondary states of the plurality of objects, and based on the secondary state of the object A second processing unit that determines the level of possibility of contact between the vehicle and the object, and controls the operation of the in-vehicle device according to the determination result (hereinafter referred to as “secondary determination result” as appropriate). ,
The second processing unit predicts whether there is a course change or overtaking to avoid contact of the first object with the second object as the secondary state of the first object, and the secondary state of the first object. When the course change or overtaking for avoiding contact with the second object is predicted, it is determined that the vehicle and the first object are likely to contact each other . In the vehicle periphery monitoring system according to claim 1 ,
In addition to the correlation between the primary states of the first object and the second object, the second processing unit adds a distance between the vehicle and the first object or the second object, or the first object and the second object. A vehicle periphery monitoring system that predicts, as the secondary state of the first object, whether there is a course change by the first object or an overtaking of the second object based on a distance from the second object. In the vehicle periphery monitoring system according to claim 1,
Based on the primary state predicted by the first processing unit for each object, the possibility of contact between the vehicle and each object is determined, and the determination result (hereinafter referred to as “primary determination result” as appropriate). The vehicle periphery monitoring system is characterized in that the operation of the in-vehicle device is controlled in accordance with. In the vehicle periphery monitoring system according to claim 3 ,
The second processing unit controls the operation of the same in-vehicle device based on the secondary determination result in a form different from the control form of the operation of the in-vehicle device based on the primary determination result by the first processing unit. Alternatively, the vehicle periphery monitoring system controls an operation of an in-vehicle device different from the in-vehicle device whose operation is controlled by the first processing unit based on a secondary determination result. In the vehicle periphery monitoring system according to claim 1,
If the second processing unit determines that there is a high possibility that the vehicle and the object are in contact with each other based on the secondary state of the object, the vehicle-mounted information output device emphasizes the presence of the object. A vehicle periphery monitoring system characterized in that the vehicle periphery is output. In the vehicle periphery monitoring system according to claim 3 ,
When the first processing unit determines that there is a high possibility that the vehicle and the object are in contact with each other based on the primary state of the object, vehicle-mounted information output device that emphasizes the presence of the object A vehicle periphery monitoring system characterized in that the vehicle periphery is output. The vehicle periphery monitoring system according to claim 6 ,
When the second processing unit determines that there is a high possibility that the vehicle and the object come into contact based on the secondary state of the object, the second processing unit emphasizes the second information that emphasizes the presence of the object. The vehicle periphery monitoring system, wherein the vehicle information output device outputs the information in a form different from the output form of the first information. In the vehicle periphery monitoring system according to claim 1,
The vehicle periphery monitoring system, wherein the second processing unit controls the behavior of the vehicle based on the secondary determination result. In the vehicle periphery monitoring system according to claim 3 ,
The vehicle periphery monitoring system, wherein the first processing unit controls the behavior of the vehicle based on the primary determination result. The vehicle periphery monitoring system according to claim 9 ,
The second processing unit controls the behavior of the vehicle based on the secondary determination result in a mode different from the control mode of the behavior of the vehicle based on the primary determination result by the first processing unit. Vehicle periphery monitoring system. In the vehicle periphery monitoring system according to claim 1,
In addition to the correlation of the primary state of each object predicted by the first processing unit, the second processing unit is configured based on the distance between the vehicle and each object or the distance between objects. A vehicle surroundings monitoring system that predicts the secondary state of the vehicle. In the vehicle periphery monitoring system according to claim 1,
Predicting some or all k + 1 order states of the plurality of objects based on the correlation of the kth order state of each object predicted by the kth processing unit (k = 2, 3,...) A k + 1-th processing unit that determines the possibility of contact between the vehicle and the object based on the k + 1-order state and controls the operation of the in-vehicle device according to the determination result. A vehicle periphery monitoring system that is characterized.

Images