CN110940982B - Vehicle front destination identification method and corresponding device - Google Patents

Vehicle front destination identification method and corresponding device Download PDF

Info

Publication number
CN110940982B
CN110940982B CN201911199145.8A CN201911199145A CN110940982B CN 110940982 B CN110940982 B CN 110940982B CN 201911199145 A CN201911199145 A CN 201911199145A CN 110940982 B CN110940982 B CN 110940982B
Authority
CN
China
Prior art keywords
target
vehicle
main target
searched
running state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911199145.8A
Other languages
Chinese (zh)
Other versions
CN110940982A (en
Inventor
王智平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Roadefend Vision Technology Shanghai Co ltd
Original Assignee
Roadefend Vision Technology Shanghai Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Roadefend Vision Technology Shanghai Co ltd filed Critical Roadefend Vision Technology Shanghai Co ltd
Priority to CN201911199145.8A priority Critical patent/CN110940982B/en
Publication of CN110940982A publication Critical patent/CN110940982A/en
Application granted granted Critical
Publication of CN110940982B publication Critical patent/CN110940982B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles

Abstract

The invention relates to a vehicle front mesh identification method, which comprises the following steps: (1) Collecting target information in front of a vehicle and vehicle information of the vehicle; (2) generating a target list from the target information; (3) Judging the running state of the vehicle according to the vehicle information of the vehicle, wherein the running state of the vehicle comprises a normal running state, a common low-speed running state and a curve low-speed running state; (4) And selecting a main target from the target list by using different target selection strategies according to different driving states of the vehicle. Correspondingly, the invention also relates to a vehicle front destination identification device.

Description

Vehicle front destination identification method and corresponding device
Technical Field
The invention relates to the field of safe driving of vehicles, in particular to the field of forward collision early warning of vehicles. In particular, the invention relates to a vehicle front destination identification method and a corresponding device. It will be apparent to those skilled in the art that the present invention is also applicable to other fields.
Background
With the increasing quantity of automobiles and the rapid development of road transportation industry, the automobiles bring convenience to life and prosperous economy of people and also bring serious challenges to road safety. The vehicle forward collision early warning device is widely applied to the field of vehicle safe driving as a part of a vehicle-mounted monitoring system, and can assist a driver to safely drive a vehicle by combining related technologies such as sensing, communication, control and the like.
At present, the recognition of targets in front of a vehicle by common vehicle forward collision early warning equipment on the market is mainly realized by the following modes: firstly, a front image of a vehicle is acquired through a forward vision sensor, then an image processing technology is used for detecting a target vehicle in the front image of the vehicle, and then the distance between the vehicle and the front vehicle and the running direction of the front vehicle are estimated according to information in the front image of the vehicle, or a radar is further added to improve the ranging precision, so that the target possibly collided is identified and tracked. However, the track of the vehicle in the curve driving process and the track of the target vehicle in front cannot be accurately estimated, and the target vehicle in front of the lane is difficult to effectively identify and track in the curve driving process of the vehicle, so that the common forward collision early warning device of the vehicle is easy to generate false alarm in the curve driving process of the vehicle, the accuracy of the forward collision early warning device of the vehicle is seriously influenced, and the safety of the vehicle in the curve driving process is further influenced.
Chinese patent CN104101878B discloses a method for identifying a target in front of a vehicle, which specifically discloses a method for selecting a target using a radar, which relatively improves the accuracy of radar for identifying a target since the target in a curve is considered and the lateral position of the target in the curve is corrected. However, the method only uses the radar target selecting module alone without combining the vision collecting module, which is disadvantageous to the integrity and accuracy of the candidate target recognition, and at the same time, the method does not divide and recognize the running state of the vehicle more finely, and does not distinguish how to recognize the target in different running states, so that the accuracy of recognizing the target by the method needs to be further improved.
Against this background, there is a need for a vehicle front destination identification method and corresponding apparatus that can satisfy different driving conditions, and can quickly, accurately and inexpensively identify a front destination.
Disclosure of Invention
In view of the foregoing drawbacks of the prior art, the present invention provides a vehicle front end identification method and corresponding apparatus. The vehicle front destination identification method and the corresponding equipment can estimate the driving track and the lane line position of the vehicle by utilizing multi-sensor information and combining the information such as the speed, the yaw rate, the target position information, the movement state and the like, and identify various driving states such as a high-speed state, a low-speed state and a curve state, so as to adopt different target selection strategies according to different driving states, thereby quickly, accurately and cheaply identifying the target of the vehicle.
In one embodiment of the invention, the general idea of the invention is to construct a method or device for identifying the front object of a vehicle, which can combine the advantages of a vision acquisition module and a radar module, and fuse the information acquired by the vision sensor and the radar module, so as to provide a more comprehensive and accurate object identification mode, and distinguish different driving states at the same time, so as to adopt different object identification strategies according to different driving states, thereby further improving the accuracy of object identification, in particular the accuracy of main object identification.
Various embodiments of the vehicle front end identification method and corresponding apparatus according to the present invention will be described in detail below.
Compared with the prior art, the vehicle front end identification method and the corresponding system or device according to the invention have at least the following advantages:
(1) The vehicle front target identification method and the corresponding system or equipment can combine the vision acquisition module and the radar module, thereby improving the comprehensiveness and the accuracy of the identified front target.
(2) According to the method for identifying the front target of the vehicle and the corresponding system or equipment, different driving states can be distinguished, and different target identification strategies are formulated according to the different driving states, so that the accuracy of target identification, in particular the accuracy of main target identification, is further improved. Therefore, the vehicle front destination identification method and the corresponding system or equipment can assist the driver to take collision avoidance measures in time, effectively improve the safety of driving the vehicle and reduce the probability of traffic accidents.
Drawings
The invention is illustrated by way of example, and not by way of limitation, with reference to the accompanying drawings, in which:
Fig. 1 illustrates a flow chart of a vehicle front destination identification method according to the present invention.
Fig. 2 illustrates a graph of a host vehicle and a front target when a running state of the vehicle is a normal running state or a normal low-speed running state in a method of identifying a front target of the vehicle according to the present invention.
Fig. 3 is a graph illustrating a host vehicle and a front target when the driving state of the vehicle is a curve low-speed driving state in the vehicle front target identification method according to the present invention.
Fig. 4 is a flowchart schematically showing a process of selecting a main target from the target list when the running state of the vehicle is a normal running state in the vehicle front destination identification method according to the present invention.
Fig. 5 is a flowchart schematically showing a process of selecting a main target from the target list when the running state of the vehicle is a normal running state in another method of identifying a front target of the vehicle according to the present invention.
Fig. 6 is a flowchart schematically showing a main target selection strategy when the running state of the vehicle is a normal low-speed running state in the vehicle front destination identification method according to the present invention.
Fig. 7 is a flowchart schematically showing a main target selection strategy when the running state of the vehicle is a curve low-speed running state in the vehicle front target identification method according to the present invention.
Fig. 8 schematically shows a schematic configuration of a vehicle front-end identification apparatus according to the present invention.
Detailed Description
Embodiments of the present invention will now be described in detail with reference to examples shown in the drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the embodiments. It will be apparent, however, to one skilled in the art, that the embodiments may be practiced without some or all of these specific details. In other instances, well-known steps and/or structures have not been described in detail in order to not unnecessarily obscure the embodiments. It is to be understood by one of ordinary skill in the art that the present discussion is a description of exemplary embodiments only, and is not intended as limiting the broader scope of the invention, which is embodied in the exemplary steps and/or structures.
Fig. 1 illustrates a flow chart of a vehicle front destination identification method according to the present invention. The vehicle front target identification method shown in fig. 1 can improve the accuracy of vehicle front target identification and reduce the cost of vehicle front target identification on the premise of ensuring the accuracy.
As shown in fig. 1, in one embodiment according to the present invention, the vehicle front end identification method 100 includes the steps of:
(1) Target information in front of the vehicle and vehicle information of the host vehicle are collected, as shown in step 101 in fig. 1. In one embodiment according to the invention, the target information in front of the vehicle may be acquired by an image sensor or a vision sensor, for example by an image sensor or a vision sensor, which image or video contains the target information. In another embodiment according to the invention, the information of the targets in front of the vehicle can also be obtained by means of a radar (for example a millimeter wave radar), which is able to find the targets by means of radio and determine their spatial position. In yet another embodiment according to the invention, the target information in front of the vehicle may be acquired by means of an image sensor and/or a radar. That is, the target information in front of the vehicle may be acquired by a combination of an image sensor and a radar (i.e., by a combination of two sensor technologies), and then the target information may be extracted by using a sensor fusion technology. Here, the target information includes at least position information of the target, a motion state of the target, and a duration of time the target appears in the effective view. In one embodiment according to the present invention, the vehicle information of the host vehicle includes at least the vehicle speed and the yaw rate of the host vehicle. The speed of the vehicle can be obtained by a wheel speed sensor. The yaw rate of the host vehicle can be obtained by a gyroscope and an acceleration sensor.
(2) A target list is generated from the target information, as shown in step 102 in fig. 1. In a vehicle front image or video obtained by an image sensor or a vision sensor, there may be a plurality of vehicle front targets, and at the same time, for each target, a plurality of information items or information items of each target may need to be detected and monitored. According to one embodiment of the present invention, in order to facilitate classification, display, extraction, calculation, and analysis of the target information, a target list may be generated from the target information. In one embodiment according to the invention, generating the target list from the target information may be implemented by a sensor fusion technique.
(3) The running state of the host vehicle is determined based on the vehicle information of the host vehicle, as shown in step 103 in fig. 1. In one embodiment according to the present invention, the running state of the host vehicle includes a normal running state, a normal low-speed running state, and a curve low-speed running state. For example, in finely dividing and identifying the vehicle running state, the discrimination criteria of the vehicle running state are: if the speed of the vehicle is greater than a preset speed threshold, for example, the speed of the vehicle is more than 35km/h (kilometers per hour), judging that the running state of the vehicle is a normal running state; if the vehicle speed of the host vehicle is equal to or greater than 0 and equal to or less than the preset speed threshold, for example, 0km/h is equal to or less than 35km/h of the host vehicle, further judging whether the yaw rate of the host vehicle is greater than the preset yaw rate threshold, for example, 0.07rad/s (radian per second), and simultaneously judging whether the absolute value of the coordinates of the object in front of the host vehicle in the Y direction in a vehicle body coordinate system (SAE coordinate system) defined by SAE (Society of Automotive Engineers, namely, society of automotive engineers) is greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, and if the yaw rate of the host vehicle is greater than the preset yaw rate threshold (for example, 0.07 rad/s) and simultaneously the absolute value of the coordinates of the object in front of the host vehicle in the Y direction in the SAE coordinate system is also greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, judging that the running state of the host vehicle is a low-speed running state; otherwise, judging the running state of the vehicle to be a common low-speed running state. That is, the running state of the host vehicle is determined as the curve low-speed running state only when the above-described requirements are satisfied by all of the vehicle speed of the host vehicle, the yaw rate of the host vehicle, and the absolute value of the coordinates of the target ahead of the host vehicle in the SAE coordinate system in the Y direction, and otherwise, the running state of the host vehicle is determined as the normal low-speed running state. For example, in one embodiment according to the present invention, if the vehicle speed of the host vehicle is 60km/h (here, the preset speed threshold value is 35 km/h), the running state of the host vehicle may be determined to be the normal running state. Since the vehicle generally runs at a reduced speed while turning, the situation in which the vehicle is running while turning is considered only when the vehicle speed is at a low speed. For another example, in one embodiment according to the present invention, if the vehicle speed of the host vehicle is 25km/h while the yaw rate of the host vehicle is 0.08rad/s (here, the preset speed threshold is 35km/h and the preset yaw rate threshold is 0.07 rad/s) and while the absolute value of the coordinates of the object in front of the host vehicle in the SAE coordinate system in the Y direction is greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, the running state of the host vehicle is determined to be the curve low-speed running state. For another example, in one embodiment according to the present invention, if the vehicle speed of the host vehicle is 0km/h, the yaw rate of the host vehicle is 0rad/s, and at the same time, the absolute value of the coordinates of the object in front of the host vehicle in the Y direction in the SAE coordinate system is equal to the absolute value of the coordinates of the object in the Y direction in the previous frame image, the running state of the host vehicle is determined to be the normal low-speed running state. It can be seen that the normal low-speed running state includes a state in which the host vehicle is stationary, for example, a state in which the host vehicle is at a red light, which means that the vehicle front destination identification method according to the present invention can continue to select the destination without stopping the operation even in the case where the vehicle is stationary. Regarding the SAE body coordinate system, the person skilled in the art can refer to the well-known prior art (e.g. website: http:// www.360doc.com/content/17/0225/08/40003352_631837542. Shtml) and will not be described in detail here.
It is obvious to a person skilled in the art that the preset speed threshold and the preset yaw-rate threshold are both variable, and that a person skilled in the art can freely choose specific values of the preset speed threshold and the preset yaw-rate threshold according to the actual needs or specific requirements. For example, the preset speed threshold may be 35km/h, 40km/h, 45km/h, 50km/h, etc., while the preset yaw rate threshold may be 0.07rad/s, 0.08rad/s, 0.09rad/s, etc.
(4) Depending on the different driving states of the host vehicle, different target selection strategies are used to select the main target from the target list, as shown in step 104 of fig. 1. In a front image or video of a vehicle obtained by an image sensor or a vision sensor, there may be a plurality of front targets of the vehicle, and in order to avoid collision with the front targets and to monitor and track collision risk in real time, it is necessary to preferentially identify a main target most likely to collide with the host vehicle. In one embodiment according to the invention, the choice of primary target priority from the target list is determined by: (1) the distance between the target and the host vehicle; (2) whether the location of the target is within the own lane; (3) confidence of the target; and (4) the number of image frames in which the target is continuously selected as the own-lane target. In one embodiment according to the present invention, the order and/or priority of the above four factors may be set according to importance or actual needs. In an embodiment according to the invention, the primary target selected from the list of targets is provided with at least the following features: the distance between the target and the host vehicle is the smallest. Further, when a main target is selected from the target list, it is necessary to determine whether or not the position of the target ahead of the vehicle is within the own lane. With respect to confidence, it will be readily appreciated by those skilled in the art that confidence indicates how well a certain event is trustworthy. When detecting or judging whether the target appears in the image or video in front of the vehicle, the confidence level needs to be used to give the detection result or the reliability level of the judgment result. The confidence level shows the accuracy of the detection result or the judgment result. For example, when the primary target is selected, a preset confidence threshold value needs to be set, and the preset confidence threshold value is related to the running state of the vehicle (i.e., the own vehicle). For example, in one embodiment according to the present invention, when the running state of the vehicle is a normal running state, the main target selected from the target list requires: the confidence level of the target is greater than or equal to 0.8 (i.e., the preset confidence threshold is 0.8). For another example, when the running state of the vehicle is a normal low-speed running state, the main target selected from the target list requires: the confidence level of the target is greater than or equal to 0.6 (i.e., the preset confidence threshold is 0.6). The confidence level of the target may be obtained by various image detection methods or other ways, and will not be described in detail herein. In one embodiment according to the invention, the confidence level of the target is preferentially dependent on the following factors: (1) whether the target is detected by an image detection algorithm; (2) whether the target is detected by radar; (3) whether the target is in motion; and (4) the duration of time that the target is present within the effective FOV. In one embodiment according to the present invention, the order and/or priority of the above four factors may be set according to importance or actual needs. In an embodiment according to the invention, the primary object selected from the list of objects is for example further characterized by: the number of image frames in which the target is consecutively selected as the own lane target is greater than or equal to a preset frame number threshold, for example, 20 frames.
Only when the object in the object list meets a preset condition (preset condition), it is selected as the master object in the object list. In colloquial terms, the predetermined condition is a threshold for screening the primary target. The preset condition is formed by arranging and combining at least two factors in a priority order and/or other required orders. For example, in one embodiment according to the present invention, the primary targets selected as in the target list are required to meet the following preset conditions: (1) The distance between the target and the host vehicle is the smallest and (2) the position of the target is within the host lane. For another example, in a specific embodiment according to the present invention, the following preset conditions need to be met for the primary target in the target list: (1) the distance between the target and the host vehicle is the smallest; (2) the location of the target is within the host lane; and (3) the confidence level of the target is greater than or equal to a preset confidence threshold, such as greater than or equal to 0.8. For another example, in a specific embodiment according to the present invention, the following preset conditions need to be met for the primary target in the target list: (1) the distance between the target and the host vehicle is the smallest; (2) the location of the target is within the host lane; (3) The confidence level of the target is greater than or equal to a preset confidence threshold, such as greater than or equal to 0.7; and (4) the number of frames of the image of which the target is continuously selected as the own-lane target is greater than or equal to a preset frame number threshold, for example, 30 frames. Under different road scenes, different preset conditions can be set according to different target detection and tracking requirements to screen the main target.
Fig. 2 illustrates a graph of a host vehicle and a front target when a running state of the vehicle is a normal running state or a normal low-speed running state in a method of identifying a front target of the vehicle according to the present invention. According to one embodiment of the present invention, when the running state of the vehicle is a normal running state or a normal low-speed running state (e.g., straight running), the method for determining whether the position of the vehicle front target is within the own lane is: the method comprises the steps of establishing a plane rectangular coordinate system XOY by taking a vehicle position as an origin O, wherein the plane rectangular coordinate system XOY is an XOY plane in an SAE coordinate system, the positive X-axis direction of the plane rectangular coordinate system XOY is the advancing direction (horizontally pointing forward) of a vehicle running track, the positive Y-axis direction of the plane rectangular coordinate system XOY is the right-side direction perpendicular to the X-axis in a vehicle body plane, and the coordinates of a target are marked as (Y, X), as shown in fig. 2, and the width w of a virtual lane line of the position of the target can be calculated according to a formula w= (0.015 x+0.85) X2. Here, the virtual lane line is actually fitted by an algorithm (e.g., an image recognition algorithm), and is not a physical lane line printed on an actual driving surface, because a large error is caused by using the printed physical lane line when determining whether a target (e.g., a preceding vehicle) is within the own lane. For example, based on the characteristics of millimeter wave radar, the farther from the host vehicle the target its lateral error is greater, e.g., the lateral error of the target 20 meters in front may be plus or minus 0.5 meters, while the target lateral error 120 meters in front may reach plus or minus 2 meters, which is already over half the conventional lane line width. In addition, in certain situations or in certain places, the printed physical lane lines do not have to be present. According to the present invention, the position of the vehicle front target can be more accurately and conveniently determined by means of the virtual lane line. In one embodiment according to the present invention, the own vehicle running track is set as the center line of the virtual lane line. And if the distance between the target and the central line of the virtual lane line is smaller than half of the width of the virtual lane line, judging that the target is in the own lane, otherwise, judging that the target is not in the own lane. The above-described method for determining whether the position of the vehicle front target is within the own lane according to the present invention can realize accurate determination of the position of the vehicle front target with simple operation at low cost. In practical application, the method for judging whether the position of the front target of the vehicle is in the lane according to the invention can enable the accuracy of judging the position of the front target of the vehicle to reach more than 95% when the vehicle is in a normal running state or a normal low-speed running state.
Fig. 3 is a graph illustrating a host vehicle and a front target when the driving state of the vehicle is a curve low-speed driving state in the vehicle front target identification method according to the present invention. In general, when the vehicle turns, the vehicle travel locus can be regarded as circular motion. For example, as shown in fig. 3, regarding a curve low-speed running state of a vehicle as a circular motion, according to one embodiment of the present invention, when the running state of the vehicle is a curve low-speed running state, a method for judging whether or not a position of a target ahead of the vehicle is within a host lane is: the method comprises the steps of establishing a plane rectangular coordinate system XOY (namely an XOY plane in an SAE coordinate system) by taking the position of the vehicle as an origin O, wherein an arc line OA is a running track of the vehicle, the positive X-axis direction of the plane rectangular coordinate system XOY is the tangential direction of the arc line OA (tangential point is the origin O), the positive Y-axis direction of the plane rectangular coordinate system XOY is the right-side direction perpendicular to the X-axis in the plane of the vehicle body, and the center coordinate of a virtual circle where the running track OA is located is (r, 0). In the embodiment shown in fig. 3, the arc line CD is a target running track, the target coordinates are (y, x), and the center coordinates of a virtual circle where the target running track CD is located are also (r, 0). It can be seen that, in the embodiment shown in fig. 3, the virtual circle where the own vehicle running track OA is located and the virtual circle where the target running track CD is located are concentric circles whose center coordinates are (r, 0). It will be readily appreciated by those skilled in the art that the value of r is generally large, so that it is reasonable to reduce the model of the two travel tracks to concentric circles and to make the calculation of the correlation simple. After establishing a planar rectangular coordinate system XOY with the host vehicle position and the host vehicle travel track and marking the coordinate position of the target, the radius of curvature r of the host vehicle travel track is calculated according to the formula r=v/ω (i.e., host vehicle Turning radius r), where v represents the speed of the host vehicle, ω represents the yaw rate of the host vehicle, and then, according to the formulaTo calculate the radius of curvature r1 of the target travel track (i.e., the turning radius r1 of the target), and then to calculate the radius of curvature of the target travel track according to the formula w= (0.015 x r x arcsin (x/γ 1 ) +0.85) x 2 to calculate the width w of the virtual lane line where the target is located. Here, the virtual lane line is actually fitted by an algorithm (e.g., an image recognition algorithm), and is not a physical lane line printed on an actual driving surface, because a large error is caused by using the printed physical lane line when determining whether a target (e.g., a preceding vehicle) is within the own lane. In addition, in certain situations or in certain places, the printed physical lane lines do not have to be present. According to the present invention, the position of the vehicle front target can be more accurately and conveniently determined by means of the virtual lane line. In one embodiment according to the present invention, the own vehicle running track is set as the center line of the virtual lane line. And if the distance between the target and the central line of the virtual lane line is smaller than half of the width of the virtual lane line, judging that the target is in the own lane, otherwise, judging that the target is not in the own lane. The above-described method for determining whether the position of the vehicle front target is within the own lane according to the present invention can realize accurate determination of the position of the vehicle front target with simple operation at low cost. In practical application, the method for judging whether the position of the object in front of the vehicle is in the own lane according to the invention can enable the accuracy of judging the position of the object in front of the vehicle to reach more than 90% when the vehicle is in the curve low-speed driving state.
Fig. 4 illustrates a flowchart of selecting a primary target from the target list (i.e., a flowchart of a primary target selection strategy 400) when the driving state of the vehicle is a normal driving state in the vehicle front destination identification method according to the present invention. According to one embodiment of the present invention, when the driving state of the host vehicle is the normal driving state, searching the target list for a main target, judging whether the main target is successfully searched in the normal driving state (as shown in step 401 of fig. 4), if the main target meeting the preset condition is successfully searched in the target list (i.e., there is a main target meeting the preset condition in the target list), further judging whether the searched main target is identical to the main target selected in the previous frame image (as shown in step 402 of fig. 4), if the searched main target is identical to the main target selected in the previous frame image (as shown in step 403 of fig. 4), if the searched main target is not identical to the main target selected in the current frame image (as shown in step 403 of fig. 4), further judging whether the searched main target triggers an alarm or has a preset confidence (as shown in step 406 of fig. 4), wherein the preset confidence value is a preset confidence value, for example, if the searched main target is not 0, if the main target is not selected in the preset frame image (as shown in step 407), further judging whether the main target is not selected in the previous frame image (as shown in fig. 4), then the selected main target in the previous frame image is selected as the main target of the current frame image (as shown in step 410 in fig. 4), and if the selected main target does not exist in the previous frame image, the searched main target is selected as the main target of the current frame image (as shown in step 408 in fig. 4); if the main target meeting the preset condition is not successfully searched in the target list, step 601 is entered: it is determined whether the main target is successfully searched in the normal low-speed running state as shown in step 601 in fig. 4, 5 and 6.
Fig. 5 illustrates a flowchart of a main target selection strategy 500 when the driving state of the vehicle is a normal driving state in another vehicle front destination identification method according to the present invention. The primary target selection policy 500 shown in fig. 5 differs from the primary target selection policy 400 shown in fig. 4 in that the primary target selection policy 500 shown in fig. 5 further comprises step 404: determining whether the searched main target is identical to the candidate target and step 405: and taking the searched main target as a new candidate target, wherein the candidate target is a target with the position in the lane and the smallest distance with the vehicle. In most cases, the candidate target is the same target as the main target that meets the preset condition. As shown in fig. 5, the main target selection policy 500 searches the target list for a main target when the driving state of the host vehicle is the normal driving state, determines whether the main target is successfully searched in the normal driving state (as shown in step 401 in fig. 5), if the main target meeting the preset condition is successfully searched in the target list (i.e., there is a main target meeting the preset condition in the target list), further determines whether the searched main target is the same as the main target selected in the previous frame image (as shown in step 402 in fig. 5), if the searched main target is the same as the main target selected in the previous frame image, then selects the searched main target as the main target of the current frame image (as shown in step 403 in fig. 5), if the searched main target is not the same as the main target selected in the previous frame image, then further compares the searched main target with a candidate target (as shown in step 404 in fig. 5), wherein the candidate target is the position and the distance between the host vehicle and the selected main target is the same as the preset target (i.0, and the confidence value of the candidate is increased by, for example, if the searched main target is the same as the candidate target is the smallest (step 0.406) and the candidate target is the same as the target of the candidate target of the current frame image is increased (step 0): judging whether the searched main target triggers an alarm or has a preset confidence, if the searched main target is not the same as the candidate target (i.e. the searched main target and the candidate target are not the same target), taking the searched main target as a new candidate target (as shown in step 405 in fig. 5) and entering step 406: further determining whether the searched main target triggers an alarm or has a preset confidence (as shown in step 406 in fig. 5), wherein the preset confidence refers to a preset high confidence, for example, the confidence value is not less than 0.8), if the searched main target triggers an alarm or has a preset confidence, selecting the searched main target as a main target of a current frame image (as shown in step 409 in fig. 5), if the searched main target does not trigger an alarm and does not have a preset confidence, further determining whether a selected main target exists in a previous frame image (as shown in step 407 in fig. 5), if the selected main target exists in the previous frame image, selecting the selected main target in the previous frame image as a main target of the current frame image (as shown in step 410 in fig. 5), and if the selected main target does not exist in the previous frame image, selecting the searched main target as a main target of the current frame image (as shown in step 408 in fig. 5); if the main target meeting the preset condition is not successfully searched in the target list, step 601 is entered: it is determined whether the main target is successfully searched in the normal low-speed running state as shown in step 601 in fig. 4, 5 and 6. By introducing the candidate target and comparing the main target meeting the preset condition with the candidate target, the accuracy and stability of the selected main target can be effectively improved, and particularly, detection or tracking errors when the main target is selected can be effectively avoided. According to one embodiment of the present invention, for each frame of image acquired by the image sensor or the vision sensor, the main object in the image is searched by using the main object selection strategy according to the present invention, wherein the candidate object is the object closest to the own lane in the current frame of image, the main object may be the object closest to the own lane in which all of the consecutive several frames of images exist stably in the image, and if one object is not in the own lane nor is the object closest to the own lane in the current frame of image, but is considered as the object closest to the own lane in the previous consecutive several frames of images, the reason for this is likely due to erroneous detection or tracking error. Since a situation that may occur when a detection error or a tracking error occurs is that the main target found by searching in the current frame image is different from the main target selected in the previous frame image, although the previous target is not actually changed, the candidate target, which is the target most likely to replace the current main target, may be introduced in order to avoid such a detection error or tracking error.
Fig. 6 illustrates a flowchart of a main target selection strategy 600 when the driving state of the vehicle is a normal low-speed driving state in the vehicle front destination identification method according to the present invention. According to a specific embodiment of the present invention, when the driving state of the host vehicle is a normal low-speed driving state, searching a main target in the target list, judging whether the main target is successfully searched in the normal low-speed driving state (as shown in step 601 in fig. 6), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (as shown in step 602 in fig. 6); if the main target meeting the preset condition is not successfully searched in the target list, the step 701 is entered: it is determined whether the main target is successfully searched in the curve low-speed running state (as shown in step 701 in fig. 6 and 7). In a specific embodiment, the main target is searched in a normal low-speed driving state, and the preset condition of the main target can be appropriately adjusted, for example, the preset confidence threshold of the target is reduced to 0.7.
Fig. 7 illustrates a flowchart of a main target selection strategy 700 when the driving state of the vehicle is a curve low-speed driving state in the vehicle front target identification method according to the present invention. According to a specific embodiment of the present invention, when the driving state of the host vehicle is a curve low-speed driving state, searching a main target in the target list, judging whether the main target is successfully searched in the curve low-speed driving state (as shown in step 701 in fig. 7), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (as shown in step 704 in fig. 7); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether a selected main target exists in the previous frame image (as shown in step 702 in fig. 7), if the selected main target exists in the previous frame image, selecting the selected main target in the previous frame image as the main target of the current frame image (as shown in step 705 in fig. 7), and if the selected main target does not exist in the previous frame image, returning and displaying the result: the present search does not find the primary target, as shown in step 703 of FIG. 7.
Fig. 8 schematically shows a schematic configuration of a vehicle front-end identification apparatus according to the present invention. The vehicle front target identification apparatus according to the present invention can accurately and inexpensively realize the identification of the vehicle front target. The vehicle front end identification apparatus according to the present invention corresponds to the vehicle front end identification method according to the present invention, and in order to avoid making the detailed description difficult to understand and unnecessarily repeated, it is easy for those skilled in the art to understand that part or all of the details of the vehicle front end identification apparatus according to the present invention may refer to the vehicle front end identification method according to the present invention. As shown in fig. 8, the vehicle front-end identification apparatus 800 includes at least: an information acquisition unit 801, wherein the information acquisition unit 801 is used for acquiring target information in front of a vehicle and vehicle information of the vehicle; a storage unit 802, wherein the storage unit 802 is at least used for storing target information in front of the vehicle and vehicle information of the vehicle; a processing unit 803, where the processing unit 803 is at least configured to generate a target list according to the target information; a running state judgment unit 804, wherein the running state judgment unit 804 is used for judging the running state of the own vehicle according to the vehicle information of the own vehicle, and the running state of the own vehicle comprises a normal running state, a normal low-speed running state and a curve low-speed running state; a target selecting unit 805, where the target selecting unit 805 is configured to select a main target from the target list using different target selection policies according to different driving states of the host vehicle, where the target selection policies include: when the running state of the host vehicle is in a normal running state, searching a main target in the target list, judging whether the main target is successfully searched in the normal running state (corresponding to a method step 401), further judging whether the searched main target is the same as the main target selected in the previous frame image (corresponding to a method step 402) if the main target is successfully searched in the target list and meets the preset condition (corresponding to the method step 406), selecting the searched main target as the main target of the current frame image (corresponding to the method step 403) if the main target is the same as the main target selected in the previous frame image, further judging whether the searched main target triggers an alarm or has the preset confidence (corresponding to the method step 406) if the main target is not the main target selected in the previous frame image, further judging whether the main target is the main target selected in the previous frame image (corresponding to the method step 410) if the main target is not preset and does not trigger an alarm or has the preset confidence (corresponding to the method step 409), then the searched primary object is selected as the current frame image primary object (corresponding to method step 408); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the normal low-speed driving state (corresponding to the method step 601); when the running state of the vehicle is a common low-speed running state, searching a main target in the target list, judging whether the main target is successfully searched in the common low-speed running state (corresponding to the method step 601), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (corresponding to the method step 602); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the curve low-speed driving state (corresponding to the method step 701); and searching a main target in the target list when the running state of the vehicle is a curve low-speed running state, judging whether the main target is successfully searched in the curve low-speed running state (corresponding to the method step 701), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (corresponding to the method step 704); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether a selected main target exists in the previous frame image (corresponding to a method step 702), selecting the selected main target in the previous frame image as the main target of the current frame image (corresponding to a method step 705) if the selected main target exists in the previous frame image, and returning and displaying a result if the selected main target does not exist in the previous frame image: the present search does not find a primary target (corresponding to method step 703).
According to one embodiment of the invention, the information acquisition unit 801 comprises an image sensor and/or radar for acquiring target information in front of the vehicle. The information acquisition unit 801 includes a vehicle information acquisition device, where the vehicle information acquisition device is configured to acquire vehicle information of the host vehicle, and the vehicle information of the host vehicle includes at least a vehicle speed and a yaw rate of the host vehicle. According to one embodiment of the present invention, the information acquisition unit 801 includes a wheel speed sensor for acquiring a vehicle speed of the host vehicle. According to one embodiment of the present invention, the information acquisition unit 801 includes a gyroscope and an acceleration sensor for acquiring a yaw rate of the host vehicle.
According to an embodiment of the present invention, the determination condition of the running state of the host vehicle is: if the speed of the vehicle is greater than a preset speed threshold, judging that the running state of the vehicle is a normal running state; if the speed of the vehicle is greater than or equal to 0 and less than or equal to the preset speed threshold, further judging whether the yaw rate of the vehicle is greater than the preset yaw rate threshold, and simultaneously judging whether the absolute value of the coordinates of the front object of the vehicle in the Y direction in the SAE defined vehicle body coordinate system is greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, and if the yaw rate of the vehicle is greater than the preset yaw rate threshold and simultaneously the absolute value of the coordinates of the front object of the vehicle in the Y direction in the SAE coordinate system is also greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, judging that the running state of the vehicle is a curve low-speed running state; otherwise, judging the running state of the vehicle to be a common low-speed running state.
According to one embodiment of the invention, the primary target meets the following preset conditions: (1) the distance between the target and the host vehicle is the smallest; and (2) the location of the target is within the own lane.
According to another embodiment of the invention, the primary target meets the following preset conditions: (1) the distance between the target and the host vehicle is the smallest; (2) the location of the target is within the host lane; (3) The confidence coefficient of the target is larger than or equal to a preset confidence coefficient threshold value; and/or (4) the number of frames of the image of the target continuously selected as the own lane target is greater than or equal to a preset frame number threshold.
According to an embodiment of the present invention, when the running state of the vehicle is a normal running state or a normal low-speed running state, the method for judging whether the position of the object in front of the vehicle is within the own lane is: and establishing a plane rectangular coordinate system XOY by taking the position of the vehicle as an origin O, wherein the plane rectangular coordinate system XOY is an XOY plane in an SAE coordinate system, the positive X-axis direction of the plane rectangular coordinate system XOY is the advancing direction (horizontally directed forward) of the driving track of the vehicle, the positive Y-axis direction of the plane rectangular coordinate system XOY is the right-side direction perpendicular to the X-axis in the plane of the vehicle body, the coordinate mark of the object is (Y, X), the width w of a virtual lane line where the object is positioned is calculated according to the formula w= (0.015 x+0.85) X2, the driving track of the vehicle is set as the center line of the virtual lane line, if the distance between the object and the center line of the virtual lane line is smaller than half of the width of the virtual lane line, the object is judged to be in the lane, otherwise, the object is judged not to be in the lane.
According to an embodiment of the present invention, when the running state of the vehicle is a curve low-speed running state, the method for determining whether the position of the object in front of the vehicle is within the own lane by regarding the curve low-speed running track of the vehicle as circular motion is: taking the position of the vehicle asThe origin O establishes a plane rectangular coordinate system XOY which is an XOY plane in an SAE coordinate system, the positive X-axis direction of the plane rectangular coordinate system XOY is the tangential direction of the running track of the vehicle, the tangential point is the origin O, the positive Y-axis direction of the plane rectangular coordinate system XOY is the right-side direction perpendicular to the X-axis in the plane of the vehicle body, the center coordinate of a virtual circle where the running track of the vehicle is located is (r, 0), the target coordinate is (Y, X), the center coordinate of a virtual circle where the running track of the target is located is (r, 0), wherein the virtual circle where the running track of the vehicle is located and the virtual circle where the running track of the target is located are concentric circles with the center coordinate of (r, 0), after the plane rectangular coordinate system XOY is established by the vehicle position and the running track of the vehicle and the coordinate position of the target is marked, the turning radius r of the running track of the vehicle is calculated according to the formula r=v/ω, wherein v represents the vehicle speed of the vehicle, ω Representing the yaw rate of the vehicle and then according to the formulaCalculating the turning radius r1 of the target running track, and calculating the width w of a virtual lane line of the position of the target according to a formula w= (0.015 x r x arcsin (x/gamma 1) +0.85) x 2, wherein the running track of the host vehicle is set as the center line of the virtual lane line, if the distance between the target and the center line of the virtual lane line is smaller than half of the width of the virtual lane line, the target is judged to be in the host vehicle lane, otherwise, the target is judged not to be in the host vehicle lane.
According to another embodiment of the present invention, a vehicle front-end apparatus according to the present invention includes: the information acquisition unit is used for acquiring target information in front of the vehicle and vehicle information of the vehicle; a storage unit configured to store at least target information in front of the vehicle and vehicle information of the host vehicle; the processing unit is at least used for generating a target list according to the target information; the driving state judging unit is used for judging the driving state of the vehicle according to the vehicle information of the vehicle, and the driving state of the vehicle comprises a normal driving state, a normal low-speed driving state and a curve low-speed driving state; the target selection unit is used for selecting a main target from the target list by using different target selection strategies according to different driving states of the vehicle, wherein the target selection strategies comprise the following steps: searching for a primary target in the target list when the driving state of the host vehicle is in a normal driving state, judging whether the primary target is successfully searched in the normal driving state (corresponding to method step 401), further judging whether the searched primary target is the same as the selected primary target in the previous frame image if the primary target is successfully searched in the target list and meets the preset condition (corresponding to method step 402), selecting the searched primary target as the primary target of the current frame image if the searched primary target is the same as the selected primary target in the previous frame image (corresponding to method step 403), further comparing the searched primary target with a candidate target if the searched primary target is not the same as the selected primary target in the previous frame image (corresponding to method step 404), judging whether the searched primary target is the target with the smallest distance between the host vehicle and the host vehicle, increasing the confidence level of the searched primary target to the candidate target (corresponding to method step 406), judging whether the searched primary target has the preset confidence level and has the preset confidence level increased and the alarm threshold value (corresponding to method step 406) or not triggering the method step 406), if the searched main target triggers an alarm or has a preset confidence, the searched main target is selected as the main target of the current frame image (corresponding to a method step 409), if the searched main target does not trigger an alarm and does not have a preset confidence, whether the selected main target exists in the previous frame image (corresponding to a method step 407), if the selected main target exists in the previous frame image, the selected main target in the previous frame image is selected as the main target of the current frame image (corresponding to a method step 410), and if the selected main target does not exist in the previous frame image, the searched main target is selected as the main target of the current frame image (corresponding to a method step 408); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the normal low-speed driving state (corresponding to the method step 601); when the running state of the vehicle is a common low-speed running state, searching a main target in the target list, judging whether the main target is successfully searched in the common low-speed running state (corresponding to the method step 601), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (corresponding to the method step 602); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the curve low-speed driving state (corresponding to the method step 701); and searching a main target in the target list when the running state of the vehicle is a curve low-speed running state, judging whether the main target is successfully searched in the curve low-speed running state (corresponding to the method step 701), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (corresponding to the method step 704); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether a selected main target exists in the previous frame image (corresponding to a method step 702), selecting the selected main target in the previous frame image as the main target of the current frame image (corresponding to a method step 705) if the selected main target exists in the previous frame image, and returning and displaying a result if the selected main target does not exist in the previous frame image: the present search does not find a primary target (corresponding to method step 703).
It will be apparent to those skilled in the art that numerous modifications and variations can be made to the embodiments described herein without departing from the spirit and scope of the claimed subject matter. Accordingly, the specification is intended to cover various embodiments and adaptations of the various embodiments described herein, provided such modifications and variations are within the scope of the appended claims and their equivalents.

Claims (22)

1. A vehicle front-end identification method, the vehicle front-end identification method comprising the steps of:
(1) Collecting target information in front of a vehicle and vehicle information of the vehicle;
(2) Generating a target list according to the target information;
(3) Judging the running state of the vehicle according to the vehicle information of the vehicle, wherein the running state of the vehicle comprises a normal running state, a common low-speed running state and a curve low-speed running state;
(4) Selecting a main target from the target list by using different target selection strategies according to different driving states of the vehicle, wherein the target selection strategies comprise:
(4-1) when the running state of the host vehicle is a normal running state, searching a main target in the target list, judging whether the main target is successfully searched in the normal running state (401), if the main target which meets the preset condition is successfully searched in the target list, further judging whether the searched main target is identical to the main target selected in the previous frame image (402), if the searched main target is identical to the main target selected in the previous frame image, the main target is selected as the main target of the current frame image (403), if the searched main target is not identical to the main target selected in the previous frame image, further judging whether the searched main target triggers an alarm or has the preset confidence (406), if the searched main target triggers an alarm or has the preset confidence, selecting the searched main target as the main target of the current frame image (409), if the searched main target does not trigger an alarm and does not have the preset confidence, further judging whether the main target selected in the previous frame image is the main target selected in the previous frame image (408), and if the main target selected in the previous frame image is not selected (410); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the normal low-speed running state (601);
(4-2) searching a main target in the target list when the running state of the host vehicle is a normal low-speed running state, judging whether the main target is successfully searched in the normal low-speed running state (601), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (602); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the curve low-speed driving state (701); and
(4-3) searching a main target in the target list when the running state of the vehicle is a curve low-speed running state, judging whether the main target is successfully searched in the curve low-speed running state (701), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (704); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether a selected main target exists in the previous frame image (702), selecting the selected main target in the previous frame image as the main target of the current frame image (705) if the selected main target exists in the previous frame image, and returning and displaying a result if the selected main target does not exist in the previous frame image: the current search does not find the primary target (703).
2. The vehicle front destination identification method according to claim 1, characterized in that the target information in front of the vehicle is acquired by an image sensor and/or a radar.
3. The vehicle front destination identification method as recited in claim 1, wherein the vehicle information of the host vehicle includes at least a vehicle speed and a yaw rate of the host vehicle.
4. A vehicle front destination identification method as claimed in claim 3, characterized in that the vehicle speed of the own vehicle is obtained by a wheel speed sensor.
5. A vehicle front mesh identification method according to claim 3, characterized in that the yaw rate of the host vehicle is acquired by a gyroscope and an acceleration sensor.
6. The vehicle front end identification method according to one of claims 1 to 5, characterized in that the determination condition of the running state of the host vehicle is:
if the speed of the vehicle is greater than a preset speed threshold, judging that the running state of the vehicle is a normal running state;
if the speed of the vehicle is greater than or equal to 0 and less than or equal to the preset speed threshold, further judging whether the yaw rate of the vehicle is greater than the preset yaw rate threshold, and simultaneously judging whether the absolute value of the coordinates of the front object of the vehicle in the Y direction in the SAE defined vehicle body coordinate system is greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, and if the yaw rate of the vehicle is greater than the preset yaw rate threshold and simultaneously the absolute value of the coordinates of the front object of the vehicle in the Y direction in the SAE coordinate system is also greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, judging that the running state of the vehicle is a curve low-speed running state;
Otherwise, judging the running state of the vehicle to be a common low-speed running state.
7. The vehicle front-end identification method according to one of claims 1 to 5, characterized in that the main target meets the following preset conditions: (1) the distance between the target and the host vehicle is the smallest; and (2) the location of the target is within the own lane.
8. The vehicle front-end identification method according to one of claims 1 to 5, characterized in that the main target meets the following preset conditions: (1) the distance between the target and the host vehicle is the smallest; (2) the location of the target is within the host lane; (3) The confidence coefficient of the target is larger than or equal to a preset confidence coefficient threshold value; and/or (4) the number of frames of the image of the target continuously selected as the own lane target is greater than or equal to a preset frame number threshold.
9. The vehicle front destination identification method as claimed in claim 7, wherein when the running state of the vehicle is a normal running state or a normal low-speed running state,
the method for judging whether the position of the target is in the lane is as follows:
and establishing a plane rectangular coordinate system XOY by taking the position of the vehicle as an origin O, wherein the plane rectangular coordinate system XOY is an XOY plane in an SAE coordinate system, the positive X-axis direction of the plane rectangular coordinate system XOY is the advancing direction of the driving track of the vehicle, the positive Y-axis direction of the plane rectangular coordinate system XOY is the right-side direction perpendicular to the X-axis in the plane of the vehicle body, the coordinate mark of the object is (Y, X), the width w of a virtual lane line where the object is positioned is calculated according to a formula w= (0.015 x+0.85) X2, the driving track of the vehicle is set as the center line of the virtual lane line, if the distance between the object and the center line of the virtual lane line is smaller than half of the width of the virtual lane line, the object is judged to be positioned in the vehicle, otherwise, the object is judged not to be positioned in the vehicle.
10. The vehicle front end identification method according to claim 7, wherein when the running state of the vehicle is a curve low-speed running state, the curve low-speed running track of the vehicle is regarded as circular movement, and the method for judging whether the position of the target is within the own lane is:
establishing a plane rectangular coordinate system XOY with a vehicle position as an origin O, wherein the plane rectangular coordinate system XOY is XOY plane in an SAE coordinate system, the positive direction of the X-axis of the plane rectangular coordinate system XOY is the tangential direction of a vehicle running track, the tangential point is the origin O, the positive direction of the Y-axis of the plane rectangular coordinate system XOY is the right direction perpendicular to the X-axis in a vehicle body plane, the center coordinates of a virtual circle where the vehicle running track is located are (r, 0), the target coordinates are (Y, X), and the center coordinates of a virtual circle where the target running track is located are also (r, 0), wherein the virtual circle where the vehicle running track is located and the virtual circle where the target running track is located are concentric circles with the center coordinates of (r, 0), after establishing the plane rectangular coordinate system XOY with the vehicle position and the vehicle running track and marking the coordinate position of the target, firstly calculating the turning radius r of the vehicle running track according to the formula r=v/ω, wherein v represents the vehicle speed of the vehicle, ω represents the yaw rate of the vehicle according to the formula To calculate the turning radius gamma of the target running track 1 And then according to the formula w= (0.015 x r x arcsin (x/y) 1 ) +0.85) x 2 to calculate the width w of the virtual lane line where the target is located, wherein the driving track of the host vehicle is set as the center line of the virtual lane line, if the distance between the target and the center line of the virtual lane line is less than half of the width of the virtual lane line, the target is determined to be in the host lane, otherwise, the target is determined not to be in the host lane.
11. A vehicle front-end identification method, the vehicle front-end identification method comprising the steps of:
(1) Collecting target information in front of a vehicle and vehicle information of the vehicle;
(2) Generating a target list according to the target information;
(3) Judging the running state of the vehicle according to the vehicle information of the vehicle, wherein the running state of the vehicle comprises a normal running state, a common low-speed running state and a curve low-speed running state;
(4) Selecting a main target from the target list by using different target selection strategies according to different driving states of the vehicle, wherein the target selection strategies comprise:
(4-1) when the running state of the host vehicle is the normal running state, searching a host target in the target list, judging whether the searched host target is successfully searched for in the normal running state (401), if the host target which meets the preset condition is successfully searched for in the target list, further judging whether the searched host target is identical to the host target selected in the previous frame image (402), if the searched host target is identical to the host target selected in the previous frame image, selecting the searched host target as the host target of the current frame image (403), if the searched host target is not identical to the host target selected in the previous frame image, further comparing the searched host target with a candidate target, judging whether the searched host target is identical to the candidate target, wherein the candidate target which is positioned in the host lane and has the minimum distance with the host vehicle (406), if the searched host target is identical to the candidate target, further judging whether the searched host target has the preset value and further judging that the searched host target has the preset confidence value and the preset target is triggered or if the searched for the candidate target has the preset confidence value is not triggered (406), and if the searched for the candidate target has the preset confidence value and the candidate target has the preset value is triggered the alarm is judged to be further judged that the candidate target is not triggered, selecting the searched main target as a main target of a current frame image (409), further judging whether the selected main target exists in a previous frame image (407) if the searched main target does not trigger an alarm and does not have a preset confidence, selecting the selected main target in the previous frame image as the main target of the current frame image (410) if the selected main target exists in the previous frame image, and selecting the searched main target as the main target of the current frame image (408) if the selected main target does not exist in the previous frame image; if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the normal low-speed running state (601);
(4-2) searching a main target in the target list when the running state of the host vehicle is a normal low-speed running state, judging whether the main target is successfully searched in the normal low-speed running state (601), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (602); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the curve low-speed driving state (701); and
(4-3) searching a main target in the target list when the running state of the vehicle is a curve low-speed running state, judging whether the main target is successfully searched in the curve low-speed running state (701), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (704); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether a selected main target exists in the previous frame image (702), selecting the selected main target in the previous frame image as the main target of the current frame image (705) if the selected main target exists in the previous frame image, and returning and displaying a result if the selected main target does not exist in the previous frame image: the current search does not find the primary target (703).
12. A vehicle front-end identification apparatus, the vehicle front-end identification apparatus comprising: an information acquisition unit (801) for acquiring target information in front of a vehicle and vehicle information of the host vehicle;
a storage unit (802) for storing at least target information in front of the vehicle and vehicle information of the host vehicle;
-a processing unit (803) for generating a target list at least from the target information;
a running state judgment unit (804) for judging the running state of the host vehicle according to the vehicle information of the host vehicle, wherein the running state of the host vehicle comprises a normal running state, a normal low-speed running state and a curve low-speed running state;
-a target selection unit (805) for selecting a master target from the target list using different target selection strategies according to different driving states of the host vehicle, wherein the target selection strategies comprise:
when the running state of the vehicle is in a normal running state, searching a main target in the target list, judging whether the main target is successfully searched in the normal running state (401), if the main target which meets the preset condition is successfully searched in the target list, further judging whether the searched main target is identical to the main target selected in the previous frame image (402), if the searched main target is identical to the main target selected in the previous frame image, the searched main target is selected as the main target of the current frame image (403), if the searched main target is not identical to the main target selected in the previous frame image, further judging whether the searched main target can trigger an alarm or has preset confidence (406), if the searched main target can trigger an alarm or has preset confidence, the searched main target is selected as the main target of the current frame image (409), if the searched main target is not triggered an alarm and does not have preset confidence, further judging whether the main target selected in the previous frame image is the current frame image (407), if the main target selected in the previous frame image is not selected (408), and if the main target selected in the previous frame image is not selected as the main target; if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the normal low-speed running state (601);
When the running state of the vehicle is a common low-speed running state, searching a main target in the target list, judging whether the main target is successfully searched in the common low-speed running state (601), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (602); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the curve low-speed driving state (701); and
when the running state of the vehicle is a curve low-speed running state, searching a main target in the target list, judging whether the main target is successfully searched in the curve low-speed running state (701), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (704); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether a selected main target exists in the previous frame image (702), selecting the selected main target in the previous frame image as the main target of the current frame image (705) if the selected main target exists in the previous frame image, and returning and displaying a result if the selected main target does not exist in the previous frame image: the current search does not find the primary target (703).
13. The vehicle front destination identification apparatus according to claim 12, characterized in that the information acquisition unit (801) includes an image sensor and/or a radar for acquiring target information in front of the vehicle.
14. The vehicle front destination identification apparatus according to claim 12, wherein the information collection unit (801) includes a vehicle information collection device for obtaining vehicle information of the host vehicle, the vehicle information of the host vehicle including at least a vehicle speed and a yaw rate of the host vehicle.
15. The vehicle front destination identification apparatus according to claim 14, characterized in that the information acquisition unit (801) includes a wheel speed sensor for acquiring a vehicle speed of the host vehicle.
16. The vehicle front end identification apparatus according to claim 14, wherein the information acquisition unit (801) includes a gyroscope and an acceleration sensor for acquiring a yaw rate of the host vehicle.
17. The vehicle front destination identification apparatus according to one of claims 12 to 16, characterized in that the determination condition of the running state of the host vehicle is:
If the speed of the vehicle is greater than a preset speed threshold, judging that the running state of the vehicle is a normal running state;
if the speed of the vehicle is greater than or equal to 0 and less than or equal to the preset speed threshold, further judging whether the yaw rate of the vehicle is greater than the preset yaw rate threshold, and simultaneously judging whether the absolute value of the coordinates of the front object of the vehicle in the Y direction in the SAE defined vehicle body coordinate system is greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, and if the yaw rate of the vehicle is greater than the preset yaw rate threshold and simultaneously the absolute value of the coordinates of the front object of the vehicle in the Y direction in the SAE coordinate system is also greater than the absolute value of the coordinates of the object in the Y direction in the previous frame image, judging that the running state of the vehicle is a curve low-speed running state;
otherwise, judging the running state of the vehicle to be a common low-speed running state.
18. The vehicle front-end identification apparatus according to one of claims 12 to 16, characterized in that the main target meets the following preset conditions: (1) the distance between the target and the host vehicle is the smallest; and (2) the location of the target is within the own lane.
19. The vehicle front-end identification apparatus according to one of claims 12 to 16, characterized in that the main target meets the following preset conditions: (1) the distance between the target and the host vehicle is the smallest; (2) the location of the target is within the host lane; (3) The confidence coefficient of the target is larger than or equal to a preset confidence coefficient threshold value; and/or (4) the number of frames of the image of the target continuously selected as the own lane target is greater than or equal to a preset frame number threshold.
20. The apparatus according to claim 18, characterized in that when the running state of the vehicle is a normal running state or a normal low-speed running state, the method for judging whether the position of the target is within the own lane is:
and establishing a plane rectangular coordinate system XOY by taking the position of the vehicle as an origin O, wherein the plane rectangular coordinate system XOY is an XOY plane in an SAE coordinate system, the positive X-axis direction of the plane rectangular coordinate system XOY is the advancing direction of the driving track of the vehicle, the positive Y-axis direction of the plane rectangular coordinate system XOY is the right-side direction perpendicular to the X-axis in the plane of the vehicle body, the coordinate mark of the object is (Y, X), the width w of a virtual lane line where the object is positioned is calculated according to a formula w= (0.015 x+0.85) X2, the driving track of the vehicle is set as the center line of the virtual lane line, if the distance between the object and the center line of the virtual lane line is smaller than half of the width of the virtual lane line, the object is judged to be positioned in the vehicle, otherwise, the object is judged not to be positioned in the vehicle.
21. The vehicle front end apparatus according to claim 18, wherein when the running state of the vehicle is a curve low-speed running state, the curve low-speed running track of the vehicle is regarded as circular motion, and the method for determining whether the position of the target is within the own lane is:
establishing a plane rectangular coordinate system XOY by taking the position of the vehicle as an origin O, wherein the plane rectangular coordinate system XOY is a XOY plane in an SAE coordinate system, and the plane rectangular coordinate systemThe positive X-axis direction of the XOY is the tangential direction of the running track of the vehicle, wherein the tangential point is the origin O, the positive Y-axis direction of the plane rectangular coordinate system XOY is the right direction perpendicular to the X-axis in the plane of the vehicle body, the circle center coordinate of the virtual circle of the running track of the vehicle is (r, 0), the object coordinate is (Y, X), the circle center coordinate of the virtual circle of the running track of the object is (r, 0), wherein the virtual circle of the running track of the vehicle and the virtual circle of the running track of the object are concentric circles with the same circle center coordinate as (r, 0), after the plane rectangular coordinate system XOY is established by the position of the vehicle and the running track of the vehicle and the coordinate position of the object is marked, the turning radius r of the running track of the vehicle is calculated firstly according to the formula r=v/ω, wherein v represents the vehicle speed of the vehicle, ω represents the yaw rate of the vehicle, and then the turning radius r of the vehicle is calculated according to the formula To calculate the turning radius gamma of the target running track 1 And then according to the formula w= (0.015 x r x arcsin (x/y) 1 ) +0.85) x 2 to calculate the width w of the virtual lane line where the target is located, wherein the driving track of the host vehicle is set as the center line of the virtual lane line, if the distance between the target and the center line of the virtual lane line is less than half of the width of the virtual lane line, the target is determined to be in the host lane, otherwise, the target is determined not to be in the host lane.
22. A vehicle front-end identification apparatus, the vehicle front-end identification apparatus comprising: the information acquisition unit is used for acquiring target information in front of the vehicle and vehicle information of the vehicle;
a storage unit configured to store at least target information in front of the vehicle and vehicle information of the host vehicle;
the processing unit is at least used for generating a target list according to the target information;
the driving state judging unit is used for judging the driving state of the vehicle according to the vehicle information of the vehicle, and the driving state of the vehicle comprises a normal driving state, a normal low-speed driving state and a curve low-speed driving state;
The target selection unit is used for selecting a main target from the target list by using different target selection strategies according to different driving states of the vehicle, wherein the target selection strategies comprise the following steps:
when the running state of the host vehicle is in a normal running state, searching a main target in the target list, judging whether the searched main target is successfully searched for in the normal running state (401), further judging whether the searched main target is the same as the selected main target in the previous frame image if the main target is successfully searched for in the target list, which is the target with the minimum distance between the main target and the host vehicle (402), increasing the confidence of the candidate target by a preset value and further judging whether the searched main target is selected as the main target of the current frame image if the main target is the same as the selected main target in the previous frame image (403), further comparing the searched main target with the candidate target if the main target is not the same as the selected main target in the previous frame image, judging whether the searched main target is the same as the candidate target (404), judging whether the searched main target is located in the host lane and has the minimum distance between the host vehicle and the candidate target, if the searched main target is the candidate target is the same as the candidate target, increasing the confidence of the candidate target by a preset value and further judging whether the searched main target is the searched for in the current frame image or not triggered (406), and further judging whether the searched main target is the searched for in the host vehicle has the preset target with the preset value or not (405), if the searched main target does not trigger an alarm and does not have a preset confidence, further judging whether a selected main target exists in the previous frame image (407), if the selected main target exists in the previous frame image, selecting the selected main target in the previous frame image as the main target of the current frame image (410), and if the selected main target does not exist in the previous frame image, selecting the searched main target as the main target of the current frame image (408); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the normal low-speed running state (601);
When the running state of the vehicle is a common low-speed running state, searching a main target in the target list, judging whether the main target is successfully searched in the common low-speed running state (601), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (602); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether the main target is successfully searched in the curve low-speed driving state (701); and
when the running state of the vehicle is a curve low-speed running state, searching a main target in the target list, judging whether the main target is successfully searched in the curve low-speed running state (701), and if the main target meeting the preset condition is successfully searched in the target list, selecting the searched main target as the main target of the current frame image (704); if the main target meeting the preset condition is not successfully searched in the target list, further judging whether a selected main target exists in the previous frame image (702), selecting the selected main target in the previous frame image as the main target of the current frame image (705) if the selected main target exists in the previous frame image, and returning and displaying a result if the selected main target does not exist in the previous frame image: the current search does not find the primary target (703).
CN201911199145.8A 2019-11-29 2019-11-29 Vehicle front destination identification method and corresponding device Active CN110940982B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911199145.8A CN110940982B (en) 2019-11-29 2019-11-29 Vehicle front destination identification method and corresponding device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911199145.8A CN110940982B (en) 2019-11-29 2019-11-29 Vehicle front destination identification method and corresponding device

Publications (2)

Publication Number Publication Date
CN110940982A CN110940982A (en) 2020-03-31
CN110940982B true CN110940982B (en) 2023-09-12

Family

ID=69909191

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911199145.8A Active CN110940982B (en) 2019-11-29 2019-11-29 Vehicle front destination identification method and corresponding device

Country Status (1)

Country Link
CN (1) CN110940982B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111798698B (en) * 2020-06-24 2022-04-08 中国第一汽车股份有限公司 Method and device for determining front target vehicle and vehicle
CN111856470A (en) * 2020-07-20 2020-10-30 中国第一汽车股份有限公司 Target screening method, device, equipment and storage medium for automobile radar
CN113340317A (en) * 2021-05-20 2021-09-03 云度新能源汽车有限公司 Method for assisting passage of flooded area and storage device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682455A (en) * 2012-05-10 2012-09-19 天津工业大学 Front vehicle detection method based on monocular vision
CN104408460A (en) * 2014-09-17 2015-03-11 电子科技大学 A lane line detecting and tracking and detecting method
CN104843007A (en) * 2014-02-14 2015-08-19 株式会社电装 Vehicle-mounted apparatus for selecting preceding vehicle positioned in the travel path of the host vehicle of the apparatus
CN105182320A (en) * 2015-07-14 2015-12-23 安徽清新互联信息科技有限公司 Depth measurement-based vehicle distance detection method
CN106605154A (en) * 2016-05-24 2017-04-26 英华达（上海）科技有限公司 Moving object monitoring method, wearing type apparatus and server

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6837196B2 (en) * 2017-02-15 2021-03-03 日立Astemo株式会社 Vehicle motion control device, vehicle motion control method and vehicle motion control system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682455A (en) * 2012-05-10 2012-09-19 天津工业大学 Front vehicle detection method based on monocular vision
CN104843007A (en) * 2014-02-14 2015-08-19 株式会社电装 Vehicle-mounted apparatus for selecting preceding vehicle positioned in the travel path of the host vehicle of the apparatus
CN104408460A (en) * 2014-09-17 2015-03-11 电子科技大学 A lane line detecting and tracking and detecting method
CN105182320A (en) * 2015-07-14 2015-12-23 安徽清新互联信息科技有限公司 Depth measurement-based vehicle distance detection method
CN106605154A (en) * 2016-05-24 2017-04-26 英华达（上海）科技有限公司 Moving object monitoring method, wearing type apparatus and server

Also Published As

Publication number Publication date
CN110940982A (en) 2020-03-31

Similar Documents

Publication Publication Date Title
JP4906398B2 (en) In-vehicle road shape identification device, in-vehicle system, road shape identification method and periphery monitoring method
US9524643B2 (en) Orientation sensitive traffic collision warning system
US8711003B2 (en) Vehicle location information-based abnormal driving determination and warning system
CN110940982B (en) Vehicle front destination identification method and corresponding device
CN103303306B (en) The unsafe condition just occurring is made warning method to vehicle driver
US8952799B2 (en) Method and system for warning a driver of a vehicle about potential obstacles behind the vehicle
JP4420011B2 (en) Object detection device
JP4604103B2 (en) Intersection line-of-sight detection device
KR100854766B1 (en) Method for detecting of parking area by using range sensor
JP5664252B2 (en) Pedestrian detection device
JP2017521745A (en) In-vehicle device that informs vehicle navigation module of presence of object
Leonhardt et al. Feature evaluation for lane change prediction based on driving situation and driver behavior
KR20180092101A (en) Ecu, autonomous vehicle including the ecu, and method of determing driving lane for the same
KR20130007243A (en) Method and system for warning forward collision using camera
CN104192063B (en) Vehicle safe driving caution system and corresponding alarming method for power
JP2012089114A (en) Obstacle recognition device
CN113815620B (en) Method, device and equipment for evaluating safe driving of vehicle and storage medium
CN110940981B (en) Method for judging whether position of object in front of vehicle is in own lane
CN107111942A (en) For detecting motor vehicle by the current method and apparatus of traffic sign door
CN111103587A (en) Method and apparatus for predicting simultaneous and concurrent vehicles and vehicle including the same
KR20170085750A (en) Apparatus and method for automatic steering control based on vehicles changing lanes
CN111796286A (en) Brake grade evaluation method and device, vehicle and storage medium
CN111959515A (en) Forward target selection method, device and system based on visual detection
Wittmann et al. Improving lidar data evaluation for object detection and tracking using a priori knowledge and sensorfusion
CN113879312B (en) Forward target selection method and device based on multi-sensor fusion and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant