WO2021000800A1 - Procédé de raisonnement pour la région roulable d'une route, et dispositif - Google Patents

Procédé de raisonnement pour la région roulable d'une route, et dispositif Download PDF

Info

Publication number
WO2021000800A1
WO2021000800A1 PCT/CN2020/098642 CN2020098642W WO2021000800A1 WO 2021000800 A1 WO2021000800 A1 WO 2021000800A1 CN 2020098642 W CN2020098642 W CN 2020098642W WO 2021000800 A1 WO2021000800 A1 WO 2021000800A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
area
grid
drivable
driving
Prior art date
Application number
PCT/CN2020/098642
Other languages
English (en)
Chinese (zh)
Inventor
陈名扬
要志良
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021000800A1 publication Critical patent/WO2021000800A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0238—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors
    • G05D1/024—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors in combination with a laser
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0214—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory in accordance with safety or protection criteria, e.g. avoiding hazardous areas
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0221—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving a learning process
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0223—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving speed control of the vehicle
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0242—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using non-visible light signals, e.g. IR or UV signals
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0257—Control of position or course in two dimensions specially adapted to land vehicles using a radar
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0276—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle
    • G05D1/0278—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle using satellite positioning signals, e.g. GPS
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0276—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle
    • G05D1/028—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle using a RF signal
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0276—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle
    • G05D1/0285—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle using signals transmitted via a public communication network, e.g. GSM network
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image

Definitions

  • the present invention relates to the field of equipment artificial intelligence, and in particular to a method and device for reasoning on road traversable areas in intelligent auxiliary driving or automatic driving technology.
  • Artificial Intelligence is a theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to obtain the best results.
  • artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a similar way to human intelligence.
  • Artificial intelligence is to study the design principles and implementation methods of various intelligent machines, so that the machines have the functions of perception, reasoning and decision-making.
  • Research in the field of artificial intelligence includes robotics, natural language processing, computer vision, decision-making and reasoning, human-computer interaction, recommendation and search, and basic AI theories.
  • Autonomous driving is a mainstream application in the field of artificial intelligence.
  • Autonomous driving technology relies on the collaboration of computer vision, radar, monitoring devices, and global positioning systems to allow motor vehicles to achieve autonomous driving without the need for human active operations.
  • Self-driving vehicles use various computing systems to help transport passengers from one location to another. Some autonomous vehicles may require some initial input or continuous input from an operator (such as a navigator, driver, or passenger). The self-driving vehicle allows the operator to switch from the manual mode to the self-driving mode or a mode in between. Since autonomous driving technology does not require humans to drive motor vehicles, it can theoretically effectively avoid human driving errors, reduce traffic accidents, and improve highway transportation efficiency. Therefore, autonomous driving technology has received more and more attention.
  • road-driving area perception, driving route decision planning, and control are indispensable core key technologies.
  • the decision-making and planning of the driving route is realized based on the perception result of the drivable area of the road. Therefore, the perception result of the drivable area of the road directly affects the performance of the automatic driving system.
  • the mainstream solution in the industry is to perceive the drivable area of the road based on the visual detection image of the camera and the point cloud measurement of the lidar.
  • Camera vision detection images combined with machine learning algorithms are suitable for the extraction of road features such as lane lines and turning arrows.
  • the lidar three-dimensional measurement point cloud is suitable for the extraction of positive and negative obstacles on the edge of the road and on the road surface.
  • sensors such as cameras and lidars are easily affected by the environment, and lighting conditions and extreme weather will affect the accuracy of the road-driving area perception results.
  • the occlusion caused by surrounding vehicles will also affect the accuracy of the perception of the road's drivable area, and the current lidar is expensive and is not a standard configuration for all mass-produced models. Therefore, the perception result of the drivable area of the road is uncertain and cannot reach 100% reliability, which will lead to short-term abnormalities or even long-term failure when the vehicle is driving in the automatic driving mode.
  • the autonomous driving system which is based entirely on the road-driving area perception results for driving route decision planning and control, cannot cope with scenarios where the drivable area perception results are abnormal.
  • the abnormality of the perception result of the drivable area of the road will directly lead to abnormal driving route planning decisions and control, and then affect the safety of autonomous driving.
  • some automatic driving systems will automatically stop or remind the driver to take over driving.
  • the safety of the autopilot system is improved, but the usability of the autopilot system is strongly dependent on the perception ability, and the autopilot function is unavailable when the perception result of the drivable area of the road is abnormal, and the user experience is affected.
  • the uncertainty of the perception results of the drivable area of the road directly affects the safety, system availability and user experience of the autonomous driving system.
  • the embodiment of the present invention provides a road drivable area reasoning method and device. Using the embodiment of the present invention is beneficial to obtain an accurate road drivable area when the road drivable area perception result is abnormal, thereby improving the safety and security of the automatic driving system. System availability and user experience.
  • an embodiment of the present invention provides a road drivable area reasoning method, including:
  • the perceived drivable area perform verification on the perceived drivable area to obtain the first area and the second area, where the first area is the drivable area with reliable verification and the second area is the drivable area with unreliable verification Area; if the first area does not cover the area of interest ROI, the second area is inferred based on the perceptual memory information of the drivable area to obtain the third area and the fourth area, the third area is the perceptual memory area overlapping the second area
  • the fourth area is the area not covered by the sensory memory area in the second area; if the first area and the third area do not cover the ROI, the fourth area is inferred based on the driving position point to obtain the fifth area;
  • the fifth area is a drivable area in the fourth area; the first area, the third area and the fifth area are determined as road drivable areas.
  • an accurate road drivable area By verifying and inferring the perceived drivable area, an accurate road drivable area can be obtained.
  • route planning is based on the accurate road drivable area, collisions with obstacles and surrounding vehicles can be avoided, thereby improving the performance of the autonomous driving system. Security, system availability and user experience.
  • verifying the perceived drivable area to obtain the first area and the second area includes:
  • condition 1 to condition 4 are:
  • w i is the width of the sub-area I, and W is determined according to the experience width of the drivable area and the memory width of the drivable area;
  • Condition 2 The angle between the boundary of the sub-region I and the boundary of the adjacent sub-region is not greater than the first preset angle
  • Condition 3 The distance between the boundary of the sub-region I and the boundary of the perceptual memory area verified before the current moment is not greater than the preset width
  • Condition 4 The ratio of the drivable position points in the subregion I is greater than the preset ratio.
  • the perceptual memory area When verifying the perceived drivable area, not only the perceptual memory area is taken into account, but also road common sense information, such as the detection of boundary integrity, width, and boundary angles of adjacent areas, to improve the ultimate road drivability.
  • the accuracy of the area can avoid collisions with obstacles and surrounding vehicles when planning routes based on accurate road drivable areas, thereby improving the safety, system availability and user experience of the automatic driving system.
  • the perceptual memory information includes perceptual memory grid maps at multiple historical moments and the drivability value of each grid in each perceptual memory grid map, and the second area is performed according to the perceptual memory information.
  • Reasoning to get the third area and the fourth area including:
  • the driving ability value calculates the driving ability value of each grid in the first inference grid map; the third area and the fourth area are determined according to the driving ability value of each grid in the first inference grid map; the third area It is an area composed of grids in the first inference grid map whose drivability value is greater than the first threshold; the fourth area is an area composed of grids in the first inference grid map whose drivability value is not greater than the first threshold.
  • the driving area in the second area is obtained by reasoning on the second area through the perceptual memory grid map, which realizes that the reasoning of the driving area can be continued when the driving area is abnormal, and the perception of the automatic driving system is reduced.
  • the dependence of the driving area increases the fault tolerance of the automatic driving system to the real-time senseable driving area, and improves the reliability and safety of the automatic driving system.
  • the perceptual memory grid maps of multiple historical moments are respectively transformed from the vehicle coordinate system of the vehicle at the historical moment to the world coordinate system to obtain multiple world grid maps, including:
  • the perceptual memory grid maps of multiple historical moments are respectively converted from the vehicle coordinate system of the vehicle at the historical moment to the world coordinate system to obtain multiple world grid maps;
  • the first conversion formula is: Among them, (x vt0 ,y vt0 ) are the coordinates of any drivable location point P in the perception memory grid map at historical time t0 in the vehicle coordinate system of the own vehicle, and (x wt0 ,y wt0 ) is the drivable location point
  • First conversion matrix (x t0 , y t0 ) are the coordinates of the vehicle at historical time t0 in the world standard system, and ⁇ t0 is the heading angle of the vehicle at historical time t0.
  • converting the inference area from the world coordinate system to the vehicle coordinate system of the vehicle at the current moment to obtain the first inference grid map includes:
  • the second conversion formula is: (x wp ,y wp ) is the coordinates of any travelable position point P'in the inference area in the world coordinate system, (x vp ,y vp ) is the vehicle coordinate system of the self-vehicle at the current moment The coordinates below, Is the second conversion matrix;
  • Second conversion matrix (x 0 , y 0 ) are the coordinates of the vehicle at the current moment in the world coordinate system, and ⁇ 0 is the heading angle of the vehicle at the current moment.
  • calculating the drivability value of each grid in the first inference grid map according to the drivability value of each grid in the perceptual memory grid map includes:
  • the drivability value of multiple historical moments is the drivability value of the corresponding grid in the perceptual memory grid map of the grid of the p-th column and the q-th row at multiple historical moments;
  • the drivability value of the grid in the p-th column and the q-th row in the first inference grid map is:
  • k' t ' is the weight of.
  • the drivable area can be determined using the grid as the basic unit, which improves the accuracy of the drivable area, and further improves the reliability and safety of the automatic driving system.
  • the fourth area is inferred based on the drivable location point to obtain the fifth area, including:
  • the location point to be inferred from the driveable location point, which is the driveable location point located in the area where the fourth area overlaps the ROI; convert the coordinates of the location to be inferred from the world coordinate system to that of the vehicle Under the vehicle coordinate system, in order to obtain the driving area to be inferred, the driving area to be inferred is the area formed by the inferred position points in the vehicle coordinate system of the own vehicle; grid division is performed on the driving area to be inferred to obtain the second Inference grid map; calculate the drivability value of each grid according to the drivable position point information in each grid in the second inference grid map; determine the fifth area according to the drivability value of each grid, The fifth area is an area composed of grids with a drivability value greater than the second threshold in the second inference grid map.
  • the fourth area can be reasoned through the drivable location points, and the driving route decision planning can be made according to the drivable area obtained by reasoning, which avoids the actual effect of the automatic driving system.
  • the scope of use of the automatic driving system is increased, and the dependence of the automatic driving system on real-time sensing of the drivable area information is reduced, thereby increasing the fault tolerance of the automatic driving system to the real-time sensing of the drivable area information.
  • transforming the coordinates of the location point to be inferred from the world coordinate system to the vehicle coordinate system of the vehicle to obtain the travelable area to be inferred includes:
  • the third conversion formula is: Among them, (x dw , y dw ) is the coordinate of any inferred position point D in the world coordinate system of the inferred position points, (x dv , y dv ) is the coordinate system of the inferred position D in the own vehicle The coordinates below, Is the second conversion matrix,
  • Second conversion matrix (x 0 , y 0 ) are the coordinates of the vehicle at the current moment in the world coordinate system, and ⁇ 0 is the heading angle of the vehicle at the current moment.
  • calculating the drivability value of each grid according to the drivable position point information in each grid in the second inference grid map includes:
  • the drivability values at different moments are calculated according to the drivable position point information in the i-th column and j-th row grid in the second inference grid map; the drivability values at different times are weighted and summed to obtain the first The drivability value of the grid in column i and row j;
  • the drivability value of the grid in the i-th column and the j-th row is Is the drivability value at time t, k t is the weight of,
  • the drivable area can be determined using the grid as the basic unit, which improves the accuracy of the drivable area, and further improves the reliability and safety of the automatic driving system.
  • the drivability value of the safe driving position is increased, and the drivability value of the dangerous driving position is reduced, which can increase The accuracy of the determined drivable area, and then the automatic driving system has the characteristics of "the more open the better".
  • the drivable position point includes the drivable position point of the self-vehicle.
  • the method further includes:
  • the driving position points of the own vehicle include safe driving position points and driving risk position points; among them, obtaining the driving position points of the own vehicle includes: judging whether the driving mode of the own vehicle at its current position is manual Driving mode; if the driving mode of the own car at its current position is manual driving mode, the current position of the own car is determined to be a safe driving position; if the driving mode of the own car at its current position is automatic driving mode, it is determined Whether the vehicle has a collision risk or abnormal driving behavior at its current location; if it is determined that the vehicle has no risk of collision and no abnormal driving behavior at its current location, the current position of the vehicle is determined to be a safe driving position; if the vehicle is determined If there is a risk of collision or abnormal driving behavior at its current position, the current position of the vehicle is determined to be a dangerous driving position.
  • the driveable area can be inferred based on the self-vehicle's drivable location point, and then travel route planning based on the drivable area is avoided.
  • the failure of the automatic driving system has improved the application range of the automatic driving system and the reliability of the system.
  • judging whether the vehicle has a collision risk at its current position includes:
  • the intersection mode risk judgment method is used to determine whether the own vehicle has a collision at its current position Risk: If the included angle ⁇ is not greater than the second preset angle, the rear-end collision mode risk judgment method is used to determine whether the vehicle has a collision risk at its current position.
  • intersection mode risk discrimination method is used to determine whether the vehicle has a collision risk at the current position, including:
  • the first time is the time required for the vehicle to travel from its current position to the potential collision point
  • the second time is the time required for the vehicle E to travel from its current position to the potential collision point
  • formula 1 and Formula 2 it is determined that the vehicle has a risk of collision at its current position
  • formula 2 it is determined that the vehicle has no risk of collision at its current position
  • formula 1 is:
  • formula 2 is: TTX 1 is the first time, TTX 2 is the second time, ⁇ is the preset threshold, and R 0 is the risk threshold.
  • adopting a rear-end collision mode risk discrimination method to determine whether the vehicle has a collision risk at the current position includes:
  • the formula 3 is:
  • the formula 4 is: a and b are constants, R 0 is the risk threshold, ⁇ is the horizontal distance threshold, and
  • determining whether the own vehicle has abnormal driving behavior at its current position includes:
  • determining whether the own vehicle has an emergency braking behavior at its current position includes:
  • determining whether the own vehicle has an emergency steering behavior at its current position includes:
  • the method further includes:
  • the vehicle If the vehicle is driving along road direction 1 at its current position, determine the travelable position point of the vehicle as the drivable position point on road direction 1, and save the drivable position point on road direction 1 to the side of road direction 1.
  • the drivable position point in the road direction 1 includes a safe driving position in the road direction 1 and a driving risk position in the road direction 1;
  • the vehicle If the vehicle is driving along road direction 2 at its current position, determine the travelable position point of the vehicle as the drivable position point on road direction 2, and save the drivable position point on road direction 2 to the side of road direction 2.
  • the drivable position point on the road direction 2 includes the driving safety position on the road direction 1 and the driving risk position on the road direction 2; wherein, the road direction 1 and the road direction 2 are opposite on the same road Direction.
  • the method further includes:
  • the drivable area can be inferred based on the drivable location points of the surrounding vehicles, and then the travel route planning based on the drivable area is avoided.
  • the failure of the automatic driving system has improved the application range of the automatic driving system and the reliability of the system.
  • the drivable position point information of surrounding vehicles includes the coordinates of the same direction drivable position point and the reverse direction drivable position point coordinates, and obtaining the drivable position point information of the surrounding vehicles includes:
  • the driving information of vehicle A includes relative position coordinates and longitudinal relative speed
  • the driving information of own vehicle includes absolute position coordinates and absolute speed in the direction of travel. And the heading angle;
  • the type of drivable position point coordinate of vehicle A includes the coordinates of the reverse drivable position point or the same direction drivable position point coordinate;
  • the relative position coordinates are the coordinates in the vehicle coordinate system
  • the vehicle A's travelable position point coordinates are the coordinates in the world coordinate system.
  • obtaining the drivable position point coordinates of vehicle A according to the absolute position coordinates of the own vehicle, the heading angle of the vehicle, and the relative position coordinates of vehicle A includes:
  • the fourth conversion formula is: (x Av , y Av ) are the relative position coordinates of vehicle A, (x Aw , y Aw ) are the coordinates of the position where vehicle A can travel;
  • Third conversion matrix (x 0 ,y 0 ) is the absolute position coordinate of the own vehicle at the current moment, and ⁇ 0 is the heading angle of the own vehicle at the current moment.
  • determining the type of the vehicle A's travelable position point coordinates according to the longitudinal relative speed and absolute speed of the vehicle A includes:
  • the coordinates of the vehicle A can be driven position point are determined to be the same direction; if the longitudinal absolute speed of vehicle A is less than the preset speed threshold, the vehicle A's The coordinates of the driving position point are the coordinates of the driving position point in the reverse direction.
  • the method further includes:
  • the coordinates of the vehicle A's travelable location point are determined as the coordinates on the road direction 1, and the vehicle A's travelable location point coordinates are saved to the roadside unit on the road direction 1 side;
  • Road direction 1 and road direction 2 are two opposite directions on the same road.
  • the automatic driving system of other vehicles can infer the drivable area based on the drivable location points of the surrounding vehicles, and then plan the driving route based on the drivable area, avoiding the automatic driving system Failure to improve the application scope of the automatic driving system and the reliability of the system.
  • obtaining information about the drivable location points of surrounding vehicles includes:
  • the method further includes:
  • the first area covers the ROI, the first area is determined to be a drivable area on the road.
  • the method further includes:
  • the first area and the third area cover the ROI, then the first area and the third area are determined as road-driving areas.
  • an embodiment of the present invention provides a road drivable area reasoning device, including:
  • the acquisition module is used to acquire the perceived drivable area
  • the verification module is used to verify the perceivable travelable area to obtain the first area and the second area, where the first area is the travelable area with reliable verification and the second area is the travelable area with unreliable verification area;
  • the inference module is used to infer the second area based on the perceptual memory information of the drivable area if the first area does not cover the area of interest ROI to obtain the third area and the fourth area.
  • the third area is the perceptual memory area and the first area.
  • the area where the two areas overlap, the fourth area is the area that is not covered by the perceptual memory area in the second area; if the first area and the third area do not cover the ROI, the fourth area is inferred based on the driving position point , To get the fifth area; the fifth area is the drivable area in the fourth area;
  • the determining module is used to determine the first area, the third area, and the fifth area as road-drivable areas.
  • the verification module is specifically used for:
  • condition 1 to condition 4 are:
  • w i is the width of the sub-area I, and W is determined according to the experience width of the drivable area and the memory width of the drivable area;
  • Condition 2 The angle between the boundary of the sub-region I and the boundary of the adjacent sub-region is not greater than the first preset angle
  • Condition 3 The distance between the boundary of the sub-region I and the boundary of the perceptual memory area verified before the current moment is not greater than the preset width
  • Condition 4 The ratio of the drivable position points in the subregion I is greater than the preset ratio.
  • the perceptual memory information includes perceptual memory grid maps at multiple historical moments and the drivability value of each grid in each perceptual memory grid map.
  • the perceptual memory information is used to compare the second area Perform reasoning to get the aspects of the third area and the fourth area.
  • the reasoning module is specifically used to:
  • the driving ability value calculates the driving ability value of each grid in the first inference grid map; the third area and the fourth area are determined according to the driving ability value of each grid in the first inference grid map; the third area It is an area composed of grids in the first inference grid map whose drivability value is greater than the first threshold; the fourth area is an area composed of grids in the first inference grid map whose drivability value is not greater than the first threshold.
  • the reasoning module is specifically used for:
  • the perceptual memory grid maps of multiple historical moments are respectively converted from the vehicle coordinate system of the vehicle at the historical moment to the world coordinate system to obtain multiple world grid maps;
  • the first conversion formula is: Among them, (x vt0 ,y vt0 ) are the coordinates of any drivable location point P in the perception memory grid map at historical time t0 in the vehicle coordinate system of the own vehicle, and (x wt0 ,y wt0 ) is the drivable location point
  • First conversion matrix (x t0 , y t0 ) are the coordinates of the vehicle at historical time t0 in the world standard system, and ⁇ t0 is the heading angle of the vehicle at historical time t0.
  • the inference module in terms of converting the inference area from the world coordinate system to the vehicle coordinate system of the vehicle at the current moment to obtain the first inference grid map, is specifically used for:
  • the second conversion formula is: (x wp ,y wp ) is the coordinates of any travelable position point P'in the inference area in the world coordinate system, (x vp ,y vp ) is the vehicle coordinate system of the self-vehicle at the current moment The coordinates below, Is the second conversion matrix;
  • Second conversion matrix (x 0 , y 0 ) are the coordinates of the vehicle at the current moment in the world coordinate system, and ⁇ 0 is the heading angle of the vehicle at the current moment.
  • the inference module is specifically used for :
  • the drivability value of multiple historical moments is the drivability value of the corresponding grid in the perceptual memory grid map of the grid of the p-th column and the q-th row at multiple historical moments;
  • the drivability value of the grid in the p-th column and the q-th row in the first inference grid map is:
  • k' t ' is the weight of.
  • the inference module is specifically configured to:
  • the location point to be inferred from the driveable location point, which is the driveable location point located in the area where the fourth area overlaps the ROI; convert the coordinates of the location to be inferred from the world coordinate system to that of the vehicle Under the vehicle coordinate system, in order to obtain the driving area to be inferred, the driving area to be inferred is the area formed by the inferred position points in the vehicle coordinate system of the own vehicle; grid division is performed on the driving area to be inferred to obtain the second Inference grid map; calculate the drivability value of each grid according to the drivable position point information in each grid in the second inference grid map; determine the fifth area according to the drivability value of each grid, The fifth area is an area composed of grids with a drivability value greater than the second threshold in the second inference grid map.
  • the inference module is specifically used for:
  • the third conversion formula is: Among them, (x dw , y dw ) is the coordinate of any inferred position point D in the world coordinate system of the inferred position points, (x dv , y dv ) is the coordinate system of the inferred position D in the own vehicle The coordinates below, Is the second conversion matrix,
  • Second conversion matrix (x 0 , y 0 ) are the coordinates of the vehicle at the current moment in the world coordinate system, and ⁇ 0 is the heading angle of the vehicle at the current moment.
  • the inference module is specifically used to:
  • the drivability values at different moments are calculated according to the drivable position point information in the i-th column and j-th row grid in the second inference grid map; the drivability values at different times are weighted and summed to obtain the first The drivability value of the grid in column i and row j;
  • the drivability value of the grid in the i-th column and the j-th row is Is the drivability value at time t, k t is the weight of,
  • the drivable position point includes the drivable position point of the self-vehicle, and the acquisition module is further used for:
  • the driving position points of the own vehicle include the driving safety position points and the driving risk position points; wherein, obtaining the driving position points of the own vehicle includes : Determine whether the driving mode of the own vehicle at its current position is manual driving mode; if the driving mode of the own vehicle at its current position is manual driving mode, determine the current position of the own vehicle as a safe driving position; If the driving mode at its current location is automatic driving mode, it is determined whether the vehicle has a risk of collision or abnormal driving behavior at its current location; if it is determined that the vehicle has no risk of collision and no abnormal driving behavior at its current location, the vehicle is determined The current position point of is a safe driving position; if it is determined that the vehicle has a risk of collision or abnormal driving behavior at its current position, the current position of the own vehicle is determined to be a dangerous driving position.
  • the acquiring module is specifically used to:
  • the intersection mode risk judgment method is used to determine whether the own vehicle has a collision at its current position Risk: If the included angle ⁇ is not greater than the second preset angle, the rear-end collision mode risk judgment method is used to determine whether the vehicle has a collision risk at its current position.
  • the acquisition module is specifically used to:
  • the first time is the time required for the vehicle to travel from its current position to the potential collision point
  • the second time is the time required for the vehicle E to travel from its current position to the potential collision point
  • formula 1 and Formula 2 it is determined that the vehicle has a risk of collision at its current position
  • formula 2 it is determined that the vehicle has no risk of collision at its current position
  • formula 1 is:
  • formula 2 is: TTX 1 is the first time, TTX 2 is the second time, ⁇ is the preset threshold, and R 0 is the risk threshold.
  • the acquisition module is specifically used to:
  • the formula 3 is:
  • the formula 4 is: a and b are constants, R 0 is the risk threshold, ⁇ is the horizontal distance threshold, and
  • the acquiring module is specifically used for:
  • the acquiring module is specifically used to:
  • the acquiring module in determining whether the own vehicle has an emergency steering behavior at its current position, is specifically used to:
  • the road drivable area reasoning device further includes a storage module
  • the determining module is also used to determine that the self-vehicle can travel along the road direction 1 after the acquisition module obtains the driveable location point of the vehicle at its current location as the driveable location point on the road direction 1.
  • Save module used to save the drivable position point on road direction 1 to the roadside unit on the side of road direction 1, where the drivable position point on road direction 1 includes the safe driving position and road in road direction 1.
  • the determination module is also used for determining that the vehicle can travel along the road direction 2 at its current position as the travelable location point on the road direction 2.
  • the drivable position points are saved to the roadside unit on the road direction 2 side, where the drivable position points on the road direction 2 include the safe driving position on the road direction 1 and the driving risk position on the road direction 2; where, the road direction 1 and road direction 2 are opposite directions on the same road.
  • the acquisition module is also used to:
  • the driving position point information of surrounding vehicles includes the coordinates of the driving position point in the same direction and the coordinates of the driving position point in the reverse direction.
  • the acquisition module is also used for :
  • the driving information of vehicle A includes relative position coordinates and longitudinal relative speed
  • the driving information of own vehicle includes absolute position coordinates and absolute speed in the direction of travel.
  • the heading angle of the vehicle according to the absolute position coordinates of the vehicle, the heading angle of the vehicle, and the relative position coordinates of the vehicle A, the coordinates of the vehicle A's driving position are obtained; according to the longitudinal relative speed of the vehicle A and the absolute speed of the vehicle, the vehicle A can be determined
  • the type of the driving position point; the type of the driving position point coordinate of the vehicle A includes the reverse driving position point coordinate or the same direction driving position point coordinate; wherein, the relative position coordinate is the coordinate in the vehicle coordinate system, and the vehicle A
  • the coordinates of the driving position point are the coordinates in the world coordinate system.
  • the acquiring module in terms of acquiring the drivable position point coordinates of vehicle A according to the absolute position coordinates of the vehicle, the heading angle of the vehicle, and the relative position coordinates of vehicle A, the acquiring module is also used for:
  • the fourth conversion formula is: (x Av , y Av ) are the relative position coordinates of vehicle A, (x Aw , y Aw ) are the coordinates of the position where vehicle A can travel;
  • Third conversion matrix (x 0 ,y 0 ) is the absolute position coordinate of the own vehicle at the current moment, and ⁇ 0 is the heading angle of the own vehicle at the current moment.
  • the acquiring module is further used to:
  • the coordinates of the vehicle A can be driven position point are determined to be the same direction; if the longitudinal absolute speed of vehicle A is less than the preset speed threshold, the vehicle A's The coordinates of the driving position point are the coordinates of the driving position point in the reverse direction.
  • the determining module is also used to determine if the vehicle A is driving along the road direction 1, then determining that the vehicle A’s travelable position point coordinates are the coordinates on the road direction 1, the saving module is also used to save the vehicle The coordinates of the driving position point of A are saved to the roadside unit on the side of the road direction 1;
  • the determination module is also used to determine if the vehicle A is traveling along the road direction 2, the driveable position point of the lane A is determined as the coordinate on the road direction 2, and the storage module is used to save the vehicle A's driveable position point coordinates to the road In the roadside unit on the direction 2 side; wherein the road direction 1 and the road direction 2 are two opposite directions on the same road.
  • the obtaining module is specifically used to:
  • the determining module is also used to:
  • the first area covers the ROI, the first area is determined to be a drivable area on the road.
  • the determining module is also used to:
  • the first area and the third area cover the ROI, the first area and the third area are determined as the road drivable area.
  • an embodiment of the present invention provides a road drivable area reasoning device, including:
  • a memory for storing executable program codes
  • a processor coupled to the memory; when the processor invokes the executable program code stored in the memory, it executes part or all of the method described in the first aspect.
  • an embodiment of the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed by a computing platform or a processor with processing capability, the method described in the first aspect Part or all of the steps of the method.
  • Figure 1a is a schematic diagram of a vehicle coordinate system provided by an embodiment of the present invention.
  • Figure 1b is a schematic structural diagram of an autonomous vehicle provided by an embodiment of the present invention.
  • FIG. 2 is a schematic structural diagram of a computer system provided by an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a neural network processor provided by an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of the application of a cloud-side commanded autonomous vehicle according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of an application of a cloud-side commanded autonomous vehicle according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of an application scenario of a method for reasoning on a road drivable area provided by an embodiment of the present invention
  • FIG. 7 is a schematic flowchart of a method for reasoning on a road drivable area according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of the positional relationship between area I and area II according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of the relationship between the historical moment perception memory grid map and the inference grid map provided by an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a method for absolute position and direction of a vehicle according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of risk identification of intersection modes provided by an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of a drivable area in an area of interest provided by an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of a road drivable area reasoning device provided by an embodiment of the present invention.
  • FIG. 14 is a schematic structural diagram of a road drivable area reasoning device provided by an embodiment of the present invention.
  • Fig. 15 is a schematic structural diagram of a computer program product provided by an embodiment of the present invention.
  • Structured roads roads with a single pavement structure, clear edge lines and obvious road geometric features, such as highways and urban arterial roads.
  • Unstructured roads roads with complex pavement structures, no lane lines and clear road boundaries, and road geometric features that are not obvious, such as residential district roads, rural roads, and urban non-main roads.
  • Drivenability grid map refers to dividing the environment map into a series of grids, where each grid is given a driveability value to indicate whether the grid can be driven.
  • Vehicle coordinate system When the vehicle is at a standstill on a horizontal road, the x-axis is parallel to the ground and points forward, the z-axis passes vertically upward through the center of the rear axle, the y-axis points to the left side of the driver's seat, and the center of the rear axle is the origin of the coordinate system O, as shown in Figure 1a.
  • World coordinate system refers to a coordinate system fixed relative to the ground. There are many ways to define the world coordinate system. For example, you can define the origin at the initial position of the vehicle, and the x-axis along the positive direction of the target. When the vehicle moves, the origin position and the x-axis direction are fixed on the ground and do not move with the vehicle, or The origin is defined at a certain position on the earth, and the x axis is north.
  • Fig. 1b is a functional block diagram of a vehicle 100 provided by an embodiment of the present invention.
  • the vehicle 100 is configured in a fully or partially autonomous driving mode.
  • the vehicle 100 can control itself while in the automatic driving mode, and can determine the current state of the vehicle and its surrounding environment through human operations, determine the possible behavior of at least one other vehicle in the surrounding environment, and determine the other vehicle
  • the confidence level corresponding to the possibility of performing possible actions is controlled based on the determined information.
  • the vehicle 100 can be placed to operate without human interaction.
  • the vehicle 100 may include various subsystems, such as a travel system 102, a sensor system 104, a control system 106, one or more peripheral devices 108 and a power supply 110, a computer system 112, and a user interface 116.
  • the vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple elements.
  • each of the subsystems and elements of the vehicle 100 may be wired or wirelessly interconnected.
  • the travel system 102 may include components that provide power movement for the vehicle 100.
  • the propulsion system 102 may include an engine 118, an energy source 119, a transmission 120, and wheels/tires 121.
  • the engine 118 may be an internal combustion engine, an electric motor, an air compression engine, or other types of engine combinations, such as a hybrid engine composed of a gasoline engine and an electric motor, or a hybrid engine composed of an internal combustion engine and an air compression engine.
  • the engine 118 converts the energy source 119 into mechanical energy.
  • Examples of energy sources 119 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity.
  • the energy source 119 may also provide energy for other systems of the vehicle 100.
  • the transmission device 120 can transmit mechanical power from the engine 118 to the wheels 121.
  • the transmission device 120 may include a gearbox, a differential, and a drive shaft.
  • the transmission device 120 may also include other devices, such as a clutch.
  • the drive shaft may include one or more shafts that can be coupled to one or more wheels 121.
  • the sensor system 104 may include several sensors that sense information about the environment around the vehicle 100.
  • the sensor system 104 may include a positioning system 122 (the positioning system may be a GPS system, a Beidou system or other positioning systems), an inertial measurement unit (IMU) 124, a radar 126, a laser rangefinder 128, and Camera 130.
  • the sensor system 104 may also include sensors of the internal system of the monitored vehicle 100 (for example, an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, direction, speed, etc.). Such detection and identification are key functions for the safe operation of the autonomous vehicle 100.
  • the positioning system 122 can be used to estimate the geographic location of the vehicle 100.
  • the IMU 124 is used to sense changes in the position and orientation of the vehicle 100 based on inertial acceleration.
  • the IMU 124 may be a combination of an accelerometer and a gyroscope.
  • the radar 126 may use radio signals to sense objects in the surrounding environment of the vehicle 100. In some embodiments, in addition to sensing the object, the radar 126 may also be used to sense the speed and/or direction of the object.
  • the laser rangefinder 128 can use laser light to sense objects in the environment where the vehicle 100 is located.
  • the laser rangefinder 128 may include one or more laser sources, laser scanners, and one or more detectors, as well as other system components.
  • the camera 130 may be used to capture multiple images of the surrounding environment of the vehicle 100.
  • the camera 130 may be a still camera or a video camera.
  • the control system 106 controls the operation of the vehicle 100 and its components.
  • the control system 106 may include various components, including a steering system 132, a throttle 134, a braking unit 136, a sensor fusion algorithm 138, a computer vision system 140, a route control system 142, and an obstacle avoidance system 144.
  • the steering system 132 is operable to adjust the forward direction of the vehicle 100.
  • it may be a steering wheel system in one embodiment.
  • the throttle 134 is used to control the operating speed of the engine 118 and thereby control the speed of the vehicle 100.
  • the braking unit 136 is used to control the vehicle 100 to decelerate.
  • the braking unit 136 may use friction to slow down the wheels 121.
  • the braking unit 136 may convert the kinetic energy of the wheels 121 into electric current.
  • the braking unit 136 may also take other forms to slow down the rotation speed of the wheels 121 to control the speed of the vehicle 100.
  • the computer vision system 140 may be operable to process and analyze the images captured by the camera 130 in order to identify objects and/or features in the surrounding environment of the vehicle 100.
  • the objects and/or features may include traffic signals, road boundaries and obstacles.
  • the computer vision system 140 may use object recognition algorithms, Structure from Motion (SFM) algorithms, video tracking, and other computer vision technologies.
  • SFM Structure from Motion
  • the computer vision system 140 may be used to map the environment, track objects, estimate the speed of objects, and so on.
  • the route control system 142 is used to determine the travel route of the vehicle 100.
  • the route control system 142 may combine data from the sensor 138, the GPS 122, and one or more predetermined maps to determine the driving route for the vehicle 100.
  • the obstacle avoidance system 144 is used to identify, evaluate, and avoid or otherwise cross over potential obstacles in the environment of the vehicle 100.
  • control system 106 may add or alternatively include components other than those shown and described. Alternatively, a part of the components shown above may be reduced.
  • the vehicle 100 interacts with external sensors, other vehicles, other computer systems, or users through peripheral devices 108.
  • the peripheral device 108 may include a wireless communication system 146, an onboard computer 148, a microphone 150 and/or a speaker 152.
  • the peripheral device 108 provides a means for the user of the vehicle 100 to interact with the user interface 116.
  • the onboard computer 148 may provide information to the user of the vehicle 100.
  • the user interface 116 can also operate the onboard computer 148 to receive user input.
  • the on-board computer 148 can be operated through a touch screen.
  • the peripheral device 108 may provide a means for the vehicle 100 to communicate with other devices located in the vehicle.
  • the microphone 150 may receive audio (eg, voice commands or other audio input) from a user of the vehicle 100.
  • the speaker 152 may output audio to the user of the vehicle 100.
  • the wireless communication system 146 may wirelessly communicate with one or more devices directly or via a communication network.
  • the wireless communication system 146 may use 3G cellular communication, such as CDMA, EVDO, GSM/GPRS, or 4G cellular communication, such as LTE. Or 5G cellular communication.
  • the wireless communication system 146 may use WiFi to communicate with a wireless local area network (WLAN).
  • WLAN wireless local area network
  • the wireless communication system 146 may directly communicate with the device using an infrared link, Bluetooth, or ZigBee.
  • Other wireless protocols such as various vehicle communication systems.
  • the wireless communication system 146 may include one or more dedicated short-range communications (DSRC) devices, which may include vehicles and/or roadside stations. Public and/or private data communications.
  • DSRC dedicated short-range communications
  • the power supply 110 may provide power to various components of the vehicle 100.
  • the power source 110 may be a rechargeable lithium ion or lead-acid battery.
  • One or more battery packs of such batteries may be configured as a power source to provide power to various components of the vehicle 100.
  • the power source 110 and the energy source 119 may be implemented together, such as in some all-electric vehicles.
  • the computer system 112 may include at least one processor 113 that executes instructions 115 stored in a non-transitory computer readable medium such as a data storage device 114.
  • the computer system 112 may also be multiple computing devices that control individual components or subsystems of the vehicle 100 in a distributed manner.
  • the processor 113 may be any conventional processor, such as a commercially available CPU. Alternatively, the processor may be a dedicated device such as an ASIC or other hardware-based processor.
  • FIG. 1b functionally illustrates the processor, memory, and other elements of the computer 110 in the same block, those of ordinary skill in the art should understand that the processor, computer, or memory may actually include Multiple processors, computers, or memories stored in the same physical enclosure.
  • the memory may be a hard disk drive or other storage medium located in a housing other than the computer 110. Therefore, a reference to a processor or computer will be understood to include a reference to a collection of processors or computers or memories that may or may not operate in parallel. Rather than using a single processor to perform the steps described here, some components such as steering components and deceleration components may each have its own processor that only performs calculations related to component-specific functions .
  • the processor may be located away from the vehicle and wirelessly communicate with the vehicle.
  • some of the processes described herein are executed on a processor disposed in the vehicle and others are executed by a remote processor, including taking the necessary steps to perform a single manipulation.
  • the data storage device 114 may include instructions 115 (eg, program logic), which may be executed by the processor 113 to perform various functions of the vehicle 100, including those functions described above.
  • the data storage device 114 may also contain additional instructions, including sending data to, receiving data from, interacting with, and/or performing data on one or more of the propulsion system 102, the sensor system 104, the control system 106, and the peripheral device 108. Control instructions.
  • the data storage device 114 may also store data, such as road maps, route information, the location, direction, and speed of the vehicle, and other such vehicle data, as well as other information. Such information may be used by the vehicle 100 and the computer system 112 during the operation of the vehicle 100 in autonomous, semi-autonomous, and/or manual modes.
  • the processor 113 obtains the road drivable area perception information through the sensor system 104, and obtains the perceptible drivable area according to the road drivable area perception information; checks the perceptual drivable area to obtain the first area and the second area, Wherein, the first area is a drivable area with reliable verification, and the second area is a drivable area with unreliable verification; if the first area covers the ROI, the processor 113 determines the first area as a road drivable area; If the first area does not cover the ROI, the processor 113 obtains the perceptual memory information from the data storage device 114, and performs inference operations on the second area according to the perceptual memory information to obtain the third area and the fourth area.
  • the processor 113 compares the first area with the third area The area is determined to be a drivable area on the road; if the first area and the third area do not cover the ROI, the processor 113 obtains the drivable position point information from the data storage device 114 or other units or servers, and compares the drivable position point information according to the drivable position point information.
  • the fourth area performs inference to obtain the fifth area, which is the drivable area in the fourth area; the processor 113 determines the first area, the third area, and the fifth area as road drivable areas; 113 makes driving route planning decisions based on the road's drivable area to obtain a planned driving route; the processor 113 sends the planned driving route to the control system 106, and each functional module of the control system 106 controls the vehicle 100 to travel according to the planned driving route.
  • the user interface 116 is used to provide information to or receive information from a user of the vehicle 100.
  • the user interface 116 may include one or more input/output devices in the set of peripheral devices 108, such as a wireless communication system 146, a car computer 148, a microphone 150, and a speaker 152.
  • the computer system 112 may control the functions of the vehicle 100 based on inputs received from various subsystems (eg, travel system 102, sensor system 104, and control system 106) and from the user interface 116. For example, the computer system 112 may utilize input from the control system 106 in order to control the steering unit 132 to avoid obstacles detected by the sensor system 104 and the obstacle avoidance system 144. In some embodiments, the computer system 112 is operable to provide control of many aspects of the vehicle 100 and its subsystems.
  • various subsystems eg, travel system 102, sensor system 104, and control system 106
  • the computer system 112 may utilize input from the control system 106 in order to control the steering unit 132 to avoid obstacles detected by the sensor system 104 and the obstacle avoidance system 144.
  • the computer system 112 is operable to provide control of many aspects of the vehicle 100 and its subsystems.
  • one or more of these components described above may be installed or associated with the vehicle 100 separately.
  • the data storage device 114 may exist partially or completely separately from the vehicle 100.
  • the aforementioned components may be communicatively coupled together in a wired and/or wireless manner.
  • FIG. 1b should not be understood as a limitation to the embodiment of the present invention.
  • An autonomous vehicle traveling on a road can recognize objects in its surrounding environment to determine the adjustment to the current speed.
  • the object may be other vehicles, traffic control equipment, or other types of objects.
  • each recognized object can be considered independently, and based on the respective characteristics of the object, such as its current speed, acceleration, distance from the vehicle, etc., can be used to determine the speed to be adjusted by the autonomous vehicle.
  • the self-driving car vehicle 100 or the computing device associated with the self-driving vehicle 100 may be based on the characteristics of the identified object and the surrounding environment
  • the state of the object e.g., traffic, rain, ice on the road, etc.
  • each recognized object depends on each other's behavior, so all recognized objects can also be considered together to predict the behavior of a single recognized object.
  • the vehicle 100 can adjust its speed based on the predicted behavior of the identified object.
  • an autonomous vehicle can determine what stable state the vehicle will need to adjust to (for example, accelerate, decelerate, or stop) based on the predicted behavior of the object.
  • other factors may also be considered to determine the speed of the vehicle 100, such as the lateral position of the vehicle 100 on the road on which it is traveling, the curvature of the road, the proximity of static and dynamic objects, and so on.
  • the computing device can also provide instructions to modify the steering angle of the vehicle 100, so that the self-driving car follows a given trajectory and/or maintains an object near the self-driving car (for example, , The safe horizontal and vertical distances of cars in adjacent lanes on the road.
  • the above-mentioned vehicle 100 can be a car, truck, motorcycle, bus, boat, airplane, helicopter, lawn mower, recreational vehicle, playground vehicle, construction equipment, tram, golf cart, train, and trolley, etc.
  • the embodiments of the invention are not particularly limited.
  • Scenario example 2 Autonomous driving system
  • the computer system 101 includes a processor 103, and the processor 103 is coupled to a system bus 105.
  • the processor 103 may be one or more processors, where each processor may include one or more processor cores.
  • a display adapter (video adapter) 107 can drive the display 109, and the display 109 is coupled to the system bus 105.
  • the system bus 105 is coupled with an input output (I/O) bus 113 through a bus bridge 111.
  • the I/O interface 115 is coupled to the I/O bus.
  • the I/O interface 115 communicates with a variety of I/O devices, such as an input device 117 (such as a keyboard, a mouse, a touch screen, etc.), a media tray 121 (such as a CD-ROM, a multimedia interface, etc.).
  • Transceiver 123 can send and/or receive radio communication signals
  • camera 155 can capture scene and dynamic digital video images
  • external USB interface 125 external USB interface 125.
  • the interface connected to the I/O interface 115 may be a USB interface.
  • the processor 103 may be any conventional processor, including a reduced instruction set computing ("RISC”) processor, a complex instruction set computing (“CISC”) processor, or a combination of the foregoing.
  • the processor may be a dedicated device such as an application specific integrated circuit (“ASIC").
  • the processor 103 may be a neural network processor or a combination of a neural network processor and the foregoing traditional processors.
  • the computer system 101 may be located far away from the autonomous driving vehicle, and may communicate with the autonomous driving vehicle O wirelessly.
  • some of the processes described herein are executed on a processor provided in an autonomous vehicle, and others are executed by a remote processor, including taking actions required to perform a single manipulation.
  • the computer 101 can communicate with the software deployment server 149 through the network interface 129.
  • the network interface 129 is a hardware network interface, such as a network card.
  • the network 127 may be an external network, such as the Internet, or an internal network, such as an Ethernet or a virtual private network (VPN).
  • the network 127 may also be a wireless network, such as a WiFi network, a cellular network, and so on.
  • the hard disk drive interface is coupled to the system bus 105.
  • the hardware drive interface is connected with the hard drive.
  • the system memory 135 is coupled to the system bus 105.
  • the data running in the system memory 135 may include the operating system 137 and application programs 143 of the computer 101.
  • the operating system includes Shell 139 and kernel 141.
  • Shell 139 is an interface between the user and the kernel of the operating system.
  • the shell is the outermost layer of the operating system. The shell manages the interaction between the user and the operating system: waiting for the user's input, explaining the user's input to the operating system, and processing the output of various operating systems.
  • the kernel 141 is composed of those parts of the operating system for managing memory, files, peripherals, and system resources. Directly interact with hardware, the operating system kernel usually runs processes and provides inter-process communication, providing CPU time slice management, interrupts, memory management, IO management, and so on.
  • Application programs 143 include programs related to controlling auto-driving cars, such as programs that manage the interaction between autonomous vehicles and road obstacles, programs that control the route or speed of autonomous vehicles, and programs that control interaction between autonomous vehicles and other autonomous vehicles on the road. .
  • the application program 143 also exists on the system of the software deployment server 149. In one embodiment, when the application program 147 needs to be executed, the computer system 101 may download the application program 143 from the software deployment server 149.
  • the sensor 153 and the camera 155 obtain the road travelable area perception information, and save the road travelable area perception information to the hard drive 131 through the I/O interface 115, the bus bridge 111, the system bus 105, and the hard drive interface 121.
  • the processor 103 obtains the road drivable area perception information from the hard disk drive 131 through the system bus 105 and the hard disk drive interface 121, and executes the automatic driving related program 147 in the application 143 for the road drivable area perception information, and executes the automatic driving related program 147
  • the processor 103 specifically executes the following steps; obtain the perceived drivable area according to the road drivable area perception information, and verify the perceived drivable area to obtain the first area and the second area, where the first area is If the first area covers the ROI, the processor 103 will determine the first area as the road-drivable area; if the first area is not covered by the ROI In ROI, the processor 103 obtains the perceptual memory information from the hard disk drive 133,
  • the third area is the perceptual memory area and the second area.
  • the area where the area overlaps, the fourth area is the area not covered by the perceptual memory area in the second area; if the first area and the third area cover the ROI, the processor 103 determines the first area and the third area as road-driving areas If the first area and the third area do not cover the ROI, the processor 103 obtains the drivable position point information from the hard disk drive 133 or other unit or server, and infers the fourth area based on the drivable position point information to obtain
  • the fifth area, the fifth area is a drivable area in the fourth area; the processor 113 determines the first area, the third area, and the fifth area as road drivable areas; the processor 113 drives according to the road drivable area Route planning decisions are made to obtain a planned driving route; the processor 113 controls the vehicle to travel according to the planned driving route.
  • the sensor 153 is associated with the computer system 101.
  • the sensor 153 is used to detect the environment around the computer 101.
  • the sensor 153 can detect animals, cars, obstacles, and crosswalks.
  • the sensor can also detect the environment around objects such as animals, cars, obstacles, and crosswalks, such as the environment around the animals, for example, when the animals appear around them. Other animals, weather conditions, the brightness of the surrounding environment, etc.
  • the sensor may be a camera, an infrared sensor, a chemical detector, a microphone, etc.
  • the absolute speed of the own vehicle and the relative speed of surrounding vehicles are obtained through the speed sensor
  • the relative position coordinates of the own vehicle are obtained through the position sensor, etc.
  • the angle of the head of the own vehicle in the driving direction is obtained through the angle sensor.
  • Figure 3 is a chip hardware structure diagram provided by an embodiment of the present invention.
  • the neural network processor NPU 50 is mounted on the main CPU (Host CPU) as a coprocessor, and the Host CPU allocates tasks.
  • the core part of the NPU is the arithmetic circuit 50.
  • the controller 504 controls the arithmetic circuit 503 to extract data from the memory (weight memory or input memory) and perform calculations.
  • the arithmetic circuit 503 includes multiple processing units (Process Engine, PE). In some implementations, the arithmetic circuit 503 is a two-dimensional systolic array. The arithmetic circuit 503 may also be a one-dimensional systolic array or other electronic circuits capable of performing mathematical operations such as multiplication and addition. In some implementations, the arithmetic circuit 503 is a general-purpose matrix processor.
  • PE Processing Unit
  • the arithmetic circuit 503 is a two-dimensional systolic array. The arithmetic circuit 503 may also be a one-dimensional systolic array or other electronic circuits capable of performing mathematical operations such as multiplication and addition. In some implementations, the arithmetic circuit 503 is a general-purpose matrix processor.
  • the arithmetic circuit fetches the corresponding data of matrix B from the weight memory 502 and buffers it on each PE in the arithmetic circuit.
  • the arithmetic circuit takes the data of matrix A and matrix B from the input memory 501 to perform matrix operations, and the partial results or final results of the obtained matrix are stored in the accumulator 508.
  • the vector calculation unit 507 can perform further processing on the output of the arithmetic circuit, such as vector multiplication, vector addition, exponential operation, logarithmic operation, size comparison and so on.
  • the vector calculation unit 507 can be used for network calculations in the non-convolutional/non-FC layer of the neural network, such as pooling, batch normalization, local response normalization, etc. .
  • the vector calculation unit 507 can store the processed output vector in the unified buffer 506.
  • the vector calculation unit 507 may apply a nonlinear function to the output of the arithmetic circuit 503, such as a vector of accumulated values, to generate the activation value.
  • the vector calculation unit 507 generates a normalized value, a combined value, or both.
  • the processed output vector can be used as an activation input to the arithmetic circuit 503, for example for use in subsequent layers in a neural network.
  • the unified memory 506 is used to store input data and output data.
  • the memory unit access controller 505 (Direct Memory Access Controller, DMAC) transfers the input data in the external memory to the input memory 501 and/or the unified memory 506, stores the weight data in the external memory into the weight memory 502, and stores the unified memory The data in 506 is stored in the external memory.
  • DMAC Direct Memory Access Controller
  • a bus interface unit (BIU) 510 is used to implement interaction between the main CPU, the DMAC, and the fetch memory 509 through the bus.
  • An instruction fetch buffer 509 connected to the controller 504 is used to store instructions used by the controller 504;
  • the controller 504 is used to call the instruction cached in the instruction fetch memory 509 to control the working process of the operation accelerator.
  • the unified memory 506, the input memory 501, the weight memory 502, and the instruction fetch memory 509 are all on-chip (On-Chip) memories, and the external memory is a memory external to the NPU.
  • the external memory can be a double data rate synchronous dynamic random access memory.
  • Memory Double Data Rate Synchronous Dynamic Random Access Memory, referred to as DDR SDRAM
  • High Bandwidth Memory (HBM) or other readable and writable memory.
  • the computer system 112 may also receive information from other computer systems or transfer information to other computer systems.
  • the sensor data collected from the sensor system 104 of the vehicle 100 may be transferred to another computer to process the data.
  • data from the computer system 112 may be transmitted to the computer 720 on the cloud side via the network for further processing.
  • the network and intermediate nodes can include various configurations and protocols, including the Internet, World Wide Web, Intranet, virtual private network, wide area network, local area network, private network using one or more company's proprietary communication protocols, Ethernet, WiFi and HTTP, And various combinations of the foregoing. This communication can be by any device capable of transferring data to and from other computers, such as modems and wireless interfaces.
  • the computer 720 may include a server with multiple computers, such as a load balancing server group, which exchanges information with different nodes of the network for the purpose of receiving, processing, and transmitting data from the computer system 112.
  • the server can be configured similarly to the computer system 110 and has a processor 730, a memory 740, instructions 750, and data 760.
  • the data in the server 720 may include information such as the vehicle's drivable position point coordinates, the angle of the front of the vehicle, and the like sent by the communication device on the vehicle.
  • the data in the server 720 may also include data such as historical grid maps.
  • FIG. 5 shows an example of an autonomous driving vehicle and a cloud service center according to an example embodiment.
  • the cloud service center 520 may receive information (such as data collected by vehicle sensors or other information) from the autonomous vehicles 510, 512, and 514 in its operating environment 500 via a network 502 such as a wireless communication network.
  • a network 502 such as a wireless communication network.
  • the coordinates of the driving position of the own vehicle For example, the coordinates of the driving position of the own vehicle, the coordinates of the driving position of the surrounding vehicles, and the area information of the driving area perception.
  • the cloud service center 520 runs its stored programs related to controlling automatic driving of automobiles to control the autonomous vehicles 510, 512, and 514.
  • Programs related to controlling auto-driving can be programs that manage the interaction between autonomous vehicles and obstacles on the road, programs that control the route or speed of autonomous vehicles, and programs that control interaction between autonomous vehicles and other autonomous vehicles on the road.
  • the cloud service center 520 obtains the road-drivable area perception information, and obtains the perceived drivable area according to the road-drivable area perception information; checks the perceived drivable area to obtain the first area and the second area.
  • the area is a drivable area with reliable verification, and the second area is a drivable area with unreliable verification; if the first area covers the ROI, the first area is determined as the road drivable area; if the first area does not cover the ROI
  • the cloud service center 520 obtains the perceptual memory information, and performs inference operations on the second area according to the perceptual memory information to obtain the third area and the fourth area.
  • the third area is the area where the perceptual memory area and the second area overlap.
  • the fourth area is the area not covered by the perceptual memory area in the second area; if the first area and the third area cover the ROI, the cloud service center 520 determines the first area and the third area as road-driving areas; If the area and the third area do not cover the ROI, the cloud service center 520 obtains the drivable position point information, and infers the fourth area based on the drivable position point information to obtain the fifth area, which is the fourth area The cloud service center 520 determines the first area, the third area, and the fifth area as road drivable areas.
  • the cloud service center 520 makes driving route planning decisions based on the driveable area of the road to obtain the planned driving route; the cloud service center 520 sends the planned driving route to the vehicle control system so that the functional modules of the control system control the vehicle according to the planned driving route Driving.
  • the network 502 externally provides part of the map to the autonomous vehicle 510, 512, or 514.
  • operations can be divided between different locations or centers.
  • multiple cloud service centers 520 may receive, confirm, combine, and/or send information reports.
  • information reports and/or sensor data can also be sent between autonomous vehicles.
  • Other configurations are also possible.
  • the cloud service center 520 sends to the autonomous vehicle a suggested solution for possible driving situations in the environment (eg, inform the obstacle ahead and tell how to avoid it). For example, the cloud service center 520 may assist the vehicle in determining how to proceed when facing a specific obstacle in the environment.
  • the cloud service center 520 sends a response to the autonomous vehicle indicating how the vehicle should travel in a given scene. For example, the cloud service center 520 can confirm the existence of a temporary stop sign in front of the road based on the collected sensor data, and also determine that the lane has been impaired due to the “lane closed” sign and the sensor data of construction vehicles on the lane. Closed.
  • the cloud service center 520 sends a suggested operation mode for the automatic driving vehicle to pass the obstacle (for example, instructing the vehicle to change lanes on another road).
  • the operation steps used for the autonomous driving vehicle can be added to the driving information map.
  • this information can be sent to other vehicles in the area that may encounter the same obstacle, so as to assist other vehicles not only to recognize the closed lane but also how to pass.
  • FIG. 6 is a schematic diagram of an application scenario of a method for reasoning on a road drivable area provided by an embodiment of the present invention.
  • the application scenario includes: a vehicle-mounted device 601, a roadside unit 602, and a cloud information platform.
  • the data interaction between the cloud information platform 603 and the roadside unit (RSU) 602 is realized through remote communication, such as 4G, 5G, optical fiber communication, etc.; the vehicle device 601 and the cloud information platform 603 Data interaction is completed through remote communication, such as 4G, 5G, etc.; information interaction between the vehicle-mounted device 601 and the roadside unit 602 is achieved through short-range communication, such as DSRC technology, long term evolution for vehicles, LTE-V ) Technology etc.
  • remote communication such as 4G, 5G, optical fiber communication, etc.
  • the vehicle device 601 and the cloud information platform 603 Data interaction is completed through remote communication, such as 4G, 5G, etc.
  • information interaction between the vehicle-mounted device 601 and the roadside unit 602 is achieved through short-range communication, such as DSRC technology, long term evolution for vehicles, LTE-V ) Technology etc.
  • the vehicle-mounted device 601 obtains road-drivable area perception information, and obtains the perceived drivable area according to the road-drivable area perception information; checks the perceived drivable area to obtain the first area and the second area, where the first area is Check the reliable drivable area, the second area is the unreliable drivable area; if the first area covers the ROI, the vehicle-mounted device 601 determines the first area as the road drivable area; if the first area is not covered In the case of ROI, the vehicle-mounted device 601 obtains the perceptual memory information of the drivable area from its memory, and uses the perceptual memory area to perform inference operations on the unreliable drivable area to obtain the third area and the fourth area.
  • the third area Is the area where the sensing memory area overlaps with the second area, and the fourth area is the area not covered by the sensing memory area in the second area; if the first area and the third area cover the ROI, the vehicle-mounted device 601 combines the first area and the third area.
  • the area is determined to be a drivable area on the road; if the first area and the third area do not cover the ROI, the vehicle-mounted device 601 obtains the drivable position point information from the RSU 602 or the cloud information platform 603, and compares the fourth area according to the drivable position point information.
  • the area is inferred to obtain the fifth area, which is the drivable area in the fourth area, and determines the first area, the third area, and the fifth area as the road drivable area. Then, the driving route planning decision is made according to the driving area of the road to obtain the planned driving route.
  • RSU602 collects the drivable position point information generated by the vehicle on the road section it is on, uploads the generated drivable position point information to the cloud information platform 603, and sends the drivable position point information to the vehicle traveling on the current road section.
  • the cloud information platform 603 collects the drivable location point information generated by each vehicle and collected by RSU602, and integrates the information; combined with the current location of the vehicle, the user's current driving destination and navigation route, the user's common driving route, etc., update the drivable location of nearby roads Point information to the on-board device of the vehicle; update the driving position point information to the RSU602 of the corresponding road according to different road directions.
  • FIG. 7 is a schematic flowchart of a method for reasoning on a road drivable area according to an embodiment of the present invention. As shown in Figure 7, the method includes:
  • the vehicle-mounted device obtains the driving area perception information of the road, and determines the perceived driving area according to the driving area perception information.
  • the driving area perception information includes relevant information obtained by the environmental sensor of the vehicle, such as the information of the area in front of the vehicle obtained by the camera or lidar, including road information, obstacle information, and related information of surrounding vehicles;
  • the wave radar obtains the speed information and relative position of the obstacle and the surrounding vehicles, and determines the acceleration of the obstacle and the surrounding vehicles according to the speed of the obstacle and the surrounding vehicles.
  • the vehicle-mounted device determines the perceived drivable area according to the relevant information obtained by the environmental sensor.
  • the perceived drivable area is essentially a grid map, and the drivability value of each grid in the grid map is used to characterize the probability of the grid being drivable.
  • the vehicle-mounted device verifies the perceived travelable area to obtain a verification result.
  • the verification result includes the first area and the second area.
  • the first area is a drivable area with reliable verification
  • the second area is a drivable area with unreliable verification
  • the vehicle-mounted device verifies the perceived travelable area to obtain the verification result, which specifically includes:
  • the perceptible drivable area is divided to obtain multiple sub-areas; determine whether each sub-areas of the multiple sub-areas satisfies the following conditions 1-condition 4; if the sub-areas If I satisfies each of the conditions 1-condition 4, the sub-area I is determined to be a reliable sub-area; if the sub-area I does not meet any of the conditions 1-condition 4, the sub-area I is determined to be a check Unreliable sub-region; where, sub-region I is any one of multiple sub-regions.
  • the first area is an area composed of sub-areas with reliable verification among multiple sub-areas
  • the second area is an area composed of sub-areas with reliable verification among multiple sub-areas.
  • condition 1 the width of sub-region I meets the following conditions:
  • W is determined jointly by the experience width We of the drivable area and the memory width Wm of the drivable area.
  • the value range of the driving area experience width We can be determined according to road construction specifications and research literature, and the driving area memory width Wm can be calculated based on the weighted average of the driving area width values for a period of time before the current moment.
  • the memory width of the drivable area W i at time i is travelable area memory width, [mu] i of the weighting value W i; the present time distances travelable area, the greater the weighted value width of the memory.
  • Condition 2 The angle between the boundary of the sub-region I and the boundary of the adjacent sub-region is not greater than the first preset angle.
  • the angle between the left boundary of the subregion I and the left boundary of its adjacent subregion is not greater than the first preset angle, and the angle between the right boundary of the subregion I and the right boundary of its adjacent subregion is not greater than the first preset angle, If the angle is set, it is determined whether the included angle between the boundary of the sub-region I and the boundary of the adjacent sub-region is not greater than the first preset angle; if the included angle between the left boundary of the sub-region I and the left boundary of the adjacent sub-region is greater than the first preset Assuming that the angle or the included angle between the right boundary of the subregion I and the right boundary of the adjacent subregion is greater than the first preset angle, it is determined that the included angle between the boundary of the subregion I and the boundary of the adjacent subregion is greater than the first preset angle .
  • the size of the first preset angle depends on the degree of structure of the drivable area; the higher the degree of structure of the drivable area, the smaller the first predetermined angle.
  • area I and area II are adjacent, and the angle between the left boundary of area I and the left boundary of area II is a vector With vector
  • the angle between the right boundary of area I and the right boundary of area II is a vector With vector The included angle.
  • Condition 3 The distance between the boundary of the sub-region I and the boundary of the perceptual memory area verified before the current moment is not greater than the preset width.
  • the distance between the left boundary of the subregion I and the left boundary of the perceptual memory area verified before the current moment is not greater than the preset width, and the right boundary of the subregion I is equal to that verified before the current moment.
  • the distance between the right boundary of the perceptual memory area is not greater than the preset width, then it is determined whether the distance between the boundary of the sub-area I and the boundary of the perceptual memory area verified before the current moment is not greater than the preset width; if the left boundary of the sub-area I The distance from the left boundary of the sensory memory area verified before the current moment is greater than the preset width or the distance between the right boundary of the sub-region I and the right boundary of the sensory memory area verified before the current moment is greater than the preset width, It is determined that the distance between the boundary of the sub-region I and the boundary of the perceptual memory area verified before the current moment is greater than the preset width.
  • Condition 4 The ratio of the drivable position points in the subregion I is greater than the preset ratio.
  • the ratio of the drivable position points in sub-area I is Is the number of driving position points in sub-area I, Is the number of non-driving position points in subarea I.
  • the vehicle-mounted device determines whether the first area covers the ROI.
  • the region of interest (region of interest, ROI) is the region of interest of the subsequent driving route decision planning module.
  • step S707 is executed; if the first area does not cover the ROI, step S704 is executed.
  • the vehicle-mounted device infers the second area according to the perceptual memory information to obtain the third area and the fourth area.
  • the perceptual memory information includes perceptual memory grid maps at multiple historical moments and the drivability value of each grid in each perceptual memory grid map, and the second region is inferred based on the perceptual memory information to obtain the first
  • the third area and the fourth area include:
  • the driving ability value calculates the driving ability value of each grid in the first inference grid map; the third area and the fourth area are determined according to the driving ability value of each grid in the first inference grid map; the third area It is an area composed of grids in the first inference grid map whose drivability value is greater than the first threshold; the fourth area is an area composed of grids in the first inference grid map whose drivability value is not greater than the first threshold.
  • the perceptual memory grid maps of multiple historical moments are respectively transformed from the vehicle coordinate system of the vehicle at the historical moment to the world coordinate system to obtain multiple world grid maps, including:
  • the perceptual memory grid maps of the multiple historical moments are respectively converted from the vehicle coordinate system of the vehicle at the historical moment to the world coordinate system to obtain the multiple world grid maps;
  • the first conversion formula is: Among them, (x vt0 ,y vt0 ) are the coordinates of any drivable location point P in the perception memory grid map at historical time t0 in the vehicle coordinate system of the own vehicle, and (x wt0 ,y wt0 ) is the drivable location point
  • First conversion matrix (x t0 , y t0 ) are the coordinates of the vehicle at historical time t0 in the world standard system, and ⁇ t0 is the heading angle of the vehicle at historical time t0.
  • converting the inference area from the world coordinate system to the vehicle coordinate system of the vehicle at the current moment to obtain the first inference grid map includes:
  • the second conversion formula is: (x wp ,y wp ) is the coordinates of any travelable position point P'in the inference area in the world coordinate system, (x vp ,y vp ) is the vehicle coordinate system of the self-vehicle at the current moment The coordinates below, Is the second conversion matrix;
  • Second conversion matrix (x 0 , y 0 ) are the coordinates of the vehicle at the current moment in the world coordinate system, and ⁇ 0 is the heading angle of the vehicle at the current moment.
  • calculating the drivability value of each grid in the first inference grid map according to the drivability value of each grid in the perceptual memory grid map includes:
  • the drivability value of the multiple historical moments is the drivability value of the corresponding grid in the perceptual memory grid map of the multiple historical moments in the grid of the p-th column and the q-th row;
  • the drivability value of the grid in the p-th column and the q-th row in the first inference grid map is: Sensing a corresponding memory in raster map raster historic time t travelable ability value, k 't' is the weight of.
  • the upper part is the perceptual memory grid map of n historical moments
  • the lower part is the area where the perceptual memory grid map of n historical moments overlaps with the second area, that is, the lower part Part is the first inference grid map.
  • the gray grid in the perceptual memory grid map of n historical moments is the grid corresponding to the gray grid in the lower part.
  • the vehicle-mounted device determines whether the first area and the third area cover the ROI.
  • step S707 is executed; if the first area and the third area do not cover the ROI, then step S706 is executed.
  • the vehicle-mounted device infers the fourth area according to the information of the driving position point to obtain the fifth area.
  • the vehicle-mounted device before inferring the fourth area based on the drivable position point information, obtains the drivable area position point information, where the drivable position point information includes the self-vehicle drivable position point information and/ Or the location information of the surrounding vehicles.
  • the location information of the self-vehicle can be obtained from the driving information of the self-vehicle, and it can also be obtained from the roadside unit and/or the cloud information platform.
  • the location information of the surrounding vehicles can be obtained according to the information of the surrounding vehicles. , It can also be obtained from the cloud information platform and/or from the roadside unit.
  • the driving position point information can be transmitted to the roadside unit and/or the cloud information platform; the vehicle-mounted device can obtain the surrounding vehicles according to the driving information of the surrounding vehicles
  • the drivable position point information of the surrounding vehicles is transmitted to the roadside unit and/or cloud information platform; the roadside unit will obtain the drivable position point information of the surrounding vehicles and the drivable position of its own vehicle Point information is transmitted to the cloud information platform.
  • the vehicle-mounted device obtains the driving position point information of surrounding vehicles according to the driving information of the surrounding vehicles, including:
  • the vehicle-mounted device acquires the driving information of surrounding vehicles and the driving information of the own vehicle.
  • the driving information of the surrounding vehicles includes relative position coordinates and longitudinal relative speed.
  • the driving information of the own vehicle includes the absolute position coordinates, absolute speed and heading angle of the vehicle.
  • the relative position coordinates are the coordinates of the surrounding vehicles in the vehicle coordinate system, and the absolute position coordinates are the coordinates in the world coordinate system;
  • the vehicle-mounted device obtains the surrounding vehicles according to the absolute position coordinates of the own vehicle, the heading angle of the vehicle and the relative position coordinates of the surrounding vehicles
  • the drivable position point coordinates of the surrounding vehicles are the coordinates of the surrounding vehicles in the world coordinate system;
  • the type of the drivable position point coordinates of the surrounding vehicles is determined according to the longitudinal relative speed of the surrounding vehicles and the absolute speed of the own vehicle, where ,
  • the types of the drivable position point coordinates include the reverse direction drivable position point coordinates and the same direction drivable position point coordinates.
  • the vehicle-mounted device obtains the coordinates of the vehicle A's traversable position point according to the absolute position coordinates of the vehicle, the heading angle of the vehicle, and the relative position coordinates of the vehicle A, including:
  • the fourth conversion formula is: (x Av , y Av ) are the relative position coordinates of vehicle A, (x Aw , y Aw ) are the coordinates of the position where vehicle A can travel;
  • Third conversion matrix (x 0 , y 0 ) is the absolute position coordinate of the own vehicle at the current moment, ⁇ 0 is the heading angle of the own vehicle at the current moment, and vehicle A is any of the surrounding vehicles.
  • the absolute speed of vehicle A is If the absolute speed V 0 of vehicle A is less than the first speed threshold VT1 , vehicle A is determined to be a stationary vehicle; otherwise, vehicle A is determined to be a moving vehicle, where ( ⁇ V x , ⁇ V y ) means that vehicle A is in the vehicle coordinate system The horizontal relative speed and the vertical relative speed of the bottom.
  • the vehicle-mounted device determines the type of absolute position coordinates of the surrounding vehicles at t0 according to the absolute speed of the vehicle and the longitudinal relative speed of the surrounding vehicles. Specifically, the vehicle-mounted device determines the surrounding vehicles according to the longitudinal relative speed of the surrounding vehicles and the absolute speed of the vehicle. For vehicle A, if V s + ⁇ V x >V T2 , it is determined that the driving direction of vehicle A is the same as the driving direction of its own vehicle according to the driving direction of surrounding vehicles. And then determine that the vehicle A’s travelable position point coordinates are the same direction travelable position point coordinates.
  • V s + ⁇ V x ⁇ -V T2 determine that the driving direction of vehicle A is opposite to the driving direction of the vehicle, and then determine the vehicle
  • the coordinates of the drivable position point of A are the coordinates of the drivable position point in the reverse direction, where V T2 is the second speed threshold.
  • the vehicle-mounted device divides the coordinates of the driving position points of the surrounding vehicles into road direction 1 and road direction 2, and road direction 1 and road direction 2 are two opposite directions on the same road.
  • the vehicle-mounted device determines that the reverse direction travelable position point coordinates are the coordinates in the road direction 2. And save the coordinates of the reverse drivable position point to the roadside unit on the road direction 2 side; if the own vehicle is not traveling along the road direction 1, the vehicle-mounted device determines that the reverse drivable position point coordinates are the coordinates on the road direction 1. , And save the coordinates of the reverse drivable position point to the roadside unit on the side of the road direction 1.
  • the on-board device should synchronize The coordinates of the driving position point are the coordinates on the road direction 1, and the coordinates of the driving position point in the same direction are saved in the roadside unit on the side of the road direction 1. If the vehicle is not traveling along the road direction 1, the vehicle-mounted device It is determined that the coordinates of the driving position point in the same direction are the coordinates on the road direction 2, and the coordinates of the driving position point in the same direction are saved in the roadside unit on the side of the road direction 2.
  • the process of obtaining the coordinates of the vehicle A's driving position point by the above-mentioned on-board device can be regarded as obtaining the coordinates of the driving position point of the surrounding vehicles at a certain moment, and the vehicle device may obtain the surrounding vehicles at different times according to the above method.
  • the coordinates of the driving position point can be the driving position point information.
  • the roadside unit on the side of the road direction 1 sends the received coordinates of the drivable position point to the cloud information platform
  • the roadside unit on the side of the road direction 2 sends the received coordinates of the drivable position point To the cloud information platform.
  • the in-vehicle device sends the driving position point information of surrounding vehicles to the cloud information platform.
  • the driving position points of the own vehicle include safe driving position points and driving risk position points
  • the vehicle-mounted device obtains the driving position point information of the own vehicle according to the driving information of the own vehicle, which specifically includes:
  • the vehicle-mounted device obtains the coordinates of the current position of the vehicle and determines whether the current position of the vehicle is a safe driving position.
  • the vehicle-mounted device determining whether the current position of the vehicle is a safe driving position includes: judging whether the vehicle is at the current position Whether the driving mode is manual driving mode, if it is determined that the driving mode of the own car at the current position is manual driving mode, the current position of the own car is determined to be a safe driving position; if the driving mode of the own car at the current position is determined to be In the automatic driving mode, it is judged whether there is a driving safety risk at the current position of the vehicle; if the vehicle has a driving safety risk at the current position, the current position of the vehicle is determined as the driving risk position; if the vehicle is at the current position If there is no driving safety risk, the current position of the vehicle is determined to be a safe driving position.
  • the driving safety position point includes the driving safety position point on the road direction 1 and the driving safety position point on the road direction 2
  • the driving risk position point includes the driving risk position point on the road direction 1 and the driving risk on the road direction 2.
  • the driving safety location point of the own vehicle It is a safe driving position point in road direction 2
  • the driving risk position point of the own vehicle is the driving risk position point in road direction 2
  • the driving safety position point and driving risk position point of the own vehicle are saved to road direction 2.
  • the roadside unit on the side In the roadside unit on the side.
  • the vehicle-mounted device determines whether the vehicle has a driving safety risk at the current location, specifically determining whether the vehicle has a collision risk or abnormal driving behavior at the current location. If it is determined that the vehicle is at the current location If there is a collision risk or abnormal driving behavior at the location point, it is determined that the own vehicle has a driving safety risk at the current location point; if it is determined that the own vehicle has no collision risk and no abnormal driving behavior at the current location point, it is determined that the own vehicle does not Driving safety risks.
  • determining whether the vehicle has a collision risk at the current location by the vehicle-mounted device specifically includes:
  • the vehicle-mounted device obtains the included angle ⁇ formed by the traveling direction of the own vehicle and the traveling direction of the vehicle S, and the vehicle S is any of the surrounding vehicles traveling in the same direction as the own vehicle; when the included angle ⁇ is greater than the second preset angle, according to the intersection
  • the mode risk discrimination method determines whether the own vehicle has a collision risk at the current position; when the included angle ⁇ is less than the second preset angle, the rear-end collision risk discrimination method determines whether the own vehicle has a collision risk at the current position.
  • the relative speed of the vehicle E in the vehicle coordinate system is ( ⁇ V Ex , ⁇ V Ey ), the coordinates of the relative position point B are (x Ev , y Ev ), and the vehicle is in the driving direction
  • the absolute speed on is V s
  • the lower relative position point is denoted as A', as shown in Figure 11, point O is the potential collision point between the own vehicle and the vehicle E.
  • the time from the vehicle to the potential collision point O is:
  • the time from the weekly car to the potential collision point O is:
  • the vehicle-mounted device determines that the vehicle has a risk of collision at the current location point, where ⁇ is the preset threshold, and R 0 is the risk threshold.
  • the preset threshold ⁇ may be 0.5s
  • the risk threshold R 0 may be 0.5.
  • the vehicle-mounted device determines whether the vehicle has a collision risk at the current position according to a rear-end collision risk discrimination method, including:
  • condition 1 is:
  • condition 2 is:
  • TTC is the collision time between the vehicle and the surrounding vehicle in front of it.
  • b and c are constants
  • ⁇ is the horizontal distance threshold
  • is the horizontal distance between the own vehicle and the vehicle E.
  • the vehicle-mounted device determines whether the own vehicle has abnormal driving behavior at the current location point, which specifically includes:
  • the vehicle-mounted device determines whether there is emergency braking or emergency steering at the current location, and if it is determined that the own vehicle has emergency braking or emergency steering at the current location, it determines that the own vehicle has abnormal driving behavior at the current location ; If it is determined that the own vehicle has no emergency braking and no emergency steering behavior at the current position, it is determined that the own vehicle has no abnormal driving behavior at the current position.
  • the vehicle-mounted device determines whether the own vehicle has an emergency braking behavior at the current position, which specifically includes:
  • the vehicle-mounted device obtains the longitudinal acceleration a lon of the vehicle at the current position. If the longitudinal acceleration a lon is less than the preset acceleration a T , it is determined that the vehicle has emergency braking behavior at the current position; if the longitudinal acceleration a lon is not less than the preset acceleration a lon With acceleration a T , it is determined that the vehicle has no emergency braking behavior at the current position.
  • the preset acceleration a T may be -6 m/s 2 or other values.
  • the vehicle-mounted device determines whether the own vehicle has an emergency steering behavior at the current position, which specifically includes:
  • the vehicle-mounted device obtains the steering wheel angle rate of the vehicle at the current position If the steering wheel angle rate Greater than preset rate It is determined that the vehicle has an emergency steering behavior at the current position; if the steering wheel angle rate Not greater than the preset rate It is determined that the vehicle has no emergency steering behavior at the current position.
  • preset rate It can be 100°/s 2 or other values.
  • the road-drivable position point information may be generated by the own vehicle or another vehicle, or may be obtained by the own vehicle from the roadside unit or cloud information platform of the road section where it is located.
  • the vehicle-mounted device can obtain the position point coordinates of the self-vehicle at different times according to the above method, and determine the safe driving position and the driving risk position of the self-vehicle at different times.
  • the vehicle-mounted device infers the fourth area according to the drivable location point to obtain the fifth area, which specifically includes:
  • the location point to be inferred from the driveable location point, which is the driveable location point located in the area where the fourth area overlaps the ROI; convert the coordinates of the location to be inferred from the world coordinate system to that of the vehicle Under the vehicle coordinate system, in order to obtain the driving area to be inferred, the driving area to be inferred is the area formed by the inferred position points in the vehicle coordinate system of the own vehicle; grid division is performed on the driving area to be inferred to obtain the second Inference grid map; calculate the drivability value of each grid according to the drivable position point information in each grid in the second inference grid map; determine the fifth area according to the drivability value of each grid, The fifth area is an area composed of grids with a drivability value greater than the second threshold in the second inference grid map.
  • the drivable location point information can also be represented by the data structure [timestamp,(x w ,y w , ⁇ w ),Label], and timestamp is the time at which the drivable location point is obtained, that is, the timestamp; (x w ,y w , ⁇ w ) are the coordinates of the drivable position point in the world coordinate system and the angle of the front of the vehicle, and Label is used to characterize the type of the drivable position point. Label includes four types, namely direct, inverse, safe and danger.
  • direct means that the drivable position point is the drivable position point of the car traveling in the same direction
  • inverse means the drivable position point is the drivable position point of the car traveling in the reverse direction
  • safe means the drivable position point is the safety of the vehicle.
  • the driving position point, danger indicates that the driving position point is the driving dangerous position point of the vehicle.
  • the vehicle-mounted device converts the coordinates of the location point to be inferred from the world coordinate system to the vehicle coordinate system of the vehicle to obtain the travelable area to be inferred, including:
  • the third conversion formula is: Among them, (x dw , y dw ) is the coordinate of any inferred position point D in the world coordinate system of the inferred position points, (x dv , y dv ) is the coordinate system of the inferred position D in the own vehicle The coordinates below, Is the second conversion matrix,
  • Second conversion matrix (x 0 , y 0 ) are the coordinates of the vehicle at the current moment in the world coordinate system, and ⁇ 0 is the heading angle of the vehicle at the current moment.
  • the vehicle-mounted device calculates the drivability value of each grid according to the drivable position point information in each grid in the second inference grid map, which specifically includes:
  • the drivability values at different moments are calculated according to the drivable position point information in the i-th column and j-th row grid in the second inference grid map; the drivability values at different times are weighted and summed to obtain the first The drivability value of the grid in column i and row j.
  • the drivability value of the raster in the i-th column and the j-th row in the raster map of the drivable area Is the drivability value at time t in the grid of column i and row j, k t is the weight of.
  • the drivability value at time t in the grid of column i and row j It can be calculated using the following formula:
  • the fifth area is determined according to the drivability value of each grid, including:
  • the drivable area grid map is divided into drivable area, non-driving area or uncertain area, where the drivable area is the drivable area
  • the non-driving area is the area composed of grids with a raster drivability value less than - ⁇
  • the uncertain area is a grid composed of grids with a drivability value not less than - ⁇ and not greater than ⁇ Area.
  • the black area is the drivable area
  • the gray area is the undrivable area
  • the white area is the uncertain area.
  • the vehicle-mounted device performs route decision planning according to the drivable area of the road to obtain a planned driving route.
  • the road drivable area includes the first area; if the first area and the third area cover the ROI, the road drivable area includes the first area and the third area; if the vehicle-mounted device executes the steps S706:
  • the road traversable area includes a first area, a third area, and a fifth area.
  • the cloud information platform obtains the drivable area of the own vehicle according to the relevant content executed by the on-board device in the above steps S702-S706, and then transmits the drivable area to the on-board device of the own vehicle. Make route decision planning according to the drivable area of the road to obtain the planned driving route.
  • the vehicle-mounted device verifies the perceived drivable area, and determines that the perceptual drivable area is a reliable travelable area; if the verified travelable area covers the ROI, the vehicle-mounted device determines The perceptually reliable drivable area performs route decision planning to obtain a planned driving route; if the verified drivable area does not cover the ROI, the vehicle-mounted device compares the ROI with the perceptual memory area except for the verified drivable area The reasoning is performed outside the area. For the specific reasoning process, please refer to the relevant description of step S704, which will not be described here.
  • step S704 if the vehicle-mounted device verifies the perceived travelable area, and it is determined that the perceived travelable area is a travelable area with unreliable verification, the vehicle-mounted device is not reliable for the verification based on the perceived memory area.
  • the perceived drivable area is acquired; the perceptual drivable area is verified to obtain the first area and the second area, where the first area is a reliable drivable area.
  • the second area is a drivable area with unreliable verification; if the first area does not cover the area of interest ROI, the second area is inferred based on the perceptual memory information of the drivable area to obtain the third area and the fourth area ,
  • the third area is the area where the perceptual memory area overlaps with the second area, and the fourth area is the area not covered by the perceptual memory area in the second area; if the first area and the third area do not cover the ROI, then according to the driving position point
  • the fourth area is inferred to obtain the fifth area; the fifth area is the drivable area in the fourth area; the first area, the third area and the fifth area are determined as road drivable areas.
  • the road can be driven position points are generated, and with the help of car end-cloud-roadside
  • the end data sharing mode allows all vehicles to use the data to reason about the drivable area. It is suitable for structured roads and unstructured roads, does not depend on the vehicle's own motion state, and does not require other vehicles around the vehicle in real time.
  • the automatic driving system can therefore make decision planning with the use of reasoning information in the drivable area when it perceives short-term and long-term abnormalities in the drivable area, avoiding the failure of the automatic driving system, increasing the coverage of the operating conditions of the system, and improving system availability and user experience.
  • the invention can reduce the dependence of the automatic driving system on real-time perception, increase the fault-tolerant ability of the automatic driving system on real-time perception, and improve the reliability and safety of the automatic driving system when the perception of the road drivable area is uncertain.
  • the data of the drivable location points with a newer timestamp has a higher weight, so as to ensure that the inference results have better real-time performance and avoid temporary changes in road structure (such as road construction).
  • Negative Effects The specific implementation takes into account the historical driving position of the human driver and the safe road position in automatic driving mode (increase the drivability value of this position) and the risk road position in the automatic driving mode (decrease the drivable value of this position). For the user's common driving route, the automatic driving system using this application has the characteristic of "the more open the better".
  • FIG. 13 is a schematic structural diagram of a road drivable area reasoning device provided by an embodiment of the present invention.
  • the device 1300 for inference of road drivable area includes:
  • the obtaining module 1301 is used to obtain the perceived drivable area
  • the verification module 1302 is used to verify the perceived drivable area to obtain the first area and the second area, where the first area is a drivable area with reliable verification, and the second area is a drivable area with unreliable verification.
  • Driving area is a drivable area with reliable verification, and the second area is a drivable area with unreliable verification.
  • the inference module 1303 is used to if the first area does not cover the area of interest ROI, infer the second area according to the perceptual memory information of the drivable area to obtain the third area and the fourth area.
  • the third area is the perceptual memory area and The area where the second area overlaps, and the fourth area is the area that is not covered by the sensory memory area in the second area; if the first area and the third area do not cover the ROI, the fourth area is performed according to the driving position.
  • Reason to get the fifth area the fifth area is the drivable area in the fourth area;
  • the determining module 1304 is configured to determine the first area, the third area, and the fifth area as road drivable areas.
  • the verification module 1302 is specifically configured to:
  • condition 1 to condition 4 are:
  • w i is the width of the sub-area I, and W is determined according to the experience width of the drivable area and the memory width of the drivable area;
  • Condition 2 The angle between the boundary of the sub-region I and the boundary of the adjacent sub-region is not greater than the first preset angle
  • Condition 3 The distance between the boundary of the sub-region I and the boundary of the perceptual memory area verified before the current moment is not greater than the preset width
  • Condition 4 The ratio of the drivable position points in the subregion I is greater than the preset ratio.
  • the perceptual memory information includes perceptual memory grid maps at multiple historical moments and the drivability value of each grid in each perceptual memory grid map.
  • the perceptual memory information is used to compare the second area Perform reasoning to obtain aspects of the third area and the fourth area, and the reasoning module 1303 is specifically used to:
  • the driving ability value calculates the driving ability value of each grid in the first inference grid map; the third area and the fourth area are determined according to the driving ability value of each grid in the first inference grid map; the third area It is an area composed of grids in the first inference grid map whose drivability value is greater than the first threshold; the fourth area is an area composed of grids in the first inference grid map whose drivability value is not greater than the first threshold.
  • the reasoning module 1303 is specifically used for:
  • the perceptual memory grid maps of multiple historical moments are respectively converted from the vehicle coordinate system of the vehicle at the historical moment to the world coordinate system to obtain multiple world grid maps;
  • the first conversion formula is: Among them, (x vt0 ,y vt0 ) are the coordinates of any drivable location point P in the perception memory grid map at historical time t0 in the vehicle coordinate system of the own vehicle, and (x wt0 ,y wt0 ) is the drivable location point
  • First conversion matrix (x t0 , y t0 ) are the coordinates of the vehicle at historical time t0 in the world standard system, and ⁇ t0 is the heading angle of the vehicle at historical time t0.
  • the inference module 1303 is specifically configured to:
  • the second conversion formula is: (x wp ,y wp ) is the coordinates of any travelable position point P'in the inference area in the world coordinate system, (x vp ,y vp ) is the vehicle coordinate system of the self-vehicle at the current moment The coordinates below, Is the second conversion matrix;
  • Second conversion matrix (x 0 , y 0 ) are the coordinates of the vehicle at the current moment in the world coordinate system, and ⁇ 0 is the heading angle of the vehicle at the current moment.
  • the inference module 1303 specifically uses in:
  • the drivability value of multiple historical moments is the drivability value of the corresponding grid in the perceptual memory grid map of the grid of the p-th column and the q-th row at multiple historical moments;
  • the drivability value of the grid in the p-th column and the q-th row in the first inference grid map is:
  • k' t ' is the weight of.
  • the inference module 1303 is specifically configured to:
  • the location point to be inferred from the driveable location point, which is the driveable location point located in the area where the fourth area overlaps the ROI; convert the coordinates of the location to be inferred from the world coordinate system to that of the vehicle Under the vehicle coordinate system, in order to obtain the driving area to be inferred, the driving area to be inferred is the area formed by the inferred position points in the vehicle coordinate system of the own vehicle; grid division is performed on the driving area to be inferred to obtain the second Inference grid map; calculate the drivability value of each grid according to the drivable position point information in each grid in the second inference grid map; determine the fifth area according to the drivability value of each grid, The fifth area is an area composed of grids with a drivability value greater than the second threshold in the second inference grid map.
  • the inference module 1303 is specifically configured to:
  • the third conversion formula is: Among them, (x dw , y dw ) is the coordinate of any inferred position point D in the world coordinate system of the inferred position points, (x dv , y dv ) is the coordinate system of the inferred position D in the own vehicle The coordinates below, Is the second conversion matrix,
  • Second conversion matrix (x 0 , y 0 ) are the coordinates of the vehicle at the current moment in the world coordinate system, and ⁇ 0 is the heading angle of the vehicle at the current moment.
  • the inference module 1303 is specifically configured to:
  • the drivability values at different moments are calculated according to the drivable position point information in the i-th column and j-th row grid in the second inference grid map; the drivability values at different times are weighted and summed to obtain the first The drivability value of the grid in column i and row j;
  • the drivability value of the grid in the i-th column and the j-th row is Is the drivability value at time t, k t is the weight of,
  • the drivable position point includes the drivable position point of the self-vehicle, and the acquisition module 1301 is further used for:
  • the driving position points of the own vehicle include the driving safety position points and the driving risk position points; wherein, obtaining the driving position points of the own vehicle includes : Determine whether the driving mode of the own vehicle at its current position is manual driving mode; if the driving mode of the own vehicle at its current position is manual driving mode, determine the current position of the own vehicle as a safe driving position; If the driving mode at its current location is automatic driving mode, it is determined whether the vehicle has a risk of collision or abnormal driving behavior at its current location; if it is determined that the vehicle has no risk of collision and no abnormal driving behavior at its current location, the vehicle is determined The current position point of is a safe driving position; if it is determined that the vehicle has a risk of collision or abnormal driving behavior at its current position, the current position of the own vehicle is determined to be a dangerous driving position.
  • the acquiring module 1301 is specifically configured to:
  • the intersection mode risk judgment method is used to determine whether the own vehicle has a collision at its current position Risk: If the included angle ⁇ is not greater than the second preset angle, the rear-end collision mode risk judgment method is used to determine whether the vehicle has a collision risk at its current position.
  • the acquiring module 1301 is specifically configured to:
  • the first time is the time required for the vehicle to travel from its current position to the potential collision point
  • the second time is the time required for the vehicle E to travel from its current position to the potential collision point
  • formula 1 and Formula 2 it is determined that the vehicle has a risk of collision at its current position
  • formula 2 it is determined that the vehicle has no risk of collision at its current position
  • formula 1 is:
  • formula 2 is: TTX 1 is the first time, TTX 2 is the second time, ⁇ is the preset threshold, and R 0 is the risk threshold.
  • the acquiring module 1301 is specifically configured to:
  • the formula 3 is:
  • the formula 4 is: a and b are constants, R 0 is the risk threshold, ⁇ is the horizontal distance threshold, and
  • the acquiring module 1301 is specifically configured to:
  • the acquiring module 1301 is specifically configured to:
  • the acquiring module 1301 is specifically configured to:
  • the road drivable area reasoning device 1300 further includes a storage module 1305;
  • the determining module 1304 is also used for determining that the driving position point of the own vehicle is the driving position in the road direction 1 if the driving position point of the own vehicle is driving along the road direction 1 at its current position after the acquiring module 1301 acquires Location point, saving module 1305, used to save the drivable location point on the road direction 1 to the roadside unit on the side of the road direction 1, where the drivable location point on the road direction 1 includes the driving safety in the road direction 1. Location and driving risk location on road direction 1;
  • the determination module 1304 is also used for determining that the vehicle can travel along the road direction 2 at its current position, and then determine the travelable location point of the vehicle as the travelable location point on the road direction 2, and the storage module 1305 is used to change the road direction 2
  • the drivable position points on the road side are saved to the roadside unit on the road direction 2 side, where the drivable position points on the road direction 2 include the safe driving position on the road direction 1 and the driving risk position on the road direction 2; wherein, Road direction 1 and road direction 2 are opposite directions on the same road.
  • the obtaining module 1301 is also used to:
  • the driving position point information of surrounding vehicles includes the coordinates of the driving position point in the same direction and the coordinates of the driving position point in the reverse direction.
  • the acquisition module 1301 also uses in:
  • the driving information of vehicle A includes relative position coordinates and longitudinal relative speed
  • the driving information of own vehicle includes absolute position coordinates and absolute speed in the direction of travel.
  • the heading angle of the vehicle according to the absolute position coordinates of the vehicle, the heading angle of the vehicle, and the relative position coordinates of the vehicle A, the coordinates of the vehicle A's driving position are obtained; according to the longitudinal relative speed of the vehicle A and the absolute speed of the vehicle, the vehicle A can be determined
  • the type of the driving position point; the type of the driving position point coordinate of the vehicle A includes the reverse driving position point coordinate or the same direction driving position point coordinate; wherein, the relative position coordinate is the coordinate in the vehicle coordinate system, and the vehicle A
  • the coordinates of the driving position point are the coordinates in the world coordinate system.
  • the acquiring module 1301 is further used to:
  • the fourth conversion formula is: (x Av , y Av ) are the relative position coordinates of vehicle A, (x Aw , y Aw ) are the coordinates of the position where vehicle A can travel;
  • Third conversion matrix (x 0 ,y 0 ) is the absolute position coordinate of the own vehicle at the current moment, and ⁇ 0 is the heading angle of the own vehicle at the current moment.
  • the acquiring module 1301 is also used to:
  • the coordinates of the vehicle A can be driven position point are determined to be the same direction; if the longitudinal absolute speed of vehicle A is less than the preset speed threshold, the vehicle A's The coordinates of the driving position point are the coordinates of the driving position point in the reverse direction.
  • the determining module 1304 is also used to determine if the vehicle A is driving along the road direction 1, the coordinates of the vehicle A's driving position point are the coordinates in the road direction 1, and the saving module 1305 is also used to Save the point coordinates of the vehicle A's driveable position to the roadside unit on the side of the road direction 1;
  • the determining module 1304 is also used to determine if the vehicle A travels along the road direction 2, the driveable position point of the lane A is the coordinate on the road direction 2, and the storage module 1305 is used to save the vehicle A's driveable position point coordinates To the roadside unit on the side of road direction 2; wherein, road direction 1 and road direction 2 are two opposite directions on the same road.
  • the acquiring module 1301 is specifically configured to:
  • the determining module 1304 is further configured to:
  • the first area covers the ROI, the first area is determined to be a drivable area on the road.
  • the determining module 1304 is further configured to:
  • the first area and the third area cover the ROI, the first area and the third area are determined as the road drivable area.
  • the above-mentioned units are used to execute the relevant steps of the above method.
  • the acquiring module 1301 is used to execute the relevant content of steps S701 and S706
  • the verification module 1302 is used to execute the relevant content of step S702
  • the inference module 1303 is used to execute the relevant content of steps S704 and S706, the determining module 1304 and the saving module 1305 Used to perform S702-S706 related content.
  • the road drivable area reasoning device 1300 is presented in the form of a module.
  • the “module” here can refer to application-specific integrated circuits (ASICs), processors and memories that execute one or more software or firmware programs, integrated logic circuits, and/or other devices that can provide the above functions .
  • ASICs application-specific integrated circuits
  • the above acquisition module 1301, verification module 1302, inference module 1303, and determination module 1304 can be implemented by the processor 1401 of the road drivable area inference device shown in FIG. 14.
  • the road drivable area inference device 1400 can be implemented with the structure in FIG. 14.
  • the road drivable area inference device 1400 includes at least one processor 1401, at least one memory 1402 and at least one communication interface 1403.
  • the processor 1401, the memory 1402, and the communication interface 1403 are connected through the communication bus and complete mutual communication.
  • the processor 1401 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of the above program programs.
  • CPU central processing unit
  • ASIC application-specific integrated circuit
  • the communication interface 1403 is used to communicate with other devices or communication networks, such as Ethernet, wireless access network (RAN), wireless local area network (Wireless Local Area Networks, WLAN), etc.
  • devices or communication networks such as Ethernet, wireless access network (RAN), wireless local area network (Wireless Local Area Networks, WLAN), etc.
  • the memory 1402 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, random access memory (RAM), or other types that can store information and instructions
  • the dynamic storage device can also be Electrically Erasable Programmable Read-Only Memory (EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disc storage, optical disc storage (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this.
  • the memory can exist independently and is connected to the processor through a bus.
  • the memory can also be integrated with the processor.
  • the memory 1402 is used to store application program codes for executing the above solutions, and the processor 1401 controls the execution.
  • the processor 1401 is configured to execute application program codes stored in the memory 1402.
  • the code stored in the memory 1402 can execute the above-provided road drivable area reasoning method, such as:
  • the perceived drivable area perform verification on the perceived drivable area to obtain the first area and the second area, where the first area is the drivable area with reliable verification and the second area is the drivable area with unreliable verification Area; if the first area does not cover the area of interest ROI, the second area is inferred based on the perceptual memory information of the drivable area to obtain the third area and the fourth area, the third area is the perceptual memory area overlapping the second area
  • the fourth area is the area not covered by the sensory memory area in the second area; if the first area and the third area do not cover the ROI, the fourth area is inferred based on the driving position point to obtain the fifth area;
  • the fifth area is a drivable area in the fourth area; the first area, the third area and the fifth area are determined as road drivable areas.
  • the disclosed methods may be implemented as computer program instructions encoded on a computer-readable storage medium in a machine-readable format or encoded on other non-transitory media or articles.
  • Figure 15 schematically illustrates a conceptual partial view of an example computer program product arranged in accordance with at least some of the embodiments shown herein, the example computer program product comprising a computer program for executing a computer process on a computing device.
  • the example computer program product 1500 is provided using a signal bearing medium 1501.
  • the signal bearing medium 1501 may include one or more program instructions 1502, which, when executed by one or more processors, can provide the functions or part of the functions described above with respect to FIG. 7.
  • program instructions 1502 in FIG. 15 also describe example instructions.
  • the signal-bearing medium 1501 may include a computer-readable medium 1503, such as, but not limited to, a hard disk drive, compact disk (CD), digital video compact disk (DVD), digital tape, memory, read-only storage memory (Read -Only Memory, ROM) or Random Access Memory (RAM), etc.
  • the signal bearing medium 1501 may include a computer recordable medium 1504, such as, but not limited to, memory, read/write (R/W) CD, R/W DVD, and so on.
  • the signal-bearing medium 1501 may include a communication medium 1505, such as, but not limited to, digital and/or analog communication media (eg, fiber optic cables, waveguides, wired communication links, wireless communication links, etc.).
  • the signal bearing medium 1501 may be communicated by a wireless communication medium 1505 (for example, a wireless communication medium that complies with the IEEE 802.11 standard or other transmission protocols).
  • the one or more program instructions 1502 may be, for example, computer-executable instructions or logic-implemented instructions.
  • a computing device such as that described with respect to FIG. 7 may be configured to, in response to communicating to the computing device via one or more of the computer readable medium 1503, the computer recordable medium 1504, and/or the communication medium 1505,
  • the program instructions 1502 provide various operations, functions, or actions. It should be understood that the arrangement described here is for illustrative purposes only.
  • the disclosed device may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable memory.
  • the technical solution of the present invention essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, A number of instructions are included to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention.
  • the aforementioned memory includes: U disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
  • the program can be stored in a computer-readable memory, and the memory can include: flash disk , Read-only memory (English: Read-Only Memory, abbreviation: ROM), random access device (English: Random Access Memory, abbreviation: RAM), magnetic disk or optical disc, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Traffic Control Systems (AREA)

Abstract

L'invention concerne une technologie de conduite autonome dans le domaine de l'intelligence artificielle, se rapportant plus précisément à un procédé de raisonnement pour la région roulable d'une route, comprenant les étapes consistant à : acquérir une région roulable perceptive ; vérifier la région roulable perceptive pour obtenir une première région et une deuxième région ; si la première région ne couvre pas une région d'intérêt (ROI), raisonner sur la deuxième région selon des informations de mémoire perceptive de la région roulable, pour obtenir une troisième région et une quatrième région ; si la première région et la troisième région ne couvrent pas la ROI, raisonner sur la quatrième région selon un point de position roulable pour obtenir une cinquième région ; et déterminer que la première région, la troisième région et la cinquième région sont la région roulable de la route. L'invention concerne également un dispositif de raisonnement pour la région roulable d'une route. Il est avantageux d'obtenir une région roulable précise d'une route lorsque le résultat de perception de région roulable de la route est anormal, ce qui permet d'améliorer la sécurité, la disponibilité du système et l'expérience de l'utilisateur du système de conduite autonome.
PCT/CN2020/098642 2019-06-29 2020-06-28 Procédé de raisonnement pour la région roulable d'une route, et dispositif WO2021000800A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910584332.1A CN112230642B (zh) 2019-06-29 2019-06-29 道路可行驶区域推理方法及装置
CN201910584332.1 2019-06-29

Publications (1)

Publication Number Publication Date
WO2021000800A1 true WO2021000800A1 (fr) 2021-01-07

Family

ID=74100314

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/098642 WO2021000800A1 (fr) 2019-06-29 2020-06-28 Procédé de raisonnement pour la région roulable d'une route, et dispositif

Country Status (2)

Country Link
CN (2) CN115291596A (fr)
WO (1) WO2021000800A1 (fr)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113200039A (zh) * 2021-06-09 2021-08-03 广州小鹏智慧充电科技有限公司 基于泊车的道路生成方法、装置、车辆及可读介质
CN114485658A (zh) * 2021-12-08 2022-05-13 上海智能网联汽车技术中心有限公司 一种面向路侧感知系统精度评估的装置及方法
CN114643984A (zh) * 2022-05-20 2022-06-21 阿里巴巴达摩院(杭州)科技有限公司 驾驶避险方法、装置、设备、介质及产品
CN114820971A (zh) * 2022-05-05 2022-07-29 吉林大学 一种描述复杂驾驶环境信息的图形化表达方法
US20220341739A1 (en) * 2021-04-27 2022-10-27 Hyundai Motor Company Apparatus for generating route of autonomous driving vehicle and method for offering service by autonomous driving vehicle
CN115877429A (zh) * 2023-02-07 2023-03-31 安徽蔚来智驾科技有限公司 自动驾驶车辆的定位方法、装置、存储介质及车辆
WO2023093306A1 (fr) * 2021-11-24 2023-06-01 上海安亭地平线智能交通技术有限公司 Procédé et appareil de commande de changement de voie de véhicule, dispositif électronique et support de stockage
CN117274939A (zh) * 2023-10-08 2023-12-22 北京路凯智行科技有限公司 安全区域检测方法和安全区域检测装置
CN117274939B (zh) * 2023-10-08 2024-05-28 北京路凯智行科技有限公司 安全区域检测方法和安全区域检测装置

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113189610A (zh) * 2021-04-28 2021-07-30 中国科学技术大学 地图增强的自动驾驶多目标追踪方法和相关设备
CN113420698A (zh) * 2021-06-18 2021-09-21 北京盈迪曼德科技有限公司 一种基于机器人的环境识别方法及装置
CN113470217B (zh) * 2021-07-13 2023-01-24 合肥工业大学 一种基于单目摄像机的车辆轨迹提取与分析系统
CN114185340B (zh) * 2021-11-15 2024-04-23 广州文远知行科技有限公司 一种障碍物位置异常检测方法及装置
CN115273541B (zh) * 2022-06-21 2023-08-15 深蓝汽车科技有限公司 一种l2级自动驾驶系统的安全性提升方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101469997A (zh) * 2007-12-27 2009-07-01 爱信艾达株式会社 导航装置及计算机程序
EP2282293A1 (fr) * 2009-07-08 2011-02-09 Valeo Vision Procédé de détermination d'une région d'intérêt dans une image
CN107622684A (zh) * 2017-09-14 2018-01-23 华为技术有限公司 信息传输方法、交通控制单元和车载单元
CN107749193A (zh) * 2017-09-12 2018-03-02 华为技术有限公司 驾驶风险分析及风险数据发送方法及装置
CN109690649A (zh) * 2016-09-05 2019-04-26 日产自动车株式会社 车辆行驶控制方法及车辆行驶控制装置
CN109919144A (zh) * 2019-05-15 2019-06-21 长沙智能驾驶研究院有限公司 可行驶区域检测方法、装置、计算机存储介质及路测视觉设备

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102009045661A1 (de) * 2009-10-14 2011-04-21 Robert Bosch Gmbh Verfahren zur Bestimmung wenigstens eines befahrbaren Bereichs in der, insbesondere für die Fahrzeugführung relevanten Umgebung eines Kraftfahrzeugs
JP2014010797A (ja) * 2012-07-03 2014-01-20 Murata Mach Ltd 自律走行装置
CN109117690A (zh) * 2017-06-23 2019-01-01 百度在线网络技术（北京）有限公司 可行驶区域检测方法、装置、设备及存储介质
CN108985194B (zh) * 2018-06-29 2022-06-10 华南理工大学 一种基于图像语义分割的智能车辆可行驶区域的识别方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101469997A (zh) * 2007-12-27 2009-07-01 爱信艾达株式会社 导航装置及计算机程序
EP2282293A1 (fr) * 2009-07-08 2011-02-09 Valeo Vision Procédé de détermination d'une région d'intérêt dans une image
CN109690649A (zh) * 2016-09-05 2019-04-26 日产自动车株式会社 车辆行驶控制方法及车辆行驶控制装置
CN107749193A (zh) * 2017-09-12 2018-03-02 华为技术有限公司 驾驶风险分析及风险数据发送方法及装置
CN107622684A (zh) * 2017-09-14 2018-01-23 华为技术有限公司 信息传输方法、交通控制单元和车载单元
CN109919144A (zh) * 2019-05-15 2019-06-21 长沙智能驾驶研究院有限公司 可行驶区域检测方法、装置、计算机存储介质及路测视觉设备

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220341739A1 (en) * 2021-04-27 2022-10-27 Hyundai Motor Company Apparatus for generating route of autonomous driving vehicle and method for offering service by autonomous driving vehicle
CN113200039A (zh) * 2021-06-09 2021-08-03 广州小鹏智慧充电科技有限公司 基于泊车的道路生成方法、装置、车辆及可读介质
CN113200039B (zh) * 2021-06-09 2024-02-02 广州小鹏智慧充电科技有限公司 基于泊车的道路生成方法、装置、车辆及可读介质
WO2023093306A1 (fr) * 2021-11-24 2023-06-01 上海安亭地平线智能交通技术有限公司 Procédé et appareil de commande de changement de voie de véhicule, dispositif électronique et support de stockage
CN114485658A (zh) * 2021-12-08 2022-05-13 上海智能网联汽车技术中心有限公司 一种面向路侧感知系统精度评估的装置及方法
CN114820971A (zh) * 2022-05-05 2022-07-29 吉林大学 一种描述复杂驾驶环境信息的图形化表达方法
CN114820971B (zh) * 2022-05-05 2023-06-09 吉林大学 一种描述复杂驾驶环境信息的图形化表达方法
CN114643984A (zh) * 2022-05-20 2022-06-21 阿里巴巴达摩院(杭州)科技有限公司 驾驶避险方法、装置、设备、介质及产品
CN115877429A (zh) * 2023-02-07 2023-03-31 安徽蔚来智驾科技有限公司 自动驾驶车辆的定位方法、装置、存储介质及车辆
CN115877429B (zh) * 2023-02-07 2023-07-07 安徽蔚来智驾科技有限公司 自动驾驶车辆的定位方法、装置、存储介质及车辆
CN117274939A (zh) * 2023-10-08 2023-12-22 北京路凯智行科技有限公司 安全区域检测方法和安全区域检测装置
CN117274939B (zh) * 2023-10-08 2024-05-28 北京路凯智行科技有限公司 安全区域检测方法和安全区域检测装置

Also Published As

Publication number Publication date
CN112230642A (zh) 2021-01-15
CN115291596A (zh) 2022-11-04
CN112230642B (zh) 2022-01-11

Similar Documents

Publication Publication Date Title
WO2021000800A1 (fr) Procédé de raisonnement pour la région roulable d'une route, et dispositif
US20210262808A1 (en) Obstacle avoidance method and apparatus
CN110379193B (zh) 自动驾驶车辆的行为规划方法及行为规划装置
US20220379920A1 (en) Trajectory planning method and apparatus
US20220332348A1 (en) Autonomous driving method, related device, and computer-readable storage medium
WO2021102955A1 (fr) Procédé et appareil de planification de trajet pour véhicule
WO2022001773A1 (fr) Procédé et appareil de prédiction de trajectoire
WO2022021910A1 (fr) Procédé et appareil de détection de collision de véhicule et support de stockage lisible par ordinateur
WO2021212379A1 (fr) Procédé et appareil de détection de ligne de délimitation de voie
WO2021196879A1 (fr) Procédé et dispositif de reconnaissance du comportement de conduite d'un véhicule
CN112512887B (zh) 一种行驶决策选择方法以及装置
WO2022062825A1 (fr) Procédé, dispositif de commande de véhicule et véhicule
WO2022016901A1 (fr) Procédé de planification d'itinéraire de conduite de véhicule, et véhicule intelligent
WO2022051951A1 (fr) Procédé de détection de ligne de voie de circulation, dispositif associé et support de stockage lisible par ordinateur
US20230048680A1 (en) Method and apparatus for passing through barrier gate crossbar by vehicle
CN113525373A (zh) 一种车辆的变道控制系统、控制方法
CN113968242B (zh) 自动驾驶场景生成方法、装置及系统
US20220309806A1 (en) Road structure detection method and apparatus
WO2021254000A1 (fr) Procédé et dispositif de planification de paramètres de mouvement longitudinal de véhicule
WO2021159397A1 (fr) Procédé de détection et dispositif de détection de région pouvant être parcourue par un véhicule
WO2022001432A1 (fr) Procédé d'inférence de voie et procédé et appareil d'entraînement de modèle d'inférence de voie
US20230256970A1 (en) Lane Change Track Planning Method and Apparatus
WO2022127502A1 (fr) Procédé et dispositif de commande
WO2021097823A1 (fr) Procédé et dispositif destinés à être utilisés pour déterminer un espace pouvant être traversé par un véhicule

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20834325

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20834325

Country of ref document: EP

Kind code of ref document: A1