WO2022148172A1 - Lane line planning method and related apparatus - Google Patents

Lane line planning method and related apparatus Download PDF

Info

Publication number
WO2022148172A1
WO2022148172A1 PCT/CN2021/133214 CN2021133214W WO2022148172A1 WO 2022148172 A1 WO2022148172 A1 WO 2022148172A1 CN 2021133214 W CN2021133214 W CN 2021133214W WO 2022148172 A1 WO2022148172 A1 WO 2022148172A1
Authority
WO
WIPO (PCT)
Prior art keywords
point
intersection
lane line
depth
projection
Prior art date
Application number
PCT/CN2021/133214
Other languages
French (fr)
Chinese (zh)
Inventor
刘大伟
周旺
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022148172A1 publication Critical patent/WO2022148172A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/28Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
    • G01C21/30Map- or contour-matching
    • G01C21/32Structuring or formatting of map data
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/165Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/38Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
    • G01S19/39Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/42Determining position
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0968Systems involving transmission of navigation instructions to the vehicle
    • G08G1/0969Systems involving transmission of navigation instructions to the vehicle having a display in the form of a map

Definitions

  • the present application relates to the field of unmanned driving technology, and in particular, to a lane line planning method and related devices.
  • High-precision maps play a vital role in scenarios such as map search, automatic navigation, and autonomous driving.
  • High-precision maps have relatively high requirements on the richness and accuracy of information, and can provide more detailed road information. It can provide geographic coordinate information of each lane on a road, and the accuracy can reach centimeter level.
  • High-precision maps can also record rich road sign information such as crosswalks, overpasses, and traffic lights.
  • the high-precision map will also generate many lane-level virtual lane lines according to the actual road scene, providing accurate and smooth navigation information for cars driving at the intersection. Therefore, in the process of autonomous driving, the autonomous vehicle can drive on a lane-level path that is pre-planned on a high-precision map.
  • the mapping process of the high-precision map is usually driven by a technician to collect the vehicle, collect the environmental information of the area that the vehicle passes through, and fuse the various information obtained to generate an electronic map. Then cartographers will use various map labeling software to label the obtained electronic map automatically or manually to label various traffic information, such as lane lines, road signs, road signs and other traffic information.
  • Manual labeling It is labelled by the cartographer according to the obtained point cloud map, but the manually labelled lane lines are not only time-consuming It is laborious, and it is not easy to ensure the aesthetics of the lane lines.
  • Automatic labeling Automatic labeling is performed based on the obtained intersection information, but this method often does not consider the clearness of obstacles in the intersection, resulting in low labeling accuracy.
  • the embodiments of the present application improve a lane line planning method and a related device, which can automatically plan a lane line that avoids obstacles, thereby improving planning efficiency and accuracy.
  • an embodiment of the present application provides a method for lane line planning, which may include: acquiring information of a first intersection, where the information of the first intersection includes information of a first reference point, information of a second reference point, and information of a first intersection.
  • the information of obstacles at the intersection; the first intersection is the intersection where the lane line needs to be planned, the first reference point is the point on the first lane line, the second reference point is the point on the second lane line, and the first intersection
  • the connected lane lines are the first lane line and the second lane line, the second lane line connects the first lane line through the lane line that needs to be planned at the first intersection, and the obstacle is the object in the first intersection that hinders the planned lane line; determine the target Projection point, where the target projection point is the projection point of the obstacle to the first depth and/or the second depth, the first depth is the depth of the first lane line extending to the first intersection, and the second depth is the second lane The depth of the line extending to the first intersection; the lane line is determined according to the first reference point, the second reference point and the target projection point.
  • the obstacles at the intersection are considered when planning the lane line at the intersection, so that the target projection point can be determined, and then the target projection point can be determined according to the first reference point, the second reference point and the target projection point.
  • Lane lines can be determined. Because of the existence of the target projection point, it can be ensured that the generated lane line will not be pressed against obstacles, and no manual adjustment is required, which can improve the efficiency and accuracy of planning lane lines.
  • the method may further include: determining a planning area, and marking objects in the planning area as obstacles.
  • the method may further include: determining the planning area according to the first reference point, the second reference point, and an intersection point, where the intersection point is a point where the first depth and the second depth meet.
  • the planning area determined by the first reference point, the second reference point and the intersection point can quickly And accurately identify objects that obstruct the planned lane lines.
  • the method may further include: projecting N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1; Project to the second depth to obtain N second projection points; select the target projection point from the N first projection points and the N second projection points, where the distance from the N first projection points to the first reference point maximum, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point; among the N second projection points, the distance to the second reference point is the largest, and the distance to the obstacle is the largest.
  • the second projected point whose distance between the corresponding points on the 2 is less than or equal to the second threshold belongs to the target projected point.
  • a target projection point that satisfies the preset requirements is selected from the N first projection points and/or the N second projection points according to a given preset condition, because the first threshold value in the preset condition is And the existence of the second threshold can improve the accuracy that the lane line drawn by the determined target projection will not overwhelm the obstacle, and also ensure that the vehicle can smoothly drive out of the intersection through the planned lane line.
  • the target projection point includes a first projection point
  • the method may further include: determining a first line segment according to the first reference point and the first projection point; according to the first projection point and the second reference point and the intersection point to determine the first curve, and the intersection point is the point where the first depth and the second depth meet; the right-turn lane line is determined by the first line segment and the first curve.
  • the lane line is composed of a first line segment and a first curve.
  • the first line segment is the longest distance that can avoid obstacles at the entrance and can guarantee a right turn, so the first line segment can pass through the first line. In the case of completely avoiding the obstacle, the segment will go out of the intersection by the first curve.
  • the target projection point includes a second projection point
  • the method may further include: determining a second curve according to the first reference point, the second projection point and an intersection point, where the intersection point is the first depth and the second depth The intersection point; the second straight line is determined according to the second projection point and the second reference point; the right-turn lane line is determined by the second curve and the second straight line.
  • the lane line is composed of a second line segment and a second curve, and the second line segment is the longest distance that can avoid obstacles at the exit from the intersection and can guarantee the completion of a right turn.
  • the second line segment When reaching the obstacle, pass the second line segment to avoid pressing the obstacle.
  • the target projection point includes a first projection point and a second projection point
  • the method may further include: determining a third line segment according to the first reference point and the first projection point; according to the first projection point, The second projection point and the intersection point determine the third curve, and the intersection point is the point where the first depth meets the second depth; the fourth line segment is determined according to the second projection point and the first reference point; the third line segment, the third curve and the fourth The line segment determines the right-turn lane line.
  • the lane line is composed of a third line segment, a third curve and a fourth line segment
  • the third line segment is the longest distance to avoid obstacles at the entrance to the intersection, which can ensure that the obstacles are completely avoided. Go down and turn right.
  • the fourth line segment is the longest distance to avoid obstacles at the exit and can guarantee to complete a right turn. It can ensure that the fourth line segment is used to avoid hitting obstacles when turning right. thing.
  • the method may further include: both the first threshold value and the second threshold value are reference values obtained by training according to sample data, and the sample data is historical driving data of the driving trajectory to avoid obstacles.
  • the first threshold value and the second threshold value obtained by training the sample data are more in line with the actual situation and have higher reliability.
  • an embodiment of the present application provides a lane line planning device, the device may include: an acquisition unit configured to acquire information of a first intersection, where the information of the first intersection includes information of a first reference point, a second reference Point information and information of obstacles at the first intersection; wherein, the first intersection is the intersection where the lane line needs to be planned, the first reference point is the point on the first lane line, and the second reference point is the second lane line.
  • Point the lane lines connected to the first intersection are the first lane line and the second lane line, the second lane line is connected to the first lane line through the lane line of the first intersection, and the obstacles are the obstacles in the first intersection that obstruct the planned lane line.
  • a determining unit for determining a target projection point, wherein the target projection point is the projection point of the obstacle to the first depth and/or the second depth, and the first depth is the extension of the first lane line to the first intersection. depth, the second depth is the depth of the second lane line extending to the first intersection; the planning unit is used to determine the lane line according to the first reference point, the second reference point and the target projection point.
  • the determining unit is further configured to: determine a planning area, and mark objects in the planning area as obstacles.
  • the determining unit is specifically configured to: determine the planning area according to the first reference point, the second reference point, and an intersection point, where the intersection point is a point where the first depth and the second depth intersect.
  • the determining unit is specifically configured to: project the N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1; N position points are projected to the second depth, and N second projection points are obtained; the target projection point is selected from the N first projection points and the N second projection points, wherein, among the N first projection points to the first The distance to the reference point is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point; the distance to the second reference point is the largest among the N second projection points, and , the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
  • the target projection point is the first projection point
  • the lane line is the right-turn lane line
  • the planning unit is specifically configured to: determine the first line according to the first reference point and the first projection point
  • the first curve is determined according to the first projection point, the second reference point and the intersection point, and the intersection point is the point where the first depth and the second depth meet;
  • the right-turn lane line is determined by the first line segment and the first curve.
  • the target projection point is the second projection point
  • the lane line is the right-turn lane line
  • the planning unit is specifically configured to: determine the first reference point, the second projection point, and the intersection point. Two curves, the intersection point is the point where the first depth meets the second depth; the second straight line is determined according to the second projection point and the second reference point; the right-turn lane line is determined by the second curve and the second straight line.
  • the target projection point includes a first projection point and a second projection point
  • the lane line is a right-turn lane line
  • the planning unit is specifically configured to: according to the first reference point and the first projection point to determine the third line segment; determine the third curve according to the first projection point, the second projection point and the intersection point, the intersection point is the point where the first depth and the second depth meet; determine the fourth line segment according to the second projection point and the first reference point ; Determine the right-turn lane line by the third line segment, the third curve and the fourth line segment.
  • an embodiment of the present application provides a high-precision map, and the high-precision map includes the method described in the first aspect or any possible implementation manner of the first aspect according to the first reference point and the second reference point. and the lane line determined by the target projection point.
  • an embodiment of the present application provides an intelligent vehicle, the intelligent vehicle includes at least one processor and at least one memory, and the at least one processor is configured to call a computer program stored in the at least one memory, so that the intelligent vehicle executes the first aspect or the method described in any one possible implementation manner of the first aspect.
  • an embodiment of the present application provides a lane line planning device, the lane line planning device includes at least one processor and at least one memory, and the at least one processor is configured to call a computer program stored in the at least one memory, so that the apparatus executes The method described in the first aspect or any possible implementation manner of the first aspect.
  • embodiments of the present application provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program runs on one or more processors, the first aspect or the first aspect is executed.
  • an embodiment of the present application provides a computer program product.
  • the computer program product runs on one or more processors, the first aspect or any possible implementation manner of the first aspect is executed. method.
  • FIG. 1 is a schematic diagram of a scene for drawing lane lines provided by the prior art
  • FIG. 2A is a schematic structural diagram of a lane line planning system provided by an embodiment of the present application.
  • 2B is a schematic structural diagram of another lane planning system provided by an embodiment of the present application.
  • FIG. 2C is a functional block diagram of an intelligent vehicle 003 provided by an embodiment of the present application.
  • 3A is a schematic flowchart of a method for drawing lane lines according to an embodiment of the present application.
  • 3B is a schematic diagram of intersection information provided by an embodiment of the present application.
  • 3C is a schematic diagram of determining a target projection point provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of a lane line planning device provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of a lane line planning device provided by an embodiment of the present application.
  • a high-resolution map also known as a high-resolution map (HD Map, High Definition Map) is a map specially designed for unmanned driving. Unlike traditional navigation maps, high-precision maps can provide lane-level navigation information in addition to road-level navigation information. Both in the richness of the information and the accuracy of the information, it is far higher than the traditional navigation map.
  • HD Map High Definition Map
  • lane-level navigation information can include high-precision coordinates, as well as accurate road shape, slope, curvature, heading, elevation, roll, and other data for each lane.
  • Vector data is in Cartesian coordinates, using x and y coordinates to represent the position and shape of map graphics or geographic entities. Generally, the spatial position of geographic entities is expressed as accurately as possible by recording coordinates.
  • vector data can be internal data stored in a vector structure in a computer, which is a direct product of a tracking digitizer. In the vector data structure, point data can be described directly by coordinate values; line data can be described by evenly or unevenly spaced sequential coordinate chains; surface data (or polygon data) can be described by boundary lines.
  • the method for planning lane lines at intersections may include the following steps:
  • FIG. 1 is a schematic diagram of a scene for drawing lane lines provided by the prior art.
  • FIG. 1 takes drawing a lane line for a right turn as an example for description. It can be seen from (1) of FIG. 1 that the first reference point is the first reference point 101A.
  • the first reference point 101A is a point on the first lane line 104A, and the first reference point 101A may specifically be the first lane line 104A (or an extension of the first lane line 104A) on an area close to the intersection 106
  • the intersection 106 is the intersection where lane lines need to be marked, the lanes connected to the intersection 106 are the first lane 102 and the second lane 103 , and the first lane line 104A may be the lane edge line of the first lane 102 .
  • the second reference point is the second reference point 101B.
  • the second reference point 101B is a point on the second lane line 105A, and the second reference point 101B may specifically be the second lane line 105A (or an extension of the second lane line 105A) on an area close to the intersection 106
  • the second lane line 105A may be the lane edge line of the second lane 103 .
  • intersection 101C is the intersection 101C.
  • the intersection point 101C is the point where the extension of the first lane line 104A toward the intersection meets the extension of the second lane line 105A toward the intersection.
  • FIG. 2A is a schematic structural diagram of a lane line planning system provided by an embodiment of the present application.
  • the system includes a collection device 001 and a drawing device 002, wherein the collection device 001 and the drawing device 002 can communicate through a network to The collected raw data for drawing lane lines is sent to the drawing device 002, and the drawing device 002 completes the drawing of the lane lines.
  • the collection device 001 may be an electronic device with specific data collection capability and data transceiver capability.
  • the acquisition device 001 may be an acquisition vehicle equipped with one or more sensors such as lidar, camera, Global Navigation Satellite System (GNSS), Inertial Measurement Unit (IMU), etc.
  • the collecting vehicle can collect the intersection information of the lane lines to be marked in the high-precision map, that is, before drawing the high-precision map, the information required for drawing the high-precision map can be collected by collecting vehicles driving on each road.
  • GNSS Global Navigation Satellite System
  • IMU Inertial Measurement Unit
  • lidar is mainly used to collect point cloud data, because lidar can accurately reflect position information, so the width of the road, the height of signal lights and some other information can be obtained through lidar;
  • the camera is mainly used to collect road signs, Lane lines and other information;
  • GNSS is mainly used to record the coordinates of the current collection point;
  • IMU is mainly used to record the angle and acceleration information of the collection vehicle, and is used to correct the position and angle of the collection vehicle.
  • the collection device 001 may also be a roadside unit installed at an intersection, and the roadside unit may acquire intersection information within the coverage area, and monitor multiple smart vehicles within the coverage area.
  • the roadside unit can collect the intersection information of the lanes to be planned in automatic driving, that is, the roadside unit can monitor the dynamics in the intersection at any time, and can send the information of the intersection to the intelligent vehicles that need to pass the intersection.
  • the intersection information may be acquired by one roadside unit, or the intersection information may be acquired by the cooperation of multiple roadside units, so as to obtain the information of all roads connected to the intersection.
  • the roadside unit may be composed of a high-gain directional beam control read-write antenna and a radio frequency controller.
  • the high-gain directional beam control read-write antenna is a microwave transceiver module, responsible for signal and data transmission/reception, modulation/demodulation, encoding/decoding, encryption/decryption; the radio frequency controller is used to control the transmission and reception of data and the processing of the upper computer.
  • intersection information of the lane lines to be marked in the high-precision map can be collected through the collection device 001, such as road-level data at the intersection (that is, the data of each road connected to the intersection), lane-level data at the intersection (that is, the data of each road connected to the intersection). data for each lane connected to the intersection), information on obstacles within the intersection.
  • Road-level can also be called non-high-precision vector road network data, which is used to describe specific roads from road-level accuracy.
  • the road-level data is the road network data collected according to the road granularity, that is, a lane containing multiple lanes will only have one vector data with the unit of link (link) as the unit.
  • Vector data includes a series of location coordinate points, usually a series of location coordinate points on the road centerline; road-level data also includes road grade, traffic capacity, number of lanes, road category, driving mode, road bandwidth, and so on.
  • Lane-level data can be called high-precision vector road network data, which are used to describe specific roads from lane line accuracy.
  • lane-level data is road network data collected according to the granularity of lane lines, which may include, but is not limited to, lane edge line information of any road (including vector data of the location of the lane edge line), lane boundary line information (including lane edge line information) vector data of the location of the dividing line), etc.
  • the obstacle can be an object that hinders driving in the intersection, the information of the obstacle can be vector data of the location of the obstacle, and the obstacle includes but is not limited to at least one of the following: curbs, trees, street lights, and so on.
  • the drawing apparatus 002 may be an electronic device with data processing capability and data transceiving capability, may be a physical device such as a host, rack server, blade server, etc., or may be a virtual device such as a virtual machine, a container, and the like.
  • the drawing device 002 can obtain the intersection information of the lane line to be marked in the high-precision map, and then obtain the information of the first reference point, the information of the second reference point and the information of the obstacles of the first intersection from the intersection information;
  • An intersection is an intersection where lane lines need to be planned, the first reference point is a point on the first lane line, the second reference point is a point on the second lane line, and the second lane line is connecting the first lane through the lane line inside the intersection
  • the lane line of the line, the obstacle is the object that obstructs the planned lane line in the first intersection; and then the target projection point is determined, and the target projection point is the projection point of the obstacle to the first depth and/or the second depth.
  • a depth is the depth of the first reference point extending to the first intersection
  • the second depth is the depth of the second reference point extending to the first intersection.
  • the drawing device 002 projects the N position points of the obstacle to the first depth to obtain N first projection points; the drawing device 002 projects the N position points of the obstacle to the second depth , to obtain N second projection points; then the drawing device 002 selects the target projection point from the N first projection points and the N second projection points, that is, the distance from the N first projection points to the first reference point The distance is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point; or, the distance from the N second projection points to the second reference point is the largest, and, The second projected point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projected point.
  • the first threshold and the second threshold are values obtained through machine learning training according to the distance between the obstacle at the intersection and the lane line.
  • the collecting device 001 when the collecting device 001 is collecting vehicles, the collected intersection information may be the intersection information of the lane lines to be marked in the high-precision map, and the drawing device 001 may be a device that generates a high-precision map. After the drawing device 001 generates the high-precision map, the above-mentioned high-precision map can be sent to the intelligent vehicle 003, and the intelligent vehicle 003 can complete the driving according to the high-precision map.
  • the collected intersection information may be the information of the intersection of the lane line to be planned in automatic driving.
  • FIG. 2B is another kind of intersection provided by the embodiment of the present application. Schematic diagram of the architecture of the lane line planning system.
  • the drawing device 001 can be an intelligent vehicle 003 driving at an intersection.
  • the intelligent vehicle 003 receives the information of the intersection sent by the roadside unit, it can plan a lane to avoid obstacles according to the information of the intersection. Wire.
  • the lane lines may include straight lane lines, left-turn lane lines, or right-turn lane lines, which are not limited in this embodiment of the present application.
  • a Bezier curve can be used to draw a lane line
  • a spline curve can also be used to accurately draw a lane line
  • the embodiment of the present application does not impose any limitation on a tool for drawing a lane line.
  • FIG. 2C is a functional block diagram of an intelligent vehicle 003 provided by an embodiment of the present application.
  • the intelligent vehicle 003 may be configured in a fully or partially autonomous driving mode.
  • the intelligent vehicle 003 can control itself while in an autonomous driving mode, and can determine the current state of the vehicle and its surroundings through human manipulation, determine the possible behavior of at least one other vehicle in the surrounding environment, and determine the other
  • the intelligent vehicle 003 is controlled based on the determined information with a confidence level corresponding to the likelihood that the vehicle will perform the possible behavior.
  • the intelligent vehicle 003 can be set to operate without human interaction.
  • Intelligent vehicle 003 may include various subsystems, such as travel system 202 , sensing system 204 , control system 206 , one or more peripherals 208 and power supply 210 , computer system 212 , and user interface 216 .
  • the intelligent vehicle 003 may include more or fewer subsystems, and each subsystem may include multiple elements. Additionally, each of the subsystems and elements of the intelligent vehicle 003 may be interconnected by wire or wirelessly.
  • the travel system 202 may include components that provide powered motion for the intelligent vehicle 003 .
  • travel system 202 may include engine 218 , energy source 219 , transmission 220 , and wheels/tires 221 .
  • Engine 218 may be an internal combustion engine, an electric motor, an air compression engine, or other types of engine combinations, such as a hybrid engine consisting of an air oil engine and an electric motor, a hybrid engine consisting of an internal combustion engine and an air compression engine.
  • Engine 218 converts energy source 219 into mechanical energy.
  • Examples of energy sources 219 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity.
  • the energy source 219 may also provide energy to other systems of the intelligent vehicle 003 .
  • Transmission 220 may transmit mechanical power from engine 218 to wheels 221 .
  • Transmission 220 may include a gearbox, a differential, and a driveshaft.
  • transmission 220 may also include other devices, such as clutches.
  • the drive shafts may include one or more axles that may be coupled to one or more wheels 221 .
  • the sensing system 204 may include several sensors that sense information about the environment surrounding the intelligent vehicle 003 .
  • the sensing system 204 may include a global positioning system 222 (the positioning system may be a GPS system, a Beidou system or other positioning systems), an inertial measurement unit (IMU) 224, a radar 226, a laser rangefinder 228 and camera 230.
  • the sensing system 204 may also include sensors that monitor the internal systems of the smart vehicle 003 (eg, an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, orientation, velocity, etc.). This detection and identification is a critical function for the safe operation of the autonomous intelligent vehicle 003 .
  • the global positioning system 222 may be used to estimate the geographic location of the intelligent vehicle 003 .
  • the IMU 224 is used to sense position and orientation changes of the intelligent vehicle 003 based on inertial acceleration.
  • the IMU 224 may be a combination of an accelerometer and a gyroscope.
  • IMU 224 may be used to measure the curvature of smart vehicle 003.
  • Radar 226 may utilize radio signals to sense objects within the surrounding environment of intelligent vehicle 003 . In some embodiments, in addition to sensing objects, radar 226 may be used to sense the speed and/or heading of objects.
  • the laser rangefinder 228 may utilize laser light to sense objects in the environment in which the intelligent vehicle 003 is located.
  • the laser rangefinder 228 may include one or more laser sources, laser scanners, and one or more detectors, among other system components.
  • Camera 230 may be used to capture multiple images of the surrounding environment of intelligent vehicle 003 .
  • Camera 230 may be a still camera or a video camera.
  • Control system 206 controls the operation of the intelligent vehicle 003 and its components.
  • Control system 206 may include various elements including steering system 232 , throttle 234 , braking unit 236 , sensors 238 , computer vision system 240 , route control system 242 , and obstacle avoidance system 244 .
  • Steering system 232 is operable to adjust the heading of intelligent vehicle 003 .
  • it may be a steering wheel system.
  • the throttle 234 is used to control the operating speed of the engine 218 and thus the speed of the intelligent vehicle 003 .
  • the braking unit 236 is used to control the deceleration of the intelligent vehicle 003 .
  • the braking unit 236 may use friction to slow the wheels 221 .
  • the braking unit 236 may convert the kinetic energy of the wheels 221 into electrical current.
  • the braking unit 236 may also take other forms to slow down the wheels 221 to control the speed of the smart vehicle 003 .
  • Computer vision system 240 is operable to process and analyze images captured by camera 230 in order to identify objects and/or features in the environment surrounding intelligent vehicle 003 .
  • the objects and/or features may include traffic signals, road boundaries and obstacles.
  • Computer vision system 240 may use object recognition algorithms, Structure from Motion (SFM) algorithms, video tracking, and other computer vision techniques.
  • SFM Structure from Motion
  • computer vision system 240 may be used to map the environment, track objects, estimate the speed of objects, and the like.
  • the route control system 242 is used to determine the travel route of the intelligent vehicle 003 .
  • the route control system 242 may combine data from the sensors 238 , the global positioning system 222 , and one or more predetermined maps to determine a driving route for the intelligent vehicle 003 .
  • the obstacle avoidance system 244 is used to identify, evaluate and avoid or otherwise overcome potential obstacles in the environment of the intelligent vehicle 003 .
  • control system 206 may additionally or alternatively include components other than those shown and described. Alternatively, some of the components shown above may be reduced.
  • Peripherals 208 may include a wireless communication system 246 , an onboard computer 248 , a microphone 250 and/or a speaker 252 .
  • peripherals 208 provide a means for a user of intelligent vehicle 003 to interact with user interface 216 .
  • the onboard computer 248 may provide information to the user of the smart vehicle 003 .
  • User interface 216 may also operate on-board computer 248 to receive user input.
  • the onboard computer 248 can be operated via a touch screen.
  • peripherals 208 may provide a means for intelligent vehicle 003 to communicate with other devices located within the vehicle.
  • microphone 250 may receive audio (eg, voice commands or other audio input) from a user of intelligent vehicle 003 .
  • speaker 252 may output audio to the user of smart vehicle 003 .
  • Wireless communication system 246 may wirelessly communicate with one or more devices, either directly or via a communication network.
  • wireless communication system 246 may use 3G cellular communications, such as CDMA, EVDO, GSM/GPRS, or 4G cellular communications, such as LTE. Or 5G cellular communications.
  • the wireless communication system 246 may communicate with a wireless local area network (WLAN) using WiFi.
  • WLAN wireless local area network
  • the wireless communication system 246 may communicate directly with the device using an infrared link, Bluetooth, or ZigBee.
  • Other wireless protocols, such as various vehicle communication systems, for example, wireless communication system 246 may include one or more dedicated short range communications (DSRC) devices, which may include a combination of vehicle and/or roadside stations. public and/or private data communications between them.
  • DSRC dedicated short range communications
  • Power supply 210 may provide power to various components of intelligent vehicle 003 .
  • the power source 210 may be a rechargeable lithium-ion or lead-acid battery.
  • One or more battery packs of such batteries may be configured as a power source to provide power to various components of the intelligent vehicle 003 .
  • power source 210 and energy source 219 may be implemented together, such as in some all-electric vehicles.
  • Computer system 212 may include at least one processor 213 that executes instructions 215 stored in a non-transitory computer-readable medium such as memory 214 .
  • Computer system 212 may also be multiple computing devices that control individual components or subsystems of intelligent vehicle 003 in a distributed fashion.
  • the processor 213 may be any conventional processor, such as a commercially available CPU. Alternatively, the processor may be a dedicated device such as an ASIC or other hardware-based processor.
  • FIG. 2C functionally illustrates a processor, memory, and other elements of the computer in the same block, one of ordinary skill in the art will understand that the processor, computer, or memory may actually include storage that may or may not be Multiple processors, computers, or memories within the same physical enclosure.
  • the memory may be a hard drive or other storage medium located within an enclosure other than a computer.
  • reference to a processor or computer will be understood to include reference to a collection of processors or computers or memories that may or may not operate in parallel.
  • some components such as the steering and deceleration components may each have their own processor that only performs computations related to component-specific functions .
  • a processor may be located remotely from the vehicle and in wireless communication with the vehicle. In other aspects, some of the processes described herein are performed on a processor disposed within the vehicle while others are performed by a remote processor, including taking steps necessary to perform a single maneuver.
  • memory 214 may include instructions 215 (eg, program logic) executable by processor 213 to perform various functions of intelligent vehicle 003, including those described above.
  • Memory 214 may also contain additional instructions, including sending data to, receiving data from, interacting with and/or controlling one or more of travel system 202 , sensing system 204 , control system 206 and peripherals 208 instruction.
  • memory 214 may store data such as road maps, route information, vehicle location, direction, speed, and other such vehicle data, among other information. Such information may be used by intelligent vehicle 003 and computer system 212 during operation of intelligent vehicle 003 in autonomous, semi-autonomous, and/or manual modes.
  • User interface 216 for providing information to or receiving information from a user of intelligent vehicle 003 .
  • user interface 216 may include one or more input/output devices within the set of peripheral devices 208 , such as wireless communication system 246 , onboard computer 248 , microphone 250 and speaker 252 .
  • Computer system 212 may control functions of intelligent vehicle 003 based on input received from various subsystems (eg, wireless communication system 246 , travel system 202 , sensing system 204 , and control system 206 ) and from user interface 216 .
  • the computer system 212 may utilize input from the wireless communication system 246 to plan lane lines at intersections that need to be passed in autonomous driving by which obstacles at the intersection can be avoided.
  • computer system 212 is operable to provide control over many aspects of intelligent vehicle 003 and its subsystems.
  • computer system 212 may also receive information from, or transfer information to, other computer systems.
  • the computer system 212 may transfer sensor data collected from the sensor system 204 of the smart vehicle 003 to another computer system remotely, and have the data processed by the other computer system, such as by another computer system.
  • the data collected by each sensor in the sensor system 204 is fused, and then the data or analysis result obtained after fusion is returned to the computer system 212 .
  • data from computer system 212 may be transmitted via a network to a cloud-side computer system for further processing.
  • Networks and intermediate nodes may include various configurations and protocols, including the Internet, the World Wide Web, Intranets, Virtual Private Networks, Wide Area Networks, Local Area Networks, private networks using one or more of the company's proprietary communication protocols, Ethernet, WiFi and HTTP, and various combinations of the foregoing.
  • Such communications may be by any device capable of transferring data to and from other computers, such as modems and wireless interfaces.
  • the remote computer system that interacts with the computer system 212 in the intelligent vehicle 003 may include a server with multiple computers, such as a load balancing server farm, in order to receive, from the computer system 212 , The purpose of processing and transmitting data, which exchanges information with different nodes of the network.
  • the server may have processors, memory, instructions and data, and the like.
  • the data of the server may include providing weather-related information.
  • the server may receive, monitor, store, update, and transmit various information related to the weather. This information may include, for example, precipitation, cloud, and/or temperature information in the form of reports, radar information, forecasts, and the like.
  • the data of the server can also include high-precision map data, traffic information of the road ahead (such as real-time traffic congestion and traffic accidents, etc.), and the server can send the high-precision map data and traffic information to the computer system 212 , so that it can assist the intelligent vehicle 003 to better perform automatic driving and ensure driving safety.
  • one or more of these components described above may be installed or associated with the intelligent vehicle 003 separately.
  • memory 214 may exist partially or completely separate from intelligent vehicle 003 .
  • the above-described components may be communicatively coupled together in a wired and/or wireless manner.
  • the above component is just an example.
  • components in each of the above modules may be added or deleted according to actual needs, and FIG. 2C should not be construed as a limitation on the embodiments of the present application.
  • a self-driving car traveling on a road can recognize objects within its surroundings to determine adjustments to its current speed.
  • the objects may be other vehicles, traffic control equipment, or other types of objects.
  • each identified object may be considered independently, and based on the object's respective characteristics, such as its current speed, acceleration, distance from the vehicle, etc., may be used to determine the speed at which the autonomous vehicle is to adjust.
  • the autonomous vehicle intelligent vehicle 003 or a computing device associated with the autonomous vehicle 003 may be based on the characteristics of the identified objects and the surrounding environment. state (eg, traffic, rain, ice on the road, etc.) to predict the behavior of the identified object.
  • each identified object is dependent on the behavior of the other, so it is also possible to predict the behavior of a single identified object by considering all identified objects together.
  • the intelligent vehicle 003 is able to adjust its speed based on the predicted behavior of the identified object.
  • the self-driving car can determine what steady state the vehicle will need to adjust to (eg, accelerate, decelerate, or stop) based on the predicted behavior of the object.
  • other factors may also be considered to determine the speed of the intelligent vehicle 003, such as the lateral position of the intelligent vehicle 003 in the road on which it is traveling, the curvature of the road, the proximity of static and dynamic objects, and the like.
  • the computing device may also provide instructions to modify the steering angle of the intelligent vehicle 003 so that the self-driving car follows a given trajectory and/or maintains contact with objects in the vicinity of the self-driving car ( For example, safe lateral and longitudinal distances for cars in adjacent lanes on the road.
  • the above-mentioned intelligent vehicles 003 can be cars, trucks, motorcycles, buses, boats, airplanes, helicopters, lawn mowers, recreational vehicles, playground vehicles, construction equipment, trams, golf carts, trains, and trolleys, etc.,
  • the embodiments of the present application are not particularly limited.
  • the function diagram of the smart vehicle 003 in FIG. 2C is only an exemplary implementation in the embodiments of the present application, and the smart vehicle 003 in the embodiments of the present application includes but is not limited to the above structures.
  • FIG. 3A is a schematic flowchart of a method for drawing lane lines provided by an embodiment of the present application.
  • the method can be applied to the system architecture described in FIG. 2A or FIG. 2B , and can be specifically applied to the above-mentioned FIG. 2A in the drawing device 002.
  • 3A as an example to illustrate, the method includes but is not limited to the following steps:
  • Step S301 Obtain the information of the first intersection.
  • the first intersection is the intersection where lane lines need to be planned.
  • the collection device 001 shown in FIG. 2A is collecting vehicles
  • the information of the intersection collected by the collection device 001 is the information of the intersection that needs to be marked with lane lines in the high-precision map. (Including the information of the first intersection), and then the collection device 001 sends the information of the intersection to the drawing device 002, so that the drawing device 002 can obtain the information of the first intersection.
  • the collecting device 001 shown in FIG. 2A is a roadside unit
  • the drawing device 002 may be an intelligent vehicle 003 . Please refer to FIG.
  • the information of the intersection collected by the collection device 001 is the information of the intersection of the lane line to be planned in the automatic driving (including the information of the first intersection), and then the collection device 001 sends the information of the above intersection to the intelligent vehicle 003, so that the intelligent vehicle 003 can obtain the information of the first intersection.
  • the information of the first intersection includes information of the first reference point, information of the second reference point, and information of obstacles at the first intersection.
  • the first reference point is a point on the first lane line
  • the second reference point is a point on the second lane line
  • the lane lines connected to the first intersection are the first lane line and the second lane line
  • the second lane line The line connects the first lane line through the lane line of the first intersection
  • the obstacle is the object that hinders the driving near the first intersection.
  • FIG. 3B is a schematic diagram of intersection information provided by an embodiment of the present application.
  • FIG. 3B illustrates an intersection as an example, in which:
  • intersection 300 is represented as the area where the roads meet.
  • the intersection 300 can be the stop line on the first lane 301, the stop line on the second lane 302, the stop line on the third lane 303 and The rectangular area enclosed by the stop line on the fourth lane 304 or the area around the rectangle.
  • the first lane 301 , the second lane 302 , the third lane 303 and the fourth lane 304 are two-way lanes, which are formed by two traffic lanes in opposite directions. It can be understood that the intersection not only includes the intersection 300 shown in FIG.
  • intersection 300 is an intersection where a lane line needs to be planned
  • the lane line is used to indicate the driving route in the intersection area
  • one end of the lane line at the intersection is connected to the end point of the exit lane, and the other end is connected to the start point of the lane entering the lane.
  • the first lane line may represent the incoming lane line outside the intersection. It can be understood that the intersection information obtained by the drawing device 002 includes the driving direction and lane line corresponding to the lane.
  • the driving direction mentioned here refers to the direction in which the vehicle in the lane can drive in the lane. From another perspective, the driving direction actually indicates how the vehicle can drive in the lane, such as straight, Turn left.
  • the driving directions corresponding to the first lane 301 , the second lane 302 , the third lane 303 and the fourth lane 304 respectively may include one or more of the following: going straight, turning left or turning right.
  • the first lane marking 301A may be the lane marking of a right-turn lane on the first lane 301, or the first lane marking 301A may be the lane marking of a straight-going lane on the second lane 302, or the first lane marking 301A may be the third lane marking
  • the lane markings of the right-turn lane on lane 303 , or the first lane marking 301A may be the lane markings of the through lane on the fourth lane 304 .
  • the second lane line may represent the outgoing lane line outside the intersection. It can be understood that the second lane line is a lane line having a corresponding relationship with the first lane line, that is, the lane line connected to the first lane line through the planned lane line at the intersection 300 is the second lane line. As can be seen from FIG.
  • the second lane line 301B may be the lane line on the second lane, that is, the second lane line 301B
  • the second lane line 301B can be the third lane 303.
  • the lane line, that is, the second lane line 301B is a lane line connecting the first lane line 301A through the straight lane line of the intersection 300 .
  • the first reference point is a point on the first lane line or an extension line of the first lane line, and may specifically be a point where the first lane line is close to the intersection.
  • the first reference point may be a point at the intersection of the first lane line and the stop line, or a point where the first lane line is close to the stop line, or the intersection of the extension of the first lane line and the intersection. point.
  • the first reference point 302A may be a point on the first lane line 301A of the first lane 301 , or a point on the first lane line 301A of the second lane 302 , or a third lane 303 A point on the first lane line 301A of , or a point on the first lane line 301A of the fourth lane 304 .
  • the second reference point is a point at the second lane line or an extension line of the second lane line, and may specifically be a point where the second lane line is close to the intersection.
  • the second reference point may be a point at the intersection of the second lane line and the stop line, or a point where the second lane line is close to the stop line, or the intersection of the extension of the second lane line and the intersection. point. Since the second lane line is a lane line having a corresponding relationship with the first lane line, the second reference point is a point having a corresponding relationship with the first reference point. As can be seen from FIG.
  • the first reference point 302A is a point on the lane line of the right-turn lane of the first lane 301
  • the second reference point 302B may be the second lane
  • the point on the second lane line 301B of 302, that is, one end of the planned right-turn lane line at the intersection is connected to the end point of the first lane line 301A of the first lane 301 is the first reference point 302A, and the other end is connected to the second lane.
  • the end point of the second lane line 301B is the second reference point 302B; if the planned lane line is a straight lane line, the first reference point 302A is a point on the lane line of the straight lane of the first lane 301, and the second reference point 302B It can be a point on the lane line of the third lane 303, that is, one end of the planned straight lane line at the intersection is connected to the end point of the first lane line 301A of the first lane 301 as the first reference point 302A, and the other end is connected to the third lane.
  • the end point of the second lane line 301B of 303 is the second reference point 302B; if the planned lane line is a left-turn lane line, then the first reference point 302A is a point on the lane line of the left-turn lane of the first lane 301, then The second reference point 302B may be a point on the second lane line 301B of the fourth lane 304 .
  • Obstacles can be objects in the intersection area that may hinder travel, such as trees, curbs, traffic signs placed on the ground, and so on. It can be seen from FIG. 3B that the obstacle 305 is a tree near the curb at the intersection.
  • the obstacle information collected by the collecting device 001 may be the vector data of the obstacle, that is, it includes one or more coordinate points that can describe the obstacle, and the shape and position of the obstacle can be inferred from the one or more coordinate points.
  • Step S302 Determine the target projection point.
  • the target projection point is the projection point of the obstacle to the first depth and/or the second depth, wherein the first depth is the depth of the first reference point extending to the intersection, and the second depth is the second reference point extending to the intersection.
  • the drawing apparatus 002 may determine a planning area, and mark objects in the planning area as obstacles.
  • the obtained obstacle information is vector data that can represent the shape, size and specific location of the obstacle, and the obstacle that affects the drawing of the right-turn lane line may be a certain part of the obstacle, such as the one near the intersection.
  • objects located within the planning area are regarded as obstacles, which can improve the accuracy that the planned lane lines will not overwhelm obstacles.
  • the drawing apparatus 002 may determine the planning area according to the first reference point, the second reference point and the intersection point, and mark objects in the planning area as obstacles.
  • intersection point is the point where the first depth and the second depth meet.
  • the first reference point, the second reference point and the intersection point are points required for planning lane lines, the planning area determined by the first reference point, the second reference point and the intersection point can quickly And accurately identify objects that obstruct the planned lane lines.
  • the drawing device 002 projects the N position points of the obstacle to the first depth to obtain N first projection points, and selects the first reference point from the N first projection points.
  • the distance is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point; by projecting the N position points of the obstacle to the second depth, N second projection points can be obtained.
  • the specific largest one to the first reference point is selected from the N Nth projection points, and the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
  • the target projection point includes one or more of the following situations: the target projection point is the first projection point, the target projection point is the second projection point, and the target projection point includes the first projection point and the second projection point.
  • a target projection point that satisfies the preset requirements is selected from the N first projection points and/or the N second projection points according to a given preset condition, because the first threshold value in the preset condition is And the existence of the second threshold can improve the accuracy that the lane line drawn by the determined target projection will not overwhelm the obstacle, and also ensure that the vehicle can smoothly drive out of the intersection through the planned lane line.
  • the first threshold and the second threshold are empirical values that can meet the needs obtained through machine learning training according to the distance between the obstacles at the intersection and the lane line. That is, through the collected data of a large number of intersections, the distance relationship between the obstacles at the intersection and the lane line is analyzed, or the distance required for the vehicle to turn at the intersection is analyzed, and the value obtained by training.
  • the target projection point determined by the first threshold and/or the second threshold can satisfy that the planned lane line will not press against obstacles, and can also ensure that the vehicle turns right or left through the planned lane line.
  • the first threshold and the second threshold may be equal or unequal.
  • FIG. 3C is a schematic diagram of determining a target projection point according to an embodiment of the present application.
  • 3C is described by taking the drawing of a right-turn lane line as an example.
  • the first reference point 302A is a point on the first lane line 301A of the first lane 301
  • the second reference point 302B is a point on the second lane line 301B of the second lane 302 .
  • the first depth 303A is the depth that the first reference point 302A extends to the intersection 300 , that is, the extension of the first lane line 301A along the intersection 300 ;
  • the second depth 303B is the depth that the second reference point 302B extends to the intersection 300 , that is, the second lane line 301B is along the extension line of the intersection 300 .
  • the intersection point of the first depth 303A and the second depth 303B is the intersection point 300B, and the intersection point 300B is a control point required when drawing a lane line.
  • the planning area can be determined according to the first reference point 302A, the second reference point 302B and the intersection point 300B.
  • the overlapping part of the obstacle 305 and the planning area can be considered as an obstacle that will affect the drawing of the lane line.
  • the point 30A represents any point on the obstacle 305 in the right turn area, that is, the point 30A includes N position points of the obstacle, and N is greater than or equal to 1. From point 30A as a starting point, draw a vertical line to the first depth 303A to obtain point 30B, and draw a vertical line through point 30A to the second depth 303B to obtain point 30C.
  • the point 30A includes N position points
  • the point 30B includes N projection points
  • the point 30C also includes N projection points. Then select the projection point with the farthest distance from the first reference point 302A from the point 30B, and the distance from the point 30B to the corresponding point on the obstacle is less than or equal to the first threshold; select the point 30C from the first reference point 302B The distance is the farthest, and the distance from the point 30C to the corresponding point on the obstacle is less than or equal to the projected point of the second threshold.
  • the point corresponding to the point 30B to the obstacle and the point corresponding to the point 30C to the obstacle may be the same point or different points.
  • the planning area may be determined according to the method of the above-mentioned right-turn lane line, which will not be repeated here.
  • Step S303 Determine the lane line according to the first reference point, the second reference point and the target projection point.
  • the target projection point includes one or more of the following situations: Case 1, the target projection point includes the first projection point ; Case 2, the target projection point includes the second projection point; Case 3, the target projection point includes the first projection point and the second projection point.
  • the drawing device 002 may determine the lane line according to the first reference point, the second reference point and the first projection point.
  • the lane line may be composed of a first line segment and a first curve, the first line segment is determined by a first reference point and a first projection point, and the first curve is determined by the first projection point, the intersection point and the second reference point.
  • the intersection point is the point where the first depth and the second depth meet.
  • the lane line is composed of a first line segment and a first curve.
  • the first line segment is the longest distance that can avoid obstacles at the entrance and can guarantee a right turn, so the first line segment can pass through the first line. In the case of completely avoiding the obstacle, the segment will go out of the intersection by the first curve.
  • the drawing device 002 may determine the lane line according to the first reference point, the second reference point and the second projection point.
  • the lane line may be composed of a second line segment and a second curve, the second line segment is determined by a second reference point and a second projection point, and the second curve is determined by the second projection point, the intersection point and the first reference point.
  • the intersection point is the point where the first depth and the second depth meet.
  • the lane line is composed of a second line segment and a second curve, and the second line segment is the longest distance that can avoid obstacles at the exit from the intersection and can guarantee the completion of a right turn. When reaching the obstacle, pass the second line segment to avoid pressing the obstacle.
  • the drawing device 002 may determine the lane line according to the first reference point, the second reference point, the first projection point and the second projection point.
  • the lane line may be composed of a third line segment, a fourth line segment and a third curve, the third line segment is determined by the first reference point and the first projection point, and the third curve is determined by the first projection point, the intersection point and the second projection point ;
  • the fourth line segment is determined by the second projection point and the second reference point.
  • the intersection point is the point where the first depth and the second depth meet.
  • the lane line is composed of a third line segment, a third curve and a fourth line segment
  • the third line segment is the longest distance to avoid obstacles at the entrance to the intersection, which can ensure that the obstacles are completely avoided. Go down and turn right.
  • the fourth line segment is the longest distance to avoid obstacles at the exit and can guarantee to complete a right turn. It can ensure that the fourth line segment is used to avoid hitting obstacles when turning right. thing.
  • the lane line can be planned according to the Bezier curve or the spline curve. It should be noted that, the embodiments of the present application do not impose any limitations on tools for planning lane lines.
  • the obstacles at the intersection are considered when planning the lane line at the intersection, so that the target projection point can be determined, and then the target projection point can be determined according to the first reference point, the second reference point and the target projection.
  • Points define lane lines. Because of the existence of the target projection point, it can be ensured that the generated lane line will not be pressed against obstacles, and no manual adjustment is required, which can improve the efficiency and accuracy of planning lane lines.
  • FIG. 4 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application.
  • FIG. 4 is an example of drawing a right-turn lane.
  • the information of the first intersection 004 acquired by the drawing device 002 includes the information of the first reference point 401A, the information of the second reference point 401B and obstacles Object 400 information.
  • the information of the obstacles in the right turn area determined by the first reference point 401A, the second reference point 401B and the intersection point 401C includes the point 400A, the point 400B and the point 400C.
  • intersection point 401C is the point where the first depth 402A and the second depth 402B meet
  • first depth 402A is the depth where the first reference point 401A extends to the first intersection 004
  • second depth 402B is the second reference point 401B to the first intersection Depth of extension at 004.
  • the drawing device 002 draws a vertical line from the point 400A to the first depth 402A to obtain the projection point of the point 400A at the first depth 402A as the point 4001A; similarly, the projection point of the point 400B at the first depth 402A can be obtained.
  • the projected point is point 4001B, and the projected point of point 400C at the first depth 402A is 4001C.
  • the projected point obtained by the drawing device 002 passing the point 400A, the point 400B and the point 400C to the second depth 402B by drawing a vertical line is the point 4002A.
  • the drawing device 002 selects the maximum distance from the point 4001A, the point 4001B and the point 4001C to the first reference point 401A, and the point whose distance to the corresponding point on the obstacle 400 is less than or equal to the first threshold is the target projection point . Because, the distance determined by point 400A and point 4001A, the distance determined by point 400B and point 4001B, and the distance determined by point 400C and point 4001C are all less than or equal to the first threshold, but point 4001C is the farthest distance from the first reference point 401A , so point 4001C is selected as the target projection point at the first depth.
  • the distance determined by point 4002A and point 400A, the distance determined by point 4002A and point 400B, and the distance determined by point 4002A and point 400C are all greater than the second threshold, so there is no target projection that meets the preset conditions at the second depth. point.
  • the first curve 404 defined by the intersection point 400C and the second reference point 401B constitutes a right-turn lane line. It can be seen from (2) of FIG. 4 that the right-turn lane line drawn by the above method will not press against the obstacle 400 .
  • the lane in which the vehicle travels is composed of two lane lines.
  • the other lane line can be determined through the corresponding relationship.
  • the complete lane can be quickly determined and improved. efficiency.
  • FIG. 5 is a schematic diagram of another scene for drawing lane lines according to an embodiment of the present application.
  • FIG. 5 is an example of drawing a right-turn lane.
  • the information of the first intersection 005 acquired by the drawing device 002 includes the information of the first reference point 501A, the information of the second reference point 501B and obstacles Item 500 information.
  • the information of obstacles in the right turn area determined by the first reference point 501A, the second reference point 501B and the intersection point 501C includes points 500A, 500B and 500C.
  • intersection point 501C is the point where the first depth 502A and the second depth 502B meet
  • the first depth 502A is the depth where the first reference point 501A extends to the first intersection 005
  • the second depth 502B is the second reference point 501B to the first intersection Depth of extension at 005.
  • the drawing device 002 draws a vertical line from the point 500A to the second depth 502B to obtain the projection point of the point 500A at the second depth 502B as the point 5001A; similarly, the projection point of the point 500B at the second depth 502B can be obtained.
  • the projected point is point 5001B
  • the projected point of point 500C at the second depth 502B is 5001C.
  • the drawing device 002 draws a vertical line from the point 500A and the point 500B to the first depth 502A to obtain a projected point as point 5002A, and draws a vertical line from the point 500C to the first depth 502A to obtain a projected point as 5002B.
  • the drawing device 002 selects the maximum distance from the point 5001A, the point 5001B and the point 5001C to the second reference point 501B, and the point whose distance to the corresponding point on the obstacle 500 is less than or equal to the second threshold is the target projection point .
  • the drawing device 002 selects the point with the largest distance from the point 5002A and the point 5002B to the first reference point 501A, and the point whose distance to the corresponding point on the obstacle 500 is less than or equal to the first threshold is the target projection point.
  • the distance determined by point 500A and point 5001A, the distance determined by point 500B and point 5001B, and the distance determined by point 500C and point 5001C are all less than or equal to the first threshold, but point 5001C is the farthest distance from the second reference point 501B , so point 5001C is selected as the target projection point on the second depth 502B.
  • the distance determined by point 5002A and point 500A, the distance determined by point 5002A and point 500B, and the distance determined by point 5002B and point 500C are all greater than the first threshold, so there is no target projection that meets the preset conditions at the first depth. point.
  • the second line segment 504 determined by 5001C and the second reference point 501B constitutes a right-turn lane line. It can be seen from (2) of FIG. 5 that the right-turn lane line drawn by the above method will not press against the obstacle 500 .
  • the lane in which the vehicle travels is composed of two lane lines.
  • the other lane line can be determined through the corresponding relationship.
  • the complete lane can be quickly determined and improved. efficiency.
  • FIG. 6 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application.
  • FIG. 6 illustrates by drawing a right-turn lane as an example.
  • the information of the first intersection 006 acquired by the drawing device 002 includes the information of the first reference point 601A, the information of the second reference point 601B and obstacles Object 600 information.
  • the information of obstacles in the right turn area determined by the first reference point 601A, the second reference point 601B and the intersection point 601C includes points 600A, 600B, 600C, 600D and 600E.
  • intersection point 601C is the point where the first depth 602A and the second depth 602B meet, the first depth 602A is the depth where the first reference point 601A extends to the first intersection 006, and the second depth 602B is the second reference point 601B to the first intersection Depth of extension at 006.
  • the drawing device 002 draws a vertical line from the point 600A to the first depth 602A to obtain the projection point of the point 600A at the first depth 602A as the point 6001A; similarly, the projection point of the point 600B at the first depth 602A can be obtained.
  • the projected point is point 6001B
  • the projected point of point 600C at the first depth 602A is 6001C.
  • the corresponding projection points of the point 600A, the point 600B, and the point 600C on the second depth 602B can be obtained.
  • the drawing device 002 draws a vertical line to the second depth 602B through the points 600D and 600E, respectively, to obtain the corresponding projection points as the point 6001D and the point 6001E; similarly, the projections of the points 600D and 600E at the first depth 602A can be obtained. point.
  • the drawing device 002 selects the largest distance to the first reference point 601A from the points 6001A, 6001B, 6001C and other projection points to the first depth 602A, and the distance to the corresponding point on the obstacle 600 is less than
  • the point equal to the first threshold is the target projection point.
  • the drawing device 002 selects the point with the largest distance to the second reference point 601B from the point 6001B, the point 6001E and other projection points to the second depth 602B, and the distance to the corresponding point on the obstacle 600 is less than or equal to the second threshold value Projection point for the target. It can be seen from (1) of FIG. 6 that the point 6001C and the point 6001D are target projection points that can satisfy the preset conditions.
  • the lane in which the vehicle travels is composed of two lane lines.
  • the other lane line can be determined through the corresponding relationship.
  • the complete lane can be quickly determined and improved. efficiency.
  • the planning of the straight lane line or the left turn lane line can be derived and planned according to the method of planning the right turn lane line in the embodiment shown in FIG. 4 , FIG. 5 or FIG. Or an example of left-turn lane markings.
  • FIG. 7 is a schematic structural diagram of a lane planning apparatus provided by an embodiment of the present application.
  • the lane planning apparatus 700 may be a node, or may be a device in a node, such as a chip or an integrated circuit, etc.
  • the lane line planning apparatus 700 may include an acquisition unit 701, a determination unit 702 and a planning unit 703, wherein the detailed description of each unit is as follows.
  • the obtaining unit 701 is configured to obtain the information of the first intersection, the information of the first intersection includes the information of the first reference point, the information of the second reference point and the information of the obstacles of the first intersection; wherein, the first intersection needs to be planned For the intersection of the lane line, the first reference point is the point on the first lane line, the second reference point is the point on the second lane line, and the lane lines connected to the first intersection are the first lane line and the second lane line, The second lane line is connected to the first lane line through the lane line of the first intersection, and the obstacle is the object in the first intersection that obstructs the planned lane line;
  • a determination unit 702 configured to determine a target projection point, wherein the target projection point is the projection point of the obstacle to the first depth and/or the second depth, and the first depth is the depth extending from the first lane line to the first intersection , the second depth is the depth of the second lane line extending to the first intersection;
  • the planning unit 703 is configured to determine the lane line according to the first reference point, the second reference point and the target projection point.
  • the target projection point can be determined, and then the lane line can be determined according to the first reference point, the second reference point and the target projection point. . Because of the existence of the target projection point, it can ensure that the generated lane line will not be pressed against obstacles, and no manual adjustment is required, which can improve the efficiency and accuracy of planning lane lines.
  • the determining unit 702 is further configured to:
  • only the part of the object close to the intersection may hinder the drawing of the lane line, so the object that may hinder the planning of the lane line may be marked as an obstacle through the planning area.
  • the determining unit 702 is specifically configured to:
  • the planning area is determined according to the first reference point, the second reference point and the intersection point, where the intersection point is a point where the first depth and the second depth meet.
  • the planning area determined by the first reference point, the second reference point and the intersection point can be more Accurately find objects that obstruct the planned lane lines.
  • the determining unit 702 is specifically configured to:
  • N Project the N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1;
  • the target projection point is selected from the N first projection points and the N second projection points, where,
  • the distance to the first reference point is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point;
  • the distance to the second reference point is the largest, and the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
  • a target projection point that satisfies the preset requirements is selected from the N first projection points and/or the N second projection points according to a given preset condition, because the first threshold value in the preset condition is And the existence of the second threshold can improve the possibility that the lane line drawn by the determined target projection will not overwhelm the obstacle, and also ensure that the vehicle can smoothly exit the intersection through the planned lane line.
  • the target projection point includes the first projection point
  • the planning unit 703 is specifically configured to:
  • the right-turn lane line is determined by the first line segment and the first curve.
  • the lane line is composed of a first line segment and a first curve.
  • the first line segment is the longest distance that can avoid obstacles at the entrance and can guarantee a right turn, so the first line segment can pass through the first line. In the case of completely avoiding the obstacle, the segment will go out of the intersection by the first curve.
  • the target projection point includes the second projection point
  • the planning unit 703 is specifically configured to:
  • the right-turn lane line is determined by the second curve and the second straight line.
  • the lane line is composed of a second line segment and a second curve, and the second line segment is the longest distance that can avoid obstacles at the exit from the intersection and can guarantee the completion of a right turn.
  • the second line segment When reaching the obstacle, pass the second line segment to avoid pressing the obstacle.
  • the target projection point includes a first projection point and a second projection point
  • the planning unit 703 is specifically configured to:
  • the right-turn lane line is determined by the third line segment, the third curve, and the fourth line segment.
  • the lane line is composed of a third line segment, a third curve and a fourth line segment
  • the third line segment is the longest distance to avoid obstacles at the entrance to the intersection, which can ensure that the obstacles are completely avoided. Go down and turn right.
  • the fourth line segment is the longest distance to avoid obstacles at the exit and can guarantee to complete a right turn. It can ensure that the fourth line segment is used to avoid hitting obstacles when turning right. thing.
  • the first threshold and the second threshold are both reference values obtained by training according to sample data
  • the sample data is historical driving data of the driving trajectory to avoid obstacles.
  • each unit may also correspond to the corresponding description of an embodiment shown in FIG. 3A .
  • FIG. 8 is a schematic structural diagram of a lane planning device provided by an embodiment of the present application.
  • the lane planning device 800 may be a node or a device in a node, such as a chip or an integrated circuit.
  • the apparatus 80 may include at least one memory 801 and at least one processor 802 .
  • a bus 803 may also be included.
  • a communication interface 804 may also be included, wherein the memory 801 , the processor 802 and the communication interface 804 are connected through a bus 803 .
  • the memory 801 is used to provide a storage space, and data such as an operating system and a computer program can be stored in the storage space.
  • the memory 801 may be random access memory (RAM), read-only memory (ROM), erasable programmable read only memory (EPROM), or portable read-only memory One or more combinations of memory (compact disc read-only memory, CD-ROM), etc.
  • the processor 802 is a module that performs arithmetic operations and/or logical operations, and can specifically be a central processing unit (central processing unit, CPU), a graphics processing unit (graphics processing unit, GPU), a microprocessor (microprocessor unit, MPU), One or more of processing modules such as Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA), and Complex Programmable Logic Device (CPLD) The combination.
  • CPU central processing unit
  • graphics processing unit graphics processing unit
  • microprocessor microprocessor unit, MPU
  • ASIC Application Specific Integrated Circuit
  • FPGA Field Programmable Gate Array
  • CPLD Complex Programmable Logic Device
  • the communication interface 804 is used to receive and/or send data to the outside, and may be a wired link interface such as an Ethernet cable, or a wireless link (Wi-Fi, Bluetooth, general wireless transmission, etc.) interface.
  • the communication interface 804 may further include a transmitter (eg, a radio frequency transmitter, an antenna, etc.), or a receiver, etc., coupled with the interface.
  • the processor 802 in the lane line planning device 800 is configured to read the computer program stored in the memory 801, to perform the following operations:
  • the information of the first intersection includes the information of the first reference point, the information of the second reference point and the information of the obstacles of the first intersection; wherein, the first intersection is the intersection where lane lines need to be planned, and the first intersection is the intersection where lane lines need to be planned.
  • the first reference point is the point on the first lane line
  • the second reference point is the point on the second lane line
  • the lane lines connected to the first intersection are the first lane line and the second lane line
  • the second lane line passes through the
  • the lane line of an intersection is connected to the first lane line
  • the obstacle is the object in the first intersection that obstructs the planned lane line
  • determine the target projection point wherein the target projection point is the obstacle to the first depth and/or the second depth.
  • Projection point the first depth is the depth of the extension of the first lane line to the first intersection
  • the second depth is the depth of the extension of the second lane line to the first intersection; according to the first reference point, the second reference point and the target projection Click to define the lane line.
  • the target projection point can be determined, and then the lane line can be determined according to the first reference point, the second reference point and the target projection point. . Because of the existence of the target projection point, it can be ensured that the generated lane line will not be pressed against obstacles, and no manual adjustment is required, which can improve the efficiency and accuracy of planning lane lines.
  • the processor 802 is further configured to:
  • only the part of the object close to the intersection may hinder the drawing of the lane line, so the object that may hinder the planning of the lane line may be marked as an obstacle through the planning area.
  • the processor 802 is specifically configured to:
  • the planning area is determined according to the first reference point, the second reference point and the intersection point, where the intersection point is a point where the first depth and the second depth meet.
  • the planning area determined by the first reference point, the second reference point and the intersection point can be more Accurately find objects that obstruct the planned lane lines.
  • the processor 802 is specifically configured to:
  • N Project the N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1;
  • the target projection point is selected from the N first projection points and the N second projection points, where,
  • the distance to the first reference point is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point;
  • the distance to the second reference point is the largest, and the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
  • a target projection point that satisfies the preset requirements is selected from the N first projection points and/or the N second projection points according to a given preset condition, because the first threshold value in the preset condition is And the existence of the second threshold can improve the possibility that the lane line drawn by the determined target projection will not overwhelm the obstacle, and also ensure that the vehicle can smoothly exit the intersection through the planned lane line.
  • the target projection point includes the first projection point
  • the processor 802 is specifically configured to:
  • the right-turn lane line is determined by the first line segment and the first curve.
  • the lane line is composed of a first line segment and a first curve.
  • the first line segment is the longest distance that can avoid obstacles at the entrance and can guarantee a right turn, so the first line segment can pass through the first line. In the case of completely avoiding the obstacle, the segment will go out of the intersection by the first curve.
  • the target projection point includes the second projection point
  • the processor 802 is specifically configured to:
  • the right-turn lane line is determined by the second curve and the second straight line.
  • the lane line is composed of a second line segment and a second curve, and the second line segment is the longest distance that can avoid obstacles at the exit from the intersection and can guarantee the completion of a right turn.
  • the second line segment When reaching the obstacle, pass the second line segment to avoid pressing the obstacle.
  • the target projection point includes a first projection point and a second projection point
  • the processor 802 is specifically configured to:
  • the right-turn lane line is determined by the third line segment, the third curve, and the fourth line segment.
  • the first threshold and the second threshold are both reference values obtained by training according to sample data
  • the sample data is historical driving data of the driving trajectory to avoid obstacles.
  • the lane line is composed of a third line segment, a third curve and a fourth line segment
  • the third line segment is the longest distance to avoid obstacles at the entrance to the intersection, which can ensure that the obstacles are completely avoided. Go down and turn right.
  • the fourth line segment is the longest distance to avoid obstacles at the exit and can guarantee to complete a right turn. It can ensure that the fourth line segment is used to avoid hitting obstacles when turning right. thing.
  • each operation may also correspond to the corresponding description with reference to the method embodiment shown in FIG. 3A .
  • An embodiment of the present application further provides a chip system, the chip system includes at least one processor, a memory and an interface circuit, the memory, the transceiver and the at least one processor are interconnected through a line, and the at least one memory
  • a computer program is stored in the computer; when the computer program is executed by the processor, the method flow shown in FIG. 3A is realized.
  • Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed on one or more processors, the method flow shown in FIG. 3A is implemented.
  • the embodiment of the present application further provides a computer program product, when the computer program product is executed on one or more processors, the method flow shown in FIG. 3A is implemented.
  • the aforementioned storage medium includes various media that can store computer program codes, such as ROM or random access memory RAM, magnetic disk or optical disk.

Abstract

A lane line planning method, a lane line planning apparatus, a high-precision map, an intelligent vehicle, a lane line planning device, and a computer readable storage medium. The method comprises: obtaining information of a first intersection, the information of the first intersection comprising information of a first reference point, information of a second reference point, and information of an obstacle of the first intersection (S301); determining a target projection point, wherein the target projection point is a projection point of the obstacle on a first depth and/or a second depth, the first depth is the depth of a first lane line extending to the first intersection, and the second depth is the depth of a second lane line extending to the first intersection (S302); and determining a lane line according to the first reference point, the second reference point and the target projection point (S303). According to the method, lane lines avoiding obstacles can be automatically planned, and the planning efficiency and accuracy are improved.

Description

车道线规划方法及相关装置Lane line planning method and related device
本申请要求于2021年01月08日提交中国专利局、申请号为202110026340.1、申请名称为“车道线规划方法及相关装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202110026340.1 and the application name "lane planning method and related device" filed with the China Patent Office on January 8, 2021, the entire contents of which are incorporated into this application by reference .
技术领域technical field
本申请涉及无人驾驶技术领域,尤其涉及一种车道线规划方法及相关装置。The present application relates to the field of unmanned driving technology, and in particular, to a lane line planning method and related devices.
背景技术Background technique
随着人工智能技术的成熟,自动驾驶技术也得到了快速发展。高精度地图在地图查找、自动导航以及自动驾驶等场景中起到至关重要的作用。高精度地图对信息的丰富度和精度的要求比较高,可以提供更多的道路细节信息,它可以提供一条路上每条车道的地理坐标信息,同时精度可以达到厘米级。高精度地图还可以记录丰富的道路标志信息比如人行横道、天桥、红绿灯等。在路口区域,高精度地图也会根据实际的道路场景,生成许多车道级别的虚拟车道线,为汽车在路口行驶提供精确平滑的导航信息。因此,在自动驾驶过程中,自动驾驶车辆可以按照预先在高精度地图上规划好的精确到车道级别的路径上行驶。With the maturity of artificial intelligence technology, autonomous driving technology has also developed rapidly. High-precision maps play a vital role in scenarios such as map search, automatic navigation, and autonomous driving. High-precision maps have relatively high requirements on the richness and accuracy of information, and can provide more detailed road information. It can provide geographic coordinate information of each lane on a road, and the accuracy can reach centimeter level. High-precision maps can also record rich road sign information such as crosswalks, overpasses, and traffic lights. In the intersection area, the high-precision map will also generate many lane-level virtual lane lines according to the actual road scene, providing accurate and smooth navigation information for cars driving at the intersection. Therefore, in the process of autonomous driving, the autonomous vehicle can drive on a lane-level path that is pre-planned on a high-precision map.
高精度地图的制图过程通常是由技术人员驾驶采集车辆,采集车辆获取所经过区域的环境信息,并对所获取的各种信息进行融合处理,生成电子地图。然后制图人员会采用各种地图标注软件,对所得到的电子地图进行自动标注或者人工标注的方式标注出各种交通信息,例如:车道线、道路指示牌、道路标识等交通信息。The mapping process of the high-precision map is usually driven by a technician to collect the vehicle, collect the environmental information of the area that the vehicle passes through, and fuse the various information obtained to generate an electronic map. Then cartographers will use various map labeling software to label the obtained electronic map automatically or manually to label various traffic information, such as lane lines, road signs, road signs and other traffic information.
对于高精度地图中路口内的车道线,目前包括人工标注和自动标注两种标注方法,其中:人工标注:是由制图人员根据获取的点云地图进行标注的,但是人工标注的车道线不仅费时费力,而且不容易保证车道线的美观度。自动标注:是根据获取的路口信息进行自动化标注,但是这种方法往往没有考虑路口内有障碍物的清楚,导致标注的准确度不高。For the lane lines in the intersections in the high-precision map, there are currently two labeling methods: manual labeling and automatic labeling. Among them: Manual labeling: It is labelled by the cartographer according to the obtained point cloud map, but the manually labelled lane lines are not only time-consuming It is laborious, and it is not easy to ensure the aesthetics of the lane lines. Automatic labeling: Automatic labeling is performed based on the obtained intersection information, but this method often does not consider the clearness of obstacles in the intersection, resulting in low labeling accuracy.
无论是人工标注还是自动标注,都无法兼顾高精度地图的标注效率和标注准确度。Whether it is manual labeling or automatic labeling, it is impossible to take into account the labeling efficiency and labeling accuracy of high-precision maps.
发明内容SUMMARY OF THE INVENTION
本申请实施例提高了一种车道线规划方法及相关装置,能够自动规划出避开障碍物的车道线,提高规划效率和准确率。The embodiments of the present application improve a lane line planning method and a related device, which can automatically plan a lane line that avoids obstacles, thereby improving planning efficiency and accuracy.
第一方面,本申请实施例提供了一种车道线规划的方法,可包括:获取第一路口的信息,第一路口的信息包括第一参考点的信息、第二参考点的信息和第一路口的障碍物的信息;其中,第一路口为需要规划车道线的路口,第一参考点为第一车道线上的点,第二参考点为第二车道线上的点,与第一路口相连的车道线为第一车道线和第二车道线,第二车道线通过第一路口需要规划的车道线连接第一车道线,障碍物为第一路口内妨碍规划车道线的物体;确定目标投影点,其中,目标投影点为障碍物到第一深度和/或第二深度上的投影点,第一深度为第一车道线向第一路口处延伸的深度,第二深度为第二车道线向第一路口处延伸的深度;根据第一参考点、第二参考点和目标投影点确定车道线。In a first aspect, an embodiment of the present application provides a method for lane line planning, which may include: acquiring information of a first intersection, where the information of the first intersection includes information of a first reference point, information of a second reference point, and information of a first intersection. The information of obstacles at the intersection; the first intersection is the intersection where the lane line needs to be planned, the first reference point is the point on the first lane line, the second reference point is the point on the second lane line, and the first intersection The connected lane lines are the first lane line and the second lane line, the second lane line connects the first lane line through the lane line that needs to be planned at the first intersection, and the obstacle is the object in the first intersection that hinders the planned lane line; determine the target Projection point, where the target projection point is the projection point of the obstacle to the first depth and/or the second depth, the first depth is the depth of the first lane line extending to the first intersection, and the second depth is the second lane The depth of the line extending to the first intersection; the lane line is determined according to the first reference point, the second reference point and the target projection point.
通过第一方面提供的方法,因为在规划路口处的车道线时,考虑到了路口处的障碍物, 从而可以确定出目标投影点,然后再根据第一参考点、第二参考点和目标投影点可以确定车道线。因为目标投影点的存在,可以保证生成的车道线不会压到障碍物,不需要再进行人工调整,可以提高规划车道线的效率和准确率。With the method provided in the first aspect, the obstacles at the intersection are considered when planning the lane line at the intersection, so that the target projection point can be determined, and then the target projection point can be determined according to the first reference point, the second reference point and the target projection point. Lane lines can be determined. Because of the existence of the target projection point, it can be ensured that the generated lane line will not be pressed against obstacles, and no manual adjustment is required, which can improve the efficiency and accuracy of planning lane lines.
在一种可能的实现方式中,该方法还可以包括:确定规划区域,将规划区域内的物体标记为障碍物。In a possible implementation manner, the method may further include: determining a planning area, and marking objects in the planning area as obstacles.
在本申请实施例,可能只有物体靠近路口的部分会妨碍到规划车道线,所以通过规划区域可以将可能妨碍规划车道线的物体标记障碍物,从而可以提高规划的车道线不会压到障碍物的准确率。In the embodiment of the present application, only the part of the object close to the intersection may obstruct the planned lane line. Therefore, objects that may obstruct the planned lane line can be marked as obstacles through the planning area, so that the planned lane line will not be pressed against the obstacle. 's accuracy.
在一种可能的实现方式中,该方法还可以包括:根据第一参考点、第二参考点和交点确定规划区域,交点为第一深度与第二深度交汇的点。In a possible implementation manner, the method may further include: determining the planning area according to the first reference point, the second reference point, and an intersection point, where the intersection point is a point where the first depth and the second depth meet.
在本申请实施例中,因为第一参考点、第二参考点和交点为规划车道线所需要用到的点,所以通过第一参考点、第二参考点和交点确定的规划区域,可以快速且准确地确定妨碍规划车道线的物体。In this embodiment of the present application, since the first reference point, the second reference point and the intersection point are points required for planning lane lines, the planning area determined by the first reference point, the second reference point and the intersection point can quickly And accurately identify objects that obstruct the planned lane lines.
在一种可能的实现方式中,该方法还可以包括:将障碍物的N个位置点向第一深度投影,得到N个第一投影点,N大于等于1;将障碍物的N个位置点向第二深度投影,得到N个第二投影点;从N个第一投影点和N个第二投影点中选择目标投影点,其中,N个第一投影点中到第一参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第一阈值的第一投影点属于目标投影点;N个第二投影点中到第二参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第二阈值的第二投影点属于目标投影点。In a possible implementation manner, the method may further include: projecting N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1; Project to the second depth to obtain N second projection points; select the target projection point from the N first projection points and the N second projection points, where the distance from the N first projection points to the first reference point maximum, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point; among the N second projection points, the distance to the second reference point is the largest, and the distance to the obstacle is the largest. The second projected point whose distance between the corresponding points on the 2 is less than or equal to the second threshold belongs to the target projected point.
在本申请实施例中,通过给定的预设条件,从N个第一投影点和/或N个第二投影点中选择满足预设要求的目标投影点,因为预设条件中第一阈值和第二阈值的存在,可以提高通过确定的目标投影所绘制车道线不会压到障碍物的准确率,也保障了车辆通过规划的车道线可以顺利驶出路口。In this embodiment of the present application, a target projection point that satisfies the preset requirements is selected from the N first projection points and/or the N second projection points according to a given preset condition, because the first threshold value in the preset condition is And the existence of the second threshold can improve the accuracy that the lane line drawn by the determined target projection will not overwhelm the obstacle, and also ensure that the vehicle can smoothly drive out of the intersection through the planned lane line.
在一种可能的实现方式中,目标投影点包括第一投影点,该方法还可以包括:根据第一参考点和第一投影点确定第一线段;根据第一投影点、第二参考点和交点确定第一曲线,交点为第一深度与第二深度交汇的点;由第一线段和第一曲线确定右转车道线。In a possible implementation manner, the target projection point includes a first projection point, and the method may further include: determining a first line segment according to the first reference point and the first projection point; according to the first projection point and the second reference point and the intersection point to determine the first curve, and the intersection point is the point where the first depth and the second depth meet; the right-turn lane line is determined by the first line segment and the first curve.
在本申请实施例中,车道线由第一线段和第一曲线组成,第一线段是在进入路口处避开障碍物且可以保证完成右转的最长距离,因此可以通过第一线段在完全避开障碍物的情况下,由第一曲线来驶出路口。In this embodiment of the present application, the lane line is composed of a first line segment and a first curve. The first line segment is the longest distance that can avoid obstacles at the entrance and can guarantee a right turn, so the first line segment can pass through the first line. In the case of completely avoiding the obstacle, the segment will go out of the intersection by the first curve.
在一种可能的实现方式中,目标投影点包括第二投影点,该方法还可以包括:根据第一参考点、第二投影点和交点确定第二曲线,交点为第一深度与第二深度交汇的点;根据第二投影点和第二参考点确定第二直线;由第二曲线和第二直线确定右转车道线。In a possible implementation manner, the target projection point includes a second projection point, and the method may further include: determining a second curve according to the first reference point, the second projection point and an intersection point, where the intersection point is the first depth and the second depth The intersection point; the second straight line is determined according to the second projection point and the second reference point; the right-turn lane line is determined by the second curve and the second straight line.
在本申请实施例中,车道线由第二线段和第二曲线组成,第二线段是在离开路口处避开障碍物且可以保证完成右转的最长距离,可以保证在右转时即将压到障碍物的时候通过第二线段来避免压到障碍物。In the embodiment of the present application, the lane line is composed of a second line segment and a second curve, and the second line segment is the longest distance that can avoid obstacles at the exit from the intersection and can guarantee the completion of a right turn. When reaching the obstacle, pass the second line segment to avoid pressing the obstacle.
在一种可能的实现方式中,目标投影点包括第一投影点和第二投影点,该方法还可以包括:根据第一参考点和第一投影点确定第三线段;根据第一投影点、第二投影点和交点确定第三曲线,交点为第一深度与第二深度交汇的点;根据第二投影点和第一参考点确定第四线段;由第三线段、第三曲线和第四线段确定右转车道线。In a possible implementation manner, the target projection point includes a first projection point and a second projection point, and the method may further include: determining a third line segment according to the first reference point and the first projection point; according to the first projection point, The second projection point and the intersection point determine the third curve, and the intersection point is the point where the first depth meets the second depth; the fourth line segment is determined according to the second projection point and the first reference point; the third line segment, the third curve and the fourth The line segment determines the right-turn lane line.
在本申请实施例中,车道线由第三线段、第三曲线和第四线段组成,第三线段是在进入路口处避开障碍物的最长距离,可以保证在完全避开障碍物的情况下进行右转,第四线段是 在离开路口处避开障碍物且可以保证完成右转的最长距离,可以保证在右转时即将压到障碍物的时候通过第四线段来避免压到障碍物。In the embodiment of the present application, the lane line is composed of a third line segment, a third curve and a fourth line segment, and the third line segment is the longest distance to avoid obstacles at the entrance to the intersection, which can ensure that the obstacles are completely avoided. Go down and turn right. The fourth line segment is the longest distance to avoid obstacles at the exit and can guarantee to complete a right turn. It can ensure that the fourth line segment is used to avoid hitting obstacles when turning right. thing.
在一种可能的实现方式中,该方法还可以包括:第一阈值和第二阈值均为根据样本数据训练得到的参考值,样本数据为行驶轨迹避开障碍物的历史行驶数据。In a possible implementation manner, the method may further include: both the first threshold value and the second threshold value are reference values obtained by training according to sample data, and the sample data is historical driving data of the driving trajectory to avoid obstacles.
在本申请实施例中,通过对样本数据训练得到的第一阈值和第二阈值更加符合实际情况,可信度较高。In the embodiment of the present application, the first threshold value and the second threshold value obtained by training the sample data are more in line with the actual situation and have higher reliability.
第二方面,本申请实施例提供了一种车道线规划装置,该装置可以包括:获取单元,用于获取第一路口的信息,第一路口的信息包括第一参考点的信息、第二参考点的信息和第一路口的障碍物的信息;其中,第一路口为需要规划车道线的路口,第一参考点为第一车道线上的点,第二参考点为第二车道线上的点,与第一路口相连的车道线为第一车道线和第二车道线,第二车道线通过第一路口的车道线连接第一车道线,障碍物为第一路口内妨碍规划车道线的物体;确定单元,用于确定目标投影点,其中,目标投影点为障碍物到第一深度和/或第二深度上的投影点,第一深度为第一车道线向第一路口处延伸的深度,第二深度为第二车道线向第一路口处延伸的深度;规划单元,用于根据第一参考点、第二参考点和目标投影点确定车道线。In a second aspect, an embodiment of the present application provides a lane line planning device, the device may include: an acquisition unit configured to acquire information of a first intersection, where the information of the first intersection includes information of a first reference point, a second reference Point information and information of obstacles at the first intersection; wherein, the first intersection is the intersection where the lane line needs to be planned, the first reference point is the point on the first lane line, and the second reference point is the second lane line. Point, the lane lines connected to the first intersection are the first lane line and the second lane line, the second lane line is connected to the first lane line through the lane line of the first intersection, and the obstacles are the obstacles in the first intersection that obstruct the planned lane line. Object; a determining unit for determining a target projection point, wherein the target projection point is the projection point of the obstacle to the first depth and/or the second depth, and the first depth is the extension of the first lane line to the first intersection. depth, the second depth is the depth of the second lane line extending to the first intersection; the planning unit is used to determine the lane line according to the first reference point, the second reference point and the target projection point.
在第二方面的一种可能的实施方式中,确定单元还用于:确定规划区域,将规划区域内的物体标记为障碍物。In a possible implementation manner of the second aspect, the determining unit is further configured to: determine a planning area, and mark objects in the planning area as obstacles.
在第二方面的一种可能的实施方式中,确定单元具体用于:根据第一参考点、第二参考点和交点确定规划区域,交点为第一深度与第二深度交汇的点。In a possible implementation manner of the second aspect, the determining unit is specifically configured to: determine the planning area according to the first reference point, the second reference point, and an intersection point, where the intersection point is a point where the first depth and the second depth intersect.
在第二方面的一种可能的实施方式中,确定单元具体用于:将障碍物的N个位置点向第一深度投影,得到N个第一投影点,N大于等于1;将障碍物的N个位置点向第二深度投影,得到N个第二投影点;从N个第一投影点和N个第二投影点中选择目标投影点,其中,N个第一投影点中到第一参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第一阈值的第一投影点属于目标投影点;N个第二投影点中到第二参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第二阈值的第二投影点属于目标投影点。In a possible implementation of the second aspect, the determining unit is specifically configured to: project the N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1; N position points are projected to the second depth, and N second projection points are obtained; the target projection point is selected from the N first projection points and the N second projection points, wherein, among the N first projection points to the first The distance to the reference point is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point; the distance to the second reference point is the largest among the N second projection points, and , the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
在第二方面的一种可能的实施方式中,目标投影点为第一投影点,车道线为右转车道线,规划单元具体用于:根据第一参考点和第一投影点确定第一线段;根据第一投影点、第二参考点和交点确定第一曲线,交点为第一深度与第二深度交汇的点;由第一线段和第一曲线确定右转车道线。In a possible implementation of the second aspect, the target projection point is the first projection point, the lane line is the right-turn lane line, and the planning unit is specifically configured to: determine the first line according to the first reference point and the first projection point The first curve is determined according to the first projection point, the second reference point and the intersection point, and the intersection point is the point where the first depth and the second depth meet; the right-turn lane line is determined by the first line segment and the first curve.
在第二方面的一种可能的实施方式中,目标投影点为第二投影点,车道线为右转车道线,规划单元具体用于:根据第一参考点、第二投影点和交点确定第二曲线,交点为第一深度与第二深度交汇的点;根据第二投影点和第二参考点确定第二直线;由第二曲线和第二直线确定右转车道线。In a possible implementation of the second aspect, the target projection point is the second projection point, the lane line is the right-turn lane line, and the planning unit is specifically configured to: determine the first reference point, the second projection point, and the intersection point. Two curves, the intersection point is the point where the first depth meets the second depth; the second straight line is determined according to the second projection point and the second reference point; the right-turn lane line is determined by the second curve and the second straight line.
在第二方面的一种可能的实施方式中,目标投影点包括第一投影点和第二投影点,车道线为右转车道线,规划单元具体用于:根据第一参考点和第一投影点确定第三线段;根据第一投影点、第二投影点和交点确定第三曲线,交点为第一深度与第二深度交汇的点;根据第二投影点和第一参考点确定第四线段;由第三线段、第三曲线和第四线段确定右转车道线。In a possible implementation of the second aspect, the target projection point includes a first projection point and a second projection point, the lane line is a right-turn lane line, and the planning unit is specifically configured to: according to the first reference point and the first projection point to determine the third line segment; determine the third curve according to the first projection point, the second projection point and the intersection point, the intersection point is the point where the first depth and the second depth meet; determine the fourth line segment according to the second projection point and the first reference point ; Determine the right-turn lane line by the third line segment, the third curve and the fourth line segment.
第三方面,本申请实施例提供了一种高精度地图,高精度地图包括第一方面或第一方面的任意一种可能的实施方式所描述的方法中根据第一参考点、第二参考点和目标投影点确定的车道线。In a third aspect, an embodiment of the present application provides a high-precision map, and the high-precision map includes the method described in the first aspect or any possible implementation manner of the first aspect according to the first reference point and the second reference point. and the lane line determined by the target projection point.
第四方面,本申请实施例提供了一种智能车辆,智能车辆包括至少一个处理器和至少一个存储器,至少一个处理器用于调用至少一个存储器中存储的计算机程序,以使智能车辆执行第一方面或第一方面的任意一种可能的实施方式所描述的方法。In a fourth aspect, an embodiment of the present application provides an intelligent vehicle, the intelligent vehicle includes at least one processor and at least one memory, and the at least one processor is configured to call a computer program stored in the at least one memory, so that the intelligent vehicle executes the first aspect or the method described in any one possible implementation manner of the first aspect.
第五方面,本申请实施例提供了一种车道线规划设备,车道线规划设备包括至少一个处理器和至少一个存储器,至少一个处理器用于调用至少一个存储器中存储的计算机程序,以使得装置执行第一方面或第一方面的任意一种可能的实施方式所描述的方法。In a fifth aspect, an embodiment of the present application provides a lane line planning device, the lane line planning device includes at least one processor and at least one memory, and the at least one processor is configured to call a computer program stored in the at least one memory, so that the apparatus executes The method described in the first aspect or any possible implementation manner of the first aspect.
第六方面,本申请实施例提供了一种计算机可读存储介质,计算机可读存储介质中存储有计算机程序,当计算机程序在一个或多个处理器上运行时,执行第一方面或第一方面的任意一种可能的实施方式所描述的方法。In a sixth aspect, embodiments of the present application provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program runs on one or more processors, the first aspect or the first aspect is executed. The method described in any of the possible embodiments of the aspect.
第七方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在一个或多个处理器上运行时,执行第一方面或第一方面的任意一种可能的实施方式所描述的方法。In a seventh aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on one or more processors, the first aspect or any possible implementation manner of the first aspect is executed. method.
附图说明Description of drawings
以下对本申请实施例用到的附图进行介绍。The accompanying drawings used in the embodiments of the present application will be introduced below.
图1是现有技术提供的一种绘制车道线的场景示意图;1 is a schematic diagram of a scene for drawing lane lines provided by the prior art;
图2A是本申请实施例提供的一种车道线规划系统的结构示意图;2A is a schematic structural diagram of a lane line planning system provided by an embodiment of the present application;
图2B是本申请实施例提供的另一种车道线规划系统的架构示意图;2B is a schematic structural diagram of another lane planning system provided by an embodiment of the present application;
图2C是本申请实施例提供的一种智能车辆003的功能框图;FIG. 2C is a functional block diagram of an intelligent vehicle 003 provided by an embodiment of the present application;
图3A是本申请实施例提供的一种绘制车道线的方法流程示意图;3A is a schematic flowchart of a method for drawing lane lines according to an embodiment of the present application;
图3B是本申请实施例提供的一种路口信息的示意图;3B is a schematic diagram of intersection information provided by an embodiment of the present application;
图3C是本申请实施例提供的一种确定目标投影点的示意图;3C is a schematic diagram of determining a target projection point provided by an embodiment of the present application;
图4是本申请实施例提供的另一种绘制车道线的场景示意图;4 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application;
图5是本申请实施例提供的另一种绘制车道线的场景示意图;5 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application;
图6是本申请实施例提供的另一种绘制车道线的场景示意图;6 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application;
图7是本申请实施例提供的一种车道线规划装置的结构示意图;7 is a schematic structural diagram of a lane line planning device provided by an embodiment of the present application;
图8是本申请实施例提供的一种车道线规划设备的结构示意图。FIG. 8 is a schematic structural diagram of a lane line planning device provided by an embodiment of the present application.
具体实施方式Detailed ways
下面结合本申请实施例中的附图对本申请实施例进行描述。The embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.
首先,对本申请实施例涉及的相关技术进行解释说明,以便本领域技术人员理解。First, the related technologies involved in the embodiments of the present application are explained so as to be understood by those skilled in the art.
1、高精度地图1. High-precision map
高精度地图也称为高分辨率地图(HD Map,High Definition Map),是一种专门为无人驾驶服务的地图。与传统导航地图不同的是,高精度地图除了能提供的道路(Road)级别的导航信息外,还能够提供车道(Lane)级别的导航信息。无论是在信息的丰富度还是信息的精度方面,都远远高于传统导航地图。A high-resolution map, also known as a high-resolution map (HD Map, High Definition Map), is a map specially designed for unmanned driving. Unlike traditional navigation maps, high-precision maps can provide lane-level navigation information in addition to road-level navigation information. Both in the richness of the information and the accuracy of the information, it is far higher than the traditional navigation map.
比如说,车道(Lane)级别的导航信息可以包括高精度的坐标,同时还可以包括准确的道路形状、每个车道的坡度、曲率、航向、高程、侧倾等数据。For example, lane-level navigation information can include high-precision coordinates, as well as accurate road shape, slope, curvature, heading, elevation, roll, and other data for each lane.
2、矢量数据2. Vector data
矢量数据是在直角坐标中,用x、y坐标表示地图图形或地理实体的位置和形状的数据,一般通过记录坐标的方式来尽可能地将地理实体的空间位置表现得准确无误。并且,矢量数 据还可以是计算机中以矢量结构存储的内部数据,它是跟踪式数字化仪的直接产物。在矢量数据结构中,点数据可直接用坐标值描述;线数据可用均匀或不均匀间隔的顺序坐标链来描述;面状数据(或多边形数据)可用边界线来描述。Vector data is in Cartesian coordinates, using x and y coordinates to represent the position and shape of map graphics or geographic entities. Generally, the spatial position of geographic entities is expressed as accurately as possible by recording coordinates. Also, vector data can be internal data stored in a vector structure in a computer, which is a direct product of a tracking digitizer. In the vector data structure, point data can be described directly by coordinate values; line data can be described by evenly or unevenly spaced sequential coordinate chains; surface data (or polygon data) can be described by boundary lines.
目前,对于路口的车道线规划的方法可以包括如下步骤:At present, the method for planning lane lines at intersections may include the following steps:
S1、确定第一参考点的信息,第一参考点为第一车道上的点。S1. Determine the information of the first reference point, where the first reference point is a point on the first lane.
请参见图1,图1是现有技术提供的一种绘制车道线的场景示意图,图1以绘制右转车道线为例来进行说明。从图1的(1)可以看出,第一参考点为第一参考点101A。可选地,第一参考点101A为第一车道线104A上的点,第一参考点101A具体可以是第一车道线104A(或者第一车道线104A的延长线)在接近路口106的区域上的点;路口106为需要标注车道线的路口,与路口106相连的车道是第一车道102和第二车道103,第一车道线104A可以是第一车道102的车道边缘线。Please refer to FIG. 1 . FIG. 1 is a schematic diagram of a scene for drawing lane lines provided by the prior art. FIG. 1 takes drawing a lane line for a right turn as an example for description. It can be seen from (1) of FIG. 1 that the first reference point is the first reference point 101A. Optionally, the first reference point 101A is a point on the first lane line 104A, and the first reference point 101A may specifically be the first lane line 104A (or an extension of the first lane line 104A) on an area close to the intersection 106 The intersection 106 is the intersection where lane lines need to be marked, the lanes connected to the intersection 106 are the first lane 102 and the second lane 103 , and the first lane line 104A may be the lane edge line of the first lane 102 .
S2、确定第二参考点的信息,第二参考点为第二车道上的点。S2. Determine the information of the second reference point, where the second reference point is a point on the second lane.
请参见图1的(1),从图1的(1)可以看出,第二参考点为第二参考点101B。可选地,第二参考点101B为第二车道线105A上的点,第二参考点101B具体可以是第二车道线105A(或者第二车道线105A的延长线)在接近路口106的区域上的点,第二车道线105A可以是第二车道103的车道边缘线。Please refer to ( 1 ) of FIG. 1 , it can be seen from ( 1 ) of FIG. 1 that the second reference point is the second reference point 101B. Optionally, the second reference point 101B is a point on the second lane line 105A, and the second reference point 101B may specifically be the second lane line 105A (or an extension of the second lane line 105A) on an area close to the intersection 106 The second lane line 105A may be the lane edge line of the second lane 103 .
S3、确定交点,交点为第一车道线向路口处延伸时与第二车道线向路口处延伸时交汇的点。S3. Determine the intersection point, which is the point where the first lane line extends toward the intersection and the second lane line extends toward the intersection.
请参见图1的(1),从图1的(1)可以看出,交点为交点101C。交点101C为第一车道线104A向路口处的延伸线与第二车道线105A向路口处的延伸性所交汇的点。Referring to (1) of FIG. 1 , it can be seen from (1) of FIG. 1 that the intersection is the intersection 101C. The intersection point 101C is the point where the extension of the first lane line 104A toward the intersection meets the extension of the second lane line 105A toward the intersection.
S4,根据第一参考点、第二参考点和交点,生成右转车道线。S4, generating a right-turn lane line according to the first reference point, the second reference point and the intersection point.
从图1的(2)可以看出,根据第一参考点101A、交点101C和第二参考点101B生成的右转车道线107的边缘车道线与路口106内的障碍物108相交,也即障碍物108可能会出现在右转车道线107所覆盖的区域中。As can be seen from (2) of FIG. 1 , the edge lane line of the right-turn lane line 107 generated according to the first reference point 101A, the intersection point 101C and the second reference point 101B intersects the obstacle 108 in the intersection 106, that is, the obstacle Object 108 may appear in the area covered by right-turn lane line 107 .
可以看出,没有进行障碍物规避处理而绘制的车道线可能会压到路口内的障碍物,依旧需要进行人工调整,效率低下且容易出错。It can be seen that the lane lines drawn without obstacle avoidance processing may press on the obstacles in the intersection, and manual adjustment is still required, which is inefficient and prone to errors.
为了便于理解本申请实施例,下面先对本申请实施例所基于的其中一种车道线规划系统的结构进行描述。请参见图2A,图2A是本申请实施例提供的一种车道线规划系统的结构示意图,该系统包括采集装置001和绘制装置002,其中,采集装置001和绘制装置002可以通过网络通信,以将采集到的用于绘制车道线的原始数据向绘制装置002发送,由绘制装置002完成车道线的绘制。In order to facilitate understanding of the embodiments of the present application, the following first describes the structure of one of the lane line planning systems on which the embodiments of the present application are based. Please refer to FIG. 2A. FIG. 2A is a schematic structural diagram of a lane line planning system provided by an embodiment of the present application. The system includes a collection device 001 and a drawing device 002, wherein the collection device 001 and the drawing device 002 can communicate through a network to The collected raw data for drawing lane lines is sent to the drawing device 002, and the drawing device 002 completes the drawing of the lane lines.
采集装置001可以是具体数据采集能力和数据收发能力的电子设备。比如说采集装置001可以是装备有激光雷达、摄像头、全球导航卫星系统(Global Navigation Satellite System,GNSS)、惯性测量单元(Inertial Measurement Unit,IMU)等一个或多种传感器的采集车辆。采集车辆可以收集高精度地图中待标注车道线的路口信息,也即在绘制高精度地图之前,可以通过行驶在各个道路上的采集车辆来收集绘制高精度地图所需要的信息。其中,激光雷达主要用于采集点云数据,因为激光雷达可以精确的反应出位置信息,所以通过激光雷达可以获取路面的宽度、信号灯的高度以及一些其他信息;摄像头主要用于采集路面的标识、车道线等信息;GNSS主要用于记录当前采集点的坐标;IMU主要用于记录采集车辆的角度和加 速度信息,用于校正采集车辆的位置和角度。The collection device 001 may be an electronic device with specific data collection capability and data transceiver capability. For example, the acquisition device 001 may be an acquisition vehicle equipped with one or more sensors such as lidar, camera, Global Navigation Satellite System (GNSS), Inertial Measurement Unit (IMU), etc. The collecting vehicle can collect the intersection information of the lane lines to be marked in the high-precision map, that is, before drawing the high-precision map, the information required for drawing the high-precision map can be collected by collecting vehicles driving on each road. Among them, lidar is mainly used to collect point cloud data, because lidar can accurately reflect position information, so the width of the road, the height of signal lights and some other information can be obtained through lidar; the camera is mainly used to collect road signs, Lane lines and other information; GNSS is mainly used to record the coordinates of the current collection point; IMU is mainly used to record the angle and acceleration information of the collection vehicle, and is used to correct the position and angle of the collection vehicle.
或者,采集装置001还可以是安装于路口处的路侧单元,路侧单元可以获取覆盖区域内的路口信息,以及监控覆盖区域内的多个智能车辆。路侧单元可以采集到自动驾驶中待规划车道线的路口信息,也即路侧单元可以随时监控路口内的动态,可以将路口的信息向需要通过路口的智能车辆发送。需要说明的是,可以由一个路侧单元来获取路口信息,也可以由多个路侧单元协作配合来获取路口信息,以达到可以获取到与路口连接的所有道路的信息。其中,路侧单元可以是由高增益定向束控读写天线和射频控制器组成。高增益定向束控读写天线是一个微波收发模块,负责信号和数据的发送/接收、调制/解调、编码/解码、加密/解密;射频控制器是控制发射和接收数据以及处理向上位机收发信息的模块。Alternatively, the collection device 001 may also be a roadside unit installed at an intersection, and the roadside unit may acquire intersection information within the coverage area, and monitor multiple smart vehicles within the coverage area. The roadside unit can collect the intersection information of the lanes to be planned in automatic driving, that is, the roadside unit can monitor the dynamics in the intersection at any time, and can send the information of the intersection to the intelligent vehicles that need to pass the intersection. It should be noted that the intersection information may be acquired by one roadside unit, or the intersection information may be acquired by the cooperation of multiple roadside units, so as to obtain the information of all roads connected to the intersection. Among them, the roadside unit may be composed of a high-gain directional beam control read-write antenna and a radio frequency controller. The high-gain directional beam control read-write antenna is a microwave transceiver module, responsible for signal and data transmission/reception, modulation/demodulation, encoding/decoding, encryption/decryption; the radio frequency controller is used to control the transmission and reception of data and the processing of the upper computer. A module for sending and receiving information.
通过采集装置001可以采集到高精度地图中待标注车道线的路口信息,比如说路口处的道路级数据(也即与路口相连的每个道路的数据)、路口处的车道级数据(也即与路口相连的每个车道的数据)、路口内的障碍物的信息。道路级还可以称为非高精矢量路网数据,用于从道路级精度描述具体的道路。道路级数据是按照道路粒度采集的路网数据,也即包含多条车道的一条车道也只会有一条以路段(link)为单位的矢量数据。矢量数据包括一系列位置坐标点,通常是道路中心线上的一系列位置坐标点;道路级数据还包括道路等级、通行能力、车道数、道路类别、行驶方式、道路宽带等等。车道级数据可以称为高精矢量路网络数据,用于从车道线精度描述具体的道路。具体来说,车道级数据是按照车道线粒度采集的路网数据,可以包括但不限于任意一条道路的车道边缘线信息(包括车道边缘线所在位置的矢量数据)、车道分界线信息(包括车道分界线所在位置的矢量数据)等。障碍物可以为路口内妨碍行驶的物体,障碍物的信息可以是障碍物所在位置的矢量数据,障碍物包括但不限于以下至少一项:路牙、树木、路灯等等。The intersection information of the lane lines to be marked in the high-precision map can be collected through the collection device 001, such as road-level data at the intersection (that is, the data of each road connected to the intersection), lane-level data at the intersection (that is, the data of each road connected to the intersection). data for each lane connected to the intersection), information on obstacles within the intersection. Road-level can also be called non-high-precision vector road network data, which is used to describe specific roads from road-level accuracy. The road-level data is the road network data collected according to the road granularity, that is, a lane containing multiple lanes will only have one vector data with the unit of link (link) as the unit. Vector data includes a series of location coordinate points, usually a series of location coordinate points on the road centerline; road-level data also includes road grade, traffic capacity, number of lanes, road category, driving mode, road bandwidth, and so on. Lane-level data can be called high-precision vector road network data, which are used to describe specific roads from lane line accuracy. Specifically, lane-level data is road network data collected according to the granularity of lane lines, which may include, but is not limited to, lane edge line information of any road (including vector data of the location of the lane edge line), lane boundary line information (including lane edge line information) vector data of the location of the dividing line), etc. The obstacle can be an object that hinders driving in the intersection, the information of the obstacle can be vector data of the location of the obstacle, and the obstacle includes but is not limited to at least one of the following: curbs, trees, street lights, and so on.
绘制装置002可以是具有数据处理能力和数据收发能力的电子设备,可以是实体设备如主机、机架式服务器、刀片式服务器等,也可以是虚拟设备如虚拟机、容器等。绘制装置002可以获取到高精度地图中待标注车道线的路口信息,然后从路口信息中获取第一参考点的信息、第二参考点的信息和第一路口的障碍物的信息;其中,第一路口为需要规划车道线的路口,第一参考点为第一车道线上的点,第二参考点为第二车道线上的点,第二车道线为通过路口内车道线连接第一车道线的车道线,障碍物为所述第一路口内妨碍规划车道线的物体;再然后确定目标投影点,目标投影点为障碍物到第一深度和/或第二深度上的投影点,第一深度为第一参考点向第一路口处延伸的深度,第二深度为第二参考点向所述第一路口处延伸的深度,最后绘制装置002根据第一参考点、第二参考点和目标投影点作为控制点来确定车道线。The drawing apparatus 002 may be an electronic device with data processing capability and data transceiving capability, may be a physical device such as a host, rack server, blade server, etc., or may be a virtual device such as a virtual machine, a container, and the like. The drawing device 002 can obtain the intersection information of the lane line to be marked in the high-precision map, and then obtain the information of the first reference point, the information of the second reference point and the information of the obstacles of the first intersection from the intersection information; An intersection is an intersection where lane lines need to be planned, the first reference point is a point on the first lane line, the second reference point is a point on the second lane line, and the second lane line is connecting the first lane through the lane line inside the intersection The lane line of the line, the obstacle is the object that obstructs the planned lane line in the first intersection; and then the target projection point is determined, and the target projection point is the projection point of the obstacle to the first depth and/or the second depth. A depth is the depth of the first reference point extending to the first intersection, and the second depth is the depth of the second reference point extending to the first intersection. Finally, the drawing device 002 is based on the first reference point, the second reference point and the The target projection points are used as control points to determine the lane lines.
在一种可能的实现方式中,绘制装置002将障碍物的N个位置点向第一深度投影,得到N个第一投影点;绘制装置002将障碍物的N个位置点向第二深度投影,得到N个第二投影点;然后绘制装置002从N个第一投影点中和N个第二投影点中选择目标投影点,也即,N个第一投影点中到第一参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第一阈值的第一投影点属于目标投影点;或者,N个第二投影点中到第二参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第二阈值的第二投影点属于目标投影点。第一阈值和第二阈值为根据路口的障碍物与车道线之间的距离,通过机器学习训练得到的数值。In a possible implementation manner, the drawing device 002 projects the N position points of the obstacle to the first depth to obtain N first projection points; the drawing device 002 projects the N position points of the obstacle to the second depth , to obtain N second projection points; then the drawing device 002 selects the target projection point from the N first projection points and the N second projection points, that is, the distance from the N first projection points to the first reference point The distance is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point; or, the distance from the N second projection points to the second reference point is the largest, and, The second projected point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projected point. The first threshold and the second threshold are values obtained through machine learning training according to the distance between the obstacle at the intersection and the lane line.
需要说明的是,当采集装置001为采集车辆时,收集的路口信息可以为高精度地图中待标注车道线的路口信息,绘制装置001可以为生成高精度地图的设备。当绘制装置001生成高精度地图后,可以将上述高精度地图发送给智能车辆003,智能车辆003可以根据该高精 度地图完成进行行驶。It should be noted that, when the collecting device 001 is collecting vehicles, the collected intersection information may be the intersection information of the lane lines to be marked in the high-precision map, and the drawing device 001 may be a device that generates a high-precision map. After the drawing device 001 generates the high-precision map, the above-mentioned high-precision map can be sent to the intelligent vehicle 003, and the intelligent vehicle 003 can complete the driving according to the high-precision map.
当采集装置001为安装于路口处的路侧单元时,收集的路口信息可以为自动驾驶中待规划车道线的路口的信息,请参见图2B,图2B是本申请实施例提供的另一种车道线规划系统的架构示意图。从图2B可以看出,绘制装置001可以为行驶于路口处的智能车辆003,当智能车辆003接收到路侧单元发送的路口的信息后,根据路口的信息可以规划出避开障碍物的车道线。When the collection device 001 is a roadside unit installed at the intersection, the collected intersection information may be the information of the intersection of the lane line to be planned in automatic driving. Please refer to FIG. 2B , which is another kind of intersection provided by the embodiment of the present application. Schematic diagram of the architecture of the lane line planning system. As can be seen from FIG. 2B , the drawing device 001 can be an intelligent vehicle 003 driving at an intersection. When the intelligent vehicle 003 receives the information of the intersection sent by the roadside unit, it can plan a lane to avoid obstacles according to the information of the intersection. Wire.
需要说明的是,车道线可以包括直行车道线、左转车道线或者右转车道线,本申请实施例不做任何限制。It should be noted that the lane lines may include straight lane lines, left-turn lane lines, or right-turn lane lines, which are not limited in this embodiment of the present application.
需要说明的是,可以使用贝塞尔曲线来绘制车道线,还可以使用样条曲线来确绘制车道线,本申请实施例对于绘制车道线的工具不做任何限制。It should be noted that a Bezier curve can be used to draw a lane line, and a spline curve can also be used to accurately draw a lane line, and the embodiment of the present application does not impose any limitation on a tool for drawing a lane line.
基于上述绘制车道线系统架构,本申请实施例提供了一种应用于上述绘制车道线系统架构中的智能车辆003。请参见图2C,图2C是本申请实施例提供的一种智能车辆003的功能框图。在一个实施例中,可以将智能车辆003配置为完全或部分地自动驾驶模式。例如,智能车辆003可以在处于自动驾驶模式中的同时控制自身,并且可通过人为操作来确定车辆及其周边环境的当前状态,确定周边环境中的至少一个其他车辆的可能行为,并确定该其他车辆执行可能行为的可能性相对应的置信水平,基于所确定的信息来控制智能车辆003。在智能车辆003处于自动驾驶模式中时,可以将智能车辆003置为在没有和人交互的情况下操作。Based on the above system architecture for drawing lane lines, an embodiment of the present application provides an intelligent vehicle 003 applied to the above system architecture for drawing lane lines. Referring to FIG. 2C , FIG. 2C is a functional block diagram of an intelligent vehicle 003 provided by an embodiment of the present application. In one embodiment, the intelligent vehicle 003 may be configured in a fully or partially autonomous driving mode. For example, the intelligent vehicle 003 can control itself while in an autonomous driving mode, and can determine the current state of the vehicle and its surroundings through human manipulation, determine the possible behavior of at least one other vehicle in the surrounding environment, and determine the other The intelligent vehicle 003 is controlled based on the determined information with a confidence level corresponding to the likelihood that the vehicle will perform the possible behavior. When the intelligent vehicle 003 is in an autonomous driving mode, the intelligent vehicle 003 can be set to operate without human interaction.
智能车辆003可包括各种子系统,例如行进系统202、传感系统204、控制系统206、一个或多个外围设备208以及电源210、计算机系统212和用户接口216。可选地,智能车辆003可包括更多或更少的子系统,并且每个子系统可包括多个元件。另外,智能车辆003的每个子系统和元件可以通过有线或者无线互连。 Intelligent vehicle 003 may include various subsystems, such as travel system 202 , sensing system 204 , control system 206 , one or more peripherals 208 and power supply 210 , computer system 212 , and user interface 216 . Alternatively, the intelligent vehicle 003 may include more or fewer subsystems, and each subsystem may include multiple elements. Additionally, each of the subsystems and elements of the intelligent vehicle 003 may be interconnected by wire or wirelessly.
行进系统202可包括为智能车辆003提供动力运动的组件。在一个实施例中,行进系统202可包括引擎218、能量源219、传动装置220和车轮/轮胎221。引擎218可以是内燃引擎、电动机、空气压缩引擎或其他类型的引擎组合,例如气油发动机和电动机组成的混动引擎,内燃引擎和空气压缩引擎组成的混动引擎。引擎218将能量源219转换成机械能量。The travel system 202 may include components that provide powered motion for the intelligent vehicle 003 . In one embodiment, travel system 202 may include engine 218 , energy source 219 , transmission 220 , and wheels/tires 221 . Engine 218 may be an internal combustion engine, an electric motor, an air compression engine, or other types of engine combinations, such as a hybrid engine consisting of an air oil engine and an electric motor, a hybrid engine consisting of an internal combustion engine and an air compression engine. Engine 218 converts energy source 219 into mechanical energy.
能量源219的示例包括汽油、柴油、其他基于石油的燃料、丙烷、其他基于压缩气体的燃料、乙醇、太阳能电池板、电池和其他电力来源。能量源219也可以为智能车辆003的其他系统提供能量。Examples of energy sources 219 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity. The energy source 219 may also provide energy to other systems of the intelligent vehicle 003 .
传动装置220可以将来自引擎218的机械动力传送到车轮221。传动装置220可包括变速箱、差速器和驱动轴。在一个实施例中,传动装置220还可以包括其他器件,比如离合器。其中,驱动轴可包括可耦合到一个或多个车轮221的一个或多个轴。Transmission 220 may transmit mechanical power from engine 218 to wheels 221 . Transmission 220 may include a gearbox, a differential, and a driveshaft. In one embodiment, transmission 220 may also include other devices, such as clutches. Among other things, the drive shafts may include one or more axles that may be coupled to one or more wheels 221 .
传感系统204可包括感测关于智能车辆003周边的环境的信息的若干个传感器。例如,传感系统204可包括全球定位系统222(定位系统可以是GPS系统,也可以是北斗系统或者其他定位系统)、惯性测量单元(inertial measurement unit,IMU)224、雷达226、激光测距仪228以及相机230。传感系统204还可包括被监视智能车辆003的内部系统的传感器(例如,车内空气质量监测器、燃油量表、机油温度表等)。来自这些传感器中的一个或多个的传感器数据可用于检测对象及其相应特性(位置、形状、方向、速度等)。这种检测和识别是自主智能车辆003的安全操作的关键功能。The sensing system 204 may include several sensors that sense information about the environment surrounding the intelligent vehicle 003 . For example, the sensing system 204 may include a global positioning system 222 (the positioning system may be a GPS system, a Beidou system or other positioning systems), an inertial measurement unit (IMU) 224, a radar 226, a laser rangefinder 228 and camera 230. The sensing system 204 may also include sensors that monitor the internal systems of the smart vehicle 003 (eg, an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, orientation, velocity, etc.). This detection and identification is a critical function for the safe operation of the autonomous intelligent vehicle 003 .
全球定位系统222可用于估计智能车辆003的地理位置。IMU 224用于基于惯性加速度来感测智能车辆003的位置和朝向变化。在一个实施例中,IMU 224可以是加速度计和陀螺 仪的组合。例如:IMU 224可以用于测量智能车辆003的曲率。The global positioning system 222 may be used to estimate the geographic location of the intelligent vehicle 003 . The IMU 224 is used to sense position and orientation changes of the intelligent vehicle 003 based on inertial acceleration. In one embodiment, the IMU 224 may be a combination of an accelerometer and a gyroscope. For example: IMU 224 may be used to measure the curvature of smart vehicle 003.
雷达226可利用无线电信号来感测智能车辆003的周边环境内的物体。在一些实施例中,除了感测物体以外,雷达226还可用于感测物体的速度和/或前进方向。Radar 226 may utilize radio signals to sense objects within the surrounding environment of intelligent vehicle 003 . In some embodiments, in addition to sensing objects, radar 226 may be used to sense the speed and/or heading of objects.
激光测距仪228可利用激光来感测智能车辆003所位于的环境中的物体。在一些实施例中,激光测距仪228可包括一个或多个激光源、激光扫描器以及一个或多个检测器,以及其他系统组件。The laser rangefinder 228 may utilize laser light to sense objects in the environment in which the intelligent vehicle 003 is located. In some embodiments, the laser rangefinder 228 may include one or more laser sources, laser scanners, and one or more detectors, among other system components.
相机230可用于捕捉智能车辆003的周边环境的多个图像。相机230可以是静态相机或视频相机。Camera 230 may be used to capture multiple images of the surrounding environment of intelligent vehicle 003 . Camera 230 may be a still camera or a video camera.
控制系统206为控制智能车辆003及其组件的操作。控制系统206可包括各种元件,其中包括转向系统232、油门234、制动单元236、传感器238、计算机视觉系统240、路线控制系统242以及障碍避免系统244。The control system 206 controls the operation of the intelligent vehicle 003 and its components. Control system 206 may include various elements including steering system 232 , throttle 234 , braking unit 236 , sensors 238 , computer vision system 240 , route control system 242 , and obstacle avoidance system 244 .
转向系统232可操作来调整智能车辆003的前进方向。例如在一个实施例中可以为方向盘系统。Steering system 232 is operable to adjust the heading of intelligent vehicle 003 . For example, in one embodiment it may be a steering wheel system.
油门234用于控制引擎218的操作速度并进而控制智能车辆003的速度。The throttle 234 is used to control the operating speed of the engine 218 and thus the speed of the intelligent vehicle 003 .
制动单元236用于控制智能车辆003减速。制动单元236可使用摩擦力来减慢车轮221。在其他实施例中,制动单元236可将车轮221的动能转换为电流。制动单元236也可采取其他形式来减慢车轮221转速从而控制智能车辆003的速度。The braking unit 236 is used to control the deceleration of the intelligent vehicle 003 . The braking unit 236 may use friction to slow the wheels 221 . In other embodiments, the braking unit 236 may convert the kinetic energy of the wheels 221 into electrical current. The braking unit 236 may also take other forms to slow down the wheels 221 to control the speed of the smart vehicle 003 .
计算机视觉系统240可以操作来处理和分析由相机230捕捉的图像以便识别智能车辆003周边环境中的物体和/或特征。所述物体和/或特征可包括交通信号、道路边界和障碍物。计算机视觉系统240可使用物体识别算法、运动中恢复结构(Structure from Motion,SFM)算法、视频跟踪和其他计算机视觉技术。在一些实施例中,计算机视觉系统240可以用于为环境绘制地图、跟踪物体、估计物体的速度等等。Computer vision system 240 is operable to process and analyze images captured by camera 230 in order to identify objects and/or features in the environment surrounding intelligent vehicle 003 . The objects and/or features may include traffic signals, road boundaries and obstacles. Computer vision system 240 may use object recognition algorithms, Structure from Motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, computer vision system 240 may be used to map the environment, track objects, estimate the speed of objects, and the like.
路线控制系统242用于确定智能车辆003的行驶路线。在一些实施例中,路线控制系统242可结合来自传感器238、全球定位系统222和一个或多个预定地图的数据以为智能车辆003确定行驶路线。The route control system 242 is used to determine the travel route of the intelligent vehicle 003 . In some embodiments, the route control system 242 may combine data from the sensors 238 , the global positioning system 222 , and one or more predetermined maps to determine a driving route for the intelligent vehicle 003 .
障碍避免系统244用于识别、评估和避免或者以其他方式越过智能车辆003的环境中的潜在障碍物。The obstacle avoidance system 244 is used to identify, evaluate and avoid or otherwise overcome potential obstacles in the environment of the intelligent vehicle 003 .
当然,在一个实例中,控制系统206可以增加或替换地包括除了所示出和描述的那些以外的组件。或者也可以减少一部分上述示出的组件。Of course, in one example, the control system 206 may additionally or alternatively include components other than those shown and described. Alternatively, some of the components shown above may be reduced.
智能车辆003通过外围设备208与外部传感器、其他车辆、其他计算机系统或用户之间进行交互。外围设备208可包括无线通信系统246、车载电脑248、麦克风250和/或扬声器252。The intelligent vehicle 003 interacts with external sensors, other vehicles, other computer systems, or the user through peripheral devices 208 . Peripherals 208 may include a wireless communication system 246 , an onboard computer 248 , a microphone 250 and/or a speaker 252 .
在一些实施例中,外围设备208提供智能车辆003的用户与用户接口216交互的手段。例如,车载电脑248可向智能车辆003的用户提供信息。用户接口216还可操作车载电脑248来接收用户的输入。车载电脑248可以通过触摸屏进行操作。在其他情况中,外围设备208可提供用于智能车辆003与位于车内的其它设备通信的手段。例如,麦克风250可从智能车辆003的用户接收音频(例如,语音命令或其他音频输入)。类似地,扬声器252可向智能车辆003的用户输出音频。In some embodiments, peripherals 208 provide a means for a user of intelligent vehicle 003 to interact with user interface 216 . For example, the onboard computer 248 may provide information to the user of the smart vehicle 003 . User interface 216 may also operate on-board computer 248 to receive user input. The onboard computer 248 can be operated via a touch screen. In other cases, peripherals 208 may provide a means for intelligent vehicle 003 to communicate with other devices located within the vehicle. For example, microphone 250 may receive audio (eg, voice commands or other audio input) from a user of intelligent vehicle 003 . Similarly, speaker 252 may output audio to the user of smart vehicle 003 .
无线通信系统246可以直接地或者经由通信网络来与一个或多个设备无线通信。例如,无线通信系统246可使用3G蜂窝通信,例如CDMA、EVD0、GSM/GPRS,或者4G蜂窝通信,例如LTE。或者5G蜂窝通信。无线通信系统246可利用WiFi与无线局域网(wireless  local area network,WLAN)通信。在一些实施例中,无线通信系统246可利用红外链路、蓝牙或ZigBee与设备直接通信。其他无线协议,例如:各种车辆通信系统,例如,无线通信系统246可包括一个或多个专用短程通信(dedicated short range communications,DSRC)设备,这些设备可包括车辆和/或路边台站之间的公共和/或私有数据通信。Wireless communication system 246 may wirelessly communicate with one or more devices, either directly or via a communication network. For example, wireless communication system 246 may use 3G cellular communications, such as CDMA, EVDO, GSM/GPRS, or 4G cellular communications, such as LTE. Or 5G cellular communications. The wireless communication system 246 may communicate with a wireless local area network (WLAN) using WiFi. In some embodiments, the wireless communication system 246 may communicate directly with the device using an infrared link, Bluetooth, or ZigBee. Other wireless protocols, such as various vehicle communication systems, for example, wireless communication system 246 may include one or more dedicated short range communications (DSRC) devices, which may include a combination of vehicle and/or roadside stations. public and/or private data communications between them.
电源210可向智能车辆003的各种组件提供电力。在一个实施例中,电源210可以为可再充电锂离子或铅酸电池。这种电池的一个或多个电池组可被配置为电源为智能车辆003的各种组件提供电力。在一些实施例中,电源210和能量源219可一起实现,例如一些全电动车中那样。Power supply 210 may provide power to various components of intelligent vehicle 003 . In one embodiment, the power source 210 may be a rechargeable lithium-ion or lead-acid battery. One or more battery packs of such batteries may be configured as a power source to provide power to various components of the intelligent vehicle 003 . In some embodiments, power source 210 and energy source 219 may be implemented together, such as in some all-electric vehicles.
智能车辆003的部分或所有功能受计算机系统212控制。计算机系统212可包括至少一个处理器213,处理器213执行存储在例如存储器214这样的非暂态计算机可读介质中的指令215。计算机系统212还可以是采用分布式方式控制智能车辆003的个体组件或子系统的多个计算设备。Some or all of the functions of intelligent vehicle 003 are controlled by computer system 212 . Computer system 212 may include at least one processor 213 that executes instructions 215 stored in a non-transitory computer-readable medium such as memory 214 . Computer system 212 may also be multiple computing devices that control individual components or subsystems of intelligent vehicle 003 in a distributed fashion.
处理器213可以是任何常规的处理器,诸如商业可获得的CPU。替选地,该处理器可以是诸如ASIC或其它基于硬件的处理器的专用设备。尽管图2C功能性地图示了处理器、存储器、和在相同块中的计算机的其它元件,但是本领域的普通技术人员应该理解该处理器、计算机、或存储器实际上可以包括可以或者可以不存储在相同的物理外壳内的多个处理器、计算机、或存储器。例如,存储器可以是硬盘驱动器或位于不同于计算机的外壳内的其它存储介质。因此,对处理器或计算机的引用将被理解为包括对可以或者可以不并行操作的处理器或计算机或存储器的集合的引用。不同于使用单一的处理器来执行此处所描述的步骤,诸如转向组件和减速组件的一些组件每个都可以具有其自己的处理器,所述处理器只执行与特定于组件的功能相关的计算。The processor 213 may be any conventional processor, such as a commercially available CPU. Alternatively, the processor may be a dedicated device such as an ASIC or other hardware-based processor. Although FIG. 2C functionally illustrates a processor, memory, and other elements of the computer in the same block, one of ordinary skill in the art will understand that the processor, computer, or memory may actually include storage that may or may not be Multiple processors, computers, or memories within the same physical enclosure. For example, the memory may be a hard drive or other storage medium located within an enclosure other than a computer. Thus, reference to a processor or computer will be understood to include reference to a collection of processors or computers or memories that may or may not operate in parallel. Rather than using a single processor to perform the steps described herein, some components such as the steering and deceleration components may each have their own processor that only performs computations related to component-specific functions .
在此处所描述的各个方面中,处理器可以位于远离该车辆并且与该车辆进行无线通信。在其它方面中,此处所描述的过程中的一些在布置于车辆内的处理器上执行而其它则由远程处理器执行,包括采取执行单一操纵的必要步骤。In various aspects described herein, a processor may be located remotely from the vehicle and in wireless communication with the vehicle. In other aspects, some of the processes described herein are performed on a processor disposed within the vehicle while others are performed by a remote processor, including taking steps necessary to perform a single maneuver.
在一些实施例中,存储器214可包含指令215(例如,程序逻辑),指令215可被处理器213执行来执行智能车辆003的各种功能,包括以上描述的那些功能。存储器214也可包含额外的指令,包括向行进系统202、传感系统204、控制系统206和外围设备208中的一个或多个发送数据、从其接收数据、与其交互和/或对其进行控制的指令。In some embodiments, memory 214 may include instructions 215 (eg, program logic) executable by processor 213 to perform various functions of intelligent vehicle 003, including those described above. Memory 214 may also contain additional instructions, including sending data to, receiving data from, interacting with and/or controlling one or more of travel system 202 , sensing system 204 , control system 206 and peripherals 208 instruction.
除了指令215以外,存储器214还可存储数据,例如道路地图、路线信息,车辆的位置、方向、速度以及其它这样的车辆数据,以及其他信息。这种信息可在智能车辆003在自主、半自主和/或手动模式中操作期间被智能车辆003和计算机系统212使用。In addition to instructions 215, memory 214 may store data such as road maps, route information, vehicle location, direction, speed, and other such vehicle data, among other information. Such information may be used by intelligent vehicle 003 and computer system 212 during operation of intelligent vehicle 003 in autonomous, semi-autonomous, and/or manual modes.
用户接口216,用于向智能车辆003的用户提供信息或从其接收信息。可选地,用户接口216可包括在外围设备208的集合内的一个或多个输入/输出设备,例如无线通信系统246、车载电脑248、麦克风250和扬声器252。User interface 216 for providing information to or receiving information from a user of intelligent vehicle 003 . Optionally, user interface 216 may include one or more input/output devices within the set of peripheral devices 208 , such as wireless communication system 246 , onboard computer 248 , microphone 250 and speaker 252 .
计算机系统212可基于从各种子系统(例如,无线通信系统246、行进系统202、传感系统204和控制系统206)以及从用户接口216接收的输入来控制智能车辆003的功能。例如,计算机系统212可利用来自无线通信系统246的输入以便规划出在自动驾驶中需要通过的路口处的车道线,通过该车道线可以避免碰到路口处的障碍物。在一些实施例中,计算机系统212可操作来对智能车辆003及其子系统的许多方面提供控制。Computer system 212 may control functions of intelligent vehicle 003 based on input received from various subsystems (eg, wireless communication system 246 , travel system 202 , sensing system 204 , and control system 206 ) and from user interface 216 . For example, the computer system 212 may utilize input from the wireless communication system 246 to plan lane lines at intersections that need to be passed in autonomous driving by which obstacles at the intersection can be avoided. In some embodiments, computer system 212 is operable to provide control over many aspects of intelligent vehicle 003 and its subsystems.
可选的,计算机系统212还可以从其它计算机系统接收信息,或者将信息转移到其它计算机系统。例如,计算机系统212可以将从智能车辆003的传感系统204收集的传感器数据 转移到远程的另一个计算机系统,并交由另一个计算机系统对此数据进行处理,比如由另一个计算机系统对传感系统204中各个传感器采集的数据进行数据融合,然后再将融合后得到的数据或者分析结果返回至计算机系统212。可选的,来自计算机系统212的数据可以经由网络被传送到云侧的计算机系统用于进一步的处理。网络以及中间节点可以包括各种配置和协议,包括因特网、万维网、内联网、虚拟专用网络、广域网、局域网、使用一个或多个公司的专有通信协议的专用网络、以太网、WiFi和HTTP、以及前述的各种组合。这种通信可以由能够传送数据到其它计算机和从其它计算机传送数据的任何设备,诸如调制解调器和无线接口。Optionally, computer system 212 may also receive information from, or transfer information to, other computer systems. For example, the computer system 212 may transfer sensor data collected from the sensor system 204 of the smart vehicle 003 to another computer system remotely, and have the data processed by the other computer system, such as by another computer system. The data collected by each sensor in the sensor system 204 is fused, and then the data or analysis result obtained after fusion is returned to the computer system 212 . Optionally, data from computer system 212 may be transmitted via a network to a cloud-side computer system for further processing. Networks and intermediate nodes may include various configurations and protocols, including the Internet, the World Wide Web, Intranets, Virtual Private Networks, Wide Area Networks, Local Area Networks, private networks using one or more of the company's proprietary communication protocols, Ethernet, WiFi and HTTP, and various combinations of the foregoing. Such communications may be by any device capable of transferring data to and from other computers, such as modems and wireless interfaces.
如上所述,在一些可能的实施例中,与该智能车辆003中的计算机系统212进行交互的远程计算机系统可以包括具有多个计算机的服务器,例如负载均衡服务器群,为了从计算机系统212接收、处理并传送数据的目的,其与网络的不同节点交换信息。该服务器可以有处理器、存储器、指令和数据等等。例如,在本申请的一些实施例中,该服务器的数据可以包括提供天气相关的信息。例如,服务器可以接收、监视、存储、更新、以及传送与天气相关的各种信息。该信息可以包括例如以报告形式、雷达信息形式、预报形式等的降水、云、和/或温度信息。该服务器的数据还可以包括高精度地图数据、前方路段的交通信息(例如实时的交通拥挤状况和交通事故发生情况等等),服务器可以将该高精度地图数据和交通信息等发送给计算机系统212,从而可以辅助智能车辆003更好地进行自动驾驶,保证驾驶安全。As mentioned above, in some possible embodiments, the remote computer system that interacts with the computer system 212 in the intelligent vehicle 003 may include a server with multiple computers, such as a load balancing server farm, in order to receive, from the computer system 212 , The purpose of processing and transmitting data, which exchanges information with different nodes of the network. The server may have processors, memory, instructions and data, and the like. For example, in some embodiments of the present application, the data of the server may include providing weather-related information. For example, the server may receive, monitor, store, update, and transmit various information related to the weather. This information may include, for example, precipitation, cloud, and/or temperature information in the form of reports, radar information, forecasts, and the like. The data of the server can also include high-precision map data, traffic information of the road ahead (such as real-time traffic congestion and traffic accidents, etc.), and the server can send the high-precision map data and traffic information to the computer system 212 , so that it can assist the intelligent vehicle 003 to better perform automatic driving and ensure driving safety.
可选地,上述这些组件中的一个或多个可与智能车辆003分开安装或关联。例如,存储器214可以部分或完全地与智能车辆003分开存在。上述组件可以按有线和/或无线方式来通信地耦合在一起。Optionally, one or more of these components described above may be installed or associated with the intelligent vehicle 003 separately. For example, memory 214 may exist partially or completely separate from intelligent vehicle 003 . The above-described components may be communicatively coupled together in a wired and/or wireless manner.
可选地,上述组件只是一个示例,实际应用中,上述各个模块中的组件有可能根据实际需要增添或者删除,图2C不应理解为对本申请实施例的限制。Optionally, the above component is just an example. In practical applications, components in each of the above modules may be added or deleted according to actual needs, and FIG. 2C should not be construed as a limitation on the embodiments of the present application.
在道路行进的自动驾驶汽车,如上面的智能车辆003,可以识别其周围环境内的物体以确定对当前速度的调整。所述物体可以是其它车辆、交通控制设备、或者其它类型的物体。在一些示例中,可以独立地考虑每个识别的物体,并且基于物体的各自的特性,诸如它的当前速度、加速度、与车辆的间距等,可以用来确定自动驾驶汽车所要调整的速度。A self-driving car traveling on a road, such as Smart Vehicle 003 above, can recognize objects within its surroundings to determine adjustments to its current speed. The objects may be other vehicles, traffic control equipment, or other types of objects. In some examples, each identified object may be considered independently, and based on the object's respective characteristics, such as its current speed, acceleration, distance from the vehicle, etc., may be used to determine the speed at which the autonomous vehicle is to adjust.
可选地,自动驾驶汽车智能车辆003或者与自动驾驶智能车辆003相关联的计算设备(如图2C的计算机系统212、计算机视觉系统240、存储器214)可以基于所识别的物体的特性和周围环境的状态(例如,交通、雨、道路上的冰、等等)来预测所述识别的物体的行为。可选地,每一个所识别的物体都依赖于彼此的行为,因此还可以将所识别的所有物体全部一起考虑来预测单个识别的物体的行为。智能车辆003能够基于预测的所述识别的物体的行为来调整它的速度。换句话说,自动驾驶汽车能够基于所预测的物体的行为来确定车辆将需要调整到(例如,加速、减速、或者停止)什么稳定状态。在这个过程中,也可以考虑其它因素来确定智能车辆003的速度,诸如,智能车辆003在行驶的道路中的横向位置、道路的曲率、静态和动态物体的接近度等等。Optionally, the autonomous vehicle intelligent vehicle 003 or a computing device associated with the autonomous vehicle 003 (eg, computer system 212, computer vision system 240, memory 214 of FIG. 2C ) may be based on the characteristics of the identified objects and the surrounding environment. state (eg, traffic, rain, ice on the road, etc.) to predict the behavior of the identified object. Optionally, each identified object is dependent on the behavior of the other, so it is also possible to predict the behavior of a single identified object by considering all identified objects together. The intelligent vehicle 003 is able to adjust its speed based on the predicted behavior of the identified object. In other words, the self-driving car can determine what steady state the vehicle will need to adjust to (eg, accelerate, decelerate, or stop) based on the predicted behavior of the object. In this process, other factors may also be considered to determine the speed of the intelligent vehicle 003, such as the lateral position of the intelligent vehicle 003 in the road on which it is traveling, the curvature of the road, the proximity of static and dynamic objects, and the like.
除了提供调整自动驾驶汽车的速度的指令之外,计算设备还可以提供修改智能车辆003的转向角的指令,以使得自动驾驶汽车遵循给定的轨迹和/或维持与自动驾驶汽车附近的物体(例如,道路上的相邻车道中的轿车)的安全横向和纵向距离。In addition to providing instructions to adjust the speed of the self-driving car, the computing device may also provide instructions to modify the steering angle of the intelligent vehicle 003 so that the self-driving car follows a given trajectory and/or maintains contact with objects in the vicinity of the self-driving car ( For example, safe lateral and longitudinal distances for cars in adjacent lanes on the road.
上述智能车辆003可以为轿车、卡车、摩托车、公共汽车、船、飞机、直升飞机、割草机、娱乐车、游乐场车辆、施工设备、电车、高尔夫球车、火车、和手推车等,本申请实施例不做特别的限定。The above-mentioned intelligent vehicles 003 can be cars, trucks, motorcycles, buses, boats, airplanes, helicopters, lawn mowers, recreational vehicles, playground vehicles, construction equipment, trams, golf carts, trains, and trolleys, etc., The embodiments of the present application are not particularly limited.
可以理解的是,图2C中的智能车辆003功能图只是本申请实施例中的一种示例性的实施方式,本申请实施例中的智能车辆003包括但不仅限于以上结构。It can be understood that the function diagram of the smart vehicle 003 in FIG. 2C is only an exemplary implementation in the embodiments of the present application, and the smart vehicle 003 in the embodiments of the present application includes but is not limited to the above structures.
请参见图3A,图3A是本申请实施例提供的一种绘制车道线的方法流程示意图,该方法可以应用于上述图2A或者图2B所述的系统架构中,以及具体可应用于上述图2A的绘制装置002中。下面结合图3A为例进行说明,该方法包括但不限于如下步骤:Please refer to FIG. 3A . FIG. 3A is a schematic flowchart of a method for drawing lane lines provided by an embodiment of the present application. The method can be applied to the system architecture described in FIG. 2A or FIG. 2B , and can be specifically applied to the above-mentioned FIG. 2A in the drawing device 002. 3A as an example to illustrate, the method includes but is not limited to the following steps:
步骤S301:获取第一路口的信息。Step S301: Obtain the information of the first intersection.
具体地,第一路口为需要规划车道线的路口,当图2A所示的采集装置001为采集车辆时,采集装置001收集到的路口的信息为高精度地图中需要标注车道线的路口的信息(其中,包括第一路口的信息),然后由采集装置001将路口的信息向绘制装置002发送,从而绘制装置002可以获取到第一路口的信息。当图2A所示的采集装置001为路侧单元时,绘制装置002可以是智能车辆003。请参见图2B,采集装置001收集到的路口的信息为自动驾驶中待规划车道线的路口的信息(其中,包括第一路口的信息),然后由采集装置001将上述路口的信息向智能车辆003发送,从而智能车辆003可以获取到第一路口的信息。Specifically, the first intersection is the intersection where lane lines need to be planned. When the collection device 001 shown in FIG. 2A is collecting vehicles, the information of the intersection collected by the collection device 001 is the information of the intersection that needs to be marked with lane lines in the high-precision map. (Including the information of the first intersection), and then the collection device 001 sends the information of the intersection to the drawing device 002, so that the drawing device 002 can obtain the information of the first intersection. When the collecting device 001 shown in FIG. 2A is a roadside unit, the drawing device 002 may be an intelligent vehicle 003 . Please refer to FIG. 2B , the information of the intersection collected by the collection device 001 is the information of the intersection of the lane line to be planned in the automatic driving (including the information of the first intersection), and then the collection device 001 sends the information of the above intersection to the intelligent vehicle 003, so that the intelligent vehicle 003 can obtain the information of the first intersection.
第一路口的信息包括第一参考点的信息、第二参考点的信息和第一路口的障碍物的信息。其中,第一参考点为第一车道线上的点,第二参考点为第二车道线上的点,与第一路口相连的车道线为第一车道线和第二车道线,第二车道线通过第一路口的车道线连接第一车道线,而障碍物是第一路口附近妨碍行驶的物体。请参见图3B,图3B是本申请实施例提供的一种路口信息的示意图。图3B是以十字路口为例进行说明的,其中:The information of the first intersection includes information of the first reference point, information of the second reference point, and information of obstacles at the first intersection. The first reference point is a point on the first lane line, the second reference point is a point on the second lane line, the lane lines connected to the first intersection are the first lane line and the second lane line, and the second lane line The line connects the first lane line through the lane line of the first intersection, and the obstacle is the object that hinders the driving near the first intersection. Referring to FIG. 3B , FIG. 3B is a schematic diagram of intersection information provided by an embodiment of the present application. FIG. 3B illustrates an intersection as an example, in which:
路口表示为道路汇合的区域,可选的,从图3B可以看出,路口300可以是第一车道301上的停止线、第二车道302上的停止线、第三车道303上的停止线和第四车道304上的停止线围成的矩形区域或者矩形周围的区域。其中,第一车道301、第二车道302、第三车道303和第四车道304为双向车道,由两个相反方向的行车道构成。可以理解的是,路口不仅包括四条道路交叉的如图3B所示的路口300(例如,十字路口,X型路口),还包括但不限于两条道路交叉的路口,三条道路交叉的路口(例如,丁字路口,Y字路口)。需要说明的是,在环形交叉的地段(例如,环岛)中,可以定义每组相邻的两条道路与环线形成一个路口。其中,路口300是需要规划车道线的路口,车道线用于指示路口区域内的行驶路线,是连接第一车道线和第二车道线的虚拟曲线。一般来说,路口的车道线的一端连接驶出车道的车道终止点,另一端连接驶入车道的车道起始点。The intersection is represented as the area where the roads meet. Optionally, it can be seen from FIG. 3B that the intersection 300 can be the stop line on the first lane 301, the stop line on the second lane 302, the stop line on the third lane 303 and The rectangular area enclosed by the stop line on the fourth lane 304 or the area around the rectangle. The first lane 301 , the second lane 302 , the third lane 303 and the fourth lane 304 are two-way lanes, which are formed by two traffic lanes in opposite directions. It can be understood that the intersection not only includes the intersection 300 shown in FIG. 3B where four roads intersect (eg, an intersection, an X-shaped intersection), but also includes, but is not limited to, an intersection where two roads intersect, and an intersection where three roads intersect (eg, an intersection, an X-shaped intersection). , T-junction, Y-junction). It should be noted that, in a roundabout section (for example, a roundabout), each group of two adjacent roads may be defined to form an intersection with the roundabout. Wherein, the intersection 300 is an intersection where a lane line needs to be planned, the lane line is used to indicate the driving route in the intersection area, and is a virtual curve connecting the first lane line and the second lane line. Generally speaking, one end of the lane line at the intersection is connected to the end point of the exit lane, and the other end is connected to the start point of the lane entering the lane.
第一车道线可以表示路口外的驶入车道线。可以理解的是,在绘制装置002获取到的路口信息中包含车道对应的行车方向以及车道线。这里提及的行车方向是指该车道上的车辆可以在该车道上行驶的方向,从另一角度来说,该行车方向其实表明了车辆可以在该车道上如何行驶,例如直行、右转、左转。从图3B可以看出,第一车道301、第二车道302、第三车道303和第四车道304分别对应的行车方向可以包括以下一种或多种:直行、左转或右转。因此,第一车道线301A可以是第一车道301上右转车道的车道线,或者第一车道线301A可以是第二车道302上直行车道的车道线,或者第一车道线301A可以是第三车道303上右转车道的车道线,或者第一车道线301A可以是第四车道304上直行车道的车道线。The first lane line may represent the incoming lane line outside the intersection. It can be understood that the intersection information obtained by the drawing device 002 includes the driving direction and lane line corresponding to the lane. The driving direction mentioned here refers to the direction in which the vehicle in the lane can drive in the lane. From another perspective, the driving direction actually indicates how the vehicle can drive in the lane, such as straight, Turn left. As can be seen from FIG. 3B , the driving directions corresponding to the first lane 301 , the second lane 302 , the third lane 303 and the fourth lane 304 respectively may include one or more of the following: going straight, turning left or turning right. Thus, the first lane marking 301A may be the lane marking of a right-turn lane on the first lane 301, or the first lane marking 301A may be the lane marking of a straight-going lane on the second lane 302, or the first lane marking 301A may be the third lane marking The lane markings of the right-turn lane on lane 303 , or the first lane marking 301A may be the lane markings of the through lane on the fourth lane 304 .
第二车道线可以表示路口外的驶出车道线。可以理解的是,第二车道线是与第一车道线具有对应关系的车道线,也即通过路口300处规划的车道线与第一车道线所连接的车道线即为第二车道线。从图3B可以看出,若第一车道线301A为第一车道301上的右转车道的车道线,则第二车道线301B可以为第二车道上的车道线,也即第二车道线301B为通过路口300 的右转车道线连接第一车道线301A的车道线;若第一车道线301A为第一车道301上的直行车道的车道线,则第二车道301B可以为第三车道303上车道线,也即第二车道线301B为通过路口300的直行车道线连接第一车道线301A的车道线。The second lane line may represent the outgoing lane line outside the intersection. It can be understood that the second lane line is a lane line having a corresponding relationship with the first lane line, that is, the lane line connected to the first lane line through the planned lane line at the intersection 300 is the second lane line. As can be seen from FIG. 3B , if the first lane line 301A is the lane line of the right-turn lane on the first lane 301 , the second lane line 301B may be the lane line on the second lane, that is, the second lane line 301B In order to connect the lane line of the first lane line 301A through the right-turn lane line of the intersection 300; if the first lane line 301A is the lane line of the straight lane on the first lane 301, the second lane 301B can be the third lane 303. The lane line, that is, the second lane line 301B is a lane line connecting the first lane line 301A through the straight lane line of the intersection 300 .
第一参考点为第一车道线或者第一车道线的延长线处的点,具体可以是第一车道线靠近路口处的点。比如说,第一参考点可以是第一车道线与停止线的交汇处上的点,或者第一车道线靠近停止线处的点,或者第一车道线的延长线与路口的交汇处上的点。从图3B可以看出,第一参考点302A可以是第一车道301的第一车道线301A上的点,或者是第二车道302的第一车道线301A上的点,或者是第三车道303的第一车道线301A上的点,或者是第四车道304的第一车道线301A上的点。The first reference point is a point on the first lane line or an extension line of the first lane line, and may specifically be a point where the first lane line is close to the intersection. For example, the first reference point may be a point at the intersection of the first lane line and the stop line, or a point where the first lane line is close to the stop line, or the intersection of the extension of the first lane line and the intersection. point. As can be seen from FIG. 3B , the first reference point 302A may be a point on the first lane line 301A of the first lane 301 , or a point on the first lane line 301A of the second lane 302 , or a third lane 303 A point on the first lane line 301A of , or a point on the first lane line 301A of the fourth lane 304 .
第二参考点为第二车道线或者第二车道线的延长线处的点,具体可以是第二车道线靠近路口处的点。比如说,第二参考点可以是第二车道线与停止线的交汇处上的点,或者第二车道线靠近停止线处的点,或者第二车道线的延长线与路口的交汇处上的点。因为第二车道线是与第一车道线具有对应关系的车道线,所以第二参考点是与第一参考点具有对应关系的点。从图3B可以看出,若规划的车道线为右转车道线,则第一参考点302A为第一车道301的右转车道的车道线上的点,第二参考点302B可以是第二车道302的第二车道线301B上的点,也即路口处规划的右转车道线的一端连接第一车道301的第一车道线301A的端点为第一参考点302A,另一端连接第二车道的第二车道线301B的端点为第二参考点302B;若规划的车道线为直行车道线,则第一参考点302A为第一车道301的直行车道的车道线上的点,第二参考点302B可以是第三车道303的车道线上的点,也即路口处规划的直行车道线的一端连接第一车道301的第一车道线301A的端点为第一参考点302A,另一端连接第三车道303的第二车道线301B的端点为第二参考点302B;若规划的车道线为左转车道线,则第一参考点302A为第一车道301的左转车道的车道线上的点,则第二参考点302B可以是第四车道304的第二车道线301B上的点。The second reference point is a point at the second lane line or an extension line of the second lane line, and may specifically be a point where the second lane line is close to the intersection. For example, the second reference point may be a point at the intersection of the second lane line and the stop line, or a point where the second lane line is close to the stop line, or the intersection of the extension of the second lane line and the intersection. point. Since the second lane line is a lane line having a corresponding relationship with the first lane line, the second reference point is a point having a corresponding relationship with the first reference point. As can be seen from FIG. 3B , if the planned lane line is a right-turn lane line, the first reference point 302A is a point on the lane line of the right-turn lane of the first lane 301 , and the second reference point 302B may be the second lane The point on the second lane line 301B of 302, that is, one end of the planned right-turn lane line at the intersection is connected to the end point of the first lane line 301A of the first lane 301 is the first reference point 302A, and the other end is connected to the second lane. The end point of the second lane line 301B is the second reference point 302B; if the planned lane line is a straight lane line, the first reference point 302A is a point on the lane line of the straight lane of the first lane 301, and the second reference point 302B It can be a point on the lane line of the third lane 303, that is, one end of the planned straight lane line at the intersection is connected to the end point of the first lane line 301A of the first lane 301 as the first reference point 302A, and the other end is connected to the third lane. The end point of the second lane line 301B of 303 is the second reference point 302B; if the planned lane line is a left-turn lane line, then the first reference point 302A is a point on the lane line of the left-turn lane of the first lane 301, then The second reference point 302B may be a point on the second lane line 301B of the fourth lane 304 .
障碍物可以是路口区域处可能妨碍行驶的物体,比如树木、路牙、放置地上的交通指示牌等等。从图3B可以看出,障碍物305为路口处靠近路牙的树木。采集装置001采集的障碍物的信息可以是障碍物的矢量数据,也即包括可以形容障碍物的一个或多个坐标点,通过上述一个或多个坐标点可以推测出障碍的形状以及位置。Obstacles can be objects in the intersection area that may hinder travel, such as trees, curbs, traffic signs placed on the ground, and so on. It can be seen from FIG. 3B that the obstacle 305 is a tree near the curb at the intersection. The obstacle information collected by the collecting device 001 may be the vector data of the obstacle, that is, it includes one or more coordinate points that can describe the obstacle, and the shape and position of the obstacle can be inferred from the one or more coordinate points.
步骤S302:确定目标投影点。Step S302: Determine the target projection point.
具体地,目标投影点为障碍物到第一深度和/或第二深度上的投影点,其中,第一深度为第一参考点向路口处延伸的深度,第二深度为第二参考点向路口处延伸的深度。Specifically, the target projection point is the projection point of the obstacle to the first depth and/or the second depth, wherein the first depth is the depth of the first reference point extending to the intersection, and the second depth is the second reference point extending to the intersection. The depth of the extension at the intersection.
在一种可能的实现方式中,在确定目标投影点之前,绘制装置002可以确定一个规划区域,将规划区域内的物体标记为障碍物。可以理解的是,获取到的障碍物的信息为可以表示障碍物的形状大小和具体位置的矢量数据,而影响绘制右转车道线的障碍物可能是障碍物的某一部分,比如说靠近路口的这一部分,因此将位于规划区域范围内(包括右转区域侧边界处)的物体视为障碍物,可以提高规划的车道线不会压到障碍物的准确率。可选地,绘制装置002可以根据第一参考点、第二参考点和交点确定规划区域,将规划区域内的物体标记为障碍物。其中,交点为第一深度和第二深度交汇的点。在本申请实施例中,因为第一参考点、第二参考点和交点为规划车道线所需要用到的点,所以通过第一参考点、第二参考点和交点确定的规划区域,可以快速且准确地确定妨碍规划车道线的物体。In a possible implementation manner, before determining the target projection point, the drawing apparatus 002 may determine a planning area, and mark objects in the planning area as obstacles. It is understandable that the obtained obstacle information is vector data that can represent the shape, size and specific location of the obstacle, and the obstacle that affects the drawing of the right-turn lane line may be a certain part of the obstacle, such as the one near the intersection. In this part, objects located within the planning area (including the side boundary of the right-turn area) are regarded as obstacles, which can improve the accuracy that the planned lane lines will not overwhelm obstacles. Optionally, the drawing apparatus 002 may determine the planning area according to the first reference point, the second reference point and the intersection point, and mark objects in the planning area as obstacles. Wherein, the intersection point is the point where the first depth and the second depth meet. In this embodiment of the present application, since the first reference point, the second reference point and the intersection point are points required for planning lane lines, the planning area determined by the first reference point, the second reference point and the intersection point can quickly And accurately identify objects that obstruct the planned lane lines.
在一种可能的实现方式中,绘制装置002将障碍物的N个位置点向第一深度投影,可以得到N个第一投影点,从N个第一投影点中选择到第一参考点的距离最大,并且,到障碍物 上的对应点的距离小于或等于第一阈值的第一投影点属于目标投影点;将障碍物的N个位置点向第二深度投影,可以得到N个第二投影点,从N个第N投影点中选择到第一参考点的具体最大,并且到障碍物上的对应点的距离小于或等于第二阈值的第二投影点属于目标投影点。可以理解的是,目标投影点包括以下一种或多种情况:目标投影点为第一投影点、目标投影点为第二投影点、目标投影点包括第一投影点和第二投影点。在本申请实施例中,通过给定的预设条件,从N个第一投影点和/或N个第二投影点中选择满足预设要求的目标投影点,因为预设条件中第一阈值和第二阈值的存在,可以提高通过确定的目标投影所绘制车道线不会压到障碍物的准确率,也保障了车辆通过规划的车道线可以顺利驶出路口。In a possible implementation manner, the drawing device 002 projects the N position points of the obstacle to the first depth to obtain N first projection points, and selects the first reference point from the N first projection points. The distance is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point; by projecting the N position points of the obstacle to the second depth, N second projection points can be obtained. For the projection point, the specific largest one to the first reference point is selected from the N Nth projection points, and the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point. It can be understood that the target projection point includes one or more of the following situations: the target projection point is the first projection point, the target projection point is the second projection point, and the target projection point includes the first projection point and the second projection point. In this embodiment of the present application, a target projection point that satisfies the preset requirements is selected from the N first projection points and/or the N second projection points according to a given preset condition, because the first threshold value in the preset condition is And the existence of the second threshold can improve the accuracy that the lane line drawn by the determined target projection will not overwhelm the obstacle, and also ensure that the vehicle can smoothly drive out of the intersection through the planned lane line.
而第一阈值和第二阈值为根据路口的障碍物与车道线之间的距离,通过机器学习训练得到的可以满足需求的经验数值。也即,通过采集到的大量路口的数据,分析路口处的障碍物与车道线之间的距离关系,或者分析在路口处车辆转弯所需要的距离,训练得到的数值。通过第一阈值和/或第二阈值所确定的目标投影点可以满足规划的车道线不会压着障碍物,并且还可以保证车辆通过规划的车道线进行右转或者左转。其中,第一阈值和第二阈值可以相等,也可以不相等。The first threshold and the second threshold are empirical values that can meet the needs obtained through machine learning training according to the distance between the obstacles at the intersection and the lane line. That is, through the collected data of a large number of intersections, the distance relationship between the obstacles at the intersection and the lane line is analyzed, or the distance required for the vehicle to turn at the intersection is analyzed, and the value obtained by training. The target projection point determined by the first threshold and/or the second threshold can satisfy that the planned lane line will not press against obstacles, and can also ensure that the vehicle turns right or left through the planned lane line. Wherein, the first threshold and the second threshold may be equal or unequal.
举例来说,请参见图3C,图3C是本申请实施例提供的一种确定目标投影点的示意图。其中,图3C是以绘制右转车道线为例进行说明的。从图3C可以看出,第一参考点302A为第一车道301的第一车道线301A上的点,第二参考点302B为第二车道302的第二车道线301B上的点。第一深度303A为第一参考点302A向路口300处延伸的深度,也即第一车道线301A沿着路口300的延长线;第二深度303B为第二参考点302B向路口300处延伸的深度,也即第二车道线301B沿着路口300的延长线。第一深度303A和第二深度303B交汇的点为交点300B,交点300B是绘制车道线时所需要的一个控制点。For example, please refer to FIG. 3C , which is a schematic diagram of determining a target projection point according to an embodiment of the present application. 3C is described by taking the drawing of a right-turn lane line as an example. As can be seen from FIG. 3C , the first reference point 302A is a point on the first lane line 301A of the first lane 301 , and the second reference point 302B is a point on the second lane line 301B of the second lane 302 . The first depth 303A is the depth that the first reference point 302A extends to the intersection 300 , that is, the extension of the first lane line 301A along the intersection 300 ; the second depth 303B is the depth that the second reference point 302B extends to the intersection 300 , that is, the second lane line 301B is along the extension line of the intersection 300 . The intersection point of the first depth 303A and the second depth 303B is the intersection point 300B, and the intersection point 300B is a control point required when drawing a lane line.
根据第一参考点302A、第二参考点302B和交点300B可以确定规划区域,障碍物305与规划区域的重叠的部分可以认为是会影响绘制车道线的障碍物,通过获取到重叠部分的障碍物的信息来确定目标投影点。从图3C可以看出,点30A表示在右转区域内的障碍物305上的任意一点,也即点30A包括障碍物的N个位置点,N大于等于1。以点30A为起点向第一深度303A作垂线得到点30B,过点30A向第二深度303B作垂线得到点30C。可以理解的是,因为点30A包括N个位置点,所以,点30B包括N个投影点,点30C也包括N个投影点。然后从点30B中选择距离第一参考点302A的距离最远,并且,点30B到障碍物上对应点的距离小于或者等于第一阈值的投影点;从点30C中选择距离第一参考点302B的距离最远,并且,点30C到障碍物上对应点的距离小于或者等于第二阈值的投影点。需要说明的是,点30B到障碍物上所对应的点与点30C到障碍物上所对应的点可以是同一个点,也可以是不同的点。The planning area can be determined according to the first reference point 302A, the second reference point 302B and the intersection point 300B. The overlapping part of the obstacle 305 and the planning area can be considered as an obstacle that will affect the drawing of the lane line. By obtaining the obstacle in the overlapping part information to determine the target projection point. It can be seen from FIG. 3C that the point 30A represents any point on the obstacle 305 in the right turn area, that is, the point 30A includes N position points of the obstacle, and N is greater than or equal to 1. From point 30A as a starting point, draw a vertical line to the first depth 303A to obtain point 30B, and draw a vertical line through point 30A to the second depth 303B to obtain point 30C. It can be understood that since the point 30A includes N position points, the point 30B includes N projection points, and the point 30C also includes N projection points. Then select the projection point with the farthest distance from the first reference point 302A from the point 30B, and the distance from the point 30B to the corresponding point on the obstacle is less than or equal to the first threshold; select the point 30C from the first reference point 302B The distance is the farthest, and the distance from the point 30C to the corresponding point on the obstacle is less than or equal to the projected point of the second threshold. It should be noted that the point corresponding to the point 30B to the obstacle and the point corresponding to the point 30C to the obstacle may be the same point or different points.
需要说明的是,若车道线为直行车道线或者左转车道线,可以按照上述右转车道线的方法来确定规划区域,此处不再赘述。It should be noted that, if the lane line is a straight lane line or a left-turn lane line, the planning area may be determined according to the method of the above-mentioned right-turn lane line, which will not be repeated here.
步骤S303:根据第一参考点、第二参考点和目标投影点确定车道线。Step S303: Determine the lane line according to the first reference point, the second reference point and the target projection point.
具体地,因为满足预设条件的第一投影点和/或第二投影点才是目标投影点,所以目标投影点包括以下一种或多种情况:情况一,目标投影点包括第一投影点;情况二,目标投影点包括第二投影点;情况三,目标投影点包括第一投影点和第二投影点。Specifically, because the first projection point and/or the second projection point satisfying the preset condition is the target projection point, the target projection point includes one or more of the following situations: Case 1, the target projection point includes the first projection point ; Case 2, the target projection point includes the second projection point; Case 3, the target projection point includes the first projection point and the second projection point.
当目标投影点为第一投影点时,绘制装置002可以根据第一参考点、第二参考点和第一投影点来确定车道线。车道线可以由第一线段和第一曲线构成,第一线段由第一参考点和第一投影点来确定,第一曲线由第一投影点、交点和第二参考点来确定。其中,交点为第一深 度和第二深度交汇的点。在本申请实施例中,车道线由第一线段和第一曲线组成,第一线段是在进入路口处避开障碍物且可以保证完成右转的最长距离,因此可以通过第一线段在完全避开障碍物的情况下,由第一曲线来驶出路口。When the target projection point is the first projection point, the drawing device 002 may determine the lane line according to the first reference point, the second reference point and the first projection point. The lane line may be composed of a first line segment and a first curve, the first line segment is determined by a first reference point and a first projection point, and the first curve is determined by the first projection point, the intersection point and the second reference point. The intersection point is the point where the first depth and the second depth meet. In this embodiment of the present application, the lane line is composed of a first line segment and a first curve. The first line segment is the longest distance that can avoid obstacles at the entrance and can guarantee a right turn, so the first line segment can pass through the first line. In the case of completely avoiding the obstacle, the segment will go out of the intersection by the first curve.
当目标投影点为第二投影点时,绘制装置002可以根据第一参考点、第二参考点和第二投影点来确定车道线。车道线可以由第二线段和第二曲线构成,第二线段由第二参考点和第二投影点来确定,第二曲线由第二投影点、交点和第一参考点来确定。其中,交点为第一深度和第二深度交汇的点。在本申请实施例中,车道线由第二线段和第二曲线组成,第二线段是在离开路口处避开障碍物且可以保证完成右转的最长距离,可以保证在右转时即将压到障碍物的时候通过第二线段来避免压到障碍物。When the target projection point is the second projection point, the drawing device 002 may determine the lane line according to the first reference point, the second reference point and the second projection point. The lane line may be composed of a second line segment and a second curve, the second line segment is determined by a second reference point and a second projection point, and the second curve is determined by the second projection point, the intersection point and the first reference point. Wherein, the intersection point is the point where the first depth and the second depth meet. In the embodiment of the present application, the lane line is composed of a second line segment and a second curve, and the second line segment is the longest distance that can avoid obstacles at the exit from the intersection and can guarantee the completion of a right turn. When reaching the obstacle, pass the second line segment to avoid pressing the obstacle.
当目标投影点包括第一投影点第二投影点时,绘制装置002可以根据第一参考点、第二参考点、第一投影点和第二投影点来确定车道线。车道线可以由第三线段、第四线段和第三曲线构成,第三线段由第一参考点和第一投影点来确定,第三曲线由第一投影点、交点和第二投影点来确定;第四线段由第二投影点和第二参考点来确定。其中,交点为第一深度和第二深度交汇的点。在本申请实施例中,车道线由第三线段、第三曲线和第四线段组成,第三线段是在进入路口处避开障碍物的最长距离,可以保证在完全避开障碍物的情况下进行右转,第四线段是在离开路口处避开障碍物且可以保证完成右转的最长距离,可以保证在右转时即将压到障碍物的时候通过第四线段来避免压到障碍物。When the target projection point includes the first projection point and the second projection point, the drawing device 002 may determine the lane line according to the first reference point, the second reference point, the first projection point and the second projection point. The lane line may be composed of a third line segment, a fourth line segment and a third curve, the third line segment is determined by the first reference point and the first projection point, and the third curve is determined by the first projection point, the intersection point and the second projection point ; The fourth line segment is determined by the second projection point and the second reference point. Wherein, the intersection point is the point where the first depth and the second depth meet. In the embodiment of the present application, the lane line is composed of a third line segment, a third curve and a fourth line segment, and the third line segment is the longest distance to avoid obstacles at the entrance to the intersection, which can ensure that the obstacles are completely avoided. Go down and turn right. The fourth line segment is the longest distance to avoid obstacles at the exit and can guarantee to complete a right turn. It can ensure that the fourth line segment is used to avoid hitting obstacles when turning right. thing.
当确定出第一参考点、第二参考点、交点和目标投影点之后,可以根据贝塞尔曲线或者样条曲线来规划车道线。需要说明的是,本申请实施例对规划车道线的工具不做任何限制。After the first reference point, the second reference point, the intersection point and the target projection point are determined, the lane line can be planned according to the Bezier curve or the spline curve. It should be noted that, the embodiments of the present application do not impose any limitations on tools for planning lane lines.
通过本申请实施例提供的方法,因为在规划路口处的车道线时,考虑到了路口处的障碍物,从而可以确定出目标投影点,然后再根据第一参考点、第二参考点和目标投影点可以确定车道线。因为目标投影点的存在,可以保证生成的车道线不会压到障碍物,不需要再进行人工调整,可以提高规划车道线的效率和准确率。With the method provided by the embodiment of the present application, the obstacles at the intersection are considered when planning the lane line at the intersection, so that the target projection point can be determined, and then the target projection point can be determined according to the first reference point, the second reference point and the target projection. Points define lane lines. Because of the existence of the target projection point, it can be ensured that the generated lane line will not be pressed against obstacles, and no manual adjustment is required, which can improve the efficiency and accuracy of planning lane lines.
请参见图4,图4是本申请实施例提供的另一种绘制车道线的场景示意图。图4是以绘制右转车道为例进行说明的,从图4可以看出,绘制装置002获取的第一路口004的信息包括第一参考点401A的信息、第二参考点401B的信息和障碍物400的信息。其中,由第一参考点401A、第二参考点401B和交点401C所确定的右转区域内的障碍物的信息包括点400A、点400B和点400C。交点401C为第一深度402A和第二深度402B交汇的点,第一深度402A为第一参考点401A向第一路口004处延伸的深度,第二深度402B为第二参考点401B向第一路口004处延伸的深度。Referring to FIG. 4 , FIG. 4 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application. FIG. 4 is an example of drawing a right-turn lane. It can be seen from FIG. 4 that the information of the first intersection 004 acquired by the drawing device 002 includes the information of the first reference point 401A, the information of the second reference point 401B and obstacles Object 400 information. Wherein, the information of the obstacles in the right turn area determined by the first reference point 401A, the second reference point 401B and the intersection point 401C includes the point 400A, the point 400B and the point 400C. The intersection point 401C is the point where the first depth 402A and the second depth 402B meet, the first depth 402A is the depth where the first reference point 401A extends to the first intersection 004, and the second depth 402B is the second reference point 401B to the first intersection Depth of extension at 004.
请参考图4的(1),绘制装置002过点400A向第一深度402A作垂线得到点400A在第一深度402A的投影点为点4001A;同理可以得到点400B在第一深度402A的投影点为点4001B,点400C在第一深度402A的投影点为4001C。绘制装置002分别过点400A、点400B和点400C向第二深度402B作垂线得到的投影点为点4002A。接下来,绘制装置002从点4001A、点4001B和点4001C中选择到第一参考点401A的距离最大,并且,到障碍物400上的对应点的距离小于等于第一阈值的点为目标投影点。因为,点400A和点4001A确定的距离,点400B和点4001B确定的距离,以及点400C和点4001C确定的距离都小于等于第一阈值,但是点4001C是距离第一参考点401A的距离最远的点,所以在第一深度上选择点4001C为目标投影点。而点4002A和点400A确定的距离,以及点4002A和点400B确定的 距离,以及点4002A和点400C确定的距离都大于第二阈值,所以,在第二深度上没有满足预设条件的目标投影点。Please refer to (1) of FIG. 4 , the drawing device 002 draws a vertical line from the point 400A to the first depth 402A to obtain the projection point of the point 400A at the first depth 402A as the point 4001A; similarly, the projection point of the point 400B at the first depth 402A can be obtained. The projected point is point 4001B, and the projected point of point 400C at the first depth 402A is 4001C. The projected point obtained by the drawing device 002 passing the point 400A, the point 400B and the point 400C to the second depth 402B by drawing a vertical line is the point 4002A. Next, the drawing device 002 selects the maximum distance from the point 4001A, the point 4001B and the point 4001C to the first reference point 401A, and the point whose distance to the corresponding point on the obstacle 400 is less than or equal to the first threshold is the target projection point . Because, the distance determined by point 400A and point 4001A, the distance determined by point 400B and point 4001B, and the distance determined by point 400C and point 4001C are all less than or equal to the first threshold, but point 4001C is the farthest distance from the first reference point 401A , so point 4001C is selected as the target projection point at the first depth. However, the distance determined by point 4002A and point 400A, the distance determined by point 4002A and point 400B, and the distance determined by point 4002A and point 400C are all greater than the second threshold, so there is no target projection that meets the preset conditions at the second depth. point.
请参考图4的(2),当确定好点4001C目标投影点之后,使用贝塞尔曲线或者样条曲线由第一参考点401A和点4001C确定的第一线段403,以及由点4001C、交点400C和第二参考点401B确定的第一曲线404组成了右转车道线。从图4的(2)可以看出,通过上述方法绘制的右转车道线不会压到障碍物400。Please refer to (2) of FIG. 4 , after determining the target projection point of point 4001C, use Bezier curve or spline curve to determine the first line segment 403 determined by the first reference point 401A and point 4001C, and the first line segment 403 determined by point 4001C, The first curve 404 defined by the intersection point 400C and the second reference point 401B constitutes a right-turn lane line. It can be seen from (2) of FIG. 4 that the right-turn lane line drawn by the above method will not press against the obstacle 400 .
可以理解的是,车辆所行驶的车道是由两条车道线所构成的,当得到其中一条车道线后,通过对应关系可以确定另一条车道线,在实际应用中可以快速确定完整的车道,提高效率。It can be understood that the lane in which the vehicle travels is composed of two lane lines. When one of the lane lines is obtained, the other lane line can be determined through the corresponding relationship. In practical applications, the complete lane can be quickly determined and improved. efficiency.
请参见图5,图5是本申请实施例提供的另一种绘制车道线的场景示意图。图5是以绘制右转车道为例进行说明的,从图5可以看出,绘制装置002获取的第一路口005的信息包括第一参考点501A的信息、第二参考点501B的信息和障碍物500的信息。其中,由第一参考点501A、第二参考点501B和交点501C所确定的右转区域内的障碍物的信息包括点500A、点500B和点500C。交点501C为第一深度502A和第二深度502B交汇的点,第一深度502A为第一参考点501A向第一路口005处延伸的深度,第二深度502B为第二参考点501B向第一路口005处延伸的深度。Referring to FIG. 5 , FIG. 5 is a schematic diagram of another scene for drawing lane lines according to an embodiment of the present application. FIG. 5 is an example of drawing a right-turn lane. It can be seen from FIG. 5 that the information of the first intersection 005 acquired by the drawing device 002 includes the information of the first reference point 501A, the information of the second reference point 501B and obstacles Item 500 information. The information of obstacles in the right turn area determined by the first reference point 501A, the second reference point 501B and the intersection point 501C includes points 500A, 500B and 500C. The intersection point 501C is the point where the first depth 502A and the second depth 502B meet, the first depth 502A is the depth where the first reference point 501A extends to the first intersection 005, and the second depth 502B is the second reference point 501B to the first intersection Depth of extension at 005.
请参考图5的(1),绘制装置002过点500A向第二深度502B作垂线得到点500A在第二深度502B的投影点为点5001A;同理可以得到点500B在第二深度502B的投影点为点5001B,点500C在第二深度502B的投影点为5001C。绘制装置002分别过点500A和点500B向第一深度502A作垂线得到投影点为点5002A,过点500C向第一深度502A作垂线得到的投影点为5002B。接下来,绘制装置002从点5001A、点5001B和点5001C中选择到第二参考点501B的距离最大,并且,到障碍物500上的对应点的距离小于等于第二阈值的点为目标投影点。绘制装置002从点5002A和点5002B中选择到第一参考点501A的距离最大,并且,到障碍物500上的对应点的距离小于等于第一阈值的点为目标投影点。因为,点500A和点5001A确定的距离,点500B和点5001B确定的距离,以及点500C和点5001C确定的距离都小于等于第一阈值,但是点5001C是距离第二参考点501B的距离最远的点,所以在第二深度502B上选择点5001C为目标投影点。而点5002A和点500A确定的距离,以及点5002A和点500B确定的距离,以及点5002B和点500C确定的距离都大于第一阈值,所以,在第一深度上没有满足预设条件的目标投影点。Please refer to (1) of FIG. 5 , the drawing device 002 draws a vertical line from the point 500A to the second depth 502B to obtain the projection point of the point 500A at the second depth 502B as the point 5001A; similarly, the projection point of the point 500B at the second depth 502B can be obtained. The projected point is point 5001B, and the projected point of point 500C at the second depth 502B is 5001C. The drawing device 002 draws a vertical line from the point 500A and the point 500B to the first depth 502A to obtain a projected point as point 5002A, and draws a vertical line from the point 500C to the first depth 502A to obtain a projected point as 5002B. Next, the drawing device 002 selects the maximum distance from the point 5001A, the point 5001B and the point 5001C to the second reference point 501B, and the point whose distance to the corresponding point on the obstacle 500 is less than or equal to the second threshold is the target projection point . The drawing device 002 selects the point with the largest distance from the point 5002A and the point 5002B to the first reference point 501A, and the point whose distance to the corresponding point on the obstacle 500 is less than or equal to the first threshold is the target projection point. Because, the distance determined by point 500A and point 5001A, the distance determined by point 500B and point 5001B, and the distance determined by point 500C and point 5001C are all less than or equal to the first threshold, but point 5001C is the farthest distance from the second reference point 501B , so point 5001C is selected as the target projection point on the second depth 502B. However, the distance determined by point 5002A and point 500A, the distance determined by point 5002A and point 500B, and the distance determined by point 5002B and point 500C are all greater than the first threshold, so there is no target projection that meets the preset conditions at the first depth. point.
请参考图5的(2),当确定好点5001C目标投影点之后,通过贝塞尔曲线或者样条曲线由第一参考点501A、交点501C和点5001C确定的第二曲线503,以及由点5001C和第二参考点501B确定的第二线段504组成了右转车道线。从图5的(2)可以看出,通过上述方法绘制的右转车道线不会压到障碍物500。Please refer to (2) of FIG. 5 , after the target projection point of point 5001C is determined, the second curve 503 determined by the first reference point 501A, the intersection point 501C and the point 5001C through a Bezier curve or a spline curve, and a second curve 503 determined by the point The second line segment 504 determined by 5001C and the second reference point 501B constitutes a right-turn lane line. It can be seen from (2) of FIG. 5 that the right-turn lane line drawn by the above method will not press against the obstacle 500 .
可以理解的是,车辆所行驶的车道是由两条车道线所构成的,当得到其中一条车道线后,通过对应关系可以确定另一条车道线,在实际应用中可以快速确定完整的车道,提高效率。It can be understood that the lane in which the vehicle travels is composed of two lane lines. When one of the lane lines is obtained, the other lane line can be determined through the corresponding relationship. In practical applications, the complete lane can be quickly determined and improved. efficiency.
请参见图6,图6是本申请实施例提供的另一种绘制车道线的场景示意图。图6是以绘制右转车道为例进行说明的,从图6可以看出,绘制装置002获取的第一路口006的信息包括第一参考点601A的信息、第二参考点601B的信息和障碍物600的信息。其中,由第一参考点601A、第二参考点601B和交点601C所确定的右转区域内的障碍物的信息包括点600A、点600B、点600C、点600D和点600E。交点601C为第一深度602A和第二深度602B交汇 的点,第一深度602A为第一参考点601A向第一路口006处延伸的深度,第二深度602B为第二参考点601B向第一路口006处延伸的深度。Referring to FIG. 6 , FIG. 6 is a schematic diagram of another scene for drawing lane lines provided by an embodiment of the present application. FIG. 6 illustrates by drawing a right-turn lane as an example. It can be seen from FIG. 6 that the information of the first intersection 006 acquired by the drawing device 002 includes the information of the first reference point 601A, the information of the second reference point 601B and obstacles Object 600 information. The information of obstacles in the right turn area determined by the first reference point 601A, the second reference point 601B and the intersection point 601C includes points 600A, 600B, 600C, 600D and 600E. The intersection point 601C is the point where the first depth 602A and the second depth 602B meet, the first depth 602A is the depth where the first reference point 601A extends to the first intersection 006, and the second depth 602B is the second reference point 601B to the first intersection Depth of extension at 006.
请参考图6的(1),绘制装置002过点600A向第一深度602A作垂线得到点600A在第一深度602A的投影点为点6001A;同理可以得到点600B在第一深度602A的投影点为点6001B,点600C在第一深度602A的投影点为6001C。再同理,可以得到点600A、点600B和点600C在第二深度602B上各自对应的投影点。同样的,绘制装置002分别过点600D和点600E向第二深度602B作垂线得到对应的投影点分别为点6001D和点6001E;同理可以得到点600D和点600E在第一深度602A的投影点。接下来,绘制装置002从点6001A、点6001B、点6001C以及其他到第一深度602A的投影点中选择到第一参考点601A的距离最大,并且,到障碍物600上的对应点的距离小于等于第一阈值的点为目标投影点。绘制装置002从点6001B、点6001E以及其他到第二深度602B的投影点中选择到第二参考点601B的距离最大,并且,到障碍物600上的对应点的距离小于等于第二阈值的点为目标投影点。从图6的(1)可以看出,点6001C和点6001D为可以满足预设条件的目标投影点。Please refer to (1) of FIG. 6 , the drawing device 002 draws a vertical line from the point 600A to the first depth 602A to obtain the projection point of the point 600A at the first depth 602A as the point 6001A; similarly, the projection point of the point 600B at the first depth 602A can be obtained. The projected point is point 6001B, and the projected point of point 600C at the first depth 602A is 6001C. In the same way, the corresponding projection points of the point 600A, the point 600B, and the point 600C on the second depth 602B can be obtained. Similarly, the drawing device 002 draws a vertical line to the second depth 602B through the points 600D and 600E, respectively, to obtain the corresponding projection points as the point 6001D and the point 6001E; similarly, the projections of the points 600D and 600E at the first depth 602A can be obtained. point. Next, the drawing device 002 selects the largest distance to the first reference point 601A from the points 6001A, 6001B, 6001C and other projection points to the first depth 602A, and the distance to the corresponding point on the obstacle 600 is less than The point equal to the first threshold is the target projection point. The drawing device 002 selects the point with the largest distance to the second reference point 601B from the point 6001B, the point 6001E and other projection points to the second depth 602B, and the distance to the corresponding point on the obstacle 600 is less than or equal to the second threshold value Projection point for the target. It can be seen from (1) of FIG. 6 that the point 6001C and the point 6001D are target projection points that can satisfy the preset conditions.
请参考图6的(2),当确定好点6001C和点6001D为目标投影点之后,通过贝塞尔曲线或者样条曲线由第一参考点601A、和点6001C确定的第三线段603,以由点6001C、交点601C和点6001D确定的第三曲线604,以及由点6001D和第二参考点601B确定的第四线段605组成了右转车道线。从图6的(2)可以看出,通过上述方法绘制的右转车道线不会压到障碍物600。Please refer to (2) of FIG. 6 , after the point 6001C and the point 6001D are determined as the target projection points, the third line segment 603 determined by the first reference point 601A and the point 6001C through the Bezier curve or the spline curve, to The third curve 604 determined by the point 6001C, the intersection point 601C and the point 6001D, and the fourth line segment 605 determined by the point 6001D and the second reference point 601B constitute a right-turn lane line. It can be seen from (2) of FIG. 6 that the right-turn lane line drawn by the above method will not press against the obstacle 600 .
可以理解的是,车辆所行驶的车道是由两条车道线所构成的,当得到其中一条车道线后,通过对应关系可以确定另一条车道线,在实际应用中可以快速确定完整的车道,提高效率。It can be understood that the lane in which the vehicle travels is composed of two lane lines. When one of the lane lines is obtained, the other lane line can be determined through the corresponding relationship. In practical applications, the complete lane can be quickly determined and improved. efficiency.
需要说明的是,可以按照图4、图5或者图6所示的实施例中规划右转车道线的方法推导规划出直行车道线或者左转车道线,此处不再赘述关于规划直行车道线或者左转车道线的实施例。It should be noted that the planning of the straight lane line or the left turn lane line can be derived and planned according to the method of planning the right turn lane line in the embodiment shown in FIG. 4 , FIG. 5 or FIG. Or an example of left-turn lane markings.
上述详细阐述了本申请实施例的方法,下面提供了本申请实施例的装置。The methods of the embodiments of the present application are described in detail above, and the apparatuses of the embodiments of the present application are provided below.
请参见图7,图7是本申请实施例提供的一种车道线规划装置的结构示意图,该车道线规划装置700可以为节点,也可以为节点中的一个器件,例如芯片或者集成电路等,车道线规划装置700可以包括获取单元701、确定单元702和规划单元703,其中,各个单元的详细描述如下。Please refer to FIG. 7. FIG. 7 is a schematic structural diagram of a lane planning apparatus provided by an embodiment of the present application. The lane planning apparatus 700 may be a node, or may be a device in a node, such as a chip or an integrated circuit, etc. The lane line planning apparatus 700 may include an acquisition unit 701, a determination unit 702 and a planning unit 703, wherein the detailed description of each unit is as follows.
获取单元701,用于获取第一路口的信息,第一路口的信息包括第一参考点的信息、第二参考点的信息和第一路口的障碍物的信息;其中,第一路口为需要规划车道线的路口,第一参考点为第一车道线上的点,第二参考点为第二车道线上的点,与第一路口相连的车道线为第一车道线和第二车道线,第二车道线通过第一路口的车道线连接第一车道线,障碍物为第一路口内妨碍规划车道线的物体;The obtaining unit 701 is configured to obtain the information of the first intersection, the information of the first intersection includes the information of the first reference point, the information of the second reference point and the information of the obstacles of the first intersection; wherein, the first intersection needs to be planned For the intersection of the lane line, the first reference point is the point on the first lane line, the second reference point is the point on the second lane line, and the lane lines connected to the first intersection are the first lane line and the second lane line, The second lane line is connected to the first lane line through the lane line of the first intersection, and the obstacle is the object in the first intersection that obstructs the planned lane line;
确定单元702,用于确定目标投影点,其中,目标投影点为障碍物到第一深度和/或第二深度上的投影点,第一深度为第一车道线向第一路口处延伸的深度,第二深度为第二车道线向第一路口处延伸的深度;A determination unit 702, configured to determine a target projection point, wherein the target projection point is the projection point of the obstacle to the first depth and/or the second depth, and the first depth is the depth extending from the first lane line to the first intersection , the second depth is the depth of the second lane line extending to the first intersection;
规划单元703,用于根据第一参考点、第二参考点和目标投影点确定车道线。The planning unit 703 is configured to determine the lane line according to the first reference point, the second reference point and the target projection point.
可以看出,因为在规划路口处的车道线时,考虑到了路口处的障碍物,从而可以确定出目标投影点,然后再根据第一参考点、第二参考点和目标投影点可以确定车道线。因为目标投影点的存在,可以保证生成的车道线不会压到障碍物,不需要再进行人工调整,可以提高 规划车道线的效率和准确率。It can be seen that, because the obstacles at the intersection are considered when planning the lane line at the intersection, the target projection point can be determined, and then the lane line can be determined according to the first reference point, the second reference point and the target projection point. . Because of the existence of the target projection point, it can ensure that the generated lane line will not be pressed against obstacles, and no manual adjustment is required, which can improve the efficiency and accuracy of planning lane lines.
在一种可能的实施方式中,确定单元702还用于:In a possible implementation manner, the determining unit 702 is further configured to:
确定规划区域,将规划区域内的物体标记为障碍物。Determine the planning area and mark objects in the planning area as obstacles.
在本申请实施例,可能只有物体靠近路口的部分会妨碍到绘制车道线,所以通过规划区域可以将可能妨碍规划车道线的物体标记障碍物。In the embodiment of the present application, only the part of the object close to the intersection may hinder the drawing of the lane line, so the object that may hinder the planning of the lane line may be marked as an obstacle through the planning area.
在一种可能的实施方式中,确定单元702具体用于:In a possible implementation manner, the determining unit 702 is specifically configured to:
根据第一参考点、第二参考点和交点确定规划区域,交点为第一深度与第二深度交汇的点。The planning area is determined according to the first reference point, the second reference point and the intersection point, where the intersection point is a point where the first depth and the second depth meet.
在本申请实施例中,因为第一参考点、第二参考点和交点为规划车道线所需要用到的点,所以通过第一参考点、第二参考点和交点确定的规划区域,可以更加准确的找到妨碍规划车道线的物体。In this embodiment of the present application, since the first reference point, the second reference point and the intersection point are points needed to plan lane lines, the planning area determined by the first reference point, the second reference point and the intersection point can be more Accurately find objects that obstruct the planned lane lines.
在一种可能的实施方式中,确定单元702具体用于:In a possible implementation manner, the determining unit 702 is specifically configured to:
将障碍物的N个位置点向第一深度投影,得到N个第一投影点,N大于等于1;Project the N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1;
将障碍物的N个位置点向第二深度投影,得到N个第二投影点;Project the N position points of the obstacle to the second depth to obtain N second projection points;
从N个第一投影点和N个第二投影点中选择目标投影点,其中,The target projection point is selected from the N first projection points and the N second projection points, where,
N个第一投影点中到第一参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第一阈值的第一投影点属于目标投影点;Among the N first projection points, the distance to the first reference point is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point;
N个第二投影点中到第二参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第二阈值的第二投影点属于目标投影点。Among the N second projection points, the distance to the second reference point is the largest, and the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
在本申请实施例中,通过给定的预设条件,从N个第一投影点和/或N个第二投影点中选择满足预设要求的目标投影点,因为预设条件中第一阈值和第二阈值的存在,可以提高通过确定的目标投影所绘制车道线不会压到障碍物的可能性,也保障了车辆通过规划的车道线可以顺利驶出路口。In this embodiment of the present application, a target projection point that satisfies the preset requirements is selected from the N first projection points and/or the N second projection points according to a given preset condition, because the first threshold value in the preset condition is And the existence of the second threshold can improve the possibility that the lane line drawn by the determined target projection will not overwhelm the obstacle, and also ensure that the vehicle can smoothly exit the intersection through the planned lane line.
在一种可能的实施方式中,目标投影点包括第一投影点,规划单元703具体用于:In a possible implementation manner, the target projection point includes the first projection point, and the planning unit 703 is specifically configured to:
根据第一参考点和第一投影点确定第一线段;determining the first line segment according to the first reference point and the first projection point;
根据第一投影点、第二参考点和交点确定第一曲线,交点为第一深度与第二深度交汇的点;Determine the first curve according to the first projection point, the second reference point and the intersection point, where the intersection point is a point where the first depth and the second depth meet;
由第一线段和第一曲线确定右转车道线。The right-turn lane line is determined by the first line segment and the first curve.
在本申请实施例中,车道线由第一线段和第一曲线组成,第一线段是在进入路口处避开障碍物且可以保证完成右转的最长距离,因此可以通过第一线段在完全避开障碍物的情况下,由第一曲线来驶出路口。In this embodiment of the present application, the lane line is composed of a first line segment and a first curve. The first line segment is the longest distance that can avoid obstacles at the entrance and can guarantee a right turn, so the first line segment can pass through the first line. In the case of completely avoiding the obstacle, the segment will go out of the intersection by the first curve.
在一种可能的实施方式中,目标投影点包括第二投影点,规划单元703具体用于:In a possible implementation manner, the target projection point includes the second projection point, and the planning unit 703 is specifically configured to:
根据第一参考点、第二投影点和交点确定第二曲线,交点为第一深度与第二深度交汇的点;Determine the second curve according to the first reference point, the second projection point and the intersection point, where the intersection point is the point where the first depth and the second depth meet;
根据第二投影点和第二参考点确定第二直线;determining a second straight line according to the second projection point and the second reference point;
由第二曲线和第二直线确定右转车道线。The right-turn lane line is determined by the second curve and the second straight line.
在本申请实施例中,车道线由第二线段和第二曲线组成,第二线段是在离开路口处避开障碍物且可以保证完成右转的最长距离,可以保证在右转时即将压到障碍物的时候通过第二线段来避免压到障碍物。In the embodiment of the present application, the lane line is composed of a second line segment and a second curve, and the second line segment is the longest distance that can avoid obstacles at the exit from the intersection and can guarantee the completion of a right turn. When reaching the obstacle, pass the second line segment to avoid pressing the obstacle.
在一种可能的实施方式中,目标投影点包括第一投影点和第二投影点,规划单元703具体用于:In a possible implementation manner, the target projection point includes a first projection point and a second projection point, and the planning unit 703 is specifically configured to:
根据第一参考点和第一投影点确定第三线段;determining a third line segment according to the first reference point and the first projection point;
根据第一投影点、第二投影点和交点确定第三曲线,交点为第一深度与第二深度交汇的点;Determine the third curve according to the first projection point, the second projection point and the intersection point, where the intersection point is the point where the first depth and the second depth meet;
根据第二投影点和第一参考点确定第四线段;determining a fourth line segment according to the second projection point and the first reference point;
由第三线段、第三曲线和第四线段确定右转车道线。The right-turn lane line is determined by the third line segment, the third curve, and the fourth line segment.
在本申请实施例中,车道线由第三线段、第三曲线和第四线段组成,第三线段是在进入路口处避开障碍物的最长距离,可以保证在完全避开障碍物的情况下进行右转,第四线段是在离开路口处避开障碍物且可以保证完成右转的最长距离,可以保证在右转时即将压到障碍物的时候通过第四线段来避免压到障碍物。In the embodiment of the present application, the lane line is composed of a third line segment, a third curve and a fourth line segment, and the third line segment is the longest distance to avoid obstacles at the entrance to the intersection, which can ensure that the obstacles are completely avoided. Go down and turn right. The fourth line segment is the longest distance to avoid obstacles at the exit and can guarantee to complete a right turn. It can ensure that the fourth line segment is used to avoid hitting obstacles when turning right. thing.
在一种可能的实施方式中,第一阈值和第二阈值均为根据样本数据训练得到的参考值,样本数据为行驶轨迹避开障碍物的历史行驶数据。In a possible implementation manner, the first threshold and the second threshold are both reference values obtained by training according to sample data, and the sample data is historical driving data of the driving trajectory to avoid obstacles.
需要说明的是,各个单元的实现还可以对应参照图3A所示的一个实施例的相应描述。It should be noted that, the implementation of each unit may also correspond to the corresponding description of an embodiment shown in FIG. 3A .
请参见图8,图8是本申请实施例提供的一种车道线规划设备的结构示意图,该车道线规划设备800可以为节点,也可以为节点中的一个器件,例如芯片或者集成电路等。该装置80可以包括至少一个存储器801和至少一个处理器802。可选的,还可以包含总线803。进一步可选的,还可以包括通信接口804,其中,存储器801、处理器802和通信接口804通过总线803相连。Referring to FIG. 8 , FIG. 8 is a schematic structural diagram of a lane planning device provided by an embodiment of the present application. The lane planning device 800 may be a node or a device in a node, such as a chip or an integrated circuit. The apparatus 80 may include at least one memory 801 and at least one processor 802 . Optionally, a bus 803 may also be included. Further optionally, a communication interface 804 may also be included, wherein the memory 801 , the processor 802 and the communication interface 804 are connected through a bus 803 .
其中,存储器801用于提供存储空间,存储空间中可以存储操作系统和计算机程序等数据。存储器801可以是随机存储记忆体(random access memory,RAM)、只读存储器(read-only memory,ROM)、可擦除可编程只读存储器(erasable programmable read only memory,EPROM)、或便携式只读存储器(compact disc read-only memory,CD-ROM)等等中的一种或者多种的组合。Among them, the memory 801 is used to provide a storage space, and data such as an operating system and a computer program can be stored in the storage space. The memory 801 may be random access memory (RAM), read-only memory (ROM), erasable programmable read only memory (EPROM), or portable read-only memory One or more combinations of memory (compact disc read-only memory, CD-ROM), etc.
处理器802是进行算术运算和/或逻辑运算的模块,具体可以是中央处理器(central processing unit,CPU)、图片处理器(graphics processing unit,GPU)、微处理器(microprocessor unit,MPU)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程逻辑门阵列(Field Programmable Gate Array,FPGA)、复杂可编程逻辑器件(Complex programmable logic device,CPLD)等处理模块中的一种或者多种的组合。The processor 802 is a module that performs arithmetic operations and/or logical operations, and can specifically be a central processing unit (central processing unit, CPU), a graphics processing unit (graphics processing unit, GPU), a microprocessor (microprocessor unit, MPU), One or more of processing modules such as Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA), and Complex Programmable Logic Device (CPLD) The combination.
通信接口804用于接收外部发送的数据和/或向外部发送数据,可以为包括诸如以太网电缆等的有线链路接口,也可以是无线链路(Wi-Fi、蓝牙、通用无线传输等)接口。可选的,通信接口804还可以包括与接口耦合的发射器(如射频发射器、天线等),或者接收器等。The communication interface 804 is used to receive and/or send data to the outside, and may be a wired link interface such as an Ethernet cable, or a wireless link (Wi-Fi, Bluetooth, general wireless transmission, etc.) interface. Optionally, the communication interface 804 may further include a transmitter (eg, a radio frequency transmitter, an antenna, etc.), or a receiver, etc., coupled with the interface.
该车道线规划设备800中的处理器802用于读取存储器801中存储的计算机程序,用于执行以下操作:The processor 802 in the lane line planning device 800 is configured to read the computer program stored in the memory 801, to perform the following operations:
获取第一路口的信息,第一路口的信息包括第一参考点的信息、第二参考点的信息和第一路口的障碍物的信息;其中,第一路口为需要规划车道线的路口,第一参考点为第一车道线上的点,第二参考点为第二车道线上的点,与第一路口相连的车道线为第一车道线和第二车道线,第二车道线通过第一路口的车道线连接第一车道线,障碍物为第一路口内妨碍规划车道线的物体;确定目标投影点,其中,目标投影点为障碍物到第一深度和/或第二深度上的投影点,第一深度为第一车道线向第一路口处延伸的深度,第二深度为第二车道线向第一路口处延伸的深度;根据第一参考点、第二参考点和目标投影点确定车道线。Obtain the information of the first intersection, and the information of the first intersection includes the information of the first reference point, the information of the second reference point and the information of the obstacles of the first intersection; wherein, the first intersection is the intersection where lane lines need to be planned, and the first intersection is the intersection where lane lines need to be planned. The first reference point is the point on the first lane line, the second reference point is the point on the second lane line, the lane lines connected to the first intersection are the first lane line and the second lane line, and the second lane line passes through the The lane line of an intersection is connected to the first lane line, and the obstacle is the object in the first intersection that obstructs the planned lane line; determine the target projection point, wherein the target projection point is the obstacle to the first depth and/or the second depth. Projection point, the first depth is the depth of the extension of the first lane line to the first intersection, and the second depth is the depth of the extension of the second lane line to the first intersection; according to the first reference point, the second reference point and the target projection Click to define the lane line.
可以看出,因为在规划路口处的车道线时,考虑到了路口处的障碍物,从而可以确定出 目标投影点,然后再根据第一参考点、第二参考点和目标投影点可以确定车道线。因为目标投影点的存在,可以保证生成的车道线不会压到障碍物,不需要再进行人工调整,可以提高规划车道线的效率和准确率。It can be seen that because the obstacles at the intersection are considered when planning the lane line at the intersection, the target projection point can be determined, and then the lane line can be determined according to the first reference point, the second reference point and the target projection point. . Because of the existence of the target projection point, it can be ensured that the generated lane line will not be pressed against obstacles, and no manual adjustment is required, which can improve the efficiency and accuracy of planning lane lines.
在一种可能的实施方式中,处理器802还用于:In a possible implementation, the processor 802 is further configured to:
确定规划区域,将规划区域内的物体标记为障碍物。Determine the planning area and mark objects in the planning area as obstacles.
在本申请实施例,可能只有物体靠近路口的部分会妨碍到绘制车道线,所以通过规划区域可以将可能妨碍规划车道线的物体标记障碍物。In the embodiment of the present application, only the part of the object close to the intersection may hinder the drawing of the lane line, so the object that may hinder the planning of the lane line may be marked as an obstacle through the planning area.
在一种可能的实施方式中,处理器802具体用于:In a possible implementation manner, the processor 802 is specifically configured to:
根据第一参考点、第二参考点和交点确定规划区域,交点为第一深度与第二深度交汇的点。The planning area is determined according to the first reference point, the second reference point and the intersection point, where the intersection point is a point where the first depth and the second depth meet.
在本申请实施例中,因为第一参考点、第二参考点和交点为规划车道线所需要用到的点,所以通过第一参考点、第二参考点和交点确定的规划区域,可以更加准确的找到妨碍规划车道线的物体。In this embodiment of the present application, since the first reference point, the second reference point and the intersection point are points needed to plan lane lines, the planning area determined by the first reference point, the second reference point and the intersection point can be more Accurately find objects that obstruct the planned lane lines.
在一种可能的实施方式中,处理器802具体用于:In a possible implementation manner, the processor 802 is specifically configured to:
将障碍物的N个位置点向第一深度投影,得到N个第一投影点,N大于等于1;Project the N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1;
将障碍物的N个位置点向第二深度投影,得到N个第二投影点;Project the N position points of the obstacle to the second depth to obtain N second projection points;
从N个第一投影点和N个第二投影点中选择目标投影点,其中,The target projection point is selected from the N first projection points and the N second projection points, where,
N个第一投影点中到第一参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第一阈值的第一投影点属于目标投影点;Among the N first projection points, the distance to the first reference point is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point;
N个第二投影点中到第二参考点的距离最大,并且,到障碍物上的对应点的距离小于或等于第二阈值的第二投影点属于目标投影点。Among the N second projection points, the distance to the second reference point is the largest, and the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
在本申请实施例中,通过给定的预设条件,从N个第一投影点和/或N个第二投影点中选择满足预设要求的目标投影点,因为预设条件中第一阈值和第二阈值的存在,可以提高通过确定的目标投影所绘制车道线不会压到障碍物的可能性,也保障了车辆通过规划的车道线可以顺利驶出路口。In this embodiment of the present application, a target projection point that satisfies the preset requirements is selected from the N first projection points and/or the N second projection points according to a given preset condition, because the first threshold value in the preset condition is And the existence of the second threshold can improve the possibility that the lane line drawn by the determined target projection will not overwhelm the obstacle, and also ensure that the vehicle can smoothly exit the intersection through the planned lane line.
在一种可能的实施方式中,目标投影点包括第一投影点,处理器802具体用于:In a possible implementation manner, the target projection point includes the first projection point, and the processor 802 is specifically configured to:
根据第一参考点和第一投影点确定第一线段;determining the first line segment according to the first reference point and the first projection point;
根据第一投影点、第二参考点和交点确定第一曲线,交点为第一深度与第二深度交汇的点;Determine the first curve according to the first projection point, the second reference point and the intersection point, where the intersection point is a point where the first depth and the second depth meet;
由第一线段和第一曲线确定右转车道线。The right-turn lane line is determined by the first line segment and the first curve.
在本申请实施例中,车道线由第一线段和第一曲线组成,第一线段是在进入路口处避开障碍物且可以保证完成右转的最长距离,因此可以通过第一线段在完全避开障碍物的情况下,由第一曲线来驶出路口。In this embodiment of the present application, the lane line is composed of a first line segment and a first curve. The first line segment is the longest distance that can avoid obstacles at the entrance and can guarantee a right turn, so the first line segment can pass through the first line. In the case of completely avoiding the obstacle, the segment will go out of the intersection by the first curve.
在一种可能的实施方式中,目标投影点包括第二投影点,处理器802具体用于:In a possible implementation manner, the target projection point includes the second projection point, and the processor 802 is specifically configured to:
根据第一参考点、第二投影点和交点确定第二曲线,交点为第一深度与第二深度交汇的点;Determine the second curve according to the first reference point, the second projection point and the intersection point, where the intersection point is the point where the first depth and the second depth meet;
根据第二投影点和第二参考点确定第二直线;determining a second straight line according to the second projection point and the second reference point;
由第二曲线和第二直线确定右转车道线。The right-turn lane line is determined by the second curve and the second straight line.
在本申请实施例中,车道线由第二线段和第二曲线组成,第二线段是在离开路口处避开障碍物且可以保证完成右转的最长距离,可以保证在右转时即将压到障碍物的时候通过第二线段来避免压到障碍物。In the embodiment of the present application, the lane line is composed of a second line segment and a second curve, and the second line segment is the longest distance that can avoid obstacles at the exit from the intersection and can guarantee the completion of a right turn. When reaching the obstacle, pass the second line segment to avoid pressing the obstacle.
在一种可能的实施方式中,目标投影点包括第一投影点和第二投影点,处理器802具体用于:In a possible implementation manner, the target projection point includes a first projection point and a second projection point, and the processor 802 is specifically configured to:
根据第一参考点和第一投影点确定第三线段;determining a third line segment according to the first reference point and the first projection point;
根据第一投影点、第二投影点和交点确定第三曲线,交点为第一深度与第二深度交汇的点;Determine the third curve according to the first projection point, the second projection point and the intersection point, where the intersection point is the point where the first depth and the second depth meet;
根据第二投影点和第一参考点确定第四线段;determining a fourth line segment according to the second projection point and the first reference point;
由第三线段、第三曲线和第四线段确定右转车道线。The right-turn lane line is determined by the third line segment, the third curve, and the fourth line segment.
在一种可能的实施方式中,第一阈值和第二阈值均为根据样本数据训练得到的参考值,样本数据为行驶轨迹避开障碍物的历史行驶数据。In a possible implementation manner, the first threshold and the second threshold are both reference values obtained by training according to sample data, and the sample data is historical driving data of the driving trajectory to avoid obstacles.
在本申请实施例中,车道线由第三线段、第三曲线和第四线段组成,第三线段是在进入路口处避开障碍物的最长距离,可以保证在完全避开障碍物的情况下进行右转,第四线段是在离开路口处避开障碍物且可以保证完成右转的最长距离,可以保证在右转时即将压到障碍物的时候通过第四线段来避免压到障碍物。In the embodiment of the present application, the lane line is composed of a third line segment, a third curve and a fourth line segment, and the third line segment is the longest distance to avoid obstacles at the entrance to the intersection, which can ensure that the obstacles are completely avoided. Go down and turn right. The fourth line segment is the longest distance to avoid obstacles at the exit and can guarantee to complete a right turn. It can ensure that the fourth line segment is used to avoid hitting obstacles when turning right. thing.
需要说明的是,各个操作的实现还可以对应参照图3A所示的方法实施例的相应描述。It should be noted that, the implementation of each operation may also correspond to the corresponding description with reference to the method embodiment shown in FIG. 3A .
本申请实施例还提供一种芯片系统,所述芯片系统包括至少一个处理器,存储器和接口电路,所述存储器、所述收发器和所述至少一个处理器通过线路互联,所述至少一个存储器中存储有计算机程序;所述计算机程序被所述处理器执行时,图3A所示的方法流程得以实现。An embodiment of the present application further provides a chip system, the chip system includes at least one processor, a memory and an interface circuit, the memory, the transceiver and the at least one processor are interconnected through a line, and the at least one memory A computer program is stored in the computer; when the computer program is executed by the processor, the method flow shown in FIG. 3A is realized.
本申请实施例还提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,当其在一个或多个处理器上运行时,图3A所示的方法流程得以实现。Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed on one or more processors, the method flow shown in FIG. 3A is implemented.
本申请实施例还提供一种计算机程序产品,当所述计算机程序产品在一个或多个处理器上运行时,图3A所示的方法流程得以实现。The embodiment of the present application further provides a computer program product, when the computer program product is executed on one or more processors, the method flow shown in FIG. 3A is implemented.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来计算机程序相关的硬件完成,该计算机程序可存储于计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储计算机程序代码的介质。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented, and the process can be completed by a computer program or computer program-related hardware, and the computer program can be stored in a computer-readable storage medium. During execution, the processes of the foregoing method embodiments may be included. The aforementioned storage medium includes various media that can store computer program codes, such as ROM or random access memory RAM, magnetic disk or optical disk.

Claims (19)

  1. 一种车道线规划方法,其特征在于,包括:A lane line planning method, comprising:
    获取第一路口的信息,所述第一路口的信息包括第一参考点的信息、第二参考点的信息和所述第一路口的障碍物的信息;其中,所述第一路口为需要规划车道线的路口,所述第一参考点为第一车道线上的点,所述第二参考点为第二车道线上的点,与所述第一路口相连的车道线为所述第一车道线和所述第二车道线,所述第二车道线通过所述第一路口的所述车道线连接所述第一车道线,所述障碍物为所述第一路口内妨碍规划车道线的物体;Obtain the information of the first intersection, where the information of the first intersection includes the information of the first reference point, the information of the second reference point and the information of the obstacles of the first intersection; wherein, the first intersection needs to be planned The intersection of the lane line, the first reference point is the point on the first lane line, the second reference point is the point on the second lane line, and the lane line connected to the first intersection is the first lane line a lane line and the second lane line, the second lane line is connected to the first lane line through the lane line of the first intersection, and the obstacle is a lane line that obstructs the planning in the first intersection the object;
    确定目标投影点,其中,所述目标投影点为所述障碍物到第一深度和/或第二深度上的投影点,所述第一深度为所述第一车道线向所述第一路口处延伸的深度,所述第二深度为所述第二车道线向所述第一路口处延伸的深度;Determining a target projection point, wherein the target projection point is a projection point of the obstacle to a first depth and/or a second depth, and the first depth is the direction from the first lane line to the first intersection The depth extending at the intersection, and the second depth is the depth extending from the second lane line to the first intersection;
    根据所述第一参考点、所述第二参考点和所述目标投影点确定所述车道线。The lane line is determined according to the first reference point, the second reference point and the target projection point.
  2. 根据权利要求1所述的方法,其特征在于,所述确定目标投影点之前,所述获取第一路口的信息之后,还包括:The method according to claim 1, wherein before the determining the target projection point and after the acquiring the information of the first intersection, the method further comprises:
    确定规划区域,将所述规划区域内的物体标记为所述障碍物。A planning area is determined, and objects in the planning area are marked as the obstacles.
  3. 根据权利要求2所述的方法,其特征在于,所述确定规划区域,包括:The method according to claim 2, wherein the determining a planning area comprises:
    根据所述第一参考点、所述第二参考点和交点确定规划区域,所述交点为所述第一深度与所述第二深度交汇的点。A planning area is determined according to the first reference point, the second reference point, and an intersection point, where the intersection point is a point where the first depth and the second depth meet.
  4. 根据权利要求1-3任一项所述的方法,其特征在于,所述确定目标投影点,包括:The method according to any one of claims 1-3, wherein the determining the target projection point comprises:
    将所述障碍物的N个位置点向所述第一深度投影,得到N个第一投影点,N大于等于1;Projecting the N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1;
    将所述障碍物的N个位置点向所述第二深度投影,得到N个第二投影点;Projecting the N position points of the obstacle to the second depth to obtain N second projection points;
    从所述N个第一投影点和所述N个第二投影点中选择所述目标投影点,其中,The target projection point is selected from the N first projection points and the N second projection points, wherein,
    所述N个第一投影点中到所述第一参考点的距离最大,并且,到所述障碍物上的对应点的距离小于或等于第一阈值的第一投影点属于目标投影点;Among the N first projection points, the distance to the first reference point is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold belongs to the target projection point;
    所述N个第二投影点中到所述第二参考点的距离最大,并且,到所述障碍物上的对应点的距离小于或等于第二阈值的第二投影点属于目标投影点。Among the N second projection points, the distance to the second reference point is the largest, and the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
  5. 根据权利要求4所述的方法,其特征在于,所述目标投影点包括所述第一投影点,所述根据所述第一参考点、所述第二参考点和所述目标投影点确定车道线,包括:The method according to claim 4, wherein the target projection point comprises the first projection point, and the lane is determined according to the first reference point, the second reference point and the target projection point line, including:
    根据所述第一参考点和所述第一投影点确定第一线段;determining a first line segment according to the first reference point and the first projection point;
    根据所述第一投影点、所述第二参考点和交点确定第一曲线,所述交点为所述第一深度与所述第二深度交汇的点;determining a first curve according to the first projection point, the second reference point, and an intersection point, where the intersection point is a point where the first depth meets the second depth;
    由所述第一线段和所述第一曲线确定所述右转车道线。The right-turn lane line is determined from the first line segment and the first curve.
  6. 根据权利要求4所述的方法,其特征在于,所述目标投影点包括所述第二投影点,所述根据所述第一参考点、所述第二参考点和所述目标投影点确定车道线,包括:The method according to claim 4, wherein the target projection point comprises the second projection point, and the lane is determined according to the first reference point, the second reference point and the target projection point line, including:
    根据所述第一参考点、所述第二投影点和交点确定第二曲线,所述交点为所述第一深度与所述第二深度交汇的点;determining a second curve according to the first reference point, the second projection point, and an intersection point, where the intersection point is a point where the first depth meets the second depth;
    根据所述第二投影点和所述第二参考点确定第二直线;determining a second straight line according to the second projection point and the second reference point;
    由所述第二曲线和所述第二直线确定所述右转车道线。The right-turn lane line is determined from the second curve and the second straight line.
  7. 根据权利要求4所述的方法,其特征在于,所述目标投影点包括所述第一投影点和所述第二投影点,所述根据所述第一参考点、所述第二参考点和所述目标投影点确定车道线,包括:The method according to claim 4, wherein the target projection point comprises the first projection point and the second projection point, and the target projection point is based on the first reference point, the second reference point and the The target projection point determines the lane line, including:
    根据所述第一参考点和所述第一投影点确定第三线段;determining a third line segment according to the first reference point and the first projection point;
    根据所述第一投影点、所述第二投影点和交点确定第三曲线,所述交点为所述第一深度与所述第二深度交汇的点;determining a third curve according to the first projection point, the second projection point and an intersection point, where the intersection point is a point where the first depth and the second depth intersect;
    根据所述第二投影点和所述第一参考点确定第四线段;determining a fourth line segment according to the second projection point and the first reference point;
    由所述第三线段、所述第三曲线和所述第四线段确定所述右转车道线。The right-turn lane line is determined from the third line segment, the third curve, and the fourth line segment.
  8. 根据权利要求4-7任一项所述的方法,其特征在于,所述第一阈值和所述第二阈值均为根据样本数据训练得到的参考值,所述样本数据为行驶轨迹避开所述障碍物的历史行驶数据。The method according to any one of claims 4-7, wherein the first threshold value and the second threshold value are both reference values obtained by training according to sample data, and the sample data is a driving track to avoid The historical driving data of the obstacle is described.
  9. 一种车道线规划装置,其特征在于,包括:A lane line planning device, characterized in that it includes:
    获取单元,用于获取第一路口的信息,所述第一路口的信息包括第一参考点的信息、第二参考点的信息和所述第一路口的障碍物的信息;其中,所述第一路口为需要规划车道线的路口,所述第一参考点为第一车道线上的点,所述第二参考点为第二车道线上的点,与所述第一路口相连的车道线为所述第一车道线和所述第二车道线,所述第二车道线通过所述第一路口的所述车道线连接所述第一车道线,所述障碍物为所述第一路口内妨碍规划车道线的物体;an obtaining unit, configured to obtain information of a first intersection, where the information of the first intersection includes information of a first reference point, information of a second reference point, and information of obstacles at the first intersection; wherein the first intersection An intersection is an intersection where lane lines need to be planned, the first reference point is a point on the first lane line, the second reference point is a point on the second lane line, and the lane line connected to the first intersection are the first lane line and the second lane line, the second lane line is connected to the first lane line through the lane line of the first intersection, and the obstacle is the first road Objects in the mouth that obstruct the planned lane lines;
    确定单元,用于确定目标投影点,其中,所述目标投影点为所述障碍物到第一深度和/或第二深度上的投影点,所述第一深度为所述第一车道线向所述第一路口处延伸的深度,所述第二深度为所述第二车道线向所述第一路口处延伸的深度;A determination unit for determining a target projection point, wherein the target projection point is a projection point of the obstacle to a first depth and/or a second depth, and the first depth is the direction of the first lane line the depth extending from the first intersection, and the second depth is the depth extending from the second lane line to the first intersection;
    规划单元,用于根据所述第一参考点、所述第二参考点和所述目标投影点确定所述车道线。A planning unit, configured to determine the lane line according to the first reference point, the second reference point and the target projection point.
  10. 根据权利要求9所述的装置,其特征在于,所述确定单元还用于:The device according to claim 9, wherein the determining unit is further configured to:
    确定规划区域,将所述规划区域内的物体标记为所述障碍物。A planning area is determined, and objects in the planning area are marked as the obstacles.
  11. 根据权利要求10所述的装置,其特征在于,所述确定单元具体用于:The device according to claim 10, wherein the determining unit is specifically configured to:
    根据所述第一参考点、所述第二参考点和交点确定规划区域,所述交点为所述第一深度与所述第二深度交汇的点。A planning area is determined according to the first reference point, the second reference point, and an intersection point, where the intersection point is a point where the first depth and the second depth meet.
  12. 根据权利要求9-11任一项所述的装置,其特征在于,所述确定单元具体用于:The device according to any one of claims 9-11, wherein the determining unit is specifically configured to:
    将所述障碍物的N个位置点向所述第一深度投影,得到N个第一投影点,N大于等于1;Projecting the N position points of the obstacle to the first depth to obtain N first projection points, where N is greater than or equal to 1;
    将所述障碍物的N个位置点向所述第二深度投影,得到N个第二投影点;Projecting the N position points of the obstacle to the second depth to obtain N second projection points;
    从所述N个第一投影点和所述N个第二投影点中选择所述目标投影点,其中,The target projection point is selected from the N first projection points and the N second projection points, wherein,
    所述N个第一投影点中到所述第一参考点的距离最大,并且,到所述障碍物上的对应点 的距离小于或等于第一阈值的第一投影点属于目标投影点;The distance to the first reference point in the N first projection points is the largest, and the first projection point whose distance to the corresponding point on the obstacle is less than or equal to the first threshold value belongs to the target projection point;
    所述N个第二投影点中到所述第二参考点的距离最大,并且,到所述障碍物上的对应点的距离小于或等于第二阈值的第二投影点属于目标投影点。Among the N second projection points, the distance to the second reference point is the largest, and the second projection point whose distance to the corresponding point on the obstacle is less than or equal to the second threshold belongs to the target projection point.
  13. 根据权利要求12所述的装置,其特征在于,所述目标投影点包括所述第一投影点,所述规划单元具体用于:The device according to claim 12, wherein the target projection point comprises the first projection point, and the planning unit is specifically configured to:
    根据所述第一参考点和所述第一投影点确定第一线段;determining a first line segment according to the first reference point and the first projection point;
    根据所述第一投影点、所述第二参考点和交点确定第一曲线,所述交点为所述第一深度与所述第二深度交汇的点;determining a first curve according to the first projection point, the second reference point, and an intersection point, where the intersection point is a point where the first depth meets the second depth;
    由所述第一线段和所述第一曲线确定所述右转车道线。The right-turn lane line is determined from the first line segment and the first curve.
  14. 根据权利要求12所述的装置,其特征在于,所述目标投影点包括所述第二投影点,所述规划单元具体用于:The device according to claim 12, wherein the target projection point comprises the second projection point, and the planning unit is specifically configured to:
    根据所述第一参考点、所述第二投影点和交点确定第二曲线,所述交点为所述第一深度与所述第二深度交汇的点;determining a second curve according to the first reference point, the second projection point, and an intersection point, where the intersection point is a point where the first depth meets the second depth;
    根据所述第二投影点和所述第二参考点确定第二直线;determining a second straight line according to the second projection point and the second reference point;
    由所述第二曲线和所述第二直线确定所述右转车道线。The right-turn lane line is determined from the second curve and the second straight line.
  15. 根据权利要求12所述的装置,其特征在于,所述目标投影点包括所述第一投影点和所述第二投影点,所述车道线为右转车道线,所述规划单元具体用于:The device according to claim 12, wherein the target projection point includes the first projection point and the second projection point, the lane line is a right-turn lane line, and the planning unit is specifically configured to :
    根据所述第一参考点和所述第一投影点确定第三线段;determining a third line segment according to the first reference point and the first projection point;
    根据所述第一投影点、所述第二投影点和交点确定第三曲线,所述交点为所述第一深度与所述第二深度交汇的点;determining a third curve according to the first projection point, the second projection point and an intersection point, where the intersection point is a point where the first depth and the second depth intersect;
    根据所述第二投影点和所述第一参考点确定第四线段;determining a fourth line segment according to the second projection point and the first reference point;
    由所述第三线段、所述第三曲线和所述第四线段确定所述右转车道线。The right-turn lane line is determined from the third line segment, the third curve, and the fourth line segment.
  16. 一种高精度地图,其特征在于,所述高精度地图包括权利要求1-8中任一项所述的方法中根据所述第一参考点、所述第二参考点和所述目标投影点确定的所述车道线。A high-precision map, characterized in that the high-precision map includes the first reference point, the second reference point and the target projection point in the method according to any one of claims 1-8 The identified lane lines.
  17. 一种智能车辆,其特征在于,所述智能车辆包括至少一个处理器和至少一个存储器,所述至少一个处理器用于调用所述至少一个存储器中存储的计算机程序,以使所述智能车辆执行如权利要求1-8中任一项所述的方法。An intelligent vehicle, characterized in that the intelligent vehicle includes at least one processor and at least one memory, and the at least one processor is configured to call a computer program stored in the at least one memory, so that the intelligent vehicle executes the following steps: The method of any one of claims 1-8.
  18. 一种车道线规划设备,其特征在于,所述车道线规划设备包括至少一个处理器和至少一个存储器,所述至少一个处理器用于调用所述至少一个存储器中存储的计算机程序,以使得所述装置执行如权利要求1-8中任一项所述的方法。A lane line planning device, characterized in that the lane line planning device includes at least one processor and at least one memory, and the at least one processor is configured to call a computer program stored in the at least one memory, so that the The apparatus performs the method of any of claims 1-8.
  19. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有计算机程序,当所述计算机程序在一个或多个处理器上运行时,执行如权利要求1-8中任一项所述的方法。A computer-readable storage medium, characterized in that, a computer program is stored in the computer-readable storage medium, and when the computer program is executed on one or more processors, it executes any one of claims 1-8. one of the methods described.
PCT/CN2021/133214 2021-01-08 2021-11-25 Lane line planning method and related apparatus WO2022148172A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110026340.1A CN114754780A (en) 2021-01-08 2021-01-08 Lane line planning method and related device
CN202110026340.1 2021-01-08

Publications (1)

Publication Number Publication Date
WO2022148172A1 true WO2022148172A1 (en) 2022-07-14

Family

ID=82325891

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/133214 WO2022148172A1 (en) 2021-01-08 2021-11-25 Lane line planning method and related apparatus

Country Status (2)

Country Link
CN (1) CN114754780A (en)
WO (1) WO2022148172A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117036541A (en) * 2023-09-18 2023-11-10 腾讯科技(深圳)有限公司 Lane center line generation method, lane center line generation device, electronic equipment and storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115993124B (en) * 2023-03-22 2023-06-23 高德软件有限公司 Virtual lane line generation method, device, equipment and computer readable storage medium
CN116046014B (en) * 2023-03-31 2023-06-30 小米汽车科技有限公司 Track planning method, track planning device, electronic equipment and readable storage medium
CN117093663B (en) * 2023-10-20 2024-01-30 腾讯科技(深圳)有限公司 Data processing method and related device of electronic map

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010026875A (en) * 2008-07-22 2010-02-04 Asahi Koyo Kk Road network data generating device and lane generation device in intersection, and generating method and program therefor
CN105651295A (en) * 2016-01-15 2016-06-08 武汉光庭信息技术股份有限公司 Connection curve algorithm for constructing intersection entry and exit lane Links based on Bezier curve
CN106441312A (en) * 2015-08-11 2017-02-22 高德软件有限公司 Guiding line generation method and guiding line generation device
CN109253735A (en) * 2018-11-30 2019-01-22 奇瑞汽车股份有限公司 Paths planning method, device and storage medium
CN110579222A (en) * 2018-06-07 2019-12-17 百度在线网络技术(北京)有限公司 Navigation route processing method, device and equipment
CN111332285A (en) * 2018-12-19 2020-06-26 长沙智能驾驶研究院有限公司 Method and device for vehicle to avoid obstacle, electronic equipment and storage medium
CN111710159A (en) * 2020-05-29 2020-09-25 同济大学 Intersection vehicle path planning method and device based on virtual lane line

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010026875A (en) * 2008-07-22 2010-02-04 Asahi Koyo Kk Road network data generating device and lane generation device in intersection, and generating method and program therefor
CN106441312A (en) * 2015-08-11 2017-02-22 高德软件有限公司 Guiding line generation method and guiding line generation device
CN105651295A (en) * 2016-01-15 2016-06-08 武汉光庭信息技术股份有限公司 Connection curve algorithm for constructing intersection entry and exit lane Links based on Bezier curve
CN110579222A (en) * 2018-06-07 2019-12-17 百度在线网络技术(北京)有限公司 Navigation route processing method, device and equipment
CN109253735A (en) * 2018-11-30 2019-01-22 奇瑞汽车股份有限公司 Paths planning method, device and storage medium
CN111332285A (en) * 2018-12-19 2020-06-26 长沙智能驾驶研究院有限公司 Method and device for vehicle to avoid obstacle, electronic equipment and storage medium
CN111710159A (en) * 2020-05-29 2020-09-25 同济大学 Intersection vehicle path planning method and device based on virtual lane line

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ZU SIJIE: "Topology Construction and Route Planning Based on Lane Driving Condition", GEOSPATIAL INFORMATION, HUBEI SHENG CEHUI DILI XINXI JU, CN, vol. 16, no. 5, 24 May 2018 (2018-05-24), CN , pages 53 - 56, 59, XP055949175, ISSN: 1672-4623, DOI: 10.3969/j.issn.1672-4623.2018.05 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117036541A (en) * 2023-09-18 2023-11-10 腾讯科技(深圳)有限公司 Lane center line generation method, lane center line generation device, electronic equipment and storage medium
CN117036541B (en) * 2023-09-18 2024-01-12 腾讯科技(深圳)有限公司 Lane center line generation method, lane center line generation device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN114754780A (en) 2022-07-15

Similar Documents

Publication Publication Date Title
WO2021027568A1 (en) Obstacle avoidance method and device
WO2021136130A1 (en) Trajectory planning method and apparatus
WO2021135371A1 (en) Automatic driving method, related device and computer-readable storage medium
WO2022027304A1 (en) Testing method and apparatus for autonomous vehicle
WO2022148172A1 (en) Lane line planning method and related apparatus
WO2021102955A1 (en) Path planning method for vehicle and path planning apparatus for vehicle
WO2021103511A1 (en) Operational design domain (odd) determination method and apparatus and related device
CN113968216B (en) Vehicle collision detection method and device and computer readable storage medium
CN112146671B (en) Path planning method, related equipment and computer readable storage medium
WO2021217420A1 (en) Lane tracking method and apparatus
WO2021147748A1 (en) Self-driving method and related device
CN112672942B (en) Vehicle lane changing method and related equipment
WO2022016901A1 (en) Method for planning driving route of vehicle, and intelligent vehicle
WO2022142839A1 (en) Image processing method and apparatus, and intelligent vehicle
WO2022022384A1 (en) Method and device for recognizing vehicle motion state
WO2022062825A1 (en) Vehicle control method, device, and vehicle
WO2022051951A1 (en) Lane line detection method, related device, and computer readable storage medium
EP4307251A1 (en) Mapping method, vehicle, computer readable storage medium, and chip
CN114792149A (en) Track prediction method and device and map
WO2022160900A1 (en) Test environment construction method and device
WO2022052881A1 (en) Map construction method and computing device
WO2022088761A1 (en) Method and apparatus for planning vehicle driving path, intelligent vehicle, and storage medium
WO2021217447A1 (en) Method and apparatus for vehicle to pass through boom barrier
WO2022151839A1 (en) Vehicle turning route planning method and apparatus
US20220309806A1 (en) Road structure detection method and apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21917213

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21917213

Country of ref document: EP

Kind code of ref document: A1