WO2024060420A1 - Parking lot data matching method and apparatus, device, medium and vehicle - Google Patents

Parking lot data matching method and apparatus, device, medium and vehicle Download PDF

Info

Publication number
WO2024060420A1
WO2024060420A1 PCT/CN2022/137917 CN2022137917W WO2024060420A1 WO 2024060420 A1 WO2024060420 A1 WO 2024060420A1 CN 2022137917 W CN2022137917 W CN 2022137917W WO 2024060420 A1 WO2024060420 A1 WO 2024060420A1
Authority
WO
WIPO (PCT)
Prior art keywords
trajectory
current
matched
frame
parking lot
Prior art date
Application number
PCT/CN2022/137917
Other languages
French (fr)
Chinese (zh)
Inventor
李江龙
罗金辉
单乐
Original Assignee
北京初速度科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京初速度科技有限公司 filed Critical 北京初速度科技有限公司
Publication of WO2024060420A1 publication Critical patent/WO2024060420A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/28Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
    • G01C21/30Map- or contour-matching
    • G01C21/32Structuring or formatting of map data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled

Definitions

  • Embodiments of the present invention relate to the field of automatic driving technology, and specifically to a parking lot data matching method, device, equipment, medium and vehicle.
  • a large multi-story parking lot often requires multiple data collections to fully cover it. Parking lots are often built underground and do not have GPS (Global Positioning System) signals. Most parking lots are multi-story, and the scenes on each floor are very similar. This brings great difficulties to the parking lot mapping. difficulty.
  • Embodiments of the present invention provide a parking lot data matching method, device, equipment, medium and vehicle to realize rapid and accurate association of multiple collected parking lot trajectories.
  • embodiments of the present invention provide a parking lot data matching method, including:
  • each driving trajectory includes The trajectory before entering the parking lot, the trajectory in the parking lot and the trajectory after exiting the parking lot;
  • the matching operation is performed with the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
  • the posture of each trajectory frame to be matched can be adjusted in turn, and the trajectory frame after posture adjustment is aligned with the reference trajectory frame with the corresponding position, so that the driving trajectories collected multiple times can be accurately and quickly associated together.
  • the vehicle posture alignment can be made more accurate.
  • the relative pose between each trajectory frame to be matched in the current trajectory to be matched, and the vehicle before entering and exiting the parking lot Based on the absolute position information after the field, the pose is adjusted for each trajectory frame to be matched in turn, and the pose is aligned with the corresponding reference trajectory frame in the current reference trajectory, and the current matching process corresponding to the current reference trajectory frame is obtained. Alignment results, including:
  • the successful matching All matched trajectory frames to be matched are optimized in pose, and the reference trajectory frame corresponding to the optimized trajectory frame to be matched and the position where the matching is successful is used as an alignment frame;
  • the method provided by the embodiment of the present invention further includes:
  • the current reference All reference trajectory frames in the trajectory are optimized for pose, and the optimized trajectory frame to be matched and the reference trajectory frame after successful matching are used as alignment frames.
  • match the current reference trajectory frame with the current trajectory frame to be matched including:
  • Obtain local feature information of the parking lot which includes: traffic signs, wall markings, road markings and lane markings;
  • the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched, it is confirmed that the current reference trajectory frame and the current trajectory frame to be matched are successfully matched; or,
  • the method provided by the embodiment of the present invention also includes:
  • the temporarily stored target trajectory frames that failed to match are traversed in sequence. For any target trajectory frame that fails to match, based on the optimized pose of the target trajectory frame, the target trajectory with the optimized pose is repeatedly executed. The matching operation of the reference trajectory frame corresponding to the frame and position is performed until all temporarily stored target trajectory frames that have failed to match are traversed and a new current alignment result is obtained;
  • the driving trajectory corresponding to the current alignment result is used as the new current reference trajectory, and another unmatched driving trajectory is selected from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and the matching operation between the new current reference trajectory and the new current trajectory to be matched is returned, including:
  • the driving trajectory corresponding to the new current alignment result is used as the new current reference trajectory, and another unmatched driving trajectory is selected from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and the matching operation between the new current reference trajectory and the new current trajectory to be matched is returned.
  • determining a current reference trajectory frame corresponding to the position of the current trajectory frame to be matched in the current reference trajectory includes:
  • the candidate reference trajectory frame is used as the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched.
  • determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot including:
  • the candidate reference trajectory frame and the current trajectory frame to be matched do not belong to the same layer of the parking lot.
  • detect whether there are slope segments in the shortest topological path including:
  • the road segment corresponding to the trajectory frame with a pitch angle greater than or equal to the preset angle is regarded as a slope segment, and the road segment corresponding to the trajectory frame with the pitch angle smaller than the preset angle is regarded as a non-slope segment.
  • the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched perform pose optimization on all successfully matched trajectory frames to be matched, including:
  • the first topological graph is optimized by a posture graph optimization method, and the trajectory frame to be matched after posture optimization and the successfully matched reference trajectory frame are used as alignment frames, wherein the alignment frame nodes in the first topological graph and the second topological graph are connected by edges.
  • the vehicle pose can be accurately aligned, thereby The reference trajectory and the trajectory to be matched are accurately associated together, which solves the problem of insufficient data correlation.
  • the method provided by the embodiment of the present invention also includes:
  • the first topology map and the second topology map are optimized respectively to reduce the deviation in absolute position between the current trajectory to be matched and the current reference trajectory.
  • the vehicle pose corresponding to each reference trajectory frame or the vehicle pose corresponding to each trajectory frame to be matched is obtained through any of the following sensor data, or by fusing the following multiple sensor data:
  • IMU data Inertial measurement unit IMU data, image data, radar point cloud data and odometer data.
  • embodiments of the present invention also provide a parking lot data matching device, including:
  • a driving trajectory selection module is configured to arbitrarily select vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, and use one of the driving trajectories as the current reference trajectory and another driving trajectory as the current trajectory to be matched, wherein each driving trajectory includes a trajectory before entering the parking lot, a trajectory in the parking lot, and a trajectory after leaving the parking lot;
  • the matching module is configured to match the current reference trajectory with the current trajectory to be matched.
  • the matching process based on the alignment frame matching the current reference trajectory with the vehicle pose in the current trajectory to be matched, each of the current trajectories to be matched.
  • the data association module is configured to use the driving trajectory corresponding to the current alignment result as the new current reference trajectory, and select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and Return to perform the matching operation of the new current reference trajectory and the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
  • Optional matching modules include:
  • the current reference trajectory frame determination unit is configured to sequentially traverse each trajectory frame to be matched in the current trajectory to be matched, and for each current trajectory frame to be matched, determine the position corresponding to the current trajectory frame to be matched in the current reference trajectory.
  • a matching unit configured to match the current reference trajectory frame with the current trajectory frame to be matched
  • a relative pose determination unit configured to determine a first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame if the current reference trajectory frame matches the current trajectory frame to be matched successfully;
  • the first posture optimization unit is configured to be based on the first relative posture, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the space between each to-be-matched trajectory frame in the current driving trajectory to be matched.
  • For the second relative pose perform pose optimization on all successfully matched trajectory frames to be matched, and use the reference trajectory frame corresponding to the optimized trajectory frame to be matched and the position where the matching is successful as an alignment frame;
  • the pose alignment unit is configured to adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame based on the current alignment frame, and use the adjacent trajectory frame after the pose adjustment as the new current trajectory frame to be matched, and Return to perform the matching operation of matching the new current trajectory frame to be matched with the current reference trajectory frame corresponding to the position, until all trajectory frames to be matched in the current trajectory to be matched are traversed, and the current alignment result of the vehicle pose in the current matching process is obtained. .
  • the device provided by the embodiment of the present invention also includes:
  • the second pose optimization unit is configured to, after determining the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, based on the first relative pose, the vehicle entering the parking lot in each driving trajectory
  • the absolute position information before and after leaving the parking lot, the second relative pose between the trajectory frames to be matched in the current driving trajectory to be matched, the pose optimization of all reference trajectory frames in the current reference trajectory, and the pose The optimized trajectory frame to be matched and the optimized reference trajectory frame of the successfully matched pose are used as alignment frames.
  • matching units include:
  • the local feature information acquisition subunit is configured to acquire local feature information of the parking lot, where the local feature information includes: traffic signs, wall markings, road markings and lane markings;
  • the matching subunit is configured to determine that the current reference trajectory frame and the current trajectory frame to be matched are successfully matched if the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched. ;or,
  • the device provided by the embodiment of the present invention also includes:
  • the matching failed frame temporary storage module is configured to temporarily store the failed matching current trajectory frame to be matched if the current reference trajectory frame fails to match the current trajectory frame to be matched;
  • the re-matching module is configured to sequentially traverse the temporarily stored target trajectory frames that failed to match. For any target trajectory frame that failed to match, based on the optimized pose of the target trajectory frame, repeatedly execute the optimized target trajectory. The matching operation of the reference trajectory frame corresponding to the frame and position is performed until all temporarily stored target trajectory frames that have failed to match are traversed and a new current alignment result is obtained;
  • the data association module is specifically configured as:
  • the reference trajectory is matched with the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
  • the current reference trajectory frame determination unit includes:
  • the first search subunit is configured to obtain the absolute position corresponding to the current trajectory frame to be matched when the current trajectory frame to be matched belongs to the trajectory before entering the parking lot or the trajectory after exiting the parking lot, and in the current reference trajectory, Search within the first set distance range from the absolute position to obtain the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched;
  • the second search subunit is configured to, in the case where the current trajectory frame to be matched belongs to the trajectory in the parking lot, based on the current location information corresponding to the current trajectory frame to be matched, in the current reference trajectory, the first distance from the current location information is Search within a certain distance range to obtain candidate reference trajectory frames;
  • the same layer determination subunit is configured to determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot;
  • the current reference trajectory frame determination subunit is configured to use the candidate reference trajectory frame as the position corresponding to the current trajectory frame to be matched if the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot.
  • the current reference trajectory frame is configured to use the candidate reference trajectory frame as the position corresponding to the current trajectory frame to be matched if the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot.
  • the same-layer judgment subunit includes:
  • a shortest topological path determination component configured to determine the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame
  • a slope segment detection component configured to detect whether there is a slope segment in the shortest topological path
  • the same layer determination component is configured to determine that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot if there is no slope segment in the shortest topological path;
  • the candidate reference trajectory frame and the current trajectory frame to be matched do not belong to the same layer of the parking lot.
  • the same layer determines the component, which is specifically configured as:
  • the road segment corresponding to the trajectory frame with a pitch angle greater than or equal to the preset angle is regarded as a slope segment, and the road segment corresponding to the trajectory frame with a pitch angle smaller than the preset angle is regarded as a non-slope segment.
  • the first attitude optimization unit is specifically configured as:
  • the graph optimization method optimizes the first topology graph, and uses the optimized trajectory frame to be matched and the successfully matched reference trajectory frame as the alignment frame, where the alignment frame node in the first topology graph and the second topology graph is Connected by edges.
  • the device provided in this embodiment also includes:
  • the initial optimization module is configured to optimize the first topology map and the second topology map respectively based on the absolute position information before entering the parking lot and after exiting the parking lot before matching the current reference trajectory with the current trajectory to be matched. , to reduce the absolute position deviation between the current trajectory to be matched and the current reference trajectory.
  • the vehicle pose corresponding to each reference trajectory frame or the vehicle pose corresponding to each trajectory frame to be matched is obtained through any of the following sensor data, or by fusing the following multiple sensor data:
  • IMU data Inertial measurement unit IMU data, image data, radar point cloud data and odometer data.
  • an electronic device which includes:
  • processors one or more processors
  • a storage device for storing one or more programs
  • the one or more processors are caused to implement the matching method of parking lot data as provided in any embodiment of the present invention.
  • embodiments of the present invention provide a storage medium on which a computer program is stored, characterized in that when the program is executed by a processor, the parking lot data matching method as provided in any embodiment of the present invention is implemented. .
  • embodiments of the present invention provide a vehicle, which includes the parking lot data matching device provided by any embodiment of the present invention, or the electronic device provided by any embodiment of the present invention.
  • an embodiment of the present invention provides a computer program.
  • the computer program includes program instructions.
  • the program instructions are executed by a computer, the parking lot data matching method provided by any embodiment of the present invention is implemented.
  • Figure 1a is a flow chart of a parking lot data matching method provided in Embodiment 1 of the present invention.
  • FIG1b is a topological diagram of vehicle driving trajectories including a first-floor underground parking lot provided in Embodiment 1 of the present invention.
  • Figure 1c is a topological diagram of vehicle driving trajectories including a two-story underground parking lot provided by Embodiment 1 of the present invention
  • FIG. 1d is a topological diagram after initial posture optimization of the reference driving trajectory and the trajectory to be matched provided by the first embodiment of the present invention
  • Figure 1e is a topological diagram for matching a trajectory to be matched with a reference trajectory provided in Embodiment 1 of the present invention
  • Figure 1f is another topological diagram for matching a trajectory to be matched with a reference trajectory provided by Embodiment 1 of the present invention.
  • FIG2 is a flow chart of a parking lot data matching method provided by Embodiment 2 of the present invention.
  • Figure 3 is a structural block diagram of a parking lot data matching device provided in Embodiment 3 of the present invention.
  • Figure 4 is a structural block diagram of an electronic device provided in Embodiment 4 of the present invention.
  • Figure 5 is a schematic diagram of a vehicle provided in Embodiment 5 of the present invention.
  • the embodiment of the invention discloses a parking lot data matching method, device, equipment, medium and vehicle. Each is explained in detail below.
  • Figure 1a is a flow chart of a parking lot data matching method provided in Embodiment 1 of the present invention.
  • This method can be applied to vehicle-mounted computers, vehicle-mounted industrial personal computers (IPC) and other vehicle-mounted terminals, and can also be applied to servers.
  • the embodiment of the present invention does not limit this.
  • the method provided in this embodiment can be applied to the application scenario of correlating the driving trajectories of multi-story parking lots collected multiple times.
  • the method provided in this embodiment can be executed by a parking lot data matching device, which can be implemented by software and/or hardware. As shown in Figure 1a, the method provided by this embodiment specifically includes:
  • vehicle-mounted sensors can include inertial measurement units (Inertial Measurement Unit, IMU), image sensors, radars and odometers, etc.
  • IMU Inertial Measurement Unit
  • the vehicle driving trajectories collected multiple times include the driving trajectory before entering the parking lot, the driving trajectory in the parking lot, and the driving trajectory after leaving the parking lot.
  • GPS Global Positioning System
  • the three trajectories before entering the parking lot, the driving trajectory inside the parking lot, and the trajectory after leaving the parking lot are continuous trajectories.
  • matching the current reference trajectory with the current trajectory to be matched actually means matching the current reference trajectory with the vehicle pose corresponding to each trajectory frame in the current trajectory frame to be matched, and optimizing the vehicle pose to optimize the vehicle pose.
  • the frame to be matched trajectory is aligned with the reference trajectory at the corresponding position.
  • multiple key frames can be selected from the current reference trajectory as reference trajectory frames, and multiple key frames can be selected from the current trajectory to be matched as trajectory frames to be matched.
  • the selection of each key frame may be: use the trajectory frame whose driving distance is the preset distance as the key frame.
  • the preset distance can be any distance within the range of 1 to 3 meters.
  • the poses of each reference trajectory frame and each trajectory frame to be matched may be initially optimized respectively.
  • a first topology graph corresponding to the current trajectory to be matched and a second topology graph corresponding to the current reference trajectory can be constructed, where the nodes of the first topology graph are each trajectory frame to be matched, and the nodes between adjacent trajectory frames to be matched are They are connected by edges.
  • the nodes of the second topology graph are each reference trajectory frame, and adjacent reference trajectory frames are connected by edges.
  • the first topology map and the second topology map are optimized respectively based on the absolute position information before entering the parking lot and after exiting the parking lot, which can reduce the current trajectory to be matched. Deviation in absolute position from the current reference trajectory.
  • Figure 1b is a topological diagram of a vehicle driving trajectory including a one-story underground parking lot (B1) provided in Embodiment 1 of the present invention
  • Figure 1c is a topological diagram of a vehicle driving trajectory including a second-level underground parking lot (B2) provided in Embodiment 1 of the present invention.
  • ) is a topological map of the vehicle's trajectory.
  • the nodes in each driving trajectory are vehicle driving trajectory frames, that is, optimization variables. Adjacent nodes are connected by edges, and adjacent nodes are constrained by relative poses. The GPS signal generated by GPS measurement is constrained before entering the parking lot and after exiting the parking lot.
  • FIG 1d shows the reference driving trajectory and the trajectory to be matched after optimizing the initial pose provided by Embodiment 1 of the present invention. Topology.
  • the initial optimization of the vehicle pose can be achieved to reduce the deviation in absolute position between the trajectory to be matched and the reference trajectory.
  • the nodes of each trajectory frame in the reference driving trajectory and the trajectory to be matched are not completely aligned, and there are still meter-level errors in their positions. Therefore, subsequent steps need to be carried out to The trajectory frame is adjusted in pose to achieve pose alignment between the trajectory frame to be matched and the reference trajectory frame.
  • the pose of each trajectory frame to be matched can be optimized through progressive optimization. Specifically, this can be achieved through the following steps (1) to (3).
  • the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched means that it belongs to the same parking lot as the current trajectory frame to be matched and is close to the location of the current trajectory frame to be matched, that is, the distance is within the first set distance range.
  • the number of reference trajectory frames that meet the above conditions can be one or multiple.
  • the current trajectory frame to be matched may belong to the trajectory before entering the parking lot or the trajectory after exiting the parking lot, or may also belong to the trajectory within the parking lot.
  • the vehicle can determine the absolute position information of the vehicle based on the received GPS signal, the position can be directly compared based on the absolute position information.
  • the search for the corresponding reference trajectory frame can be implemented in the following ways:
  • the first set distance range may be 8 to 12 meters.
  • the vehicle cannot receive the GPS signal, or the received GPS signal is weak.
  • the following steps A to C can be used to determine the position of the current trajectory frame.
  • This embodiment uses the method of detecting the slope segment from the shortest topological path and determining the uphill road in the slope segment. The height difference between the segment and the downhill segment is used to determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot. This can be achieved in the following ways:
  • the second set distance range may be 3 to 5 meters.
  • whether it is a slope segment can be determined by the pitch angle of the vehicle relative to the horizontal plane.
  • the segment corresponding to the trajectory frame whose pitch angle is greater than or equal to the preset angle can be regarded as the slope segment, and the pitch angle is less than
  • the road segment corresponding to the trajectory frame at the preset angle is regarded as a non-slope segment.
  • the range of the preset angle may be 5° to 10°.
  • the pitch angle of the vehicle relative to the horizontal plane can be determined by the IMU, or the attitude of the vehicle can also be determined based on the fused data of multiple sensors, thereby determining the pitch angle of the vehicle relative to the horizontal plane.
  • multi-sensors can include IMU, odometer, image sensor, etc.
  • the height information of the uphill section or the height information of the downhill section can be calculated based on the height difference between the vehicle posture at the top of the ramp section and the vehicle posture at the bottom of the ramp section.
  • a candidate reference trajectory frame that belongs to the same parking lot as the current trajectory to be matched is used as the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched.
  • candidate reference trajectory frames that do not belong to the same parking lot level as the current trajectory to be matched they will not be matched with the current trajectory to be matched. In this case, continue to traverse backward to the next new trajectory frame to be matched, and return to perform the operation of determining the current reference trajectory frame corresponding to the position of the new current trajectory frame to be matched, that is, return to step (1) operate.
  • Figure 1e is a topological diagram for matching a trajectory to be matched with a reference trajectory provided in Embodiment 1 of the present invention.
  • K2, K4, K8, K7 and K6 are the reference trajectory frames in the current reference trajectory.
  • K1, K3, K9, K10, K5 and K11 are the trajectory frames to be matched in the current trajectory to be matched, where K1 and K2, K3 and K4 are alignment frames whose poses have been aligned.
  • the vehicle trajectory will obviously drift in the absolute position, and may even cause misalignment.
  • the shortest topological path between the two needs to be queried from the topology map.
  • the shortest topological path_0 between K5 and K6 is: K5-K10-K9-K3- K4-K8-K7-K6.
  • the uphill and downhill conditions on the shortest topological path are queried based on the posture of the trajectory frame to be matched.
  • K3-K9 descended directly from outside the parking lot to the B2 floor, for example, they dropped 6m
  • K4-K8 descended from outside the parking lot to the B1 floor, for example, they dropped 3m.
  • the current trajectory frame to be matched can be determined.
  • K5 and the candidate reference trajectory frame K6 are not in the same layer, so there is no need to match K5 and K6, thereby eliminating erroneous matching situations.
  • the candidate reference trajectory frame K11 which is the next trajectory frame to be matched, needs to be searched again.
  • K11 and K6 belong to the same layer, that is, calculate K11 Uphill and downhill conditions on the shortest topological path to K6. For example, K4-K8 dropped by 3m, K3-K9 dropped by 6m, and K5-K11 rose by 3m. Therefore, it can be judged that K11 and K6 are on the same floor. At this time, the reference trajectory frame K6 can be used as the current key frame K11 to be matched.
  • step (2) that is, use the local feature information of the parking lot to match K6 and K11, and after K6 and K11 become alignment frames that match the pose, Connect K6 and K11 in the topology diagram.
  • the local characteristic information of the parking lot may include traffic signs, wall markings, road markings, lane markings, etc.
  • the local characteristic information of the parking lot can be collected through vehicle-mounted sensors (such as image sensors, radar, etc.).
  • the current reference trajectory frame can be matched with the current trajectory frame to be matched based on the acquired local feature information of the parking lot. If the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the current If the local feature information of the parking lot corresponding to the trajectory frame to be matched is consistent, it is determined that the current reference trajectory frame and the current trajectory frame to be matched are successfully matched; if the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the current trajectory frame to be matched. If the local feature information of the parking lot is inconsistent, it is determined that the current reference trajectory frame and the current trajectory frame to be matched have failed to match.
  • the relative pose of the two is calculated to associate the two.
  • the current track frame to be matched that fails to match it will be temporarily stored, and after the traversal of all track frames to be matched is completed, the track frame to be matched that fails to match will be re-matched.
  • the posture of the vehicle is optimized by constructing a posture topology map and optimizing the posture topology map, so as to achieve posture alignment between the trajectory frame to be matched and the reference trajectory frame corresponding to the position where the match is successful. This can be achieved through the following steps 1 to 2:
  • the topology map shown in Figure 1b is used as the topology map corresponding to the current reference trajectory
  • the topology map shown in Figure 1c is used as the topology map corresponding to the current trajectory to be matched.
  • the nodes of the second topology graph corresponding to the current reference trajectory are each reference trajectory frame, and adjacent reference trajectory frames are connected by edges.
  • the nodes of the first topology graph corresponding to the current trajectory to be matched are each trajectory frame to be matched, and adjacent trajectory frames to be matched are connected by edges.
  • the first topology graph is optimized through the pose graph optimization method, and the optimized trajectory frame to be matched and the successfully matched reference trajectory frame are used as alignment frames, wherein, the aligned frame nodes in the first topology graph and the second topology graph are connected by edges.
  • the variable to be optimized represented by the node in Figure 1c that is, the vehicle pose
  • the trajectory frame for pose optimization is obtained from the 1st trajectory frame to be matched to the current Nth trajectory frame to be matched. is the optimized position corresponding to the first to N nodes, and the trajectory frames to be matched after the optimization of these N poses and the successfully matched reference trajectory frame can be used as alignment frames.
  • the vehicle poses in the trajectory to be matched and the reference trajectory can be accurately aligned, so that the reference trajectory and the trajectory to be matched are accurately associated together. , which solves the problem of insufficient data correlation.
  • the current trajectory frame to be matched and the corresponding current reference trajectory can be optimized.
  • the first relative pose between frames is the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot in each driving trajectory, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched. All reference trajectory frames in the current reference trajectory undergo pose optimization to achieve more accurate pose alignment between the reference trajectory and the trajectory to be matched.
  • Figure 1f is another topological diagram for matching a trajectory to be matched with a reference trajectory provided in Embodiment 1 of the present invention.
  • Figure 1f shows the further optimization process of the vehicle pose.
  • the trajectory frame K1 is the trajectory frame before entering the parking lot.
  • the reference trajectory frame K2 corresponding to the posture of the trajectory frame K1 to be matched within the first set distance range can be queried in the reference driving trajectory data1.
  • the matching is successful, calculate the relative pose of the vehicle corresponding to the K1 trajectory frame and the K2 trajectory frame, and after completing the calculation of the relative pose, pass Optimizing the first topology map and the second topology map can achieve a more accurate posture configuration between K1 and K2.
  • the current trajectory frame K1 to be matched and the corresponding reference trajectory frame K2 after pose optimization are the alignment frames.
  • the trajectory frame K1 to be matched and the trajectory frame K2 to be matched have been aligned.
  • the pose of the trajectory frame K1 to be matched has been optimized. Since the relative pose between the trajectory frame K1 to be matched and the adjacent trajectory frame K3 is fixed, after the pose of the trajectory frame K1 to be matched is adjusted, the adjacent trajectory frame K3 (solid black circle) According to the relative pose between it and K1, the pose can be updated to the black dotted circle, that is, the position of the adjacent trajectory frame K3 is adjusted.
  • trajectory frame K3 Use the posture-adjusted trajectory frame K3 as the new current trajectory frame to be matched, and search based on the position again to obtain the corresponding reference trajectory frame K4 in the reference trajectory, and use the local features of the parking lot to perform trajectory frame K4 and trajectory Match between frames K3, and calculate the relative pose after successful matching, so as to associate the trajectory frame K4 with the trajectory frame K3.
  • the above process is repeated for all subsequent trajectory frames to be matched until the processing of all frames to be matched is completed.
  • the predetermined number can be set according to the number of actually collected parking lot driving trajectories, for example, it can be set to the total number of collected parking lot driving trajectories, which is not specifically limited in this embodiment.
  • the technical solution provided by this embodiment is, in the process of matching the reference trajectories collected at different times with the trajectories to be matched, based on the alignment frames that match the reference trajectories and the vehicle poses in the trajectories to be matched, and each of the current trajectories to be matched.
  • the poses of each trajectory frame to be matched can be adjusted in turn, and the adjusted trajectory frames are combined with The position is aligned with the reference trajectory frame so that the driving trajectories collected multiple times can be accurately associated together.
  • the vehicle pose alignment can be made more accurate.
  • the method provided by this embodiment improves the efficiency and accuracy of parking lot data correlation.
  • Figure 2 is a flow chart of a parking lot data matching method provided in Embodiment 2 of the present invention. Based on the above embodiment, this embodiment performs a test on the situation where the current reference trajectory frame and the current trajectory frame to be matched fail to match. To refine, as shown in Figure 2, the method provided by this embodiment includes:
  • S200 Randomly select the vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, use one of the driving trajectories as the current reference trajectory, and use the other driving trajectory as the current trajectory to be matched.
  • step S230 Determine the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, and continue to step S250.
  • the pose graph optimization method for pose optimization when using the pose graph optimization method for pose optimization, by optimizing the pose of all successfully matched trajectory frames to be matched and all reference trajectory frames in the current reference trajectory, the current to-be-matched The trajectory frame is more accurately aligned with the current reference trajectory frame pose.
  • step S260 Based on the current alignment frame, adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame, and use the adjacent trajectory frame after the pose adjustment as the new current trajectory frame to be matched, and return to step S210 until After traversing all the trajectory frames to be matched in the current trajectory to be matched, the current alignment result corresponding to the current matching process is obtained, and step S270 is continued.
  • step S270 Traverse the temporarily stored target trajectory frames that fail to match in sequence. For any target trajectory frame that fails to match, obtain the optimized pose of the target trajectory frame, and return to step S210 until all temporarily stored failed matching targets are traversed. The target trajectory frame is obtained, the new current alignment result is obtained, and step S280 is continued.
  • the method provided in this embodiment further improves the efficiency and accuracy of parking lot data correlation.
  • Figure 3 is a structural block diagram of a parking lot data matching device provided in Embodiment 3 of the present invention. As shown in Figure 3, the device includes: a driving trajectory selection module 310, a matching module 320 and a data association module 330, where,
  • the driving trajectory selection module 310 is configured to arbitrarily select the vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, and use one of the driving trajectories as the current reference trajectory and the other driving trajectory as the current trajectory to be matched. , where each driving trajectory includes the trajectory before entering the parking lot, the trajectory in the parking lot, and the trajectory after exiting the parking lot;
  • the matching module 320 is configured to match the current reference trajectory with the current trajectory to be matched. During the matching process, based on the alignment frame matching the current reference trajectory with the vehicle pose in the current trajectory to be matched, the current trajectory to be matched. The relative pose between each trajectory frame to be matched, as well as the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot, adjust the pose of each trajectory frame to be matched in turn, and the adjusted trajectory frame Perform pose alignment with the corresponding reference trajectory frame in the current reference trajectory to obtain the current alignment result corresponding to the current matching process;
  • the data association module 330 is configured to use the driving trajectory corresponding to the current alignment result as a new current reference trajectory, select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as a new current trajectory to be matched, and return to perform a matching operation between the new current reference trajectory and the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed to obtain a target matching result of the vehicle posture.
  • matching module 320 includes:
  • the current reference trajectory frame determination unit is configured to sequentially traverse each trajectory frame to be matched in the current trajectory to be matched, and for each current trajectory frame to be matched, determine the position corresponding to the current trajectory frame to be matched in the current reference trajectory. the current reference trajectory frame;
  • a matching unit configured to match the current reference trajectory frame with the current trajectory frame to be matched
  • a relative pose determination unit configured to determine a first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame if the current reference trajectory frame matches the current trajectory frame to be matched successfully;
  • the first posture optimization unit is configured to be based on the first relative posture, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the space between each to-be-matched trajectory frame in the current driving trajectory to be matched.
  • For the second relative pose perform pose optimization on all successfully matched trajectory frames to be matched, and use the reference trajectory frame corresponding to the optimized trajectory frame to be matched and the position where the matching is successful as an alignment frame;
  • the pose alignment unit is configured to adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame based on the current alignment frame, and use the adjacent trajectory frame after the pose adjustment as the new current trajectory frame to be matched, and Return to perform the matching operation of matching the new current trajectory frame to be matched with the current reference trajectory frame corresponding to the position, until all trajectory frames to be matched in the current trajectory to be matched are traversed, and the current alignment result of the vehicle pose in the current matching process is obtained. .
  • the device provided by the embodiment of the present invention also includes:
  • the second pose optimization unit is configured to, after determining the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, based on the first relative pose, the vehicle entering the parking lot in each driving trajectory
  • the absolute position information before and after leaving the parking lot, the second relative pose between the trajectory frames to be matched in the current driving trajectory to be matched, the pose optimization of all reference trajectory frames in the current reference trajectory, and the pose The optimized trajectory frame to be matched and the optimized reference trajectory frame of the successfully matched pose are used as alignment frames.
  • matching units include:
  • the local feature information acquisition subunit is configured to acquire local feature information of the parking lot, where the local feature information includes: traffic signs, wall markings, road markings and lane markings;
  • the matching subunit is configured to determine that the current reference trajectory frame matches the current trajectory frame to be matched successfully if the parking lot local feature information corresponding to the current reference trajectory frame is consistent with the parking lot local feature information corresponding to the current trajectory frame to be matched; or
  • the parking lot local feature information corresponding to the current reference trajectory frame is inconsistent with the parking lot local feature information corresponding to the current trajectory frame to be matched, it is determined that the current reference trajectory frame fails to match the current trajectory frame to be matched.
  • the device provided by the embodiment of the present invention also includes:
  • the matching failed frame temporary storage module is configured to temporarily store the failed matching current trajectory frame to be matched if the current reference trajectory frame fails to match the current trajectory frame to be matched;
  • the re-matching module is configured to sequentially traverse the temporarily stored target trajectory frames that failed to match. For any target trajectory frame that failed to match, based on the optimized pose of the target trajectory frame, repeatedly execute the optimized target trajectory. The matching operation of the reference trajectory frame corresponding to the frame and position is performed until all temporarily stored target trajectory frames that have failed to match are traversed and a new current alignment result is obtained;
  • the data association module is specifically configured as:
  • the reference trajectory is matched with the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
  • the current reference trajectory frame determination unit includes:
  • the first search subunit is configured to obtain the absolute position corresponding to the current trajectory frame to be matched when the current trajectory frame to be matched belongs to the trajectory before entering the parking lot or the trajectory after exiting the parking lot, and in the current reference trajectory, Search within the first set distance range from the absolute position to obtain the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched;
  • the second search subunit is configured to, in the case where the current trajectory frame to be matched belongs to the trajectory in the parking lot, based on the current location information corresponding to the current trajectory frame to be matched, in the current reference trajectory, the first distance from the current location information is Search within a certain distance range to obtain candidate reference trajectory frames;
  • the same layer determination subunit is configured to determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot;
  • the current reference trajectory frame determination subunit is configured to use the candidate reference trajectory frame as the position corresponding to the current trajectory frame to be matched if the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot.
  • the current reference trajectory frame is configured to use the candidate reference trajectory frame as the position corresponding to the current trajectory frame to be matched if the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot.
  • same-layer judgment subunits include:
  • a shortest topological path determination component configured to determine the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame
  • a slope segment detection component configured to detect whether there is a slope segment in the shortest topological path
  • the same layer determination component is configured to determine that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot if there is no slope segment in the shortest topological path; or,
  • the frame belongs to the same level of the parking lot; or,
  • the candidate reference trajectory frame and the current trajectory frame to be matched do not belong to the same layer of the parking lot.
  • the same layer determines the component, which is specifically configured as:
  • the road segment corresponding to the trajectory frame with a pitch angle greater than or equal to the preset angle is regarded as a slope segment, and the road segment corresponding to the trajectory frame with a pitch angle smaller than the preset angle is regarded as a non-slope segment.
  • the first attitude optimization unit is specifically configured as:
  • first topology graph corresponding to the current trajectory to be matched
  • second topology graph corresponding to the current reference trajectory
  • the nodes of the first topology graph are each trajectory frame to be matched, and adjacent trajectory frames to be matched are connected by edges
  • the nodes of the second topological graph are each reference trajectory frame, and adjacent reference trajectory frames are connected by edges;
  • the graph optimization method optimizes the first topology graph, and uses the optimized trajectory frame to be matched and the successfully matched reference trajectory frame as the alignment frame, where the alignment frame node in the first topology graph and the second topology graph Connected by edges.
  • the device provided in this embodiment also includes:
  • the initial optimization module is configured to optimize the first topological map and the second topological map respectively based on the absolute position information before entering the parking lot and after exiting the parking lot before matching the current reference trajectory with the current trajectory to be matched, so as to reduce the deviation in absolute position between the current trajectory to be matched and the current reference trajectory.
  • the vehicle pose corresponding to each reference trajectory frame or the vehicle pose corresponding to each trajectory frame to be matched is obtained through any of the following sensor data, or by fusing the following multiple sensor data:
  • IMU data Inertial measurement unit IMU data, image data, radar point cloud data and odometer data.
  • the parking lot data matching device provided by the embodiment of the present invention can execute the parking lot data matching method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method.
  • the parking lot data matching method provided by any embodiment of the present invention please refer to the parking lot data matching method provided by any embodiment of the present invention.
  • FIG 4 is a structural block diagram of an electronic device provided in Embodiment 4 of the present invention. As shown in Figure 4, the electronic device includes:
  • Memory 510 storing executable program code
  • processor 520 coupled to memory 510;
  • the processor 520 calls the executable program code stored in the memory 510 to execute the parking lot data matching method provided by any embodiment of the present invention.
  • another embodiment of the present invention provides a vehicle, which includes the device as described in any of the above embodiments, or includes the electronic device as described above.
  • FIG. 5 is a schematic diagram of a vehicle provided in Embodiment 5 of the present invention.
  • the vehicle includes a speed sensor 61, an ECU (Electronic Control Unit) 62, a GPS (Global Positioning System) positioning device 63, and a T-Box (Telematics Box). 64.
  • the speed sensor 61 is used to measure the vehicle speed and uses the vehicle speed as the empirical speed for model training;
  • the GPS positioning device 63 is used to obtain the current geographical location of the vehicle;
  • the T-Box64 can be used as a gateway to communicate with the server;
  • the ECU62 can perform the above-mentioned parking Field data matching method.
  • the vehicle may also include: a V2X (Vehicle-to-Everything) module 65, a radar 66 and a camera 67.
  • the V2X module 65 is used to communicate with other vehicles, roadside equipment, etc.; the radar 66 or the camera 67 is used to sense the road environment information in the front and/or other directions to obtain original point cloud data; the radar 66 and/or the camera 67 can be configured at the front and/or rear of the vehicle body.
  • V2X Vehicle-to-Everything
  • another embodiment of the present invention provides a storage medium on which executable instructions are stored. When executed by the processor, the instructions enable the processor to implement the parking lot data as described in any of the above embodiments. matching method.
  • modules in the device in the embodiment may be distributed in the device in the embodiment according to the description of the embodiment, or may be correspondingly changed and located in one or more devices different from this embodiment.
  • the modules of the above embodiments can be combined into one module, or further divided into multiple sub-modules.

Abstract

A parking lot data matching method and apparatus, a device, a medium, and a vehicle. The method comprises: randomly selecting, from parking lot traveling trajectories collected on multiple occasions, vehicle traveling trajectories collected on different occasions, taking one of the traveling trajectories as a current reference trajectory, and taking the other traveling trajectory as a current trajectory to be matched (S110); on the basis of alignment frames matched with vehicle poses in the current reference trajectory and the current trajectory to be matched, relative poses of trajectory frames to be matched, and an absolute position of a vehicle outside a parking lot, sequentially performing pose adjustment on the trajectory frames to be matched, and performing pose alignment on the pose-adjusted trajectory frames and a corresponding reference trajectory frame to obtain a current alignment result (S120); and returning to execute a matching operation between the current reference trajectory and the current trajectory to be matched until a predetermined number of parking lot traveling trajectory matching operations are completed (S130). Hence, the parking lot traveling trajectories collected on multiple occasions are quickly and accurately associated.

Description

一种停车场数据的匹配方法、装置、设备、介质及车辆A parking lot data matching method, device, equipment, medium and vehicle 技术领域Technical field
本发明实施例涉及自动驾驶技术领域,具体而言,涉及一种停车场数据的匹配方法、装置、设备、介质及车辆。Embodiments of the present invention relate to the field of automatic driving technology, and specifically to a parking lot data matching method, device, equipment, medium and vehicle.
背景技术Background technique
目前,无人驾驶车辆在停车场自主泊车和自动导航的功能越来越被重视,而实现停车场自主泊车和自动导航时需要依赖高精度地图,因此,对停车场进行精确地建图显得尤为重要。At present, the functions of autonomous parking and automatic navigation of driverless vehicles in parking lots are getting more and more attention. However, realizing autonomous parking and automatic navigation in parking lots requires relying on high-precision maps. Therefore, it is necessary to accurately map the parking lot. appears particularly important.
一个多层的大停车场往往需要多次采集数据才能完整覆盖。而停车场往往建在地下,没有GPS(Global Positioning System,全球定位系统)信号,且停车场多为多层,各层之间场景又非常相似,这给停车场建图带来了很大的困难。A large multi-story parking lot often requires multiple data collections to fully cover it. Parking lots are often built underground and do not have GPS (Global Positioning System) signals. Most parking lots are multi-story, and the scenes on each floor are very similar. This brings great difficulties to the parking lot mapping. difficulty.
相关技术中,对于多次采集的停车场数据,通常是通过人工的方式将各次采集的轨迹数据进行关联。由于多次采集数据中车辆轨迹帧的数据量较大,人工进行数据关联的方式效率和准确率均较为低下。In related technologies, for parking lot data collected multiple times, the trajectory data collected each time are usually correlated manually. Due to the large amount of data of vehicle trajectory frames in multiple collected data, the efficiency and accuracy of manual data association are relatively low.
发明内容Contents of the invention
本发明实施例提供一种停车场数据的匹配方法、装置、设备、介质及车辆,以实现对多次采集的停车场轨迹进行快速、准确地关联。Embodiments of the present invention provide a parking lot data matching method, device, equipment, medium and vehicle to realize rapid and accurate association of multiple collected parking lot trajectories.
具体技术方案如下:The specific technical solutions are as follows:
第一方面,本发明实施例提供了一种停车场数据的匹配方法,包括:In a first aspect, embodiments of the present invention provide a parking lot data matching method, including:
从多次采集的停车场行驶轨迹中任意选择不同次采集的车辆行驶轨迹,并将其中一个行驶轨迹作为当前参考轨迹,将另一个行驶轨迹作为当前待匹配轨迹,其中,各行驶轨迹中均包括进停车场前轨迹、停车场内轨迹和出停车场后轨迹;Randomly select the vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, and use one of the driving trajectories as the current reference trajectory and the other driving trajectory as the current trajectory to be matched, where each driving trajectory includes The trajectory before entering the parking lot, the trajectory in the parking lot and the trajectory after exiting the parking lot;
将当前参考轨迹与当前待匹配轨迹进行匹配,在匹配过程中,基于当前参考轨迹与当前待匹配轨迹中车辆位姿相匹配的对齐帧、当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与当前参考轨迹中对应的参考轨迹帧进行位姿对齐,得到当前匹配过程对应的当前对齐结果;Match the current reference trajectory with the current trajectory to be matched. During the matching process, based on the alignment frame matching the current reference trajectory and the vehicle pose in the current trajectory to be matched, and the relative relationship between each trajectory frame to be matched in the current trajectory to be matched. pose, as well as the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot, adjust the pose of each trajectory frame to be matched in turn, and compare the adjusted trajectory frame with the corresponding reference trajectory in the current reference trajectory The frame is aligned to pose and pose, and the current alignment result corresponding to the current matching process is obtained;
将当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得到车辆位姿的目标匹配结果。Use the driving trajectory corresponding to the current alignment result as the new current reference trajectory, and select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and return to execute the new current reference trajectory. The matching operation is performed with the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
通过上述方案可知,在将不同次采集的参考轨迹与待匹配轨迹进行匹配的过程中,基于参考轨迹与待匹配轨迹中车辆位姿相匹配的对齐帧、当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,可依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与位置相对应参考轨迹帧进行位姿对齐,以使得多次采集的行驶轨迹能够准确、快速地关联到一起。在关联过程中,通过对各个待匹配轨迹帧采用渐进式的位姿调整方式,可使得车辆位姿对齐得更加准确。Through the above scheme, it can be known that in the process of matching the reference trajectory collected at different times with the trajectory to be matched, based on the alignment frame that matches the reference trajectory with the vehicle posture in the trajectory to be matched, the relative posture between each trajectory frame to be matched in the current trajectory to be matched, and the absolute position information of the vehicle before entering the parking lot and after leaving the parking lot, the posture of each trajectory frame to be matched can be adjusted in turn, and the trajectory frame after posture adjustment is aligned with the reference trajectory frame with the corresponding position, so that the driving trajectories collected multiple times can be accurately and quickly associated together. In the association process, by using a progressive posture adjustment method for each trajectory frame to be matched, the vehicle posture alignment can be made more accurate.
可选的,基于当前参考轨迹与当前待匹配轨迹中车辆位姿相匹配的对齐帧、当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置 信息,依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与当前参考轨迹中对应的参考轨迹帧进行位姿对齐,得到当前匹配过程对应的当前对齐结果,包括:Optionally, based on the alignment frame that matches the current reference trajectory and the vehicle pose in the current trajectory to be matched, the relative pose between each trajectory frame to be matched in the current trajectory to be matched, and the vehicle before entering and exiting the parking lot. Based on the absolute position information after the field, the pose is adjusted for each trajectory frame to be matched in turn, and the pose is aligned with the corresponding reference trajectory frame in the current reference trajectory, and the current matching process corresponding to the current reference trajectory frame is obtained. Alignment results, including:
依次遍历当前待匹配轨迹中的各个待匹配轨迹帧,对于每个当前待匹配轨迹帧,在当前参考轨迹中确定与当前待匹配轨迹帧位置相对应的当前参考轨迹帧;Traverse each to-be-matched trajectory frame in the current to-be-matched trajectory in sequence, and for each current to-be-matched trajectory frame, determine the current reference trajectory frame corresponding to the current to-be-matched trajectory frame position in the current reference trajectory;
将当前参考轨迹帧与当前待匹配轨迹帧进行匹配;Match the current reference trajectory frame with the current trajectory frame to be matched;
如果匹配成功,则确定当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿;If the matching is successful, determine the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame;
基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位置相对应的参考轨迹帧作为对齐帧;Based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched, the successful matching All matched trajectory frames to be matched are optimized in pose, and the reference trajectory frame corresponding to the optimized trajectory frame to be matched and the position where the matching is successful is used as an alignment frame;
基于当前对齐帧,调整与当前对齐帧相邻的待匹配轨迹帧的位姿,并将位姿调整后的相邻轨迹帧作为新的当前待匹配轨迹帧,并返回执行将新的当前待匹配轨迹帧与位置相对应的当前参考轨迹帧的匹配操作,直到遍历完当前待匹配轨迹中所有的待匹配轨迹帧,得到当前匹配过程中车辆位姿的当前对齐结果。Based on the current alignment frame, adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame, and use the adjusted adjacent trajectory frame as the new current trajectory frame to be matched, and return to execute the new current trajectory frame to be matched. The matching operation of the trajectory frame and the current reference trajectory frame corresponding to the position is performed until all the trajectory frames to be matched in the current trajectory to be matched are traversed, and the current alignment result of the vehicle pose in the current matching process is obtained.
可选的,在确定当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿之后,本发明实施例提供的方法还包括:Optionally, after determining the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, the method provided by the embodiment of the present invention further includes:
基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对当前参考轨迹中的所有参考轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位姿优化后的参考轨迹帧作为对齐帧。Based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched, the current reference All reference trajectory frames in the trajectory are optimized for pose, and the optimized trajectory frame to be matched and the reference trajectory frame after successful matching are used as alignment frames.
通过上述技术方案可知,在对当前待匹配轨迹帧对应的拓扑图进行优化时,可同时对当前参考轨迹中的所有参考轨迹帧进行位姿优化,从而实现参考轨迹与待匹配轨迹之间更加精准地位姿对齐。It can be seen from the above technical solution that when optimizing the topology map corresponding to the current trajectory frame to be matched, the pose of all reference trajectory frames in the current reference trajectory can be optimized at the same time, thereby achieving a more accurate relationship between the reference trajectory and the trajectory to be matched. Position alignment.
可选的,将当前参考轨迹帧与当前待匹配轨迹帧进行匹配,包括:Optionally, match the current reference trajectory frame with the current trajectory frame to be matched, including:
获取停车场的局部特征信息,局部特征信息包括:交通标志牌、墙体标识、路面标识和车道线标识;Obtain local feature information of the parking lot, which includes: traffic signs, wall markings, road markings and lane markings;
如果当前参考轨迹帧所对应的停车场局部特征信息与当前待匹配轨迹帧所对应的停车场局部特征信息一致,则确述当前参考轨迹帧与当前待匹配轨迹帧匹配成功;或者,If the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched, it is confirmed that the current reference trajectory frame and the current trajectory frame to be matched are successfully matched; or,
如果当前参考轨迹帧所对应的停车场局部特征信息与当前待匹配轨迹帧所对应的停车场局部特征信息不一致,则确定当前参考轨迹帧与当前待匹配轨迹帧匹配失败。If the local feature information of the parking lot corresponding to the current reference trajectory frame is inconsistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched, it is determined that the matching between the current reference trajectory frame and the current trajectory frame to be matched fails.
可选的,本发明实施例提供的方法还包括:Optionally, the method provided by the embodiment of the present invention also includes:
如果当前参考轨迹帧与当前待匹配轨迹帧匹配失败,则将匹配失败的当前待匹配轨迹帧进行暂存;If the current reference trajectory frame fails to match the current trajectory frame to be matched, the current trajectory frame to be matched that fails to match is temporarily stored;
在得到当前对齐结果后,依次遍历暂存的匹配失败的目标轨迹帧,对于任意一个匹配失败的目标轨迹帧,基于该目标轨迹帧优化后的位姿,重复执行将位姿优化后的目标轨迹帧与位置相对应的参考轨迹帧的匹配操作,直到遍历完暂存的所有匹配失败的目标轨迹帧,得到新的当前对齐结果;After obtaining the current alignment result, the temporarily stored target trajectory frames that failed to match are traversed in sequence. For any target trajectory frame that fails to match, based on the optimized pose of the target trajectory frame, the target trajectory with the optimized pose is repeatedly executed. The matching operation of the reference trajectory frame corresponding to the frame and position is performed until all temporarily stored target trajectory frames that have failed to match are traversed and a new current alignment result is obtained;
相应的,将当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,包括:Accordingly, the driving trajectory corresponding to the current alignment result is used as the new current reference trajectory, and another unmatched driving trajectory is selected from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and the matching operation between the new current reference trajectory and the new current trajectory to be matched is returned, including:
将新的当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作。The driving trajectory corresponding to the new current alignment result is used as the new current reference trajectory, and another unmatched driving trajectory is selected from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and the matching operation between the new current reference trajectory and the new current trajectory to be matched is returned.
通过上述技术方案可知,通过将匹配失败的目标轨迹帧再次进行对应位置的参考轨迹帧的查询和匹配,可使得车辆位姿的对齐结果更加准确。It can be seen from the above technical solution that by querying and matching the reference trajectory frame of the corresponding position again with the failed target trajectory frame, the alignment result of the vehicle pose can be made more accurate.
可选的,在当前参考轨迹中确定与当前待匹配轨迹帧位置相对应的当前参考轨迹帧,包括:Optionally, determining a current reference trajectory frame corresponding to the position of the current trajectory frame to be matched in the current reference trajectory includes:
在当前待匹配轨迹帧属于进停车场前轨迹或出停车场后轨迹的情况下:When the current trajectory frame to be matched belongs to the trajectory before entering the parking lot or the trajectory after exiting the parking lot:
获取当前待匹配轨迹帧对应的绝对位置,并在当前参考轨迹中,在距离绝对位置第一设定距离范围内进行搜索,得到与该当前待匹配轨迹帧位置相对应的当前参考轨迹帧;Obtain the absolute position corresponding to the current trajectory frame to be matched, and search within the first set distance range from the absolute position in the current reference trajectory to obtain the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched;
或者,在当前待匹配轨迹帧属于停车场内轨迹的情况下:Or, when the current trajectory frame to be matched belongs to the trajectory in the parking lot:
根据当前待匹配轨迹帧对应的当前位置信息,在当前参考轨迹中,在距离当前位置信息第一设定距离范围内进行搜索,得到候选参考轨迹帧;According to the current position information corresponding to the current trajectory frame to be matched, in the current reference trajectory, search within the first set distance range from the current position information to obtain the candidate reference trajectory frame;
判断候选参考轨迹帧与当前待匹配轨迹帧是否属于停车场的同一层;Determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot;
如果属于同一层,则将候选参考轨迹帧作为与当前待匹配轨迹帧位置相对应的当前参考轨迹帧。If they belong to the same layer, the candidate reference trajectory frame is used as the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched.
可选的,判断候选参考轨迹帧与当前待匹配轨迹帧是否属于停车场的同一层,包括:Optionally, determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot, including:
确定从当前待匹配轨迹帧到候选参考轨迹帧的最短拓扑路径;Determine the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame;
检测最短拓扑路径中是否存在坡道路段;Detect whether there is a slope segment in the shortest topological path;
如果不存在坡道路段,则确定候选参考轨迹帧与所述当前待匹配轨迹帧属于停车场的同一层;或者,If there is no slope segment, determine that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot; or,
如果存在坡道路段,且如果坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值在第二设定距离范围内,则确定候选参考轨迹帧与当前待匹配轨迹帧属于停车场的同一层;或者,If there is a slope segment, and if the difference between the height information of the uphill segment and the height information of the downhill segment in the slope segment is within the second set distance range, it is determined that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the parking lot. of the same layer; or,
如果坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值超过第二设定距离范围,则确定候选参考轨迹帧与当前待匹配轨迹帧不属于停车场的同一层。If the difference between the height information of the uphill section and the height information of the downhill section in the slope section exceeds the second set distance range, it is determined that the candidate reference trajectory frame and the current trajectory frame to be matched do not belong to the same layer of the parking lot.
通过上述技术方案可知,通过确定当前待匹配轨迹帧到候选参考轨迹帧的最短拓扑路径,避免了从当前待匹配轨迹帧到候选参考轨迹帧之间各种路径之间的复杂情况。通过在最短拓扑路径中检测坡道路段,并根据坡道路段中上坡路段和下坡路段的高度信息,可有效判断出当前参考轨迹中的候选参考轨迹帧与当前待匹配轨迹帧是否属于同一层停车场,以避免出现不属于同一层停车场的轨迹帧错匹配的情况,解决了跨层数据错误关联的问题。It can be seen from the above technical solution that by determining the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame, complications between various paths from the current trajectory frame to be matched to the candidate reference trajectory frame are avoided. By detecting slope segments in the shortest topological path and based on the height information of the uphill and downhill segments in the slope segments, it can be effectively determined whether the candidate reference trajectory frame in the current reference trajectory and the current trajectory frame to be matched belong to the same parking level. field to avoid mismatching of trajectory frames that do not belong to the same parking lot, and solve the problem of incorrect correlation of cross-layer data.
可选的,检测最短拓扑路径中是否存在坡道路段,包括:Optionally, detect whether there are slope segments in the shortest topological path, including:
判断车辆相对于水平面的俯仰角是否大于预设角度;Determine whether the pitch angle of the vehicle relative to the horizontal plane is greater than the preset angle;
将俯仰角大于或等于预设角度的轨迹帧所对应的路段作为坡道路段,并将所述俯仰角小于预设角度的轨迹帧所对应的路段作为非坡道路段。The road segment corresponding to the trajectory frame with a pitch angle greater than or equal to the preset angle is regarded as a slope segment, and the road segment corresponding to the trajectory frame with the pitch angle smaller than the preset angle is regarded as a non-slope segment.
可选的,基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧进行位姿优化,包括:Optionally, based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched. , perform pose optimization on all successfully matched trajectory frames to be matched, including:
构建当前待匹配轨迹对应的第一拓扑图,以及当前参考轨迹对应的第二拓扑图,其中,第一拓扑图的节点是各待匹配轨迹帧,相邻待匹配轨迹帧之间用边连接,第二拓扑图的节点是各参考轨迹帧,相邻参考轨迹帧之间用边连接;Constructing a first topological graph corresponding to the current trajectory to be matched and a second topological graph corresponding to the current reference trajectory, wherein the nodes of the first topological graph are the trajectory frames to be matched, and adjacent trajectory frames to be matched are connected by edges, and the nodes of the second topological graph are the reference trajectory frames, and adjacent reference trajectory frames are connected by edges;
基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,通过位姿图优化方法对第一拓扑图进行优化,并将位姿优化后的待匹配轨迹帧与匹配成功的参考轨迹帧作为对齐帧,其中,第一拓扑图和第二拓扑图中的对齐帧节点之间用边连接。Based on the first relative posture, the absolute position information of the vehicle in each driving trajectory before entering and exiting the parking lot, and the second relative posture between each trajectory frame to be matched in the current driving trajectory to be matched, the first topological graph is optimized by a posture graph optimization method, and the trajectory frame to be matched after posture optimization and the successfully matched reference trajectory frame are used as alignment frames, wherein the alignment frame nodes in the first topological graph and the second topological graph are connected by edges.
上述技术方案中,通过采用位姿图(posegraph)优化方法对当前待匹配轨迹帧对应的拓扑图和参考轨迹对应的拓扑图进行优化,可使得车辆位姿能够得到精确的位姿配准,从而使待参考轨迹与待匹配轨迹准确地关联到一起,解决了数据关联度不足的问题。In the above technical solution, by using the posegraph optimization method to optimize the topology map corresponding to the current trajectory frame to be matched and the topology map corresponding to the reference trajectory, the vehicle pose can be accurately aligned, thereby The reference trajectory and the trajectory to be matched are accurately associated together, which solves the problem of insufficient data correlation.
可选的,在将当前参考轨迹与当前待匹配轨迹进行匹配之前,本发明实施例提供的方法还包括:Optionally, before matching the current reference trajectory with the current trajectory to be matched, the method provided by the embodiment of the present invention also includes:
基于在进停车场前和出停车场后的绝对位置信息,分别对第一拓扑图和第二拓扑图进行优化,以缩小当前待匹配轨迹与当前参考轨迹之间在绝对位置上的偏差。Based on the absolute position information before entering the parking lot and after exiting the parking lot, the first topology map and the second topology map are optimized respectively to reduce the deviation in absolute position between the current trajectory to be matched and the current reference trajectory.
可选的,各参考轨迹帧对应的车辆位姿或者各待匹配轨迹帧对应的车辆位姿均通过如下任意一种传感器数据得到,或者,通过将如下多种传感器数据进行融合的方式得到:Optionally, the vehicle pose corresponding to each reference trajectory frame or the vehicle pose corresponding to each trajectory frame to be matched is obtained through any of the following sensor data, or by fusing the following multiple sensor data:
惯性测量单元IMU数据、图像数据、雷达点云数据和里程计数据。Inertial measurement unit IMU data, image data, radar point cloud data and odometer data.
第二方面,本发明实施例还提供了一种停车场数据的匹配装置,包括:In a second aspect, embodiments of the present invention also provide a parking lot data matching device, including:
行驶轨迹选择模块,被配置为从多次采集的停车场行驶轨迹中任意选择不同次采集的车辆行驶轨迹,并将其中一个行驶轨迹作为当前参考轨迹,将另一个行驶轨迹作为当前待匹配轨迹,其中,各行驶轨迹中均包括进停车场前轨迹、停车场内轨迹和出停车场后轨迹;A driving trajectory selection module is configured to arbitrarily select vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, and use one of the driving trajectories as the current reference trajectory and another driving trajectory as the current trajectory to be matched, wherein each driving trajectory includes a trajectory before entering the parking lot, a trajectory in the parking lot, and a trajectory after leaving the parking lot;
匹配模块,被配置为将当前参考轨迹与当前待匹配轨迹进行匹配,在匹配过程中,基于当前参考轨迹与所述当前待匹配轨迹中车辆位姿相匹配的对齐帧、当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与所述当前参考轨迹中对应的参考轨迹帧进行位姿对齐,得到当前匹配过程对应的当前对齐结果;The matching module is configured to match the current reference trajectory with the current trajectory to be matched. During the matching process, based on the alignment frame matching the current reference trajectory with the vehicle pose in the current trajectory to be matched, each of the current trajectories to be matched. The relative pose between the trajectory frames to be matched, as well as the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot, adjust the pose of each trajectory frame to be matched in turn, and compare the adjusted trajectory frame with The corresponding reference trajectory frames in the current reference trajectory are pose aligned to obtain the current alignment result corresponding to the current matching process;
数据关联模块,被配置为将当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得到车辆位姿的目标匹配结果。The data association module is configured to use the driving trajectory corresponding to the current alignment result as the new current reference trajectory, and select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and Return to perform the matching operation of the new current reference trajectory and the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
可选的,匹配模块,包括:Optional matching modules include:
当前参考轨迹帧确定单元,被配置为依次遍历当前待匹配轨迹中的各个待匹配轨迹帧,对于每个当前待匹配轨迹帧,在当前参考轨迹中确定与所述当前待匹配轨迹帧位置相对应的当前参考轨迹帧;The current reference trajectory frame determination unit is configured to sequentially traverse each trajectory frame to be matched in the current trajectory to be matched, and for each current trajectory frame to be matched, determine the position corresponding to the current trajectory frame to be matched in the current reference trajectory. The current reference trajectory frame;
匹配单元,被配置为将当前参考轨迹帧与当前待匹配轨迹帧进行匹配;A matching unit configured to match the current reference trajectory frame with the current trajectory frame to be matched;
相对位姿确定单元,被配置为如果当前参考轨迹帧与所述当前待匹配轨迹帧匹配成功,则确定当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿;A relative pose determination unit configured to determine a first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame if the current reference trajectory frame matches the current trajectory frame to be matched successfully;
第一位姿优化单元,被配置为基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位置相对应的参考轨迹帧作为对齐帧;The first posture optimization unit is configured to be based on the first relative posture, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the space between each to-be-matched trajectory frame in the current driving trajectory to be matched. For the second relative pose, perform pose optimization on all successfully matched trajectory frames to be matched, and use the reference trajectory frame corresponding to the optimized trajectory frame to be matched and the position where the matching is successful as an alignment frame;
位姿对齐单元,被配置为基于当前对齐帧,调整与当前对齐帧相邻的待匹配轨迹帧的位姿,并将位姿调整后的相邻轨迹帧作为新的当前待匹配轨迹帧,并返回执行将新的当前待匹配轨迹帧与位置相对应的当前参考轨迹帧的匹配操作,直到遍历完当前待匹配轨迹中所有的待匹配轨迹帧,得到当前匹配过程中车辆位姿的当前对齐结果。The pose alignment unit is configured to adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame based on the current alignment frame, and use the adjacent trajectory frame after the pose adjustment as the new current trajectory frame to be matched, and Return to perform the matching operation of matching the new current trajectory frame to be matched with the current reference trajectory frame corresponding to the position, until all trajectory frames to be matched in the current trajectory to be matched are traversed, and the current alignment result of the vehicle pose in the current matching process is obtained. .
可选的,本发明实施例提供的装置还包括:Optionally, the device provided by the embodiment of the present invention also includes:
第二位姿优化单元,被配置为在确定当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿之后,基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对当前参考轨迹中的所有参考轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位姿优化后的参考轨迹帧作为对齐帧。The second pose optimization unit is configured to, after determining the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, based on the first relative pose, the vehicle entering the parking lot in each driving trajectory The absolute position information before and after leaving the parking lot, the second relative pose between the trajectory frames to be matched in the current driving trajectory to be matched, the pose optimization of all reference trajectory frames in the current reference trajectory, and the pose The optimized trajectory frame to be matched and the optimized reference trajectory frame of the successfully matched pose are used as alignment frames.
可选的,匹配单元,包括:Optional, matching units include:
局部特征信息获取子单元,被配置为获取停车场的局部特征信息,所述局部特征信息包括:交通标志牌、墙体标识、路面标识和车道线标识;The local feature information acquisition subunit is configured to acquire local feature information of the parking lot, where the local feature information includes: traffic signs, wall markings, road markings and lane markings;
匹配子单元,被配置为如果当前参考轨迹帧所对应的停车场局部特征信息与当前待匹配轨迹帧所对应的停车场局部特征信息一致,则确定当前参考轨迹帧与当前待匹配轨迹帧匹配成功;或者,The matching subunit is configured to determine that the current reference trajectory frame and the current trajectory frame to be matched are successfully matched if the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched. ;or,
如果当前参考轨迹帧所对应的停车场局部特征信息与当前待匹配轨迹帧所对应的停车场局部特征信息不一致,则确定当前参考轨迹帧与当前待匹配轨迹帧匹配失败。If the local feature information of the parking lot corresponding to the current reference trajectory frame is inconsistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched, it is determined that the matching between the current reference trajectory frame and the current trajectory frame to be matched fails.
可选的,本发明实施例提供的装置还包括:Optionally, the device provided by the embodiment of the present invention also includes:
匹配失败帧暂存模块,被配置为如果当前参考轨迹帧与当前待匹配轨迹帧匹配失败,则将匹配失败的当前待匹配轨迹帧进行暂存;The matching failed frame temporary storage module is configured to temporarily store the failed matching current trajectory frame to be matched if the current reference trajectory frame fails to match the current trajectory frame to be matched;
重新匹配模块,被配置为依次遍历暂存的匹配失败的目标轨迹帧,对于任意一个匹配失 败的目标轨迹帧,基于该目标轨迹帧优化后的位姿,重复执行将位姿优化后的目标轨迹帧与位置相对应的参考轨迹帧的匹配操作,直到遍历完暂存的所有匹配失败的目标轨迹帧,得到新的当前对齐结果;The re-matching module is configured to sequentially traverse the temporarily stored target trajectory frames that failed to match. For any target trajectory frame that failed to match, based on the optimized pose of the target trajectory frame, repeatedly execute the optimized target trajectory. The matching operation of the reference trajectory frame corresponding to the frame and position is performed until all temporarily stored target trajectory frames that have failed to match are traversed and a new current alignment result is obtained;
相应的,数据关联模块,具体被配置为:Correspondingly, the data association module is specifically configured as:
将新的当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得到车辆位姿的目标匹配结果。Use the driving trajectory corresponding to the new current alignment result as the new current reference trajectory, and select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and return to execute the new current trajectory. The reference trajectory is matched with the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
可选的,当前参考轨迹帧确定单元,包括:Optional, the current reference trajectory frame determination unit includes:
第一搜索子单元,被配置为在当前待匹配轨迹帧属于进停车场前轨迹或出停车场后轨迹的情况下,获取当前待匹配轨迹帧对应的绝对位置,并在当前参考轨迹中,在距离绝对位置第一设定距离范围内进行搜索,得到与该当前待匹配轨迹帧位置相对应的当前参考轨迹帧;The first search subunit is configured to obtain the absolute position corresponding to the current trajectory frame to be matched when the current trajectory frame to be matched belongs to the trajectory before entering the parking lot or the trajectory after exiting the parking lot, and in the current reference trajectory, Search within the first set distance range from the absolute position to obtain the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched;
或者,or,
第二搜索子单元,被配置为在当前待匹配轨迹帧属于停车场内轨迹的情况下,根据当前待匹配轨迹帧对应的当前位置信息,在当前参考轨迹中,在距离当前位置信息第一设定距离范围内进行搜索,得到候选参考轨迹帧;The second search subunit is configured to, in the case where the current trajectory frame to be matched belongs to the trajectory in the parking lot, based on the current location information corresponding to the current trajectory frame to be matched, in the current reference trajectory, the first distance from the current location information is Search within a certain distance range to obtain candidate reference trajectory frames;
同层判断子单元,被配置为判断候选参考轨迹帧与所述当前待匹配轨迹帧是否属于停车场的同一层;The same layer determination subunit is configured to determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot;
当前参考轨迹帧确定子单元,被配置为如果候选参考轨迹帧与所述当前待匹配轨迹帧属于停车场的同一层,则将候选参考轨迹帧作为与所述当前待匹配轨迹帧位置相对应的当前参考轨迹帧。The current reference trajectory frame determination subunit is configured to use the candidate reference trajectory frame as the position corresponding to the current trajectory frame to be matched if the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot. The current reference trajectory frame.
可选的,同层判断子单元,包括:Optionally, the same-layer judgment subunit includes:
最短拓扑路径确定组件,被配置为确定从当前待匹配轨迹帧到所述候选参考轨迹帧的最短拓扑路径;a shortest topological path determination component configured to determine the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame;
坡道路段检测组件,被配置为检测最短拓扑路径中是否存在坡道路段;a slope segment detection component configured to detect whether there is a slope segment in the shortest topological path;
同层确定组件,被配置为如果最短拓扑路径中不存在坡道路段,则确定候选参考轨迹帧与当前待匹配轨迹帧属于停车场的同一层;The same layer determination component is configured to determine that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot if there is no slope segment in the shortest topological path;
或者,如果最短拓扑路径中存在坡道路段,且如果坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值在第二设定距离范围内,则确定候选参考轨迹帧与当前待匹配轨迹帧属于停车场的同一层;Alternatively, if there is a ramp section in the shortest topological path, and if the difference between the height information of the uphill section and the height information of the downhill section in the ramp section is within a second set distance range, it is determined that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot;
或者,如果坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值超过第二设定距离范围,则确定候选参考轨迹帧与当前待匹配轨迹帧不属于停车场的同一层。Alternatively, if the difference between the height information of the uphill section and the height information of the downhill section in the slope section exceeds the second set distance range, it is determined that the candidate reference trajectory frame and the current trajectory frame to be matched do not belong to the same layer of the parking lot.
可选的,同层确定组件,具体被配置为:Optional, the same layer determines the component, which is specifically configured as:
判断车辆相对于水平面的俯仰角是否大于预设角度;Determine whether the pitch angle of the vehicle relative to the horizontal plane is greater than the preset angle;
将俯仰角大于或等于预设角度的轨迹帧所对应的路段作为坡道路段,并将俯仰角小于预设角度的轨迹帧所对应的路段作为非坡道路段。The road segment corresponding to the trajectory frame with a pitch angle greater than or equal to the preset angle is regarded as a slope segment, and the road segment corresponding to the trajectory frame with a pitch angle smaller than the preset angle is regarded as a non-slope segment.
可选的,第一位姿优化单元,具体被配置为:Optional, the first attitude optimization unit is specifically configured as:
构建当前待匹配轨迹对应的第一拓扑图,以及当前参考轨迹对应的第二拓扑图,其中,第一拓扑图的节点是各待匹配轨迹帧,相邻待匹配轨迹帧之间用边连接,第二拓扑图的节点是各参考轨迹帧,相邻参考轨迹帧之间用边连接;Constructing a first topological graph corresponding to the current trajectory to be matched and a second topological graph corresponding to the current reference trajectory, wherein the nodes of the first topological graph are the trajectory frames to be matched, and adjacent trajectory frames to be matched are connected by edges, and the nodes of the second topological graph are the reference trajectory frames, and adjacent reference trajectory frames are connected by edges;
基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,通过位姿图优化方法对第一拓扑图进行优化,并将位姿优化后的待匹配轨迹帧与匹配成功的参考轨迹帧作为对齐帧,其中,第一拓扑图和第二拓扑图中的对齐帧节点之间用边连接。Based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched, through the pose The graph optimization method optimizes the first topology graph, and uses the optimized trajectory frame to be matched and the successfully matched reference trajectory frame as the alignment frame, where the alignment frame node in the first topology graph and the second topology graph is Connected by edges.
可选的,本实施例提供的装置还包括:Optionally, the device provided in this embodiment also includes:
初始优化模块,被配置为在将当前参考轨迹与当前待匹配轨迹进行匹配之前,基于在进停车场前和出停车场后的绝对位置信息,分别对第一拓扑图和第二拓扑图进行优化,以缩小 当前待匹配轨迹与当前参考轨迹之间在绝对位置上的偏差。The initial optimization module is configured to optimize the first topology map and the second topology map respectively based on the absolute position information before entering the parking lot and after exiting the parking lot before matching the current reference trajectory with the current trajectory to be matched. , to reduce the absolute position deviation between the current trajectory to be matched and the current reference trajectory.
可选的,各参考轨迹帧对应的车辆位姿或者各待匹配轨迹帧对应的车辆位姿均通过如下任意一种传感器数据得到,或者,通过将如下多种传感器数据进行融合的方式得到:Optionally, the vehicle pose corresponding to each reference trajectory frame or the vehicle pose corresponding to each trajectory frame to be matched is obtained through any of the following sensor data, or by fusing the following multiple sensor data:
惯性测量单元IMU数据、图像数据、雷达点云数据和里程计数据。Inertial measurement unit IMU data, image data, radar point cloud data and odometer data.
第三方面,本发明实施例提供了一种电子设备,该电子设备包括:In a third aspect, an embodiment of the present invention provides an electronic device, which includes:
一个或多个处理器;one or more processors;
存储装置,用于存储一个或多个程序,a storage device for storing one or more programs,
当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如本发明任意实施例所提供的停车场数据的匹配方法。When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the matching method of parking lot data as provided in any embodiment of the present invention.
第四方面,本发明实施例提供了一种存储介质,其上存储有计算机程序,其特征在于,所述程序被处理器执行时实现如本发明任意实施例所提供的停车场数据的匹配方法。In a fourth aspect, embodiments of the present invention provide a storage medium on which a computer program is stored, characterized in that when the program is executed by a processor, the parking lot data matching method as provided in any embodiment of the present invention is implemented. .
第五方面,本发明实施例提供了一种车辆,该车辆包含本发明任意实施例所提供的停车场数据的匹配装置,或者包含本发明任意实施例所提供的电子设备。In a fifth aspect, embodiments of the present invention provide a vehicle, which includes the parking lot data matching device provided by any embodiment of the present invention, or the electronic device provided by any embodiment of the present invention.
第六方面,本发明实施例提供了一种计算机程序,所述计算机程序包括程序指令,该程序指令被计算机执行时实现如本发明任意实施例所提供的停车场数据的匹配方法。In a sixth aspect, an embodiment of the present invention provides a computer program. The computer program includes program instructions. When the program instructions are executed by a computer, the parking lot data matching method provided by any embodiment of the present invention is implemented.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.
图1a为本发明实施例一提供的一种停车场数据的匹配方法的流程图;Figure 1a is a flow chart of a parking lot data matching method provided in Embodiment 1 of the present invention;
图1b为本发明实施例一提供的包含有地下一层停车场的车辆行驶轨迹的拓扑图;FIG1b is a topological diagram of vehicle driving trajectories including a first-floor underground parking lot provided in Embodiment 1 of the present invention;
图1c为本发明实施例一提供的包含有地下二层停车场的车辆行驶轨迹的拓扑图;Figure 1c is a topological diagram of vehicle driving trajectories including a two-story underground parking lot provided by Embodiment 1 of the present invention;
图1d为本发明实施例一提供的将参考行驶轨迹和待匹配轨迹进行初始位姿优化后的拓扑图;FIG. 1d is a topological diagram after initial posture optimization of the reference driving trajectory and the trajectory to be matched provided by the first embodiment of the present invention;
图1e为本发明实施例一提供的一种将待匹配轨迹与参考轨迹进行匹配的拓扑图;Figure 1e is a topological diagram for matching a trajectory to be matched with a reference trajectory provided in Embodiment 1 of the present invention;
图1f为本发明实施例一提供的又一种将待匹配轨迹与参考轨迹进行匹配的拓扑图;Figure 1f is another topological diagram for matching a trajectory to be matched with a reference trajectory provided by Embodiment 1 of the present invention;
图2为本发明实施例二提供的一种停车场数据的匹配方法的流程图;FIG2 is a flow chart of a parking lot data matching method provided by Embodiment 2 of the present invention;
图3为本发明实施例三提供的一种停车场数据的匹配装置的结构框图;Figure 3 is a structural block diagram of a parking lot data matching device provided in Embodiment 3 of the present invention;
图4为本发明实施例四提供的一种电子设备的结构框图;Figure 4 is a structural block diagram of an electronic device provided in Embodiment 4 of the present invention;
图5为本发明实施例五提供的一种车辆的示意图。Figure 5 is a schematic diagram of a vehicle provided in Embodiment 5 of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有付出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without exerting creative efforts fall within the scope of protection of the present invention.
需要说明的是,本发明实施例及附图中的术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present invention and the drawings are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes Other steps or units inherent to such processes, methods, products or devices.
本发明实施例公开了一种停车场数据的匹配方法、装置、设备、介质及车辆。以下分别进行详细说明。The embodiment of the invention discloses a parking lot data matching method, device, equipment, medium and vehicle. Each is explained in detail below.
实施例一Embodiment 1
图1a为本发明实施例一提供的一种停车场数据的匹配方法的流程图,该方法可应用于车载电脑、车载工业控制计算机(Industrial personal Computer,IPC)等车载终端,也可应用于服务器,本发明实施例对此不做限定。本实施例提供的方法可应用于将多次采集的多层停车 场行驶轨迹进行关联的应用场景下。本实施例提供的方法可由停车场数据的匹配装置来执行,该装置可通过软件和/或硬件的方式实现。如图1a所示,本实施例提供的方法具体包括:Figure 1a is a flow chart of a parking lot data matching method provided in Embodiment 1 of the present invention. This method can be applied to vehicle-mounted computers, vehicle-mounted industrial personal computers (IPC) and other vehicle-mounted terminals, and can also be applied to servers. , the embodiment of the present invention does not limit this. The method provided in this embodiment can be applied to the application scenario of correlating the driving trajectories of multi-story parking lots collected multiple times. The method provided in this embodiment can be executed by a parking lot data matching device, which can be implemented by software and/or hardware. As shown in Figure 1a, the method provided by this embodiment specifically includes:
S110、从多次采集的停车场行驶轨迹中任意选择不同次采集的车辆行驶轨迹,并将其中一个行驶轨迹作为当前参考轨迹,将另一个行驶轨迹作为当前待匹配轨迹。S110: Randomly select vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, use one of the driving trajectories as the current reference trajectory, and use the other driving trajectory as the current trajectory to be matched.
其中,不同次采集的车辆行驶轨迹中,各帧轨迹所对应的车辆位姿可通过车载传感器采集得到,或者,也可通过将多种传感器数据进行融合的方式得到。其中,车载传感器可以包括惯性测量单元(Inertial Measurement Unit,IMU)、图像传感器、雷达和里程计等。Among the vehicle driving trajectories collected at different times, the vehicle pose corresponding to each frame trajectory can be obtained by collecting vehicle-mounted sensors, or can also be obtained by fusing multiple sensor data. Among them, vehicle-mounted sensors can include inertial measurement units (Inertial Measurement Unit, IMU), image sensors, radars and odometers, etc.
本实施例中,多次采集的车辆行驶轨迹均包括进停车场前的行驶轨迹、在停车场内的行驶轨迹和出停车场后的行驶轨迹。其中,车辆在进入停车场之前以及从停车场出来后都会存在GPS(Global Positioning System,全球定位系统)信号。进停车场前轨迹、停车场内部行驶轨迹和出停车场后轨迹这三段轨迹是连续的轨迹。通过对进出停车场的这两段轨迹施加GPS约束,同时利用三段轨迹的连续性可以使整个轨迹获得绝对位置在米级的定位精度。In this embodiment, the vehicle driving trajectories collected multiple times include the driving trajectory before entering the parking lot, the driving trajectory in the parking lot, and the driving trajectory after leaving the parking lot. Among them, there will be GPS (Global Positioning System) signals before the vehicle enters the parking lot and after it comes out of the parking lot. The three trajectories before entering the parking lot, the driving trajectory inside the parking lot, and the trajectory after leaving the parking lot are continuous trajectories. By applying GPS constraints to the two trajectories of entering and leaving the parking lot, and using the continuity of the three trajectories, the entire trajectory can obtain an absolute position positioning accuracy of meters.
本实施例中,将当前参考轨迹与当前待匹配轨迹进行匹配实际上是将当前参考轨迹与当前待匹配轨迹帧中各个轨迹帧对应的车辆位姿进行匹配,并通过优化车辆位姿来将各帧待匹配轨迹与对应位置的参考轨迹实现位姿对齐。为了减少计算量,可从当前参考轨迹中选择出多个关键帧作为参考轨迹帧,并可从当前待匹配轨迹中选择出多个关键帧作为待匹配轨迹帧。其中,各个关键帧的选择可以为:将行驶距离为预设距离的轨迹帧作为关键帧。其中,预设距离可以为1~3米范围内的任意一个距离。In this embodiment, matching the current reference trajectory with the current trajectory to be matched actually means matching the current reference trajectory with the vehicle pose corresponding to each trajectory frame in the current trajectory frame to be matched, and optimizing the vehicle pose to optimize the vehicle pose. The frame to be matched trajectory is aligned with the reference trajectory at the corresponding position. In order to reduce the amount of calculation, multiple key frames can be selected from the current reference trajectory as reference trajectory frames, and multiple key frames can be selected from the current trajectory to be matched as trajectory frames to be matched. Among them, the selection of each key frame may be: use the trajectory frame whose driving distance is the preset distance as the key frame. Among them, the preset distance can be any distance within the range of 1 to 3 meters.
本实施例中,为了实现当前参考轨迹与当前待匹配轨迹之间位姿的准确对齐,可对各参考轨迹帧与各待匹配轨迹帧的位姿分别进行初始优化。具体的,可构建当前待匹配轨迹对应的第一拓扑图,以及当前参考轨迹对应的第二拓扑图,其中,第一拓扑图的节点是各待匹配轨迹帧,相邻待匹配轨迹帧之间用边连接,第二拓扑图的节点是各参考轨迹帧,相邻参考轨迹帧之间用边连接。在将当前参考轨迹与当前待匹配轨迹进行匹配之前,基于在进停车场前和出停车场后的绝对位置信息,分别对第一拓扑图和第二拓扑图进行优化,可缩小当前待匹配轨迹与当前参考轨迹之间在绝对位置上的偏差。In this embodiment, in order to achieve accurate alignment of poses between the current reference trajectory and the current trajectory to be matched, the poses of each reference trajectory frame and each trajectory frame to be matched may be initially optimized respectively. Specifically, a first topology graph corresponding to the current trajectory to be matched and a second topology graph corresponding to the current reference trajectory can be constructed, where the nodes of the first topology graph are each trajectory frame to be matched, and the nodes between adjacent trajectory frames to be matched are They are connected by edges. The nodes of the second topology graph are each reference trajectory frame, and adjacent reference trajectory frames are connected by edges. Before matching the current reference trajectory with the current trajectory to be matched, the first topology map and the second topology map are optimized respectively based on the absolute position information before entering the parking lot and after exiting the parking lot, which can reduce the current trajectory to be matched. Deviation in absolute position from the current reference trajectory.
具体的,图1b为本发明实施例一提供的包含有地下一层停车场(B1)的车辆行驶轨迹的拓扑图,图1c为本发明实施例一提供的包含有地下二层停车场(B2)的车辆行驶轨迹的拓扑图。如图1b和1c所示,各行驶轨迹中的节点为车辆行驶轨迹帧,即优化变量。相邻节点之间用边连接,且相邻节点之间通过相对位姿进行约束。在进停车场前和出停车场后通过GPS量测产生的GPS信号进行约束。将图1b和图1c中的其中一个行驶轨迹作为待匹配轨迹,另一个行驶轨迹作为参考轨迹,图1d为本发明实施例一提供的将参考行驶轨迹和待匹配轨迹进行初始位姿优化后的拓扑图。通过对图1b和图1c进行位姿图优化(posegraph)后,可实现对车辆位姿的初始优化,以缩小待匹配轨迹与参考轨迹之间在绝对位置上的偏差。如图1d所示,在完成初始优化后,参考行驶轨迹和待匹配轨迹中的各个轨迹帧的节点之间并未完全对齐,二者位置上仍有米级误差,因此需通过后续步骤对各轨迹帧进行位姿调整,以实现待匹配轨迹帧与参考轨迹帧中各轨迹帧之间的位姿对齐。Specifically, Figure 1b is a topological diagram of a vehicle driving trajectory including a one-story underground parking lot (B1) provided in Embodiment 1 of the present invention, and Figure 1c is a topological diagram of a vehicle driving trajectory including a second-level underground parking lot (B2) provided in Embodiment 1 of the present invention. ) is a topological map of the vehicle's trajectory. As shown in Figures 1b and 1c, the nodes in each driving trajectory are vehicle driving trajectory frames, that is, optimization variables. Adjacent nodes are connected by edges, and adjacent nodes are constrained by relative poses. The GPS signal generated by GPS measurement is constrained before entering the parking lot and after exiting the parking lot. One of the driving trajectories in Figure 1b and Figure 1c is used as the trajectory to be matched, and the other driving trajectory is used as the reference trajectory. Figure 1d shows the reference driving trajectory and the trajectory to be matched after optimizing the initial pose provided by Embodiment 1 of the present invention. Topology. By optimizing the pose graph of Figure 1b and Figure 1c, the initial optimization of the vehicle pose can be achieved to reduce the deviation in absolute position between the trajectory to be matched and the reference trajectory. As shown in Figure 1d, after the initial optimization is completed, the nodes of each trajectory frame in the reference driving trajectory and the trajectory to be matched are not completely aligned, and there are still meter-level errors in their positions. Therefore, subsequent steps need to be carried out to The trajectory frame is adjusted in pose to achieve pose alignment between the trajectory frame to be matched and the reference trajectory frame.
S120、将当前参考轨迹与当前待匹配轨迹进行匹配,在匹配过程中,基于当前参考轨迹与当前待匹配轨迹中车辆位姿相匹配的对齐帧、当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与当前参考轨迹中对应的参考轨迹帧进行位姿对齐,得到当前匹配过程对应的当前对齐结果。S120. Match the current reference trajectory with the current trajectory to be matched. During the matching process, based on the alignment frame that matches the current reference trajectory and the vehicle pose in the current trajectory to be matched, the alignment frame between each trajectory frame to be matched in the current trajectory to be matched. The relative pose of the vehicle, as well as the absolute position information of the vehicle before entering the parking lot and after leaving the parking lot, adjust the pose of each trajectory frame to be matched in turn, and compare the adjusted trajectory frame with the corresponding one in the current reference trajectory. Perform pose alignment with reference to the trajectory frame, and obtain the current alignment result corresponding to the current matching process.
本实施例中,对于待匹配轨迹中的每个待匹配轨迹帧,可通过渐进式优化的方式,对各个待匹配轨迹帧进行位姿优化。具体的,可通过如下步骤(一)~(三)来实现。In this embodiment, for each trajectory frame to be matched in the trajectory to be matched, the pose of each trajectory frame to be matched can be optimized through progressive optimization. Specifically, this can be achieved through the following steps (1) to (3).
(一)依次遍历当前待匹配轨迹中的各个待匹配轨迹帧,对于每个当前待匹配轨迹帧,在当前参考轨迹中确定与当前待匹配轨迹帧位置相对应的当前参考轨迹帧。(1) Sequentially traverse each trajectory frame to be matched in the current trajectory to be matched, and for each current trajectory frame to be matched, determine the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched in the current reference trajectory.
其中,与当前待匹配轨迹帧位置相对应的当前参考轨迹帧是指与当前待匹配轨迹帧属于同一层停车场且与当前待匹配轨迹帧位置接近,即距离在第一设定距离范围内的参考轨迹帧。 满足上述条件的参考轨迹帧的个数可以为一个,也可以为多个。Wherein, the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched means that it belongs to the same parking lot as the current trajectory frame to be matched and is close to the location of the current trajectory frame to be matched, that is, the distance is within the first set distance range. Reference trajectory frame. The number of reference trajectory frames that meet the above conditions can be one or multiple.
本实施例中,当前待匹配轨迹帧可以是属于进停车场前轨迹或出停车场后轨迹,或者,也可以是属于停车场内轨迹。In this embodiment, the current trajectory frame to be matched may belong to the trajectory before entering the parking lot or the trajectory after exiting the parking lot, or may also belong to the trajectory within the parking lot.
其中,在当前待匹配轨迹帧属于进停车场前轨迹或出停车场后轨迹的情况下,由于车辆可基于接收到的GPS信号确定车辆的绝对位置信息,因此可直接根据绝对位置信息进行位置相对应的参考轨迹帧的搜索,具体可通过如下方式来实现:Among them, when the current trajectory frame to be matched belongs to the trajectory before entering the parking lot or the trajectory after exiting the parking lot, since the vehicle can determine the absolute position information of the vehicle based on the received GPS signal, the position can be directly compared based on the absolute position information. The search for the corresponding reference trajectory frame can be implemented in the following ways:
获取当前待匹配轨迹帧对应的绝对位置,并在当前参考轨迹中,在距离绝对位置第一设定距离范围内进行搜索,得到与该当前待匹配轨迹帧位置相对应的当前参考轨迹帧。其中,第一设定距离范围可以为8~12米。Obtain the absolute position corresponding to the current trajectory frame to be matched, and search within the first set distance range from the absolute position in the current reference trajectory to obtain the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched. Among them, the first set distance range may be 8 to 12 meters.
或者,在当前待匹配轨迹帧属于停车场内轨迹的情况下,车辆无法接收到GPS信号,或者接收到的GPS信号较弱,此时,可通过如下步骤A~C来确定与当前轨迹帧位置相对应的当前参考轨迹帧。Or, when the current trajectory frame to be matched belongs to the trajectory in the parking lot, the vehicle cannot receive the GPS signal, or the received GPS signal is weak. At this time, the following steps A to C can be used to determine the position of the current trajectory frame. The corresponding current reference trajectory frame.
A、根据当前待匹配轨迹帧对应的当前位置信息,在当前参考轨迹中,在距离当前位置信息第一设定距离范围内进行搜索,得到候选参考轨迹帧。A. According to the current position information corresponding to the current trajectory frame to be matched, in the current reference trajectory, search within the first set distance range from the current position information to obtain the candidate reference trajectory frame.
B、判断候选参考轨迹帧与当前待匹配轨迹帧是否属于停车场的同一层,如果属于同一层,则将候选参考轨迹帧作为与当前轨迹帧位置相对应的当前参考轨迹帧。B. Determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot. If they belong to the same layer, use the candidate reference trajectory frame as the current reference trajectory frame corresponding to the current trajectory frame position.
其中,判断候选参考轨迹帧与当前待匹配轨迹帧是否属于停车场的同一层的方式有多种,本实施例采用的是从最短拓扑路径中检测坡道路段,并通过判断坡道路段中上坡路段和下坡路段高度差的方式来判断候选参考轨迹帧与当前待匹配轨迹帧是否属于停车场的同一层,具体可通过如下方式来实现:Among them, there are many ways to determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot. This embodiment uses the method of detecting the slope segment from the shortest topological path and determining the uphill road in the slope segment. The height difference between the segment and the downhill segment is used to determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot. This can be achieved in the following ways:
确定从当前待匹配轨迹帧到候选参考轨迹帧的最短拓扑路径;检测最短拓扑路径中是否存在坡道路段;如果不存在坡道路段,则确定候选参考轨迹帧与当前待匹配轨迹帧属于停车场的同一层;或者,如果存在坡道路段,且如果坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值在第二设定距离范围内,则确定候选参考轨迹帧与当前待匹配轨迹帧属于停车场的同一层;或者,如果坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值超过第二设定距离范围,则确定候选参考轨迹帧与当前待匹配轨迹帧不属于停车场的同一层。其中,第二设定距离范围可以为3~5米。Determine the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame; detect whether there is a slope segment in the shortest topology path; if there is no slope segment, determine that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the parking lot on the same layer; or, if there is a slope segment, and if the difference between the height information of the uphill segment and the height information of the downhill segment in the slope segment is within the second set distance range, determine the candidate reference trajectory frame and the current waiting The matching trajectory frame belongs to the same layer of the parking lot; or, if the difference between the height information of the uphill section and the height information of the downhill section in the slope section exceeds the second set distance range, determine the candidate reference trajectory frame and the current trajectory to be matched The frame does not belong to the same level of the parking lot. Among them, the second set distance range may be 3 to 5 meters.
本实施例中,是否为坡道路段可通过车辆相对于水平面的俯仰角来确定,具体可将俯仰角大于或等于预设角度的轨迹帧所对应的路段作为坡道路段,并将俯仰角小于预设角度的轨迹帧所对应的路段作为非坡道路段。其中,预设角度所在的范围可以是5°~10°。车辆相对于水平面的俯仰角可通过IMU来确定,或者也可基于多传感器融合后的数据确定车辆的姿态,从而确定该姿态相对于水平面的车辆俯仰角。其中,多传感器可以包括IMU、里程计和图像传感器等。In this embodiment, whether it is a slope segment can be determined by the pitch angle of the vehicle relative to the horizontal plane. Specifically, the segment corresponding to the trajectory frame whose pitch angle is greater than or equal to the preset angle can be regarded as the slope segment, and the pitch angle is less than The road segment corresponding to the trajectory frame at the preset angle is regarded as a non-slope segment. The range of the preset angle may be 5° to 10°. The pitch angle of the vehicle relative to the horizontal plane can be determined by the IMU, or the attitude of the vehicle can also be determined based on the fused data of multiple sensors, thereby determining the pitch angle of the vehicle relative to the horizontal plane. Among them, multi-sensors can include IMU, odometer, image sensor, etc.
本实施例中,上坡路段的高度信息或者下坡路段的高度信息,可根据车辆在坡道路段顶部的车辆位姿与车辆在坡道路段底部的车辆位姿之间的高度差来计算。In this embodiment, the height information of the uphill section or the height information of the downhill section can be calculated based on the height difference between the vehicle posture at the top of the ramp section and the vehicle posture at the bottom of the ramp section.
本实施例中,对于与当前待匹配轨迹属于同一层停车场的候选参考轨迹帧,将其作为与当前待匹配轨迹帧位置相对应的当前参考轨迹帧。对于与当前待匹配轨迹不属于同一层停车场的候选参考轨迹帧,则不与当前待匹配轨迹进行匹配。在这种情况下,继续向后遍历下一个新的待匹配轨迹帧,并返回执行确定与新的当前待匹配轨迹帧位置相对应的当前参考轨迹帧的操作,即返回执行步骤(一)的操作。In this embodiment, a candidate reference trajectory frame that belongs to the same parking lot as the current trajectory to be matched is used as the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched. For candidate reference trajectory frames that do not belong to the same parking lot level as the current trajectory to be matched, they will not be matched with the current trajectory to be matched. In this case, continue to traverse backward to the next new trajectory frame to be matched, and return to perform the operation of determining the current reference trajectory frame corresponding to the position of the new current trajectory frame to be matched, that is, return to step (1) operate.
例如,图1e为本发明实施例一提供的一种将待匹配轨迹与参考轨迹进行匹配的拓扑图。如图1e所示,K2、K4、K8、K7和K6是当前参考轨迹中的参考轨迹帧。K1、K3、K9、K10、K5和K11是当前待匹配待轨迹中的待匹配轨迹帧,其中,K1和K2,K3和K4是位姿已对齐的对齐帧。在渐进式定位匹配过程中由于进入到停车场内部后无法接收到GPS信号,因此车辆轨迹在绝对位置上会有明显的漂移,甚至会产生错层。如图1e中的K5和K6,由于K5所在的轨迹逐渐漂移,其位置与K6很近,会导致两者错误的关联,这种情况会导致整个建图失败。为了避免这一问题,在每次发起两帧匹配时需要从拓扑图中查询两者之间的最短拓 扑路径,例如K5与K6之间的最短拓扑路径path_0为:K5-K10-K9-K3-K4-K8-K7-K6。For example, Figure 1e is a topological diagram for matching a trajectory to be matched with a reference trajectory provided in Embodiment 1 of the present invention. As shown in Figure 1e, K2, K4, K8, K7 and K6 are the reference trajectory frames in the current reference trajectory. K1, K3, K9, K10, K5 and K11 are the trajectory frames to be matched in the current trajectory to be matched, where K1 and K2, K3 and K4 are alignment frames whose poses have been aligned. During the progressive positioning matching process, since the GPS signal cannot be received after entering the parking lot, the vehicle trajectory will obviously drift in the absolute position, and may even cause misalignment. As shown in Figure 1e, K5 and K6, because the trajectory of K5 gradually drifts, its position is very close to K6, which will lead to an erroneous correlation between the two. This situation will cause the entire mapping to fail. In order to avoid this problem, each time two frame matching is initiated, the shortest topological path between the two needs to be queried from the topology map. For example, the shortest topological path path_0 between K5 and K6 is: K5-K10-K9-K3- K4-K8-K7-K6.
在最短拓扑路径path_0中根据待匹配轨迹帧的姿态查询出最短拓扑路径上的上下坡情况。如图1e中K3-K9是从停车场外直接下到了B2层,例如下降了6m,K4-K8是从停车场外下降到了B1层,例如下降了3m,那么可以判断出当前待匹配轨迹帧K5和候选参考轨迹帧K6不在同一层,则不需要对K5和K6进行匹配,从而排除了错误的匹配情况。此时,需对当前待匹配轨迹帧的下一个待匹配轨迹帧K11再次进行候选参考轨迹帧的搜索,如果搜索到候选参考轨迹帧K6,则继续判断K11与K6是否属于同一层,即计算K11到K6中最短拓扑路径上的上下坡情况。例如,K4-K8下降3m,K3-K9下降6m,K5-K11又上升3m,因此可判断出K11和K6处在同一楼层,此时,可将参考轨迹帧K6作为与当前待匹配关键帧K11位置相对应的当前参考轨迹帧,并可继续执行下述步骤(二),即使用停车场局部特征信息对K6和K11进行匹配,并在K6和K11成为位姿相匹配的对齐帧后,在拓扑图中将K6和K11进行连接。In the shortest topological path path_0, the uphill and downhill conditions on the shortest topological path are queried based on the posture of the trajectory frame to be matched. As shown in Figure 1e, K3-K9 descended directly from outside the parking lot to the B2 floor, for example, they dropped 6m, and K4-K8 descended from outside the parking lot to the B1 floor, for example, they dropped 3m. Then the current trajectory frame to be matched can be determined. K5 and the candidate reference trajectory frame K6 are not in the same layer, so there is no need to match K5 and K6, thereby eliminating erroneous matching situations. At this time, the candidate reference trajectory frame K11, which is the next trajectory frame to be matched, needs to be searched again. If the candidate reference trajectory frame K6 is found, continue to determine whether K11 and K6 belong to the same layer, that is, calculate K11 Uphill and downhill conditions on the shortest topological path to K6. For example, K4-K8 dropped by 3m, K3-K9 dropped by 6m, and K5-K11 rose by 3m. Therefore, it can be judged that K11 and K6 are on the same floor. At this time, the reference trajectory frame K6 can be used as the current key frame K11 to be matched. The current reference trajectory frame corresponding to the position, and you can continue to perform the following step (2), that is, use the local feature information of the parking lot to match K6 and K11, and after K6 and K11 become alignment frames that match the pose, Connect K6 and K11 in the topology diagram.
本实施例中,通过确定当前待匹配轨迹帧到候选参考轨迹帧的最短拓扑路径,避免了从当前待匹配轨迹帧到候选参考轨迹帧之间各种路径之间的复杂情况。通过在最短拓扑路径中检测坡道路段,并根据坡道路段中上坡路段和下坡路段的高度信息,可有效判断出当前参考轨迹中的候选参考轨迹帧与当前待匹配轨迹帧是否属于同一层停车场,以避免出现不属于同一层停车场的轨迹帧错匹配的情况,解决了跨层数据错误关联的问题。In this embodiment, by determining the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame, complications between various paths from the current trajectory frame to be matched to the candidate reference trajectory frame are avoided. By detecting slope segments in the shortest topological path and based on the height information of the uphill and downhill segments in the slope segments, it can be effectively determined whether the candidate reference trajectory frame in the current reference trajectory and the current trajectory frame to be matched belong to the same parking level. field to avoid mismatching of trajectory frames that do not belong to the same parking lot, and solve the problem of incorrect correlation of cross-layer data.
(二)将当前参考轨迹帧与当前待匹配轨迹帧进行匹配,如果匹配成功,则确定当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿。(2) Match the current reference trajectory frame with the current trajectory frame to be matched. If the matching is successful, determine the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame.
本领域技术人员可以理解的是,车辆在同一层停车场中不同次行驶得到的车辆轨迹会存在位姿上的偏差,但不同行驶轨迹中位置相对应的轨迹帧所对应的停车场的局部特征信息是固定不变的。其中,停车场局部特征信息可包括交通标志牌、墙体标识、路面标识和车道线标识等。停车场局部特征信息可通过车载传感器(例如图像传感器、雷达等)采集得到。Those skilled in the art can understand that vehicle trajectories obtained by driving different times in the same parking lot will have deviations in posture, but the local characteristics of the parking lot corresponding to the corresponding trajectory frames in different driving trajectories Information is fixed. Among them, the local characteristic information of the parking lot may include traffic signs, wall markings, road markings, lane markings, etc. The local characteristic information of the parking lot can be collected through vehicle-mounted sensors (such as image sensors, radar, etc.).
基于上述原因,本实施例中,可基于获取到的停车场的局部特征信息,将当前参考轨迹帧与当前待匹配轨迹帧进行匹配,如果当前参考轨迹帧所对应的停车场局部特征信息与当前待匹配轨迹帧所对应的停车场局部特征信息一致,则确定当前参考轨迹帧与当前待匹配轨迹帧匹配成功;如果当前参考轨迹帧所对应的停车场局部特征信息与当前待匹配轨迹帧所对应的停车场局部特征信息不一致,则确定当前参考轨迹帧与当前待匹配轨迹帧匹配失败。Based on the above reasons, in this embodiment, the current reference trajectory frame can be matched with the current trajectory frame to be matched based on the acquired local feature information of the parking lot. If the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the current If the local feature information of the parking lot corresponding to the trajectory frame to be matched is consistent, it is determined that the current reference trajectory frame and the current trajectory frame to be matched are successfully matched; if the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the current trajectory frame to be matched. If the local feature information of the parking lot is inconsistent, it is determined that the current reference trajectory frame and the current trajectory frame to be matched have failed to match.
本实施例中,对于匹配成功的当前待匹配轨迹帧与对应的当前参考轨迹帧,会对上述两者进行相对位姿的计算,以将上述两者进行关联。对于匹配失败的当前待匹配轨迹帧,则会对其进行暂存,并在完成所有待匹配轨迹帧的遍历后,再对匹配失败的待匹配轨迹帧进行重新匹配。In this embodiment, for the successfully matched current to-be-matched trajectory frame and the corresponding current reference trajectory frame, the relative pose of the two is calculated to associate the two. For the current track frame to be matched that fails to match, it will be temporarily stored, and after the traversal of all track frames to be matched is completed, the track frame to be matched that fails to match will be re-matched.
(三)基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位置相对应的参考轨迹帧作为对齐帧。(3) Based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched, The pose is optimized for all the successfully matched trajectory frames to be matched, and the reference trajectory frame corresponding to the position of the optimized trajectory frame to be matched and the position where the matching is successful is used as an alignment frame.
本实施例中,通过构建位姿拓扑图,并通过对位姿拓扑图优化来对车辆的位姿进行优化,以实现将待匹配轨迹帧与匹配成功的位置相对应的参考轨迹帧进行位姿对齐。具体可通过如下步骤1~2来实现:In this embodiment, the posture of the vehicle is optimized by constructing a posture topology map and optimizing the posture topology map, so as to achieve posture alignment between the trajectory frame to be matched and the reference trajectory frame corresponding to the position where the match is successful. This can be achieved through the following steps 1 to 2:
1、构建当前待匹配轨迹对应的第一拓扑图,以及当前参考轨迹对应的第二拓扑图。1. Construct a first topological graph corresponding to the current trajectory to be matched and a second topological graph corresponding to the current reference trajectory.
例如,将图1b所示的拓扑图作为当前参考轨迹对应的拓扑图,将图1c所示的拓扑图作为当前待匹配轨迹对应的拓扑图。如图1b所示,当前参考轨迹对应的第二拓扑图的节点是各参考轨迹帧,相邻参考轨迹帧之间用边连接。如图1c所示,当前待匹配轨迹对应的第一拓扑图的节点是各待匹配轨迹帧,相邻待匹配轨迹帧之间用边连接,For example, the topology map shown in Figure 1b is used as the topology map corresponding to the current reference trajectory, and the topology map shown in Figure 1c is used as the topology map corresponding to the current trajectory to be matched. As shown in Figure 1b, the nodes of the second topology graph corresponding to the current reference trajectory are each reference trajectory frame, and adjacent reference trajectory frames are connected by edges. As shown in Figure 1c, the nodes of the first topology graph corresponding to the current trajectory to be matched are each trajectory frame to be matched, and adjacent trajectory frames to be matched are connected by edges.
2、基于当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,通过位姿图优化方法对第一拓扑图进行优化,并将位姿优化后的待匹配 轨迹帧与匹配成功的参考轨迹帧作为对齐帧,其中,第一拓扑图和第二拓扑图中的对齐帧节点之间用边连接。2. Based on the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the current driving trajectory to be matched. For the second relative pose between the trajectory frames to be matched, the first topology graph is optimized through the pose graph optimization method, and the optimized trajectory frame to be matched and the successfully matched reference trajectory frame are used as alignment frames, Wherein, the aligned frame nodes in the first topology graph and the second topology graph are connected by edges.
本实施例中,通过采用位姿图(posegraph)优化方法对当前待匹配轨迹帧对应的拓扑图进行优化,可对如图1c中节点表示的待优化变量,即车辆位姿进行优化。具体的,在优化过程中,如果当前遍历的是第N个待匹配轨迹帧,则进行位姿优化的轨迹帧是从第1个待匹配轨迹帧到当前第N个待匹配轨迹帧,得到的是第1个到N个节点对应的优化后的位置,并可将这N个位姿优化后的待匹配轨迹帧与匹配成功的参考轨迹帧作为对齐帧。本实施例中,通过采用位姿图优化的方式,可使得待匹配轨迹与参考轨迹中的车辆位姿能够得到精确的位姿配准,从而使待参考轨迹与待匹配轨迹准确地关联到一起,解决了数据关联度不足的问题。In this embodiment, by using a posegraph optimization method to optimize the topology graph corresponding to the current trajectory frame to be matched, the variable to be optimized represented by the node in Figure 1c, that is, the vehicle pose, can be optimized. Specifically, during the optimization process, if the current traversal is the Nth trajectory frame to be matched, the trajectory frame for pose optimization is obtained from the 1st trajectory frame to be matched to the current Nth trajectory frame to be matched. is the optimized position corresponding to the first to N nodes, and the trajectory frames to be matched after the optimization of these N poses and the successfully matched reference trajectory frame can be used as alignment frames. In this embodiment, by adopting the pose graph optimization method, the vehicle poses in the trajectory to be matched and the reference trajectory can be accurately aligned, so that the reference trajectory and the trajectory to be matched are accurately associated together. , which solves the problem of insufficient data correlation.
进一步的,为了使得当前待匹配轨迹帧与当前参考轨迹帧位姿对齐得更加准确,在对当前待匹配轨迹帧对应的拓扑图进行优化时,可基于当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对当前参考轨迹中的所有参考轨迹帧进行位姿优化,从而实现参考轨迹与待匹配轨迹之间更加精准地位姿对齐。Furthermore, in order to make the alignment of the current trajectory frame to be matched and the current reference trajectory frame more accurate, when optimizing the topology map corresponding to the current trajectory frame to be matched, the current trajectory frame to be matched and the corresponding current reference trajectory can be optimized. The first relative pose between frames is the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot in each driving trajectory, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched. All reference trajectory frames in the current reference trajectory undergo pose optimization to achieve more accurate pose alignment between the reference trajectory and the trajectory to be matched.
例如,图1f为本发明实施例一提供的又一种将待匹配轨迹与参考轨迹进行匹配的拓扑图。在图1d的基础上,图1f示出了对车辆位姿的进一步优化过程。对于当前待匹配轨迹data2中的第一个待匹配轨迹帧K1,该轨迹帧K1是进入停车场前的轨迹帧。根据轨迹帧K1在进入停车场前的绝对位置信息,可在参考行驶轨迹data1中查询到在第一设定距离范围内的与待匹配轨迹帧K1位姿相对应的参考轨迹帧K2。利用K1和K2对应的停车场局部特征信息,将K1和K2进行匹配,如果匹配成功,则计算K1轨迹帧和K2轨迹帧对应的车辆相对位姿,并在完成相对位姿的计算后,通过对第一拓扑图和第二拓扑图进行优化,可实现K1与K2之间更加精准地位姿配置。位姿优化后的当前待匹配轨迹帧K1和对应的参考轨迹帧K2即为对齐帧。在拓扑图中,将K1和K2对应的节点进行连接,使得当前待匹配轨迹data2和当前参考轨迹data1获得初始配准。For example, Figure 1f is another topological diagram for matching a trajectory to be matched with a reference trajectory provided in Embodiment 1 of the present invention. Based on Figure 1d, Figure 1f shows the further optimization process of the vehicle pose. For the first trajectory frame K1 to be matched in the current trajectory data2 to be matched, the trajectory frame K1 is the trajectory frame before entering the parking lot. According to the absolute position information of the trajectory frame K1 before entering the parking lot, the reference trajectory frame K2 corresponding to the posture of the trajectory frame K1 to be matched within the first set distance range can be queried in the reference driving trajectory data1. Use the local feature information of the parking lot corresponding to K1 and K2 to match K1 and K2. If the matching is successful, calculate the relative pose of the vehicle corresponding to the K1 trajectory frame and the K2 trajectory frame, and after completing the calculation of the relative pose, pass Optimizing the first topology map and the second topology map can achieve a more accurate posture configuration between K1 and K2. The current trajectory frame K1 to be matched and the corresponding reference trajectory frame K2 after pose optimization are the alignment frames. In the topology diagram, connect the nodes corresponding to K1 and K2 so that the current trajectory data2 to be matched and the current reference trajectory data1 obtain initial registration.
(四)基于当前对齐帧,调整与当前对齐帧相邻的待匹配轨迹帧的位姿,并将位姿调整后的相邻轨迹帧作为新的当前待匹配轨迹帧,并返回执行将新的当前待匹配轨迹帧与位置相对应的当前参考轨迹帧的匹配操作,直到遍历完当前待匹配轨迹中所有的待匹配轨迹帧,得到当前匹配过程中车辆位姿的当前对齐结果。(4) Based on the current alignment frame, adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame, and use the adjusted adjacent trajectory frame as the new current trajectory frame to be matched, and return to execute the new The matching operation of the current trajectory frame to be matched and the current reference trajectory frame corresponding to the position is performed until all the trajectory frames to be matched in the current trajectory to be matched are traversed, and the current alignment result of the vehicle pose in the current matching process is obtained.
本领域技术人员可以理解的是,由于同一个行驶轨迹帧中相邻两个轨迹帧之间的相对位姿是固定不变的,因此,当通过拓扑图优化得到当前遍历的第N个待匹配轨迹帧的优化后的位置后,与当前遍历的第N个待匹配轨迹帧相邻的下一个待匹配轨迹帧,即第N+1帧的位姿也需得到相应地调整,并将位姿调整后的第N+1个待匹配轨迹帧作为当前新的待匹配轨迹帧,并返回执行上述步骤(一)的操作,得到与该新的当前待匹配轨迹帧位置相对应的当前参考轨迹帧,并继续执行上述步骤(二)中将新的当前待匹配轨迹帧与位置相对应的当前参考轨迹帧的匹配操作,然后再继续执行步骤(三)和(四),直到遍历完当前待匹配轨迹中所有的待匹配轨迹帧,得到当前匹配过程中车辆位姿的当前对齐结果。Those skilled in the art can understand that since the relative pose between two adjacent trajectory frames in the same driving trajectory frame is fixed, when the Nth currently traversed to-be-matched object is obtained through topology graph optimization, After the optimized position of the trajectory frame, the next trajectory frame to be matched adjacent to the currently traversed Nth trajectory frame to be matched, that is, the pose of the N+1th frame also needs to be adjusted accordingly, and the pose is The adjusted N+1th trajectory frame to be matched is used as the current new trajectory frame to be matched, and the operation of step (1) above is returned to obtain the current reference trajectory frame corresponding to the position of the new current trajectory frame to be matched. , and continue to perform the matching operation of the new current trajectory frame to be matched with the current reference trajectory frame corresponding to the position in step (2) above, and then continue to perform steps (3) and (4) until the current trajectory frame to be matched is traversed. All the trajectory frames to be matched in the trajectory are used to obtain the current alignment result of the vehicle pose in the current matching process.
具体的,如图1f所示,待匹配轨迹帧K1和待匹配轨迹帧K2已经对齐,此时,待匹配轨迹帧K1的位姿已得到优化。由于待匹配轨迹帧K1与相邻的轨迹帧K3之间的相对位姿是固定不变的,因此,在待匹配轨迹帧K1的位姿调整后,相邻的轨迹帧K3(实心黑色圆)根据其与K1之间的相对位姿可以更新位姿到黑色虚线圆,即将相邻轨迹帧K3的位置进行调整。将位姿调整后的轨迹帧K3作为新的当前待匹配轨迹帧,并再次根据位置进行搜索,得到在参考轨迹中相对应的参考轨迹帧K4,并使用停车场局部特征进行轨迹帧K4和轨迹帧K3之间的匹配,并在匹配成功后进行相对位姿的计算,以实现将轨迹帧K4和轨迹帧K3进行关联。对于后续所有的待匹配轨迹帧均重复上述过程,直到完成所有待匹配帧的处理。Specifically, as shown in Figure 1f, the trajectory frame K1 to be matched and the trajectory frame K2 to be matched have been aligned. At this time, the pose of the trajectory frame K1 to be matched has been optimized. Since the relative pose between the trajectory frame K1 to be matched and the adjacent trajectory frame K3 is fixed, after the pose of the trajectory frame K1 to be matched is adjusted, the adjacent trajectory frame K3 (solid black circle) According to the relative pose between it and K1, the pose can be updated to the black dotted circle, that is, the position of the adjacent trajectory frame K3 is adjusted. Use the posture-adjusted trajectory frame K3 as the new current trajectory frame to be matched, and search based on the position again to obtain the corresponding reference trajectory frame K4 in the reference trajectory, and use the local features of the parking lot to perform trajectory frame K4 and trajectory Match between frames K3, and calculate the relative pose after successful matching, so as to associate the trajectory frame K4 with the trajectory frame K3. The above process is repeated for all subsequent trajectory frames to be matched until the processing of all frames to be matched is completed.
S130、将当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得 到车辆位姿的目标匹配结果。S130, taking the driving trajectory corresponding to the current alignment result as the new current reference trajectory, and selecting another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and returning to perform the matching operation between the new current reference trajectory and the new current trajectory to be matched, until a predetermined number of parking lot driving trajectory matching operations are completed, and obtaining a target matching result of the vehicle posture.
其中,预定数量可根据实际采集的停车场行驶轨迹的数量进行设置,例如可设置为所采集的停车场行驶轨迹的总数量,本实施例对此不作具体限定。The predetermined number can be set according to the number of actually collected parking lot driving trajectories, for example, it can be set to the total number of collected parking lot driving trajectories, which is not specifically limited in this embodiment.
本实施例提供的技术方案,在将不同次采集的参考轨迹与待匹配轨迹进行匹配的过程中,基于参考轨迹与待匹配轨迹中车辆位姿相匹配的对齐帧、当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,可依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与位置相对应参考轨迹帧进行位姿对齐,以使得多次采集的行驶轨迹能够准确地关联到一起。在关联过程中,通过对各个待匹配轨迹帧采用渐进式的位姿调整方式,可使得车辆位姿对齐得更加准确。相对于相关技术中人工进对多次采集的车场数据进行关联的方式,本实施例提供的方法提高了停车场数据关联的效率和准确率。The technical solution provided by this embodiment is, in the process of matching the reference trajectories collected at different times with the trajectories to be matched, based on the alignment frames that match the reference trajectories and the vehicle poses in the trajectories to be matched, and each of the current trajectories to be matched. By matching the relative poses between trajectory frames, as well as the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot, the poses of each trajectory frame to be matched can be adjusted in turn, and the adjusted trajectory frames are combined with The position is aligned with the reference trajectory frame so that the driving trajectories collected multiple times can be accurately associated together. During the association process, by adopting a progressive pose adjustment method for each trajectory frame to be matched, the vehicle pose alignment can be made more accurate. Compared with the method of manually correlating parking lot data collected multiple times in the related art, the method provided by this embodiment improves the efficiency and accuracy of parking lot data correlation.
实施例二Embodiment 2
图2为本发明实施例二提供的一种停车场数据的匹配方法的流程图,本实施例在上述实施例的基础上,对当前参考轨迹帧与当前待匹配轨迹帧匹配失败的情况进行了细化,如图2所示,本实施例提供的方法包括:Figure 2 is a flow chart of a parking lot data matching method provided in Embodiment 2 of the present invention. Based on the above embodiment, this embodiment performs a test on the situation where the current reference trajectory frame and the current trajectory frame to be matched fail to match. To refine, as shown in Figure 2, the method provided by this embodiment includes:
S200、从多次采集的停车场行驶轨迹中任意选择不同次采集的车辆行驶轨迹,并将其中一个行驶轨迹作为当前参考轨迹,将另一个行驶轨迹作为当前待匹配轨迹。S200: Randomly select the vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, use one of the driving trajectories as the current reference trajectory, and use the other driving trajectory as the current trajectory to be matched.
S210、将当前参考轨迹与当前待匹配轨迹进行匹配,在匹配过程中,依次遍历当前待匹配轨迹中的各个待匹配轨迹帧,对于每个当前待匹配轨迹帧,在当前参考轨迹中确定与当前待匹配轨迹帧位置相对应的当前参考轨迹帧。S210. Match the current reference trajectory with the current trajectory to be matched. During the matching process, traverse each trajectory frame to be matched in the current trajectory to be matched in sequence. For each current trajectory frame to be matched, determine the current reference trajectory and the current trajectory frame. The current reference trajectory frame corresponding to the position of the trajectory frame to be matched.
S220、将当前参考轨迹帧与当前待匹配轨迹帧进行匹配,判断二者是否匹配成功,若是,则执行步骤S230;否则,执行步骤S240。S220. Match the current reference trajectory frame with the current trajectory frame to be matched, and determine whether the two match successfully. If so, execute step S230; otherwise, execute step S240.
S230、确定当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿,继续执行步骤S250。S230: Determine the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, and continue to step S250.
S240、将匹配失败的当前待匹配轨迹帧进行暂存,继续执行步骤S270。S240: Temporarily store the current trajectory frame to be matched that fails to match, and continue to execute step S270.
S250、基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧,以及当前参考轨迹中的所有参考轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位姿优化后的参考轨迹帧作为对齐帧,继续执行步骤S260。S250. Based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched, All trajectory frames to be matched that have been successfully matched, as well as all reference trajectory frames in the current reference trajectory, are optimized for pose, and the optimized trajectory frames to be matched are aligned with the successfully matched reference trajectory frames after pose optimization. frame, continue to step S260.
本实施例中,在使用位姿图优化方法进行位姿优化时,通过对已成功匹配的所有待匹配轨迹帧,以及当前参考轨迹中的所有参考轨迹帧进行位姿优化,可使得当前待匹配轨迹帧与当前参考轨迹帧位姿对齐得更加准确。In this embodiment, when using the pose graph optimization method for pose optimization, by optimizing the pose of all successfully matched trajectory frames to be matched and all reference trajectory frames in the current reference trajectory, the current to-be-matched The trajectory frame is more accurately aligned with the current reference trajectory frame pose.
S260、基于当前对齐帧,调整与当前对齐帧相邻的待匹配轨迹帧的位姿,并将位姿调整后的相邻轨迹帧作为新的当前待匹配轨迹帧,并返回执行步骤S210,直到遍历完当前待匹配轨迹中所有的待匹配轨迹帧,得到当前匹配过程对应的当前对齐结果,继续执行步骤S270。S260. Based on the current alignment frame, adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame, and use the adjacent trajectory frame after the pose adjustment as the new current trajectory frame to be matched, and return to step S210 until After traversing all the trajectory frames to be matched in the current trajectory to be matched, the current alignment result corresponding to the current matching process is obtained, and step S270 is continued.
S270、依次遍历暂存的匹配失败的目标轨迹帧,对于任意一个匹配失败的目标轨迹帧,获取该目标轨迹帧优化后的位姿,并返回执行步骤S210,直到遍历完暂存的所有匹配失败的目标轨迹帧,得到新的当前对齐结果,继续执行步骤S280。S270. Traverse the temporarily stored target trajectory frames that fail to match in sequence. For any target trajectory frame that fails to match, obtain the optimized pose of the target trajectory frame, and return to step S210 until all temporarily stored failed matching targets are traversed. The target trajectory frame is obtained, the new current alignment result is obtained, and step S280 is continued.
S280、将新的当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,即返回执行步骤S210,直到遍历完所有的停车场行驶轨迹,得到车辆位姿的目标匹配结果。S280. Use the driving trajectory corresponding to the new current alignment result as the new current reference trajectory, select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and return to execute the new The matching operation between the current reference trajectory and the new current trajectory to be matched is to return to step S210 until all parking lot driving trajectories are traversed and the target matching result of the vehicle pose is obtained.
本实施例中,在完成当前参考轨迹与当前待匹配轨迹的匹配后,已经有很多待匹配帧实现了正确匹配,待匹配轨迹与参考轨迹之间的相对位姿比匹配之前更准确,基于此,通过将匹配失败的目标轨迹帧再次进行对应位置的参考轨迹帧的查询和匹配,可使得车辆位姿的对齐结果更加准确。此外,通过将每次得到的匹配结果作为新的参考轨迹,并重复执行将新的参考轨迹与新的待匹配轨迹进行匹配的方式,实现了将多次采集的行驶轨迹进行准确关联。 相对于相关技术中人工进对多次采集的车场数据进行关联的方式,本实施例提供的方法进一步提高了停车场数据关联的效率和准确率。In this embodiment, after completing the matching between the current reference trajectory and the current trajectory to be matched, many frames to be matched have been correctly matched. The relative pose between the trajectory to be matched and the reference trajectory is more accurate than before matching. Based on this , by querying and matching the reference trajectory frame of the corresponding position again for the target trajectory frame that failed to match, the alignment result of the vehicle pose can be made more accurate. In addition, by using the matching results obtained each time as a new reference trajectory and repeatedly matching the new reference trajectory with the new trajectory to be matched, the driving trajectories collected multiple times can be accurately associated. Compared with the method of manually correlating parking lot data collected multiple times in the related art, the method provided in this embodiment further improves the efficiency and accuracy of parking lot data correlation.
实施例三Embodiment 3
图3为本发明实施例三提供的一种停车场数据的匹配装置的结构框图,如图3所示,该装置包括:行驶轨迹选择模块310、匹配模块320和数据关联模块330,其中,Figure 3 is a structural block diagram of a parking lot data matching device provided in Embodiment 3 of the present invention. As shown in Figure 3, the device includes: a driving trajectory selection module 310, a matching module 320 and a data association module 330, where,
行驶轨迹选择模块310,被配置为从多次采集的停车场行驶轨迹中任意选择不同次采集的车辆行驶轨迹,并将其中一个行驶轨迹作为当前参考轨迹,将另一个行驶轨迹作为当前待匹配轨迹,其中,各行驶轨迹中均包括进停车场前轨迹、停车场内轨迹和出停车场后轨迹;The driving trajectory selection module 310 is configured to arbitrarily select the vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, and use one of the driving trajectories as the current reference trajectory and the other driving trajectory as the current trajectory to be matched. , where each driving trajectory includes the trajectory before entering the parking lot, the trajectory in the parking lot, and the trajectory after exiting the parking lot;
匹配模块320,被配置为将当前参考轨迹与当前待匹配轨迹进行匹配,在匹配过程中,基于当前参考轨迹与所述当前待匹配轨迹中车辆位姿相匹配的对齐帧、当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与所述当前参考轨迹中对应的参考轨迹帧进行位姿对齐,得到当前匹配过程对应的当前对齐结果;The matching module 320 is configured to match the current reference trajectory with the current trajectory to be matched. During the matching process, based on the alignment frame matching the current reference trajectory with the vehicle pose in the current trajectory to be matched, the current trajectory to be matched. The relative pose between each trajectory frame to be matched, as well as the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot, adjust the pose of each trajectory frame to be matched in turn, and the adjusted trajectory frame Perform pose alignment with the corresponding reference trajectory frame in the current reference trajectory to obtain the current alignment result corresponding to the current matching process;
数据关联模块330,被配置为将当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得到车辆位姿的目标匹配结果。The data association module 330 is configured to use the driving trajectory corresponding to the current alignment result as a new current reference trajectory, select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as a new current trajectory to be matched, and return to perform a matching operation between the new current reference trajectory and the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed to obtain a target matching result of the vehicle posture.
可选的,匹配模块320,包括:Optional, matching module 320 includes:
当前参考轨迹帧确定单元,被配置为依次遍历当前待匹配轨迹中的各个待匹配轨迹帧,对于每个当前待匹配轨迹帧,在当前参考轨迹中确定与所述当前待匹配轨迹帧位置相对应的当前参考轨迹帧;The current reference trajectory frame determination unit is configured to sequentially traverse each trajectory frame to be matched in the current trajectory to be matched, and for each current trajectory frame to be matched, determine the position corresponding to the current trajectory frame to be matched in the current reference trajectory. the current reference trajectory frame;
匹配单元,被配置为将当前参考轨迹帧与当前待匹配轨迹帧进行匹配;A matching unit configured to match the current reference trajectory frame with the current trajectory frame to be matched;
相对位姿确定单元,被配置为如果当前参考轨迹帧与所述当前待匹配轨迹帧匹配成功,则确定当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿;A relative pose determination unit configured to determine a first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame if the current reference trajectory frame matches the current trajectory frame to be matched successfully;
第一位姿优化单元,被配置为基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位置相对应的参考轨迹帧作为对齐帧;The first posture optimization unit is configured to be based on the first relative posture, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the space between each to-be-matched trajectory frame in the current driving trajectory to be matched. For the second relative pose, perform pose optimization on all successfully matched trajectory frames to be matched, and use the reference trajectory frame corresponding to the optimized trajectory frame to be matched and the position where the matching is successful as an alignment frame;
位姿对齐单元,被配置为基于当前对齐帧,调整与当前对齐帧相邻的待匹配轨迹帧的位姿,并将位姿调整后的相邻轨迹帧作为新的当前待匹配轨迹帧,并返回执行将新的当前待匹配轨迹帧与位置相对应的当前参考轨迹帧的匹配操作,直到遍历完当前待匹配轨迹中所有的待匹配轨迹帧,得到当前匹配过程中车辆位姿的当前对齐结果。The pose alignment unit is configured to adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame based on the current alignment frame, and use the adjacent trajectory frame after the pose adjustment as the new current trajectory frame to be matched, and Return to perform the matching operation of matching the new current trajectory frame to be matched with the current reference trajectory frame corresponding to the position, until all trajectory frames to be matched in the current trajectory to be matched are traversed, and the current alignment result of the vehicle pose in the current matching process is obtained. .
可选的,本发明实施例提供的装置还包括:Optionally, the device provided by the embodiment of the present invention also includes:
第二位姿优化单元,被配置为在确定当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿之后,基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对当前参考轨迹中的所有参考轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位姿优化后的参考轨迹帧作为对齐帧。The second pose optimization unit is configured to, after determining the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, based on the first relative pose, the vehicle entering the parking lot in each driving trajectory The absolute position information before and after leaving the parking lot, the second relative pose between the trajectory frames to be matched in the current driving trajectory to be matched, the pose optimization of all reference trajectory frames in the current reference trajectory, and the pose The optimized trajectory frame to be matched and the optimized reference trajectory frame of the successfully matched pose are used as alignment frames.
可选的,匹配单元,包括:Optional, matching units include:
局部特征信息获取子单元,被配置为获取停车场的局部特征信息,所述局部特征信息包括:交通标志牌、墙体标识、路面标识和车道线标识;The local feature information acquisition subunit is configured to acquire local feature information of the parking lot, where the local feature information includes: traffic signs, wall markings, road markings and lane markings;
匹配子单元,被配置为如果当前参考轨迹帧所对应的停车场局部特征信息与当前待匹配轨迹帧所对应的停车场局部特征信息一致,则确定当前参考轨迹帧与当前待匹配轨迹帧匹配成功;或者,The matching subunit is configured to determine that the current reference trajectory frame matches the current trajectory frame to be matched successfully if the parking lot local feature information corresponding to the current reference trajectory frame is consistent with the parking lot local feature information corresponding to the current trajectory frame to be matched; or
如果当前参考轨迹帧所对应的停车场局部特征信息与当前待匹配轨迹帧所对应的停车场局部特征信息不一致,则确定当前参考轨迹帧与当前待匹配轨迹帧匹配失败。If the parking lot local feature information corresponding to the current reference trajectory frame is inconsistent with the parking lot local feature information corresponding to the current trajectory frame to be matched, it is determined that the current reference trajectory frame fails to match the current trajectory frame to be matched.
可选的,本发明实施例提供的装置还包括:Optionally, the device provided by the embodiment of the present invention also includes:
匹配失败帧暂存模块,被配置为如果当前参考轨迹帧与当前待匹配轨迹帧匹配失败,则将匹配失败的当前待匹配轨迹帧进行暂存;The matching failed frame temporary storage module is configured to temporarily store the failed matching current trajectory frame to be matched if the current reference trajectory frame fails to match the current trajectory frame to be matched;
重新匹配模块,被配置为依次遍历暂存的匹配失败的目标轨迹帧,对于任意一个匹配失败的目标轨迹帧,基于该目标轨迹帧优化后的位姿,重复执行将位姿优化后的目标轨迹帧与位置相对应的参考轨迹帧的匹配操作,直到遍历完暂存的所有匹配失败的目标轨迹帧,得到新的当前对齐结果;The re-matching module is configured to sequentially traverse the temporarily stored target trajectory frames that failed to match. For any target trajectory frame that failed to match, based on the optimized pose of the target trajectory frame, repeatedly execute the optimized target trajectory. The matching operation of the reference trajectory frame corresponding to the frame and position is performed until all temporarily stored target trajectory frames that have failed to match are traversed and a new current alignment result is obtained;
相应的,数据关联模块,具体被配置为:Correspondingly, the data association module is specifically configured as:
将新的当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得到车辆位姿的目标匹配结果。Use the driving trajectory corresponding to the new current alignment result as the new current reference trajectory, and select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and return to execute the new current trajectory. The reference trajectory is matched with the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
可选的,当前参考轨迹帧确定单元,包括:Optional, the current reference trajectory frame determination unit includes:
第一搜索子单元,被配置为在当前待匹配轨迹帧属于进停车场前轨迹或出停车场后轨迹的情况下,获取当前待匹配轨迹帧对应的绝对位置,并在当前参考轨迹中,在距离绝对位置第一设定距离范围内进行搜索,得到与该当前待匹配轨迹帧位置相对应的当前参考轨迹帧;The first search subunit is configured to obtain the absolute position corresponding to the current trajectory frame to be matched when the current trajectory frame to be matched belongs to the trajectory before entering the parking lot or the trajectory after exiting the parking lot, and in the current reference trajectory, Search within the first set distance range from the absolute position to obtain the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched;
或者,or,
第二搜索子单元,被配置为在当前待匹配轨迹帧属于停车场内轨迹的情况下,根据当前待匹配轨迹帧对应的当前位置信息,在当前参考轨迹中,在距离当前位置信息第一设定距离范围内进行搜索,得到候选参考轨迹帧;The second search subunit is configured to, in the case where the current trajectory frame to be matched belongs to the trajectory in the parking lot, based on the current location information corresponding to the current trajectory frame to be matched, in the current reference trajectory, the first distance from the current location information is Search within a certain distance range to obtain candidate reference trajectory frames;
同层判断子单元,被配置为判断候选参考轨迹帧与所述当前待匹配轨迹帧是否属于停车场的同一层;The same layer determination subunit is configured to determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot;
当前参考轨迹帧确定子单元,被配置为如果候选参考轨迹帧与所述当前待匹配轨迹帧属于停车场的同一层,则将候选参考轨迹帧作为与所述当前待匹配轨迹帧位置相对应的当前参考轨迹帧。The current reference trajectory frame determination subunit is configured to use the candidate reference trajectory frame as the position corresponding to the current trajectory frame to be matched if the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot. The current reference trajectory frame.
可选的,同层判断子单元,包括:Optional, same-layer judgment subunits include:
最短拓扑路径确定组件,被配置为确定从当前待匹配轨迹帧到所述候选参考轨迹帧的最短拓扑路径;a shortest topological path determination component configured to determine the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame;
坡道路段检测组件,被配置为检测最短拓扑路径中是否存在坡道路段;a slope segment detection component configured to detect whether there is a slope segment in the shortest topological path;
同层确定组件,被配置为如果最短拓扑路径中不存在坡道路段,则确定候选参考轨迹帧与当前待匹配轨迹帧属于停车场的同一层;或者,The same layer determination component is configured to determine that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot if there is no slope segment in the shortest topological path; or,
如果最短拓扑路径中存在坡道路段,且如果坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值在第二设定距离范围内,则确定候选参考轨迹帧与当前待匹配轨迹帧属于停车场的同一层;或者,If there is a slope segment in the shortest topological path, and if the difference between the height information of the uphill segment and the height information of the downhill segment in the slope segment is within the second set distance range, determine the candidate reference trajectory frame and the current trajectory to be matched. The frame belongs to the same level of the parking lot; or,
如果坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值超过第二设定距离范围,则确定候选参考轨迹帧与当前待匹配轨迹帧不属于停车场的同一层。If the difference between the height information of the uphill section and the height information of the downhill section in the slope section exceeds the second set distance range, it is determined that the candidate reference trajectory frame and the current trajectory frame to be matched do not belong to the same layer of the parking lot.
可选的,同层确定组件,具体被配置为:Optional, the same layer determines the component, which is specifically configured as:
判断车辆相对于水平面的俯仰角是否大于预设角度;Determine whether the pitch angle of the vehicle relative to the horizontal plane is greater than a preset angle;
将俯仰角大于或等于预设角度的轨迹帧所对应的路段作为坡道路段,并将俯仰角小于预设角度的轨迹帧所对应的路段作为非坡道路段。The road segment corresponding to the trajectory frame with a pitch angle greater than or equal to the preset angle is regarded as a slope segment, and the road segment corresponding to the trajectory frame with a pitch angle smaller than the preset angle is regarded as a non-slope segment.
可选的,第一位姿优化单元,具体被配置为:Optional, the first attitude optimization unit is specifically configured as:
构建当前待匹配轨迹对应的第一拓扑图,以及当前参考轨迹对应的第二拓扑图,其中,第一拓扑图的节点是各待匹配轨迹帧,相邻待匹配轨迹帧之间用边连接,第二拓扑图的节点是各参考轨迹帧,相邻参考轨迹帧之间用边连接;Construct a first topology graph corresponding to the current trajectory to be matched, and a second topology graph corresponding to the current reference trajectory, where the nodes of the first topology graph are each trajectory frame to be matched, and adjacent trajectory frames to be matched are connected by edges, The nodes of the second topological graph are each reference trajectory frame, and adjacent reference trajectory frames are connected by edges;
基于第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,通过位姿图优化方法对第一拓扑图进行优化,并将位姿优化后的待匹配轨迹帧与匹配成功的参考轨迹帧作为对齐帧,其中,第一拓扑图和第二拓扑图中的对齐帧节点之间用边连接。Based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched, through the pose The graph optimization method optimizes the first topology graph, and uses the optimized trajectory frame to be matched and the successfully matched reference trajectory frame as the alignment frame, where the alignment frame node in the first topology graph and the second topology graph Connected by edges.
可选的,本实施例提供的装置还包括:Optionally, the device provided in this embodiment also includes:
初始优化模块,被配置为在将当前参考轨迹与当前待匹配轨迹进行匹配之前,基于在进停车场前和出停车场后的绝对位置信息,分别对第一拓扑图和第二拓扑图进行优化,以缩小当前待匹配轨迹与当前参考轨迹之间在绝对位置上的偏差。The initial optimization module is configured to optimize the first topological map and the second topological map respectively based on the absolute position information before entering the parking lot and after exiting the parking lot before matching the current reference trajectory with the current trajectory to be matched, so as to reduce the deviation in absolute position between the current trajectory to be matched and the current reference trajectory.
可选的,各参考轨迹帧对应的车辆位姿或者各待匹配轨迹帧对应的车辆位姿均通过如下任意一种传感器数据得到,或者,通过将如下多种传感器数据进行融合的方式得到:Optionally, the vehicle pose corresponding to each reference trajectory frame or the vehicle pose corresponding to each trajectory frame to be matched is obtained through any of the following sensor data, or by fusing the following multiple sensor data:
惯性测量单元IMU数据、图像数据、雷达点云数据和里程计数据。Inertial measurement unit IMU data, image data, radar point cloud data and odometer data.
本发明实施例所提供的停车场数据的匹配装置可执行本发明任意实施例所提供的停车场数据的匹配方法,具备执行方法相应的功能模块和有益效果。未在上述实施例中详尽描述的技术细节,可参见本发明任意实施例所提供的停车场数据的匹配方法。The parking lot data matching device provided by the embodiment of the present invention can execute the parking lot data matching method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method. For technical details that are not described in detail in the above embodiments, please refer to the parking lot data matching method provided by any embodiment of the present invention.
实施例四Embodiment 4
图4为本发明实施例四提供的一种电子设备的结构框图,如图4所示,该电子设备包括:Figure 4 is a structural block diagram of an electronic device provided in Embodiment 4 of the present invention. As shown in Figure 4, the electronic device includes:
存储有可执行程序代码的存储器510;Memory 510 storing executable program code;
与存储器510耦合的处理器520; processor 520 coupled to memory 510;
其中,处理器520调用存储器510中存储的可执行程序代码,执行本发明任意实施例所提供的停车场数据的匹配方法。The processor 520 calls the executable program code stored in the memory 510 to execute the parking lot data matching method provided by any embodiment of the present invention.
实施例五Embodiment 5
基于上述实施例,本发明的另一实施例提供了一种车辆,所述车辆包含如上述任一实施例所述的装置,或者包含如上所述的电子设备。Based on the above embodiments, another embodiment of the present invention provides a vehicle, which includes the device as described in any of the above embodiments, or includes the electronic device as described above.
图5为本发明实施例五提供的一种车辆的示意图。如图5所示,车辆包括速度传感器61、ECU(Electronic Control Unit,电子控制单元)62、GPS(Global Positioning System,全球定位系统)定位设备63、T-Box(Telematics Box,远程信息处理器)64。其中,速度传感器61用于测量车速,并将车速作为经验速度供模型训练使用;GPS定位设备63用于获取车辆的当前地理位置;T-Box64可以作为网关与服务器进行通信;ECU62可以执行上述停车场数据的匹配方法。Figure 5 is a schematic diagram of a vehicle provided in Embodiment 5 of the present invention. As shown in Figure 5, the vehicle includes a speed sensor 61, an ECU (Electronic Control Unit) 62, a GPS (Global Positioning System) positioning device 63, and a T-Box (Telematics Box). 64. Among them, the speed sensor 61 is used to measure the vehicle speed and uses the vehicle speed as the empirical speed for model training; the GPS positioning device 63 is used to obtain the current geographical location of the vehicle; the T-Box64 can be used as a gateway to communicate with the server; the ECU62 can perform the above-mentioned parking Field data matching method.
此外,该车辆还可以包括:V2X(Vehicle-to-Everything,车联网)模块65、雷达66和摄像头67。V2X模块65用于与其他车辆、路侧设备等进行通信;雷达66或摄像头67用于感知前方和/或其他方向的道路环境信息,得到原始点云数据;雷达66和/或摄像头67可以配置在车身前部和/或车身尾部。In addition, the vehicle may also include: a V2X (Vehicle-to-Everything) module 65, a radar 66 and a camera 67. The V2X module 65 is used to communicate with other vehicles, roadside equipment, etc.; the radar 66 or the camera 67 is used to sense the road environment information in the front and/or other directions to obtain original point cloud data; the radar 66 and/or the camera 67 can be configured at the front and/or rear of the vehicle body.
基于上述方法实施例,本发明的另一实施例提供了一种存储介质,其上存储有可执行指令,该指令被处理器执行时使处理器实现如上任一实施方式所述的停车场数据的匹配方法。Based on the above method embodiments, another embodiment of the present invention provides a storage medium on which executable instructions are stored. When executed by the processor, the instructions enable the processor to implement the parking lot data as described in any of the above embodiments. matching method.
本领域普通技术人员可以理解:附图只是一个实施例的示意图,附图中的模块或流程并不一定是实施本发明所必须的。Those of ordinary skill in the art can understand that the accompanying drawing is only a schematic diagram of an embodiment, and the modules or processes in the accompanying drawing are not necessarily necessary for implementing the present invention.
本领域普通技术人员可以理解:实施例中的装置中的模块可以按照实施例描述分布于实施例的装置中,也可以进行相应变化位于不同于本实施例的一个或多个装置中。上述实施例的模块可以合并为一个模块,也可以进一步拆分成多个子模块。Those of ordinary skill in the art can understand that the modules in the device in the embodiment may be distributed in the device in the embodiment according to the description of the embodiment, or may be correspondingly changed and located in one or more devices different from this embodiment. The modules of the above embodiments can be combined into one module, or further divided into multiple sub-modules.
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明实施例技术方案的精神和范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still be used Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent substitutions are made to some of the technical features; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (23)

  1. 一种停车场数据的匹配方法,其特征在于,包括:A parking lot data matching method, which is characterized by including:
    从多次采集的停车场行驶轨迹中任意选择不同次采集的车辆行驶轨迹,并将其中一个行驶轨迹作为当前参考轨迹,将另一个行驶轨迹作为当前待匹配轨迹,其中,各行驶轨迹中均包括进停车场前轨迹、停车场内轨迹和出停车场后轨迹;Randomly select the vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, and use one of the driving trajectories as the current reference trajectory and the other driving trajectory as the current trajectory to be matched, where each driving trajectory includes The trajectory before entering the parking lot, the trajectory in the parking lot and the trajectory after exiting the parking lot;
    将所述当前参考轨迹与所述当前待匹配轨迹进行匹配,在匹配过程中,基于所述当前参考轨迹与所述当前待匹配轨迹中车辆位姿相匹配的对齐帧、所述当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与所述当前参考轨迹中对应的参考轨迹帧进行位姿对齐,得到当前匹配过程对应的当前对齐结果;The current reference trajectory is matched with the current trajectory to be matched. During the matching process, based on the alignment frame matching the current reference trajectory with the vehicle pose in the current trajectory to be matched, the current trajectory to be matched. The relative pose between each trajectory frame to be matched, as well as the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot, adjust the pose of each trajectory frame to be matched in turn, and add the adjusted trajectory The frame is aligned with the corresponding reference trajectory frame in the current reference trajectory to obtain the current alignment result corresponding to the current matching process;
    将所述当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得到车辆位姿的目标匹配结果。Use the driving trajectory corresponding to the current alignment result as the new current reference trajectory, select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and return to execute the new current reference trajectory. The reference trajectory is matched with the new current trajectory to be matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
  2. 根据权利要求1所述的方法,其特征在于,所述基于所述当前参考轨迹与所述当前待匹配轨迹中车辆位姿相匹配的对齐帧、所述当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与所述当前参考轨迹中对应的参考轨迹帧进行位姿对齐,得到当前匹配过程对应的当前对齐结果,包括:The method according to claim 1 is characterized in that, based on the alignment frame matching the current reference trajectory with the vehicle posture in the current trajectory to be matched, the relative posture between each trajectory frame to be matched in the current trajectory to be matched, and the absolute position information of the vehicle before entering and leaving the parking lot, each trajectory frame to be matched is adjusted in turn, and the trajectory frame after the posture adjustment is aligned with the corresponding reference trajectory frame in the current reference trajectory to obtain the current alignment result corresponding to the current matching process, including:
    依次遍历所述当前待匹配轨迹中的各个待匹配轨迹帧,对于每个当前待匹配轨迹帧,在所述当前参考轨迹中确定与所述当前待匹配轨迹帧位置相对应的当前参考轨迹帧;Sequentially traverse each to-be-matched trajectory frame in the current to-be-matched trajectory, and for each current to-be-matched trajectory frame, determine the current reference trajectory frame corresponding to the current to-be-matched trajectory frame position in the current reference trajectory;
    将所述当前参考轨迹帧与所述当前待匹配轨迹帧进行匹配;Match the current reference trajectory frame with the current trajectory frame to be matched;
    如果匹配成功,则确定所述当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿;If the matching is successful, determine the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame;
    基于所述第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、所述当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位置相对应的参考轨迹帧作为对齐帧;Based on the first relative posture, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after leaving the parking lot, and the second relative posture between each trajectory frame to be matched in the current driving trajectory to be matched, the posture of all trajectory frames to be matched that have been successfully matched are optimized, and the trajectory frame to be matched after the posture optimization and the reference trajectory frame corresponding to the position of the successful match are used as alignment frames;
    基于当前对齐帧,调整与所述当前对齐帧相邻的待匹配轨迹帧的位姿,并将位姿调整后的相邻轨迹帧作为新的当前待匹配轨迹帧,并返回执行将新的当前待匹配轨迹帧与位置相对应的当前参考轨迹帧的匹配操作,直到遍历完所述当前待匹配轨迹中所有的待匹配轨迹帧,得到当前匹配过程中车辆位姿的当前对齐结果。Based on the current alignment frame, adjust the posture of the trajectory frame to be matched adjacent to the current alignment frame, and use the posture-adjusted adjacent trajectory frame as the new current trajectory frame to be matched, and return to execute the new current trajectory frame. The matching operation of the trajectory frame to be matched and the current reference trajectory frame corresponding to the position is performed until all the trajectory frames to be matched in the current trajectory to be matched are traversed, and the current alignment result of the vehicle pose in the current matching process is obtained.
  3. 根据权利要求2所述的方法,其特征在于,在确定所述当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿之后,所述方法还包括:The method according to claim 2, characterized in that, after determining the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, the method further includes:
    基于所述第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、所述当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对所述当前参考轨迹中的所有参考轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位姿优化后的参考轨迹帧作为对齐帧。Based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched. , perform pose optimization on all reference trajectory frames in the current reference trajectory, and use the pose-optimized trajectory frame to be matched and the successfully matched reference trajectory frame after pose optimization as an alignment frame.
  4. 根据权利要求2所述的方法,其特征在于,所述将所述当前参考轨迹帧与所述当前待匹配轨迹帧进行匹配,包括:The method according to claim 2, wherein matching the current reference trajectory frame with the current trajectory frame to be matched includes:
    获取停车场的局部特征信息,所述局部特征信息包括:交通标志牌、墙体标识、路面标识和车道线标识;Obtain local feature information of the parking lot, which includes: traffic signs, wall markings, road markings and lane markings;
    如果所述当前参考轨迹帧所对应的停车场局部特征信息与所述当前待匹配轨迹帧所对 应的停车场局部特征信息一致,则确定所述当前参考轨迹帧与所述当前待匹配轨迹帧匹配成功;或者,If the local feature information of the parking lot corresponding to the current reference trajectory frame is consistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched, it is determined that the current reference trajectory frame matches the current trajectory frame to be matched. Success; or,
    如果所述当前参考轨迹帧所对应的停车场局部特征信息与所述当前待匹配轨迹帧所对应的停车场局部特征信息不一致,则确定所述当前参考轨迹帧与所述当前待匹配轨迹帧匹配失败。If the local feature information of the parking lot corresponding to the current reference trajectory frame is inconsistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched, it is determined that the current reference trajectory frame matches the current trajectory frame to be matched. fail.
  5. 根据权利要求2-4任一所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 2-4, characterized in that the method further includes:
    如果所述当前参考轨迹帧与所述当前待匹配轨迹帧匹配失败,则将匹配失败的当前待匹配轨迹帧进行暂存;If the current reference trajectory frame fails to match the current trajectory frame to be matched, the current trajectory frame to be matched that fails to match is temporarily stored;
    在得到所述当前对齐结果后,依次遍历暂存的匹配失败的目标轨迹帧,对于任意一个匹配失败的目标轨迹帧,基于该目标轨迹帧优化后的位姿,重复执行将位姿优化后的目标轨迹帧与位置相对应的参考轨迹帧的匹配操作,直到遍历完暂存的所有匹配失败的目标轨迹帧,得到新的当前对齐结果;After obtaining the current alignment result, the temporarily stored target trajectory frames that failed to match are traversed in sequence. For any target trajectory frame that fails to match, based on the optimized pose of the target trajectory frame, the optimized pose is repeatedly executed. The matching operation of the target trajectory frame and the reference trajectory frame corresponding to the position is performed until all temporarily stored target trajectory frames that have failed to match are traversed, and a new current alignment result is obtained;
    相应的,所述将所述当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,包括:Correspondingly, the driving trajectory corresponding to the current alignment result is used as a new current reference trajectory, and another unmatched driving trajectory is selected from the parking lot driving trajectories collected multiple times as a new current trajectory to be matched, and the matching operation between the new current reference trajectory and the new current trajectory to be matched is returned, including:
    将所述新的当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作。The driving trajectory corresponding to the new current alignment result is used as a new current reference trajectory, and another unmatched driving trajectory is selected from the parking lot driving trajectories collected multiple times as a new current trajectory to be matched, and the matching operation between the new current reference trajectory and the new current trajectory to be matched is returned.
  6. 根据权利要求2所述的方法,其特征在于,所述在所述当前参考轨迹中确定与所述当前待匹配轨迹帧位置相对应的当前参考轨迹帧,包括:The method according to claim 2, wherein determining the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched in the current reference trajectory includes:
    在所述当前待匹配轨迹帧属于进停车场前轨迹或出停车场后轨迹的情况下:When the current trajectory frame to be matched belongs to the trajectory before entering the parking lot or the trajectory after exiting the parking lot:
    获取当前待匹配轨迹帧对应的绝对位置,并在所述当前参考轨迹中,在距离所述绝对位置第一设定距离范围内进行搜索,得到与该当前待匹配轨迹帧位置相对应的当前参考轨迹帧;Obtain the absolute position corresponding to the current trajectory frame to be matched, and search within the first set distance range from the absolute position in the current reference trajectory to obtain the current reference corresponding to the position of the current trajectory frame to be matched. track frame;
    或者,在所述当前待匹配轨迹帧属于停车场内轨迹的情况下:Or, when the current trajectory frame to be matched belongs to the trajectory in the parking lot:
    根据当前待匹配轨迹帧对应的当前位置信息,在所述当前参考轨迹中,在距离所述当前位置信息第一设定距离范围内进行搜索,得到候选参考轨迹帧;According to the current position information corresponding to the current trajectory frame to be matched, in the current reference trajectory, search within the first set distance range from the current position information to obtain a candidate reference trajectory frame;
    判断所述候选参考轨迹帧与所述当前待匹配轨迹帧是否属于停车场的同一层;Determining whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same floor of the parking lot;
    如果属于同一层,则将所述候选参考轨迹帧作为与所述当前待匹配轨迹帧位置相对应的当前参考轨迹帧。If they belong to the same layer, the candidate reference trajectory frame is used as the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched.
  7. 根据权利要求6所述的方法,其特征在于,所述判断所述候选参考轨迹帧与所述当前待匹配轨迹帧是否属于停车场的同一层,包括:The method according to claim 6, wherein determining whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot includes:
    确定从所述当前待匹配轨迹帧到所述候选参考轨迹帧的最短拓扑路径;Determine the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame;
    检测所述最短拓扑路径中是否存在坡道路段;Detect whether there is a slope segment in the shortest topological path;
    如果不存在坡道路段,则确定所述候选参考轨迹帧与所述当前待匹配轨迹帧属于停车场的同一层;或者,If there is no slope segment, it is determined that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot; or,
    如果存在坡道路段,且如果所述坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值在第二设定距离范围内,则确定所述候选参考轨迹帧与所述当前待匹配轨迹帧属于停车场的同一层;If there is a slope segment, and if the difference between the height information of the uphill segment and the height information of the downhill segment in the slope segment is within the second set distance range, it is determined that the candidate reference trajectory frame is the same as the current to-be-subjected trajectory frame. Matching trajectory frames belong to the same level of the parking lot;
    如果所述坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值超过第二设定距离范围,则确定所述候选参考轨迹帧与所述当前待匹配轨迹帧不属于停车场的同一层。If the difference between the height information of the uphill section and the height information of the downhill section in the slope section exceeds the second set distance range, it is determined that the candidate reference trajectory frame and the current trajectory frame to be matched do not belong to the parking lot. same floor.
  8. 根据权利要求7所述的方法,其特征在于,所述检测所述最短拓扑路径中是否存在坡道路段,包括:The method according to claim 7, wherein detecting whether there is a slope segment in the shortest topological path includes:
    判断车辆相对于水平面的俯仰角是否大于预设角度;Determine whether the pitch angle of the vehicle relative to the horizontal plane is greater than the preset angle;
    将所述俯仰角大于或等于所述预设角度的轨迹帧所对应的路段作为坡道路段,并将所述 俯仰角小于所述预设角度的轨迹帧所对应的路段作为非坡道路段。The road segment corresponding to the trajectory frame with the pitch angle greater than or equal to the preset angle is regarded as a slope segment, and the road segment corresponding to the trajectory frame with the pitch angle smaller than the preset angle is regarded as a non-slope segment.
  9. 根据权利要求2所述的方法,其特征在于,所述基于所述第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、所述当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧进行位姿优化,包括:The method according to claim 2, characterized in that, based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, the current driving to be matched The second relative pose between the trajectory frames to be matched in the trajectory, and pose optimization for all trajectory frames to be matched that have been successfully matched, including:
    构建所述当前待匹配轨迹对应的第一拓扑图,以及所述当前参考轨迹对应的第二拓扑图,其中,第一拓扑图的节点是各待匹配轨迹帧,相邻待匹配轨迹帧之间用边连接,第二拓扑图的节点是各参考轨迹帧,相邻参考轨迹帧之间用边连接;Constructing a first topological graph corresponding to the current trajectory to be matched and a second topological graph corresponding to the current reference trajectory, wherein the nodes of the first topological graph are the trajectory frames to be matched, and adjacent trajectory frames to be matched are connected by edges, and the nodes of the second topological graph are the reference trajectory frames, and adjacent reference trajectory frames are connected by edges;
    基于所述第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、所述当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,通过位姿图优化方法对所述第一拓扑图进行优化,并将位姿优化后的待匹配轨迹帧与匹配成功的参考轨迹帧作为对齐帧,其中,第一拓扑图和第二拓扑图中的对齐帧节点之间用边连接。Based on the first relative pose, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the second relative pose between each to-be-matched trajectory frame in the current driving trajectory to be matched. , the first topology map is optimized through the pose graph optimization method, and the pose-optimized trajectory frame to be matched and the successfully matched reference trajectory frame are used as alignment frames, where the first topology map and the second topology map The aligned frame nodes in are connected by edges.
  10. 根据权利要求9所述的方法,其特征在于,在将所述当前参考轨迹与所述当前待匹配轨迹进行匹配之前,所述方法还包括:The method according to claim 9, characterized in that, before matching the current reference trajectory with the current trajectory to be matched, the method further includes:
    基于在进停车场前和出停车场后的绝对位置信息,分别对第一拓扑图和第二拓扑图进行优化,以缩小所述当前待匹配轨迹与所述当前参考轨迹之间在绝对位置上的偏差。Based on the absolute position information before entering the parking lot and after exiting the parking lot, the first topology map and the second topology map are optimized respectively to narrow the absolute position between the current trajectory to be matched and the current reference trajectory. deviation.
  11. 根据权利要求1所述的方法,其特征在于,各参考轨迹帧对应的车辆位姿或者各待匹配轨迹帧对应的车辆位姿均通过如下任意一种传感器数据得到,或者,通过将如下多种传感器数据进行融合的方式得到:The method according to claim 1, characterized in that the vehicle posture corresponding to each reference trajectory frame or the vehicle posture corresponding to each trajectory frame to be matched is obtained through any one of the following sensor data, or by combining the following multiple types of sensor data: The sensor data is fused to obtain:
    惯性测量单元IMU数据、图像数据、雷达点云数据和里程计数据。Inertial measurement unit IMU data, image data, radar point cloud data and odometer data.
  12. 一种停车场数据的匹配装置,其特征在于,包括:A parking lot data matching device, which is characterized by including:
    行驶轨迹选择模块,被配置为从多次采集的停车场行驶轨迹中任意选择不同次采集的车辆行驶轨迹,并将其中一个行驶轨迹作为当前参考轨迹,将另一个行驶轨迹作为当前待匹配轨迹,其中,各行驶轨迹中均包括进停车场前轨迹、停车场内轨迹和出停车场后轨迹;The driving trajectory selection module is configured to arbitrarily select the vehicle driving trajectories collected at different times from the parking lot driving trajectories collected multiple times, and use one of the driving trajectories as the current reference trajectory and the other driving trajectory as the current trajectory to be matched. Among them, each driving trajectory includes the trajectory before entering the parking lot, the trajectory in the parking lot, and the trajectory after exiting the parking lot;
    匹配模块,被配置为将所述当前参考轨迹与所述当前待匹配轨迹进行匹配,在匹配过程中,基于所述当前参考轨迹与所述当前待匹配轨迹中车辆位姿相匹配的对齐帧、所述当前待匹配轨迹中各个待匹配轨迹帧之间的相对位姿,以及车辆在进停车场前和出停车场后的绝对位置信息,依次对各个待匹配轨迹帧进行位姿调整,并将位姿调整后的轨迹帧与所述当前参考轨迹中对应的参考轨迹帧进行位姿对齐,得到当前匹配过程对应的当前对齐结果;A matching module configured to match the current reference trajectory with the current trajectory to be matched. During the matching process, based on the alignment frame that matches the vehicle pose in the current reference trajectory and the current trajectory to be matched, The relative pose between each track frame to be matched in the current track to be matched, as well as the absolute position information of the vehicle before entering the parking lot and after exiting the parking lot, adjust the pose of each track frame to be matched in turn, and The posture-adjusted trajectory frame is aligned with the corresponding reference trajectory frame in the current reference trajectory to obtain the current alignment result corresponding to the current matching process;
    数据关联模块,被配置为将所述当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得到车辆位姿的目标匹配结果。The data association module is configured to use the driving trajectory corresponding to the current alignment result as the new current reference trajectory, and select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched. , and return to perform the matching operation of the new current reference trajectory and the new current trajectory to be matched, until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
  13. 根据权利要求12所述的装置,其特征在于,所述匹配模块,包括:The device according to claim 12, characterized in that the matching module includes:
    当前参考轨迹帧确定单元,被配置为将所述当前参考轨迹与所述当前待匹配轨迹进行匹配,在匹配过程中,依次遍历所述当前待匹配轨迹中的各个待匹配轨迹帧,对于每个当前待匹配轨迹帧,在所述当前参考轨迹中确定与所述当前待匹配轨迹帧位置相对应的当前参考轨迹帧;The current reference trajectory frame determination unit is configured to match the current reference trajectory with the current trajectory to be matched, and during the matching process, sequentially traverse each trajectory frame to be matched in the current trajectory to be matched, for each The current trajectory frame to be matched, the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched is determined in the current reference trajectory;
    匹配单元,被配置为将所述当前参考轨迹帧与所述当前待匹配轨迹帧进行匹配;A matching unit configured to match the current reference trajectory frame with the current trajectory frame to be matched;
    相对位姿确定单元,被配置为如果所述当前参考轨迹帧与所述当前待匹配轨迹帧匹配成功,则确定所述当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿;A relative pose determination unit configured to determine a first relative position between the current trajectory frame to be matched and the corresponding current reference trajectory frame if the current reference trajectory frame and the current trajectory frame to be matched are successfully matched. posture;
    第一位姿优化单元,被配置为基于所述第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、所述当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对已成功匹配的所有待匹配轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位置相对应的参考轨迹帧作为对齐帧;The first posture optimization unit is configured to be based on the first relative posture, the absolute position information of the vehicle in each driving trajectory before entering the parking lot and after exiting the parking lot, and the current driving trajectory to be matched. For the second relative pose between trajectory frames, pose optimization is performed on all trajectory frames to be matched that have been successfully matched, and the optimized trajectory frame to be matched is used as the alignment with the reference trajectory frame corresponding to the position where the matching is successful. frame;
    位姿对齐单元,被配置为基于当前对齐帧,调整与所述当前对齐帧相邻的待匹配轨迹帧的位姿,并将位姿调整后的相邻轨迹帧作为新的当前待匹配轨迹帧,并返回执行将新的当前待匹配轨迹帧与位置相对应的当前参考轨迹帧的匹配操作,直到遍历完所述当前待匹配轨迹中所有的待匹配轨迹帧,得到当前匹配过程中车辆位姿的当前对齐结果。The pose alignment unit is configured to adjust the pose of the trajectory frame to be matched adjacent to the current alignment frame based on the current alignment frame, and use the adjacent trajectory frame after the pose adjustment as the new current trajectory frame to be matched. , and return to perform the matching operation of matching the new current trajectory frame to be matched with the current reference trajectory frame corresponding to the position, until all the trajectory frames to be matched in the current trajectory to be matched are traversed, and the vehicle pose in the current matching process is obtained. the current alignment result.
  14. 根据权利要求13所述的装置,其特征在于,所述装置还包括:The device according to claim 13, characterized in that the device further includes:
    第二位姿优化单元,被配置为在确定所述当前待匹配轨迹帧与对应的当前参考轨迹帧之间的第一相对位姿之后,基于所述第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、所述当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,对所述当前参考轨迹中的所有参考轨迹帧进行位姿优化,并将位姿优化后的待匹配轨迹帧与匹配成功的位姿优化后的参考轨迹帧作为对齐帧。The second pose optimization unit is configured to, after determining the first relative pose between the current trajectory frame to be matched and the corresponding current reference trajectory frame, based on the first relative pose, the vehicle in each driving trajectory The absolute position information before entering the parking lot and after exiting the parking lot, the second relative pose between the trajectory frames to be matched in the current driving trajectory to be matched, and all reference trajectory frames in the current reference trajectory are processed. The pose is optimized, and the trajectory frame to be matched after the pose is optimized and the successfully matched reference trajectory frame after the pose is optimized are used as alignment frames.
  15. 根据权利要求13所述的装置,其特征在于,所述匹配单元,包括:The device according to claim 13, characterized in that the matching unit includes:
    局部特征信息获取子单元,被配置为获取停车场的局部特征信息,所述局部特征信息包括:交通标志牌、墙体标识、路面标识和车道线标识;The local feature information acquisition subunit is configured to acquire local feature information of the parking lot, where the local feature information includes: traffic signs, wall markings, road markings and lane markings;
    匹配子单元,被配置为如果所述当前参考轨迹帧所对应的停车场局部特征信息与所述当前待匹配轨迹帧所对应的停车场局部特征信息一致,则确定所述当前参考轨迹帧与所述当前待匹配轨迹帧匹配成功;或者,The matching subunit is configured to determine that the current reference trajectory frame is consistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched. The current trajectory frame to be matched is successfully matched; or,
    如果所述当前参考轨迹帧所对应的停车场局部特征信息与所述当前待匹配轨迹帧所对应的停车场局部特征信息不一致,则确定所述当前参考轨迹帧与所述当前待匹配轨迹帧匹配失败。If the local feature information of the parking lot corresponding to the current reference trajectory frame is inconsistent with the local feature information of the parking lot corresponding to the current trajectory frame to be matched, it is determined that the current reference trajectory frame matches the current trajectory frame to be matched. fail.
  16. 根据权利要求13-15任一所述的装置,其特征在于,所述装置还包括:The device according to any one of claims 13 to 15, characterized in that the device further comprises:
    匹配失败帧暂存模块,被配置为如果所述当前参考轨迹帧与所述当前待匹配轨迹帧匹配失败,则将匹配失败的当前待匹配轨迹帧进行暂存;The matching failed frame temporary storage module is configured to temporarily store the failed matching current trajectory frame to be matched if the current reference trajectory frame fails to match the current trajectory frame to be matched;
    重新匹配模块,被配置为依次遍历暂存的匹配失败的目标轨迹帧,对于任意一个匹配失败的目标轨迹帧,基于该目标轨迹帧优化后的位姿,重复执行将位姿优化后的目标轨迹帧与位置相对应的参考轨迹帧的匹配操作,直到遍历完暂存的所有匹配失败的目标轨迹帧,得到新的当前对齐结果;The re-matching module is configured to sequentially traverse the temporarily stored target trajectory frames that failed to match. For any target trajectory frame that failed to match, based on the optimized pose of the target trajectory frame, repeatedly execute the optimized target trajectory. The matching operation of the reference trajectory frame corresponding to the frame and position is performed until all temporarily stored target trajectory frames that have failed to match are traversed and a new current alignment result is obtained;
    相应的,所述数据关联模块,具体被配置为:Correspondingly, the data association module is specifically configured as:
    将所述新的当前对齐结果对应的行驶轨迹作为新的当前参考轨迹,并从多次采集的停车场行驶轨迹中选择另一未匹配的行驶轨迹作为新的当前待匹配轨迹,并返回执行新的当前参考轨迹与新的当前待匹配轨迹的匹配操作,直到完成预定数量的停车场行驶轨迹匹配操作,得到车辆位姿的目标匹配结果。Use the driving trajectory corresponding to the new current alignment result as the new current reference trajectory, select another unmatched driving trajectory from the parking lot driving trajectories collected multiple times as the new current trajectory to be matched, and return to execute the new The current reference trajectory and the new current trajectory to be matched are matched until a predetermined number of parking lot driving trajectory matching operations are completed, and the target matching result of the vehicle pose is obtained.
  17. 根据权利要求13所述的装置,其特征在于,所述当前参考轨迹帧确定单元,包括:The device according to claim 13, characterized in that the current reference trajectory frame determination unit includes:
    第一搜索子单元,被配置为在所述当前待匹配轨迹帧属于进停车场前轨迹或出停车场后轨迹的情况下,获取当前待匹配轨迹帧对应的绝对位置,并在所述当前参考轨迹中,在距离所述绝对位置第一设定距离范围内进行搜索,得到与该当前待匹配轨迹帧位置相对应的当前参考轨迹帧;The first search subunit is configured to obtain the absolute position corresponding to the current trajectory frame to be matched when the current trajectory frame to be matched belongs to the trajectory before entering the parking lot or the trajectory after exiting the parking lot, and obtain the absolute position corresponding to the current trajectory frame to be matched in the current reference In the trajectory, search within the first set distance range from the absolute position to obtain the current reference trajectory frame corresponding to the position of the current trajectory frame to be matched;
    或者,or,
    第二搜索子单元,被配置为在所述当前待匹配轨迹帧属于停车场内轨迹的情况下,根据当前待匹配轨迹帧对应的当前位置信息,在所述当前参考轨迹中,在距离所述当前位置信息第一设定距离范围内进行搜索,得到候选参考轨迹帧;The second search subunit is configured to, when the current trajectory frame to be matched belongs to the trajectory in the parking lot, based on the current location information corresponding to the current trajectory frame to be matched, in the current reference trajectory, within the distance from the Search within the first set distance range of the current position information to obtain candidate reference trajectory frames;
    同层判断子单元,被配置为判断所述候选参考轨迹帧与所述当前待匹配轨迹帧是否属于停车场的同一层;The same layer determination subunit is configured to determine whether the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot;
    当前参考轨迹帧确定子单元,被配置为如果所述候选参考轨迹帧与所述当前待匹配轨迹帧属于停车场的同一层,则将所述候选参考轨迹帧作为与所述当前待匹配轨迹帧位置相对应 的当前参考轨迹帧。The current reference trajectory frame determination subunit is configured to use the candidate reference trajectory frame as the current trajectory frame to be matched if the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot. The current reference trajectory frame corresponding to the position.
  18. 根据权利要求17所述的装置,其特征在于,所述同层判断子单元,包括:The device according to claim 17, characterized in that the same layer determination subunit includes:
    最短拓扑路径确定组件,被配置为确定从所述当前待匹配轨迹帧到所述候选参考轨迹帧的最短拓扑路径;a shortest topological path determination component configured to determine the shortest topological path from the current trajectory frame to be matched to the candidate reference trajectory frame;
    坡道路段检测组件,被配置为检测所述最短拓扑路径中是否存在坡道路段;a slope segment detection component configured to detect whether there is a slope segment in the shortest topological path;
    同层确定组件,被配置为如果所述最短拓扑路径中不存在坡道路段,则确定所述候选参考轨迹帧与所述当前待匹配轨迹帧属于停车场的同一层;A same-layer determination component configured to determine that the candidate reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot if there is no slope segment in the shortest topological path;
    或者,如果所述最短拓扑路径中存在坡道路段,且如果所述坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值在第二设定距离范围内,则确定所述候选参考轨迹帧与所述当前待匹配轨迹帧属于停车场的同一层;Alternatively, if there is a slope segment in the shortest topological path, and if the difference between the height information of the uphill segment and the height information of the downhill segment in the slope segment is within a second set distance range, determine the candidate The reference trajectory frame and the current trajectory frame to be matched belong to the same layer of the parking lot;
    或者,如果所述坡道路段中上坡路段的高度信息和下坡路段的高度信息的差值超过第二设定距离范围,则确定所述候选参考轨迹帧与所述当前待匹配轨迹帧不属于停车场的同一层。Alternatively, if the difference between the height information of the uphill section and the height information of the downhill section in the slope section exceeds the second set distance range, it is determined that the candidate reference trajectory frame and the current trajectory frame to be matched do not belong to parking. same layer of the field.
  19. 根据权利要求18所述的装置,其特征在于,所述同层确定组件,具体被配置为:The device according to claim 18, wherein the peer determination component is specifically configured as:
    判断车辆相对于水平面的俯仰角是否大于预设角度;Determine whether the pitch angle of the vehicle relative to the horizontal plane is greater than the preset angle;
    将所述俯仰角大于或等于所述预设角度的轨迹帧所对应的路段作为坡道路段,并将所述俯仰角小于所述预设角度的轨迹帧所对应的路段作为非坡道路段。The road segment corresponding to the trajectory frame with the pitch angle greater than or equal to the preset angle is regarded as a slope segment, and the road segment corresponding to the trajectory frame with the pitch angle smaller than the preset angle is regarded as a non-slope segment.
  20. 根据权利要求13所述的装置,其特征在于,所述第一位姿优化单元,具体被配置为:The device according to claim 13, characterized in that the first attitude optimization unit is specifically configured to:
    构建所述当前待匹配轨迹对应的第一拓扑图,以及所述当前参考轨迹对应的第二拓扑图,其中,第一拓扑图的节点是各待匹配轨迹帧,相邻待匹配轨迹帧之间用边连接,第二拓扑图的节点是各参考轨迹帧,相邻参考轨迹帧之间用边连接;Construct a first topology graph corresponding to the current trajectory to be matched, and a second topology graph corresponding to the current reference trajectory, wherein the nodes of the first topology graph are each trajectory frame to be matched, and between adjacent trajectory frames to be matched Connected by edges, the nodes of the second topology graph are each reference trajectory frame, and adjacent reference trajectory frames are connected by edges;
    基于所述第一相对位姿、各行驶轨迹中车辆在进停车场前和出停车场后的绝对位置信息、所述当前待匹配行驶轨迹中各待匹配轨迹帧之间的第二相对位姿,通过位姿图优化方法对所述第一拓扑图进行优化,并将位姿优化后的待匹配轨迹帧与匹配成功的参考轨迹帧作为对齐帧,其中,第一拓扑图和第二拓扑图中的对齐帧节点之间用边连接。Based on the first relative posture, the absolute position information of the vehicle in each driving trajectory before entering and exiting the parking lot, and the second relative posture between each trajectory frame to be matched in the current driving trajectory to be matched, the first topological graph is optimized by a posture graph optimization method, and the trajectory frame to be matched after posture optimization and the successfully matched reference trajectory frame are used as alignment frames, wherein the alignment frame nodes in the first topological graph and the second topological graph are connected by edges.
  21. 一种电子设备,其特征在于,包括:An electronic device, characterized by including:
    一个或多个处理器;one or more processors;
    存储装置,用于存储一个或多个程序,a storage device for storing one or more programs,
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-11任一所述的方法。When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method as described in any one of claims 1-11.
  22. 一种存储介质,其上存储有计算机程序,其特征在于,所述程序被处理器执行时实现如权利要求1-11任一所述的方法。A storage medium on which a computer program is stored, characterized in that when the program is executed by a processor, the method according to any one of claims 1-11 is implemented.
  23. 一种车辆,其特征在于,所述车辆包含如权利要求1-11中任一所述的系统,或者包含如权利要求21所述的电子设备。A vehicle, characterized in that the vehicle includes the system according to any one of claims 1 to 11, or the electronic device according to claim 21.
PCT/CN2022/137917 2022-09-19 2022-12-09 Parking lot data matching method and apparatus, device, medium and vehicle WO2024060420A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211135734.1 2022-09-19
CN202211135734.1A CN117789444A (en) 2022-09-19 2022-09-19 Parking lot data matching method, device, equipment, medium and vehicle

Publications (1)

Publication Number Publication Date
WO2024060420A1 true WO2024060420A1 (en) 2024-03-28

Family

ID=90387897

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/137917 WO2024060420A1 (en) 2022-09-19 2022-12-09 Parking lot data matching method and apparatus, device, medium and vehicle

Country Status (2)

Country Link
CN (1) CN117789444A (en)
WO (1) WO2024060420A1 (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106840175A (en) * 2016-12-06 2017-06-13 北京中交兴路信息科技有限公司 A kind of vehicle driving trace matches the method and device of road network
WO2018021870A1 (en) * 2016-07-29 2018-02-01 현대엠엔소프트 주식회사 Navigation system and location correction method of navigation system
CN110149594A (en) * 2019-05-05 2019-08-20 深圳市荣盛智能装备有限公司 Individual soldier companion calling method, device, electronic equipment and storage medium
CN110645997A (en) * 2018-09-30 2020-01-03 北京奇虎科技有限公司 Method and device for digging new roads based on track route
CN110909961A (en) * 2019-12-19 2020-03-24 盈嘉互联(北京)科技有限公司 BIM-based indoor path query method and device
CN112304302A (en) * 2019-07-26 2021-02-02 北京初速度科技有限公司 Multi-scene high-precision vehicle positioning method and device and vehicle-mounted terminal
CN112857378A (en) * 2019-11-26 2021-05-28 北京初速度科技有限公司 Track matching method and device
WO2022021209A1 (en) * 2020-07-30 2022-02-03 深圳元戎启行科技有限公司 Electronic map generation method and apparatus, computer device, and storage medium
CN114419268A (en) * 2022-01-20 2022-04-29 湖北亿咖通科技有限公司 Track edge connecting method for incremental map construction, electronic equipment and storage medium
CN114579683A (en) * 2022-02-08 2022-06-03 广州小鹏自动驾驶科技有限公司 Map network updating method and device, computer equipment and storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018021870A1 (en) * 2016-07-29 2018-02-01 현대엠엔소프트 주식회사 Navigation system and location correction method of navigation system
CN106840175A (en) * 2016-12-06 2017-06-13 北京中交兴路信息科技有限公司 A kind of vehicle driving trace matches the method and device of road network
CN110645997A (en) * 2018-09-30 2020-01-03 北京奇虎科技有限公司 Method and device for digging new roads based on track route
CN110149594A (en) * 2019-05-05 2019-08-20 深圳市荣盛智能装备有限公司 Individual soldier companion calling method, device, electronic equipment and storage medium
CN112304302A (en) * 2019-07-26 2021-02-02 北京初速度科技有限公司 Multi-scene high-precision vehicle positioning method and device and vehicle-mounted terminal
CN112857378A (en) * 2019-11-26 2021-05-28 北京初速度科技有限公司 Track matching method and device
CN110909961A (en) * 2019-12-19 2020-03-24 盈嘉互联(北京)科技有限公司 BIM-based indoor path query method and device
WO2022021209A1 (en) * 2020-07-30 2022-02-03 深圳元戎启行科技有限公司 Electronic map generation method and apparatus, computer device, and storage medium
CN114419268A (en) * 2022-01-20 2022-04-29 湖北亿咖通科技有限公司 Track edge connecting method for incremental map construction, electronic equipment and storage medium
CN114579683A (en) * 2022-02-08 2022-06-03 广州小鹏自动驾驶科技有限公司 Map network updating method and device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN117789444A (en) 2024-03-29

Similar Documents

Publication Publication Date Title
WO2021017212A1 (en) Multi-scene high-precision vehicle positioning method and apparatus, and vehicle-mounted terminal
CN108983781B (en) Environment detection method in unmanned vehicle target search system
US20220388500A1 (en) Apparatus and method for estimating position in automated valet parking system
WO2020042348A1 (en) Method for generating autonomous driving navigation map, system, vehicle-mounted terminal, and server
CN108627175A (en) The system and method for vehicle location for identification
JPWO2018235239A1 (en) Vehicle information storage method, vehicle travel control method, and vehicle information storage device
WO2020232648A1 (en) Lane line detection method, electronic device and storage medium
WO2021238026A1 (en) Vehicle positioning method and apparatus, and vehicle, and storage medium
US11205079B2 (en) Determining position data
CN109754636B (en) Parking space cooperative sensing identification and parking assistance method and device
CN111915675B (en) Particle drift-based particle filtering point cloud positioning method, device and system thereof
US11281228B2 (en) Method and device for determining a position of a transportation vehicle
JP7123154B2 (en) Driving support method and driving support device
KR20220004203A (en) Methods, devices and devices for instrument positioning
JP2018077162A (en) Vehicle position detection device, vehicle position detection method and computer program for vehicle position detection
US11579628B2 (en) Method for localizing a vehicle
WO2024060420A1 (en) Parking lot data matching method and apparatus, device, medium and vehicle
TWM617479U (en) Automatic positioning management system of vehicle
CN113015243A (en) Vehicle positioning method and device and vehicle
CN112304322B (en) Restarting method after visual positioning failure and vehicle-mounted terminal
US20220198714A1 (en) Camera to camera calibration
JP2018185156A (en) Target position estimation method and target position estimation device
JP7260668B2 (en) Method and Apparatus for Generating First Map
CN111504332A (en) Method for determining the position of a vehicle in a digital map
CN112229418A (en) Vehicle positioning system based on OBD box

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22959419

Country of ref document: EP

Kind code of ref document: A1