WO2020168742A1 - Method and device for vehicle body positioning - Google Patents

Method and device for vehicle body positioning Download PDF

Info

Publication number
WO2020168742A1
WO2020168742A1 PCT/CN2019/115903 CN2019115903W WO2020168742A1 WO 2020168742 A1 WO2020168742 A1 WO 2020168742A1 CN 2019115903 W CN2019115903 W CN 2019115903W WO 2020168742 A1 WO2020168742 A1 WO 2020168742A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle body
point cloud
cloud data
line lidar
lidar
Prior art date
Application number
PCT/CN2019/115903
Other languages
French (fr)
Chinese (zh)
Inventor
杜新新
Original Assignee
苏州风图智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 苏州风图智能科技有限公司 filed Critical 苏州风图智能科技有限公司
Publication of WO2020168742A1 publication Critical patent/WO2020168742A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes

Definitions

  • the present disclosure relates to the technical field of radar positioning, in particular to a vehicle body positioning method and device.
  • Unmanned driving is a type of smart car, also known as wheeled mobile robot, which mainly relies on the intelligent driving instrument based on the computer system in the car to realize the purpose of unmanned driving.
  • unmanned driving technology positioning and path planning in robotic systems are a problem. Without positioning, the path cannot be planned.
  • unmanned vehicle positioning mostly relies on multi-line lidar (also called three-dimensional lidar) or single-line lidar (also called two-dimensional lidar) or GPS (Global Positioning System, Global Positioning System) positioning.
  • Three-dimensional lidar (also called multi-line lidar) is relatively expensive and has limited applications.
  • Two-dimensional lidar (also known as single-line lidar) has fewer features in the surrounding environment, such as relatively open deserts or suburbs, and has poor positioning effects.
  • GPS positioning technology based on radio technology is used in high buildings or tunnels, indoors, etc. In the environment, the positioning is not accurate enough. Therefore, how to achieve accurate positioning in some special environments, such as open areas or indoors, tunnels, etc., while saving costs has become an urgent technical problem to be solved.
  • the present disclosure provides a vehicle body positioning method and device.
  • a vehicle body positioning method including:
  • At least one single-line lidar to scan and obtain three-dimensional point cloud data of the surrounding environment of the vehicle body, and the directions of the at least one single-line lidar emitting laser light respectively have at least one angle relationship with the plane where the bottom of the vehicle body is located;
  • the point cloud feature information is registered with a preset high-precision map to determine the position information of the vehicle body.
  • the included angle relationship includes: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar is in an oblique upward direction Or diagonally downward.
  • the included angle relationship includes: the single-line lidar is arranged on the upper half of the vehicle body in an obliquely downward direction, so that the laser pulse emitted by the single-line lidar is in an obliquely downward direction.
  • the scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body by using at least one single-line lidar includes:
  • the three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions are fused to generate three-dimensional point cloud data based on the same coordinate system.
  • the fusing three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions to generate three-dimensional point cloud data based on the same coordinate system includes:
  • the point cloud data corresponding to the observation point is converted into the same coordinate system.
  • the converting point cloud data corresponding to the observation point into the same coordinate system based on the coordinate position of the observation point includes:
  • the point cloud data corresponding to the observation point in the previous scan is sequentially converted to the coordinate system corresponding to the next scan, until the point cloud data corresponding to the observation point is transferred to the last scan Scan the corresponding coordinate system.
  • the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image.
  • the scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body using at least one single-line lidar includes:
  • the point cloud data corresponding to the observation point is converted into the same coordinate system.
  • the relative position relationship includes:
  • At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
  • At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
  • a vehicle body positioning device including:
  • the lidar device includes at least one single-line lidar for scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body, and the direction in which the at least one single-line lidar emits laser light is at least the same as the plane where the bottom of the vehicle body is located.
  • Kind of angle relationship ;
  • An extraction module for extracting point cloud feature information in the three-dimensional point cloud data
  • the registration module is used to register the point cloud feature information with a preset high-precision map to determine the position information of the vehicle body.
  • the included angle relationship includes: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar is in an oblique upward direction Or diagonally downward.
  • the included angle relationship includes: the single-line lidar is arranged on the upper half of the vehicle body in an obliquely downward direction, so that the laser pulse emitted by the single-line lidar is in an obliquely downward direction.
  • the lidar device includes:
  • the first acquisition module is configured to use at least one single-line lidar to perform multiple scans to acquire three-dimensional point cloud data of the surrounding environment of the vehicle body at different scanning positions;
  • the processing module is used to fuse the three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions to generate three-dimensional point cloud data based on the same coordinate system.
  • the processing module includes:
  • the determining sub-module is used to determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
  • the conversion sub-module is used to convert the point cloud data corresponding to the observation point into the same coordinate system based on the coordinate position of the observation point.
  • the conversion submodule includes:
  • the determining unit is used to determine the coordinate system information of the observation point during multiple scans
  • the conversion unit based on the coordinate system information and the relative pose information, sequentially converts the point cloud data corresponding to the observation point in the previous scan to the coordinate system corresponding to the next scan, until the point cloud data corresponding to the observation point is transferred To the coordinate system corresponding to the last scan.
  • the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image.
  • the included angle relationship includes a plane parallel to the bottom of the vehicle body.
  • the lidar device includes:
  • the second acquisition module is configured to acquire the relative position relationship between the single-line laser radars when at least two single-line laser radars are provided on the vehicle body;
  • the conversion module is configured to convert the point cloud data corresponding to the observation point by the single-line lidar into the same coordinate system according to the relative position relationship.
  • the relative position relationship includes:
  • At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
  • At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
  • a vehicle body positioning device including:
  • a memory for storing processor executable instructions
  • the processor is configured to execute the method described in any embodiment of the present disclosure.
  • a non-transitory computer-readable storage medium When instructions in the storage medium are executed by a processor, the processor can execute the method.
  • the present disclosure includes at least one single-line lidar disposed on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the at least one single-line lidar emits laser light
  • the directions are in at least one angle relationship with the plane where the bottom of the vehicle body is located, so that the scanning plane of the single-line radar constantly changes when the vehicle is traveling, so as to obtain three-dimensional point cloud data of the surrounding environment of the vehicle body.
  • the two-dimensional point cloud data obtained by the single-line radar in the prior art is more reliable when the surrounding environment is scarce; at the same time, single-line radars located in other parts of the car body are used, such as parallel to the plane where the bottom of the car body is located, Long-distance two-dimensional point cloud data can be obtained, and then fused with the three-dimensional point cloud data to further enhance the accuracy and stability of positioning.
  • Fig. 1 is a flow chart showing a method for positioning a vehicle body according to an exemplary embodiment.
  • Fig. 2 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment.
  • Fig. 3 is a flow chart showing a vehicle body positioning method according to an exemplary embodiment.
  • Fig. 4 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment.
  • Fig. 5 is a flow chart showing a method for positioning a vehicle body according to an exemplary embodiment.
  • Fig. 6 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • Fig. 7 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • Fig. 8 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • Fig. 9 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • Fig. 10 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • Fig. 11 is a block diagram showing a device according to an exemplary embodiment.
  • Fig. 12 is a block diagram showing a device according to an exemplary embodiment.
  • Lidar is an active sensor, the data formed is in the form of point cloud, which is mainly composed of transmitter, receiver, measurement control and power supply.
  • the lidar When the lidar is working, it first emits a laser beam to the measured target, and then measures the time for the reflected or scattered signal to reach the transmitter, the signal strength, and the frequency change, so as to determine the distance, movement speed and orientation of the measured target
  • it can also measure the dynamics of particles in the atmosphere that are invisible to the naked eye, such as distance and angle, shape and size, and speed and attitude.
  • lidar includes single-line lidar and multi-line lidar.
  • the line beam emitted by the laser source in single-line lidar is single-line, and point cloud information is obtained on a fixed scanning plane, such as the horizontal plane;
  • a laser source can emit laser pulses of multiple beams.
  • the multiple laser sources are arranged and distributed in a vertical direction, and the scanning of the multiple beams is formed by motor rotation, and has multiple scanning planes.
  • Fig. 1 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment. Referring to Fig. 1, the method includes the following steps.
  • step S101 at least one single-line lidar is used to scan and obtain three-dimensional point cloud data of the surrounding environment of the vehicle body, and the direction in which the at least one single-line lidar emits laser light and the plane at the bottom of the vehicle body are at least one kind of clip. Angle relationship.
  • the direction of the at least one single-line lidar emitting laser light is in at least one angle relationship with the plane of the bottom of the vehicle body, and the angle relationship may be an angle number below the plane of the bottom of the vehicle body. , It can also be a number of angles above the bottom plane of the vehicle.
  • the laser emission direction of the single-line lidar can include 45 degrees diagonally upwards, or diagonally. 45 degrees downward; when the single-line lidar is installed at the roof of the vehicle, the laser emission direction of the single-line lidar may include an oblique downward 45 degrees.
  • step S102 point cloud feature information in the three-dimensional point cloud data is extracted.
  • the amount of three-dimensional point cloud data obtained through the step S101 is relatively large, and there are data redundancy and noise.
  • the point cloud feature information refers to the information of some special points in the point cloud data, such as sharp edges. , Smooth edges, ridges or valleys, sharps, etc., the feature points can reflect the most basic geometric shape of the model. Extracting point cloud feature information includes detecting feature points from the three-dimensional point cloud data, and retaining several shapes of the model for subsequent Prepare for registration.
  • step S103 the point cloud feature information is registered with a preset high-precision map to determine the position information of the vehicle body.
  • the GPS of the vehicle can be used to make an approximate location judgment, and then a pre-prepared high-precision map can be used for registration with the point cloud feature information. After the pairing is successful, the location information of the vehicle body can be confirmed.
  • the present disclosure includes that at least one single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the direction in which the at least one single-line lidar emits laser light and the plane of the bottom of the vehicle body are at least one kind of clip
  • the angle relationship makes the scanning plane of the single-line radar continuously change during the vehicle's travel, and then obtain the three-dimensional point cloud data of the surrounding environment of the vehicle body, compared with the two-dimensional point cloud data obtained by the single-line radar in the prior art , When the surrounding environment is scarce, reliability is enhanced.
  • the included angle relationship includes: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar is in an oblique upward direction Or diagonally downward.
  • the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, including the single-line lidar is arranged at the front middle position of the vehicle body, such as the headlights. Including the single-line lidar is arranged on the upper part of the front of the vehicle body, such as the roof.
  • the laser emission direction of the single-line lidar may include an oblique upward direction or an oblique downward direction; when the single-line lidar is set on the roof At the time, the laser emission direction of the single-line lidar may include an oblique downward direction.
  • the single-line lidar is arranged on the upper half of the vehicle body in an obliquely downward direction, so that the laser pulse emitted by the single-line lidar is in an obliquely downward direction.
  • the position of the single-line lidar is higher than that of other parts of the vehicle body, and then scans and obtains more comprehensive point cloud information. Transmitting laser pulses can obtain point cloud information of objects that are equivalent to the height of the vehicle body to meet the driving needs of unmanned driving.
  • the laser pulse emitted by the single-line lidar is in the diagonally downward direction, adjust the appropriate diagonal downward direction
  • the number of angles can be within a small range, such as 20 meters, within the three-dimensional point cloud data.
  • Fig. 2 is a flowchart of a vehicle body positioning method according to an exemplary embodiment.
  • the step S101 uses at least one single-line lidar to scan and acquire the surrounding environment of the vehicle body
  • the 3D point cloud data includes step S104 and step S105.
  • step S104 at least one single-line lidar is used to perform multiple scans to obtain three-dimensional point cloud data of the surrounding environment of the vehicle body at different scan positions.
  • the scanning frequency of the single-line lidar can be set according to time or distance parameters. For example, it can be set that the single-line lidar scans once every 2 seconds. According to the driving speed of the vehicle, The acceleration and other information can be used to obtain the driving distance of the vehicle; it can also be set that the single-line lidar scans once every 1m.
  • step S105 the three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions are merged to generate three-dimensional point cloud data based on the same coordinate system.
  • the position of the single-line lidar can be the origin of the coordinate, and the coordinate system can be defined according to the sequence of data acquisition and the direction of motor rotation.
  • the X axis is defined to be in the horizontal scanning plane and to the right. It is the positive X-axis, the Y-axis is positive when it is perpendicular to the X-axis in the horizontal scanning plane, and the Z-axis is positive when it is perpendicular to the XY plane.
  • the coordinate system of the three-dimensional point cloud data obtained from two adjacent scans is not the same, and the three-dimensional point cloud data needs to be fused to generate the data based on the same Three-dimensional point cloud data of the coordinate system.
  • Fig. 3 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment. Referring to Fig. 3, the difference from the above embodiment is that in step S105, the vehicle body is positioned at the different scanning positions. The three-dimensional point cloud data of the surrounding environment is merged to generate three-dimensional point cloud data based on the same coordinate system, including step S107 and step S108.
  • step S107 determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
  • a precise clock can be used to obtain the time difference between the time when the single-line lidar emits laser pulses and the time when the reflected signal is received, and the distance S between the observation point and the single-line lidar can be calculated.
  • the precision encoding device that comes with the scanning instrument records the vertical scanning angle ⁇ and the horizontal scanning angle ⁇ between adjacent pulses in the encoder, and uses the polar coordinate method to convert the distance and angle into the coordinates of the observation point P, which defines The X axis is in the horizontal scanning plane, the X axis is positive to the right, the Y axis is positive in the horizontal scanning plane perpendicular to the X axis, and the Z axis and the XY plane are positive.
  • step S108 based on the coordinate position of the observation point, the information corresponding to the observation point is converted into the same coordinate system.
  • the coordinate system used in each scan is different, and the coordinate system used in the observation point in the last scan can be changed to 0 1 -X by means of coordinate conversion.
  • 1 Y 1 Z 1 is converted to the coordinate system used by the observation point in the next scan, such as 0 2 -X 2 Y 2 Z 2 , and the coordinate conversion method may include: First, realize the two coordinate centers 0 1 and 0 through translation.
  • Fig. 4 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment.
  • the difference from the above-mentioned embodiment is that in step S108, based on the coordinate position of the observation point, The information corresponding to the observation point is converted to the same coordinate system, including step S109, step S110, and step S111.
  • step S109 determine the coordinate system information of the observation point during multiple scans
  • step S110 obtain relative pose information of the vehicle body between two adjacent scans in multiple scans
  • step S111 based on the coordinate system information and the relative pose information, the information corresponding to the observation point in the previous scan is sequentially converted to the coordinate system corresponding to the next scan, until the information corresponding to the observation point is transferred to the last One scan corresponds to the coordinate system.
  • the scanning frequency of the single-line lidar can be set according to time or distance parameters. For example, according to the distance parameter setting, for example, the vehicle body travels 1 meter forward, and the starting position of the vehicle body is used as the starting point. During this period, the single-line lidar scans once every 0.1 meters, for a total of 10 scans.
  • the first scan is started, the first coordinate system information of the observation point is determined, and the position where the single-line laser class is located is the coordinate origin; when the vehicle body continues to travel forward 0.2 meters , Start the second scan, determine the second coordinate system information of the observation point, take the position of the single-line laser class as the origin of the coordinate, and use different coordinate systems for the two scans.
  • the point cloud data of the observation point is converted into the coordinate system used in the second scan.
  • the wheel speed sensor can be used to measure the rotation angle of the car body between the first scan and the second scan, which can be obtained by an inertial sensor (IMU, Inertial Measurement Unit). According to the obtained distance and angle, Perform the same translation or rotation on the first coordinate system, and convert the point cloud data of the observation point acquired in the first scan to the second coordinate system. By analogy, the point cloud data of the observation point acquired in the ninth scan is converted to the coordinate system used in the tenth scan.
  • IMU Inertial Measurement Unit
  • the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image.
  • the normal estimation method can be used to extract point cloud features.
  • the advantage of the normal estimation method is that the calculation speed is faster, and the point feature histogram can be used for more complex scenes.
  • Method by parameterizing the spatial difference between the query point and the neighboring point, and forming a multi-dimensional histogram to describe the k-neighborhood geometric attributes of the point.
  • the high-dimensional hyperspace where the histogram is located provides measurable information for the feature representation Space, it is invariant to the 6-dimensional posture of the corresponding surface of the point cloud, and it is robust under different sampling densities or noise levels in the neighborhood; fast point feature histograms with a small amount of calculation and Anti-resolution change rotating image method to extract point cloud feature information.
  • Fig. 5 is a flowchart of a vehicle body positioning method according to an exemplary embodiment. Referring to Fig. 5, the difference from the above-mentioned embodiment is that in step S101, at least one single-line lidar is used to scan and acquire the vehicle body
  • the three-dimensional point cloud data of the surrounding environment includes step S112 and step S113.
  • step S112 when at least two single-line lidars are provided on the vehicle body, the relative position relationship between the single-line lidars is acquired;
  • step S113 the point cloud data corresponding to the observation point is converted into the same coordinate system according to the relative position relationship.
  • the lidars when there are multiple lidars installed on the vehicle body, for example, there is a single-line lidar arranged diagonally downward on the roof of the vehicle, and a single-line laser arranged parallel to the plane of the vehicle bottom at the bottom of the vehicle Radar, or a single-line lidar with an oblique upward direction at the headlights, where diagonally downward and diagonally upward refer to the laser pulse direction emitted by the single-line lidar.
  • the multiple single-line lidars When the multiple single-line lidars are installed, the relative positional relationship of the single-line lidars has been determined.
  • the multiple lidars are used to scan and acquire three-dimensional point cloud data of the surrounding environment of the vehicle body, and the single-line lidar is used to translate and rotate the point cloud data corresponding to the observation point.
  • the method is converted to the unified coordinate system.
  • the relative position relationship includes:
  • At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
  • At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
  • At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
  • the plane scanned by the single-line lidar includes a horizontal plane. If the vehicle body is running smoothly, the scanning plane of the single-line lidar does not change, so The acquired point cloud data is two-dimensional point cloud data.
  • the single-line lidar can scan a relatively distant observation point, which can be 80 meters away, and is used in conjunction with the single-line lidar placed diagonally downward, and the single-line lidar placed diagonally downward It is used to scan close observation points, such as observation points within 20 meters, and merge the point cloud data obtained by the two kinds of lidars to achieve a more stable positioning.
  • Fig. 6 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment. 6, the device includes a lidar device 11, an extraction module 12 and a registration module 13.
  • the lidar device 11 includes at least one single-line lidar for scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body, and the direction in which the at least one single-line lidar emits laser light is at least on the plane of the bottom of the vehicle body. An angle relationship;
  • the extraction module 12 is used to extract point cloud feature information in the three-dimensional point cloud data
  • the registration module 13 is configured to register the point cloud feature information with a preset high-precision map to determine the position information of the vehicle body.
  • the included angle relationship includes: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar is in an oblique upward direction Or diagonally downward.
  • the included angle relationship includes: the single-line lidar is arranged on the upper half of the vehicle body in an obliquely downward direction, so that the laser pulse emitted by the single-line lidar is in an obliquely downward direction.
  • Fig. 7 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • the lidar device 11 includes:
  • the first acquisition module 14 is configured to use at least one single-line lidar to perform multiple scans to acquire three-dimensional point cloud data of the surrounding environment of the vehicle body at different scanning positions;
  • the processing module 15 is used for fusing the three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions to generate three-dimensional point cloud data based on the same coordinate system.
  • Fig. 8 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • the processing module 15 includes:
  • the determining sub-module 16 is used to determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
  • the conversion sub-module 17 is configured to convert the point cloud data corresponding to the observation point into the same coordinate system based on the coordinate position of the observation point.
  • Fig. 9 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • the conversion unit 17 includes:
  • the determining unit 18 is used to determine the coordinate system information of the observation point during multiple scans
  • the acquiring unit 19 acquires the relative pose information of the vehicle body between two adjacent scans in multiple scans;
  • the conversion unit 20 based on the coordinate system information and the relative pose information, sequentially converts the point cloud data corresponding to the observation point in the previous scan to the coordinate system corresponding to the next scan until the point cloud data corresponding to the observation point Transfer to the coordinate system corresponding to the last scan.
  • the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image.
  • Fig. 10 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
  • the lidar device 11 includes:
  • the second acquisition module 21 is configured to acquire the relative position relationship between the single-line lidars when at least two single-line lidars are provided on the vehicle body;
  • the conversion module 22 is configured to convert the point cloud data corresponding to the observation point by the single-line lidar to the same coordinate system according to the relative position relationship.
  • the relative position relationship includes:
  • At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
  • At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
  • Fig. 11 is a block diagram showing a vehicle body positioning device 800 according to an exemplary embodiment.
  • the device 800 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
  • the device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, And the communication component 816.
  • the processing component 802 generally controls the overall operations of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing method.
  • the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components.
  • the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
  • the memory 804 is configured to store various types of data to support operations in the device 800. Examples of these data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc.
  • the memory 804 can be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic Disk Magnetic Disk or Optical Disk.
  • the power supply component 806 provides power to various components of the device 800.
  • the power supply component 806 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the device 800.
  • the multimedia component 808 includes a screen that provides an output interface between the device 800 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
  • the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 810 is configured to output and/or input audio signals.
  • the audio component 810 includes a microphone (MIC), and when the device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive external audio signals.
  • the received audio signal may be further stored in the memory 804 or transmitted via the communication component 816.
  • the audio component 810 further includes a speaker for outputting audio signals.
  • the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module.
  • the peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include but are not limited to: home button, volume button, start button, and lock button.
  • the sensor component 814 includes one or more sensors for providing the device 800 with various aspects of status assessment.
  • the sensor component 814 can detect the on/off status of the device 800 and the relative positioning of the components.
  • the component is the display and the keypad of the device 800.
  • the sensor component 814 can also detect the position change of the device 800 or a component of the device 800. , The presence or absence of contact between the user and the device 800, the orientation or acceleration/deceleration of the device 800, and the temperature change of the device 800.
  • the sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact.
  • the sensor component 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.
  • the communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices.
  • the device 800 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof.
  • the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • the apparatus 800 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing equipment (DSPD), programmable logic devices (PLD), field programmable A gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
  • ASIC application specific integrated circuits
  • DSP digital signal processors
  • DSPD digital signal processing equipment
  • PLD programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
  • non-transitory computer-readable storage medium including instructions, such as the memory 804 including instructions, which can be executed by the processor 820 of the device 800 to complete the foregoing method.
  • the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
  • Fig. 12 is a block diagram showing a vehicle body positioning device 1900 according to an exemplary embodiment.
  • the device 1900 may be provided as a server. 12
  • the device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932, for storing instructions executable by the processing component 1922, such as application programs.
  • the application program stored in the memory 1932 may include one or more modules each corresponding to a set of instructions.
  • the processing component 1922 is configured to execute instructions to perform the above-described methods.
  • the device 1900 may also include a power component 1926 configured to perform power management of the device 1900, a wired or wireless network interface 1950 configured to connect the device 1900 to the network, and an input output (I/O) interface 1958.
  • the device 1900 can operate based on an operating system stored in the memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.
  • non-transitory computer-readable storage medium including instructions, such as the memory 1932 including instructions, which may be executed by the processing component 1922 of the device 1900 to complete the foregoing method.
  • the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Abstract

A method and device for vehicle body positioning. At least one linear single-line lidar is utilized to scan and acquire three-dimensional point cloud data of the surrounding environment of a vehicle body, and, at least one angular relation is found respectively between the direction of laser beam emission of the at least one single-line lidar and the plane on which the bottom of the vehicle body is located (S101); point cloud feature information in the three-dimensional point cloud data is extracted (S102); and the point cloud feature information is registered with a preset high-definition map to determine location information of the vehicle body (S103). Compared with two-dimensional point cloud data acquired by a single-line radar in the prior art, the reliability is increased when the features of the surrounding environment are sparse.

Description

一种车体定位方法及装置Vehicle body positioning method and device 技术领域Technical field
本公开涉及雷达定位技术领域,尤其涉及一种车体定位方法及装置。The present disclosure relates to the technical field of radar positioning, in particular to a vehicle body positioning method and device.
背景技术Background technique
无人驾驶是智能汽车的一种,也称为轮式移动机器人,主要依靠车内的以计算机系统为主的智能驾驶仪来实现无人驾驶的目的。在无人驾驶技术中,机器人系统中定位和路径规划是一个问题,没有定位,就无法规划路径。相关技术中,无人车定位大多依赖于多线激光雷达(又称三维激光雷达)或单线激光雷达(又称二维激光雷达)或GPS(Global Positioning System,全球定位系统)定位。Unmanned driving is a type of smart car, also known as wheeled mobile robot, which mainly relies on the intelligent driving instrument based on the computer system in the car to realize the purpose of unmanned driving. In unmanned driving technology, positioning and path planning in robotic systems are a problem. Without positioning, the path cannot be planned. In related technologies, unmanned vehicle positioning mostly relies on multi-line lidar (also called three-dimensional lidar) or single-line lidar (also called two-dimensional lidar) or GPS (Global Positioning System, Global Positioning System) positioning.
三维激光雷达(又称多线激光雷达)价格较为昂贵,应用受限。二维激光雷达(又称单线激光雷达),在周边环境特征较少,如较为空旷的沙漠或郊外等,定位效果较差,而依靠无线电技术的GPS定位技术在高建筑物或隧道、室内等环境中,定位不够准确。因此,如何在节省成本的情况下,在一些特殊环境,如空旷区域或室内、隧道等,实现准确定位成为亟待解决的技术问题。Three-dimensional lidar (also called multi-line lidar) is relatively expensive and has limited applications. Two-dimensional lidar (also known as single-line lidar) has fewer features in the surrounding environment, such as relatively open deserts or suburbs, and has poor positioning effects. GPS positioning technology based on radio technology is used in high buildings or tunnels, indoors, etc. In the environment, the positioning is not accurate enough. Therefore, how to achieve accurate positioning in some special environments, such as open areas or indoors, tunnels, etc., while saving costs has become an urgent technical problem to be solved.
发明内容Summary of the invention
为克服相关技术中存在的问题,本公开提供一种车体定位方法及装置。In order to overcome the problems in the related art, the present disclosure provides a vehicle body positioning method and device.
根据本公开实施例的第一方面,提供一种车体定位方法,包括:According to a first aspect of the embodiments of the present disclosure, there is provided a vehicle body positioning method, including:
利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据,且所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系;Using at least one single-line lidar to scan and obtain three-dimensional point cloud data of the surrounding environment of the vehicle body, and the directions of the at least one single-line lidar emitting laser light respectively have at least one angle relationship with the plane where the bottom of the vehicle body is located;
提取所述三维点云数据中的点云特征信息;Extracting point cloud feature information in the three-dimensional point cloud data;
将所述点云特征信息与预设高精地图进行配准,确定所述车体的位置信息。The point cloud feature information is registered with a preset high-precision map to determine the position information of the vehicle body.
在一种可能的实现方式中,所述夹角关系包括:所述单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,所述单线激光雷达发射的激光脉冲为斜向上方向或斜向下方向。In a possible implementation, the included angle relationship includes: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar is in an oblique upward direction Or diagonally downward.
在一种可能的实现方式中,所述夹角关系包括:所述单线激光雷达按照斜向下方向设置于车体上半部,使得所述单线激光雷达发射的激光脉冲为斜向下方向。In a possible implementation manner, the included angle relationship includes: the single-line lidar is arranged on the upper half of the vehicle body in an obliquely downward direction, so that the laser pulse emitted by the single-line lidar is in an obliquely downward direction.
在一种可能的实现方式中,所述利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据包括:In a possible implementation, the scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body by using at least one single-line lidar includes:
利用至少一个单线激光雷达进行多次扫描,获取车体在不同扫描位置处周围环境的三维点云数据;Use at least one single-line lidar to perform multiple scans to obtain three-dimensional point cloud data of the surrounding environment of the vehicle body at different scan positions;
将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据。The three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions are fused to generate three-dimensional point cloud data based on the same coordinate system.
在一种可能的实现方式中,所述将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据,包括:In a possible implementation manner, the fusing three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions to generate three-dimensional point cloud data based on the same coordinate system includes:
确定所述单线激光雷达在多次扫描中扫描到的周围环境中的观测点,并获取所述观测点的坐标位 置;Determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
基于所述观测点的坐标位置,将所述观测点对应的点云数据转换到同一坐标系中。Based on the coordinate position of the observation point, the point cloud data corresponding to the observation point is converted into the same coordinate system.
在一种可能的实现方式中,所述基于所述观测点的坐标位置,将所述观测点对应的点云数据转换到同一坐标系中,包括:In a possible implementation manner, the converting point cloud data corresponding to the observation point into the same coordinate system based on the coordinate position of the observation point includes:
确定多次扫描时所述观测点所在的坐标系信息;Determining the coordinate system information of the observation point during multiple scans;
获取多次扫描中相邻两次扫描之间所述车体的相对位姿信息;Acquiring relative pose information of the vehicle body between two adjacent scans in multiple scans;
基于所述坐标系信息以及相对位姿信息,依次将上一次扫描时观测点对应的点云数据转换至下一次扫描对应的坐标系中,直至所述观测点对应的点云数据转移至最后一次扫描对应的坐标系中。Based on the coordinate system information and the relative pose information, the point cloud data corresponding to the observation point in the previous scan is sequentially converted to the coordinate system corresponding to the next scan, until the point cloud data corresponding to the observation point is transferred to the last scan Scan the corresponding coordinate system.
在一种可能的实现方式中,所述点云特征信息的描述形式包括法线估计、点特征直方图、快速点特征直方图及旋转图像(spin image)中的一种或几种。In a possible implementation manner, the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image.
在一种可能的实现方式中,所述利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据,包括:In a possible implementation manner, the scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body using at least one single-line lidar includes:
在车体上设置有至少两个单线激光雷达的情况下,获取所述单线激光雷达之间的相对位置关系;In the case where at least two single-line lidars are provided on the vehicle body, acquiring the relative position relationship between the single-line lidars;
根据所述相对位置关系,将所述观测点对应的点云数据转换到同一坐标系中。According to the relative position relationship, the point cloud data corresponding to the observation point is converted into the same coordinate system.
在一种可能的实现方式中,所述相对位置关系包括:In a possible implementation manner, the relative position relationship includes:
至少一个所述单线激光雷达设置于车体顶部,使得所述单线激光雷达发射的激光脉冲为斜向下方向;At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
至少一个所述单线激光雷达设置于车体底部,使得所述单线激光雷达发射的激光脉冲为平行于车体底部方向。At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
根据本公开实施例的第二方面,提供一种车体定位装置,包括:According to a second aspect of the embodiments of the present disclosure, there is provided a vehicle body positioning device, including:
激光雷达装置,包括至少一个单线激光雷达,用于扫描并获取车体周围环境的三维点云数据,且所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系;The lidar device includes at least one single-line lidar for scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body, and the direction in which the at least one single-line lidar emits laser light is at least the same as the plane where the bottom of the vehicle body is located. Kind of angle relationship;
提取模块,用于提取所述三维点云数据中的点云特征信息;An extraction module for extracting point cloud feature information in the three-dimensional point cloud data;
配准模块,用于将所述点云特征信息与预设高精地图进行配准,确定所述车体的位置信息。The registration module is used to register the point cloud feature information with a preset high-precision map to determine the position information of the vehicle body.
在一种可能的实现方式中,所述夹角关系包括:所述单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,所述单线激光雷达发射的激光脉冲为斜向上方向或斜向下方向。In a possible implementation, the included angle relationship includes: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar is in an oblique upward direction Or diagonally downward.
在一种可能的实现方式中,所述夹角关系包括:所述单线激光雷达按照斜向下方向设置于车体上半部,使得所述单线激光雷达发射的激光脉冲为斜向下方向。In a possible implementation manner, the included angle relationship includes: the single-line lidar is arranged on the upper half of the vehicle body in an obliquely downward direction, so that the laser pulse emitted by the single-line lidar is in an obliquely downward direction.
在一种可能的实现方式中,所述激光雷达装置包括:In a possible implementation manner, the lidar device includes:
第一获取模块,用于利用至少一个单线激光雷达进行多次扫描,获取车体在不同扫描位置处周围环境的三维点云数据;The first acquisition module is configured to use at least one single-line lidar to perform multiple scans to acquire three-dimensional point cloud data of the surrounding environment of the vehicle body at different scanning positions;
处理模块,用于将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据。The processing module is used to fuse the three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions to generate three-dimensional point cloud data based on the same coordinate system.
在一种可能的实现方式中,所述处理模块包括:In a possible implementation manner, the processing module includes:
确定子模块,用于确定所述单线激光雷达在多次扫描中扫描到的周围环境中的观测点,并获取所述观测点的坐标位置;The determining sub-module is used to determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
转换子模块,用于基于所述观测点的坐标位置,将所述观测点对应的点云数据转换到同一坐标系中。The conversion sub-module is used to convert the point cloud data corresponding to the observation point into the same coordinate system based on the coordinate position of the observation point.
在一种可能的实现方式中,所述转换子模块包括:In a possible implementation manner, the conversion submodule includes:
确定单元,用于确定多次扫描时所述观测点所在的坐标系信息;The determining unit is used to determine the coordinate system information of the observation point during multiple scans;
获取单元,获取多次扫描中相邻两次扫描之间所述车体的相对位姿信息;An acquiring unit to acquire relative pose information of the vehicle body between two adjacent scans in multiple scans;
转换单元,基于所述坐标系信息以及相对位姿信息,依次将上一次扫描时观测点对应的点云数据转换至下一次扫描对应的坐标系中,直至所述观测点对应的点云数据转移至最后一次扫描对应的坐标系中。The conversion unit, based on the coordinate system information and the relative pose information, sequentially converts the point cloud data corresponding to the observation point in the previous scan to the coordinate system corresponding to the next scan, until the point cloud data corresponding to the observation point is transferred To the coordinate system corresponding to the last scan.
在一种可能的实现方式中,所述点云特征信息的描述形式包括法线估计、点特征直方图、快速点特征直方图及旋转图像(spin image)中的一种或几种。In a possible implementation manner, the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image.
在一种可能的实现方式中,所述夹角关系包括平行于所述车体底部所在平面。In a possible implementation manner, the included angle relationship includes a plane parallel to the bottom of the vehicle body.
在一种可能的实现方式中,所述激光雷达装置包括:In a possible implementation manner, the lidar device includes:
第二获取模块,用于在车体上设置有至少两个单线激光雷达的情况下,获取所述单线激光雷达之间的相对位置关系;The second acquisition module is configured to acquire the relative position relationship between the single-line laser radars when at least two single-line laser radars are provided on the vehicle body;
转换模块,用于根据所述相对位置关系,将所述单线激光雷达将所述观测点对应的点云数据转换到同一坐标系中。The conversion module is configured to convert the point cloud data corresponding to the observation point by the single-line lidar into the same coordinate system according to the relative position relationship.
在一种可能的实现方式中,所述相对位置关系包括:In a possible implementation manner, the relative position relationship includes:
至少一个所述单线激光雷达设置于车体顶部,使得所述单线激光雷达发射的激光脉冲为斜向下方向;At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
至少一个所述单线激光雷达设置于车体底部,使得所述单线激光雷达发射的激光脉冲为平行于车体底部方向。At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
根据本公开的第三方面,提供一种车体定位装置,包括:According to a third aspect of the present disclosure, there is provided a vehicle body positioning device, including:
处理器;processor;
用于存储处理器可执行指令的存储器;A memory for storing processor executable instructions;
其中,所述处理器被配置为:执行本公开任一实施例所述的方法。Wherein, the processor is configured to execute the method described in any embodiment of the present disclosure.
根据本公开的第四方面,提供了一种非临时性计算机可读存储介质,当所述存储介质中的指令由处理器执行时,使得处理器能够执行根据本公开任一实施例所述的方法。According to a fourth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium. When instructions in the storage medium are executed by a processor, the processor can execute the method.
本公开的实施例提供的技术方案可以包括以下有益效果:本公开包括至少一个单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,且所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系,使得车辆在行进的过程中,单线雷达的扫描平面不断的发生变化,进而获取车体周围环境的三维点云数据,相较于现有技术中单线雷达的获取的二维点云数据,在周边环境稀少时,可靠性增强;同时,利用位于车体其他部位的单线雷达,如平行于所述车体 底部所在的平面,可获得远距离的二维点云数据,再与所述三维点云数据进行融合,进一步增强了定位的准确度和稳定性。The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects: the present disclosure includes at least one single-line lidar disposed on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the at least one single-line lidar emits laser light The directions are in at least one angle relationship with the plane where the bottom of the vehicle body is located, so that the scanning plane of the single-line radar constantly changes when the vehicle is traveling, so as to obtain three-dimensional point cloud data of the surrounding environment of the vehicle body. The two-dimensional point cloud data obtained by the single-line radar in the prior art is more reliable when the surrounding environment is scarce; at the same time, single-line radars located in other parts of the car body are used, such as parallel to the plane where the bottom of the car body is located, Long-distance two-dimensional point cloud data can be obtained, and then fused with the three-dimensional point cloud data to further enhance the accuracy and stability of positioning.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure.
附图说明Description of the drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。The drawings herein are incorporated into the specification and constitute a part of the specification, show embodiments in accordance with the disclosure, and together with the specification are used to explain the principle of the disclosure.
图1是根据一示例性实施例示出的一种车体定位方法的流程图。Fig. 1 is a flow chart showing a method for positioning a vehicle body according to an exemplary embodiment.
图2是根据一示例性实施例示出的一种车体定位方法的流程图。Fig. 2 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment.
图3是根据一示例性实施例示出的一种车体定位方法的流程图。Fig. 3 is a flow chart showing a vehicle body positioning method according to an exemplary embodiment.
图4是根据一示例性实施例示出的一种车体定位方法的流程图。Fig. 4 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment.
图5是根据一示例性实施例示出的一种车体定位方法的流程图。Fig. 5 is a flow chart showing a method for positioning a vehicle body according to an exemplary embodiment.
图6是根据一示例性实施例示出的一种车体定位装置的框图。Fig. 6 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
图7是根据一示例性实施例示出的一种车体定位装置的框图。Fig. 7 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
图8是根据一示例性实施例示出的一种车体定位装置的框图。Fig. 8 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
图9是根据一示例性实施例示出的一种车体定位装置的框图。Fig. 9 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
图10是根据一示例性实施例示出的一种车体定位装置的框图。Fig. 10 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment.
图11是根据一示例性实施例示出的一种装置的框图。Fig. 11 is a block diagram showing a device according to an exemplary embodiment.
图12是根据一示例性实施例示出的一种装置的框图。Fig. 12 is a block diagram showing a device according to an exemplary embodiment.
具体实施方式detailed description
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Here, exemplary embodiments will be described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. Rather, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
激光雷达是一种主动传感器,所形成的数据是点云形式,主要由发射机、接收机、测量控制和电源组成。激光雷达在工作时,首先向被测目标发射一束激光,然后测量反射或散射信号到达发射机的时间、信号强弱程度和频率变化等参数,从而确定被测目标的距离、运动速度以及方位;除此以外还可以测出大气中肉眼看不到的微粒的动态,比如距离和角度、形状和大小以及速度和姿态等。Lidar is an active sensor, the data formed is in the form of point cloud, which is mainly composed of transmitter, receiver, measurement control and power supply. When the lidar is working, it first emits a laser beam to the measured target, and then measures the time for the reflected or scattered signal to reach the transmitter, the signal strength, and the frequency change, so as to determine the distance, movement speed and orientation of the measured target In addition, it can also measure the dynamics of particles in the atmosphere that are invisible to the naked eye, such as distance and angle, shape and size, and speed and attitude.
目前激光雷达包括单线激光雷达和多线激光雷达,其中,单线激光雷达中激光源发出的线束是单线的,在一个固定的扫描平面上获取点云信息,比如水平面;多线激光雷达中具有多个激光源,可以发射多线束的激光脉冲,所述多个激光源在垂直方向上排列分布,通过电机旋转形成多线束的扫描,并具有多个扫描平面。At present, lidar includes single-line lidar and multi-line lidar. Among them, the line beam emitted by the laser source in single-line lidar is single-line, and point cloud information is obtained on a fixed scanning plane, such as the horizontal plane; A laser source can emit laser pulses of multiple beams. The multiple laser sources are arranged and distributed in a vertical direction, and the scanning of the multiple beams is formed by motor rotation, and has multiple scanning planes.
图1是根据一示例性实施例示出的一种车体定位方法的流程图,参考图1,包括以下步骤。Fig. 1 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment. Referring to Fig. 1, the method includes the following steps.
在步骤S101中,利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据,且所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系。In step S101, at least one single-line lidar is used to scan and obtain three-dimensional point cloud data of the surrounding environment of the vehicle body, and the direction in which the at least one single-line lidar emits laser light and the plane at the bottom of the vehicle body are at least one kind of clip. Angle relationship.
本公开实施例中,所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系,所述夹角关系可以是车体底部平面以下一夹角度数,也可以是车底平面以上一夹角度数,比如,当所述单线激光雷达设置于前车灯位置时,所述单线激光雷达的激光发射方向可以包括斜向上45度,也可以包括斜向下45度;当所述单线激光雷达设置于车顶处时,所述单线激光雷达的激光发射方向可以包括斜向下45度。In the embodiment of the present disclosure, the direction of the at least one single-line lidar emitting laser light is in at least one angle relationship with the plane of the bottom of the vehicle body, and the angle relationship may be an angle number below the plane of the bottom of the vehicle body. , It can also be a number of angles above the bottom plane of the vehicle. For example, when the single-line lidar is set at the position of the front lights, the laser emission direction of the single-line lidar can include 45 degrees diagonally upwards, or diagonally. 45 degrees downward; when the single-line lidar is installed at the roof of the vehicle, the laser emission direction of the single-line lidar may include an oblique downward 45 degrees.
在步骤S102中,提取所述三维点云数据中的点云特征信息。In step S102, point cloud feature information in the three-dimensional point cloud data is extracted.
本公开实施例中,通过所述步骤S101获取的三维点云数据量较为庞大,存在数据冗余和噪声,点云特征信息指的是点云数据中较为特殊的一些点的信息,比如尖锐边、光滑边、脊或谷、尖头等,特征点能够反映模型最基本的几何形状,提取点云特征信息包括从所述三维点云数据中进行特征点检测,保留模型的几个形状,为后续配准做准备。In the embodiment of the present disclosure, the amount of three-dimensional point cloud data obtained through the step S101 is relatively large, and there are data redundancy and noise. The point cloud feature information refers to the information of some special points in the point cloud data, such as sharp edges. , Smooth edges, ridges or valleys, sharps, etc., the feature points can reflect the most basic geometric shape of the model. Extracting point cloud feature information includes detecting feature points from the three-dimensional point cloud data, and retaining several shapes of the model for subsequent Prepare for registration.
在步骤S103中,将所述点云特征信息与预设高精地图进行配准,确定所述车体的位置信息。In step S103, the point cloud feature information is registered with a preset high-precision map to determine the position information of the vehicle body.
本公开实施例中,可以利用车辆自带的GPS做出大概位置判断,然后用预先准备好的高精度地图与所述点云特征信息做配准,配对成功后,确认车体的位置信息。In the embodiment of the present disclosure, the GPS of the vehicle can be used to make an approximate location judgment, and then a pre-prepared high-precision map can be used for registration with the point cloud feature information. After the pairing is successful, the location information of the vehicle body can be confirmed.
本公开包括至少一个单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,且所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系,使得车辆在行进的过程中,单线雷达的扫描平面不断的发生变化,进而获取车体周围环境的三维点云数据,相较于现有技术中单线雷达的获取的二维点云数据,在周边环境稀少时,可靠性增强。The present disclosure includes that at least one single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the direction in which the at least one single-line lidar emits laser light and the plane of the bottom of the vehicle body are at least one kind of clip The angle relationship makes the scanning plane of the single-line radar continuously change during the vehicle's travel, and then obtain the three-dimensional point cloud data of the surrounding environment of the vehicle body, compared with the two-dimensional point cloud data obtained by the single-line radar in the prior art , When the surrounding environment is scarce, reliability is enhanced.
在一种可能的实现方式中,所述夹角关系包括:所述单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,所述单线激光雷达发射的激光脉冲为斜向上方向或斜向下方向。In a possible implementation, the included angle relationship includes: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar is in an oblique upward direction Or diagonally downward.
本公开实施例中,所述单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,包括所述单线激光雷达设置于车体的前方中部位置,如前车灯处,还可以包括所述单线激光雷达设置于车体前方上部位置,如车顶处。相应的,当所述单线激光雷达设置于前车灯位置时,所述单线激光雷达的激光发射方向可以包括斜向上方向,也可以包括斜向下方向;当所述单线激光雷达设置于车顶处时,所述单线激光雷达的激光发射方向可以包括斜向下方向。In the embodiment of the present disclosure, the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, including the single-line lidar is arranged at the front middle position of the vehicle body, such as the headlights. Including the single-line lidar is arranged on the upper part of the front of the vehicle body, such as the roof. Correspondingly, when the single-line lidar is set at the front light position, the laser emission direction of the single-line lidar may include an oblique upward direction or an oblique downward direction; when the single-line lidar is set on the roof At the time, the laser emission direction of the single-line lidar may include an oblique downward direction.
在一种可能的实现方式中,所述单线激光雷达按照斜向下方向设置于车体上半部,使得所述单线激光雷达发射的激光脉冲为斜向下方向。In a possible implementation manner, the single-line lidar is arranged on the upper half of the vehicle body in an obliquely downward direction, so that the laser pulse emitted by the single-line lidar is in an obliquely downward direction.
本公开实施例中,当所述单线激光雷达设置于车体顶部时,相较于车体其他部位,单线激光雷达位置更高,进而扫描并获取更为全面的点云信息,通过斜向下发射激光脉冲,可获取与车体高度相当的物体的点云信息,满足无人驾驶的行驶需求,当所述单线激光雷达发射的激光脉冲为斜向下方向时,调节适当的斜向下方向的夹角度数,可以在较小范围,如20米,内的三维点云数据。In the embodiments of the present disclosure, when the single-line lidar is installed on the top of the vehicle body, the position of the single-line lidar is higher than that of other parts of the vehicle body, and then scans and obtains more comprehensive point cloud information. Transmitting laser pulses can obtain point cloud information of objects that are equivalent to the height of the vehicle body to meet the driving needs of unmanned driving. When the laser pulse emitted by the single-line lidar is in the diagonally downward direction, adjust the appropriate diagonal downward direction The number of angles can be within a small range, such as 20 meters, within the three-dimensional point cloud data.
图2是根据一示例性实施例示出的一种车体定位方法的流程图,参考图2,与上述实施例不同的是,所述步骤S101利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据,包括步骤S104和步骤S105。Fig. 2 is a flowchart of a vehicle body positioning method according to an exemplary embodiment. Referring to Fig. 2, the difference from the above-mentioned embodiment is that the step S101 uses at least one single-line lidar to scan and acquire the surrounding environment of the vehicle body The 3D point cloud data includes step S104 and step S105.
在步骤S104中,利用至少一个单线激光雷达进行多次扫描,获取车体在不同扫描位置处周围环 境的三维点云数据。In step S104, at least one single-line lidar is used to perform multiple scans to obtain three-dimensional point cloud data of the surrounding environment of the vehicle body at different scan positions.
本公开实施例中,可以根据时间或距离参数对所述单线激光雷达的扫描频率进行设置,比如,可以设置,每间隔2秒钟时间,所述单线激光雷达扫描一次,根据车辆的行驶速度、加速度等信息可以获得车辆的行驶距离;还可以设置,每间隔1m,所述单线激光雷达扫描一次。In the embodiment of the present disclosure, the scanning frequency of the single-line lidar can be set according to time or distance parameters. For example, it can be set that the single-line lidar scans once every 2 seconds. According to the driving speed of the vehicle, The acceleration and other information can be used to obtain the driving distance of the vehicle; it can also be set that the single-line lidar scans once every 1m.
在步骤S105中,将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据。In step S105, the three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions are merged to generate three-dimensional point cloud data based on the same coordinate system.
本公开实施例中,可以将所述单线激光雷达的所在位置为坐标原点,可以根据数据获取的顺序以及电机旋转的方向,对坐标系进行定义,如定义X轴在横向扫描面内,向右为X轴正向,Y轴在横向扫描面内与X轴垂直向外为正,Z轴与XY平面垂直向上为正。由于车体在不断的前进,坐标原点也在不断的变化,因此,相邻两次扫描获取的三维点云数据所在的坐标系不相同,需要对所述三维点云数据进行融合,生成基于同一坐标系的三维点云数据。In the embodiment of the present disclosure, the position of the single-line lidar can be the origin of the coordinate, and the coordinate system can be defined according to the sequence of data acquisition and the direction of motor rotation. For example, the X axis is defined to be in the horizontal scanning plane and to the right. It is the positive X-axis, the Y-axis is positive when it is perpendicular to the X-axis in the horizontal scanning plane, and the Z-axis is positive when it is perpendicular to the XY plane. Since the car body is constantly advancing and the origin of the coordinates is constantly changing, the coordinate system of the three-dimensional point cloud data obtained from two adjacent scans is not the same, and the three-dimensional point cloud data needs to be fused to generate the data based on the same Three-dimensional point cloud data of the coordinate system.
图3是根据一示例性实施例示出的一种车体定位方法的流程图,参考图3,与上述实施例不同的是,所述步骤S105,将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据,包括步骤S107、步骤S108。Fig. 3 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment. Referring to Fig. 3, the difference from the above embodiment is that in step S105, the vehicle body is positioned at the different scanning positions. The three-dimensional point cloud data of the surrounding environment is merged to generate three-dimensional point cloud data based on the same coordinate system, including step S107 and step S108.
在步骤S107中,确定所述单线激光雷达在多次扫描中扫描到的周围环境中的观测点,并获取所述观测点的坐标位置;In step S107, determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
本公开实施例中,可以利用精密时钟获取所述单线激光雷达发射激光脉冲的时间与接收到反射信号的时间差,可计算出所述观测点到所述单线激光雷达之间的距离S,可以利用扫描仪器自带的精密编码装置将相邻脉冲之间的纵向扫描角度β以及横向扫描角度α记录在编码器中,利用极坐标法将距离和角度转换为所述观测点P的坐标,其中定义X轴在横向扫描面内,向右为X轴正向,Y轴在横向扫描面内与X轴垂直向外为正,Z轴与XY平面垂直向上为正。所述观测点P的坐标表示为:X(p)=S·cosα·cosβ,Y(p)=S·sinα·sinβ,Z(p)=S·cosβ。In the embodiments of the present disclosure, a precise clock can be used to obtain the time difference between the time when the single-line lidar emits laser pulses and the time when the reflected signal is received, and the distance S between the observation point and the single-line lidar can be calculated. The precision encoding device that comes with the scanning instrument records the vertical scanning angle β and the horizontal scanning angle α between adjacent pulses in the encoder, and uses the polar coordinate method to convert the distance and angle into the coordinates of the observation point P, which defines The X axis is in the horizontal scanning plane, the X axis is positive to the right, the Y axis is positive in the horizontal scanning plane perpendicular to the X axis, and the Z axis and the XY plane are positive. The coordinates of the observation point P are expressed as: X(p)=S·cosα·cosβ, Y(p)=S·sinα·sinβ, Z(p)=S·cosβ.
在步骤S108中,基于所述观测点的坐标位置,将所述观测点对应的信息转换到同一坐标系中。In step S108, based on the coordinate position of the observation point, the information corresponding to the observation point is converted into the same coordinate system.
本公开实施例中,由于车体在不断的前进,每次扫描所使用的坐标系并不相同,可以通过坐标转换的方法,将上一次扫描所述观测点使用的坐标系如0 1-X 1Y 1Z 1转换到下一次扫描所述观测点使用的坐标系如0 2-X 2Y 2Z 2中,所述坐标转换方法可以包括:首先,通过平移实现两坐标中心0 1和0 2的重合,其次,平移后原点重合的两坐标系0 1-X 1Y 1Z 1和0 2-X 2Y 2Z 2通过旋转,实现0 1-X 1Y 1Z 1向0 2-X 2Y 2Z 2的转换。 In the embodiments of the present disclosure, since the vehicle body is continuously advancing, the coordinate system used in each scan is different, and the coordinate system used in the observation point in the last scan can be changed to 0 1 -X by means of coordinate conversion. 1 Y 1 Z 1 is converted to the coordinate system used by the observation point in the next scan, such as 0 2 -X 2 Y 2 Z 2 , and the coordinate conversion method may include: First, realize the two coordinate centers 0 1 and 0 through translation. The coincidence of 2 , and secondly, the two coordinate systems where the origin coincides after translation 0 1 -X 1 Y 1 Z 1 and 0 2 -X 2 Y 2 Z 2 through rotation to achieve 0 1 -X 1 Y 1 Z 1 to 0 2- X 2 Y 2 Z 2 conversion.
图4是根据一示例性实施例示出的一种车体定位方法的流程图,参考图4,与上述实施例不同的是,所述步骤S108中,基于所述观测点的坐标位置,将所述观测点对应的信息转换到同一坐标系中,包括步骤S109、步骤S110和步骤S111。Fig. 4 is a flowchart showing a vehicle body positioning method according to an exemplary embodiment. Referring to Fig. 4, the difference from the above-mentioned embodiment is that in step S108, based on the coordinate position of the observation point, The information corresponding to the observation point is converted to the same coordinate system, including step S109, step S110, and step S111.
在步骤S109中,确定多次扫描时所述观测点所在的坐标系信息;In step S109, determine the coordinate system information of the observation point during multiple scans;
在步骤S110中,获取多次扫描中相邻两次扫描之间所述车体的相对位姿信息;In step S110, obtain relative pose information of the vehicle body between two adjacent scans in multiple scans;
在步骤S111中,基于所述坐标系信息以及相对位姿信息,依次将上一次扫描时观测点对应的信 息转换至下一次扫描对应的坐标系中,直至所述观测点对应的信息转移至最后一次扫描对应的坐标系中。In step S111, based on the coordinate system information and the relative pose information, the information corresponding to the observation point in the previous scan is sequentially converted to the coordinate system corresponding to the next scan, until the information corresponding to the observation point is transferred to the last One scan corresponds to the coordinate system.
上述实施例中提到,可以根据时间或距离参数对所述单线激光雷达的扫描频率进行设置。比如按照距离参数设置,如,车体向前行驶了1米,以所述车体始发位置作为起点,在这期间,所述单线激光雷达每经过0.1米扫描一次,一共扫描10次。所述车体行驶0.1米,开始第一扫描,确定所述观测点的第一坐标系信息,以此处单线激光类达所在的位置为坐标原点;当所述车体继续向前行驶0.2米,开始第二次扫描,确定所述观测点的第二坐标系信息,以此处单线激光类达所在的位置为坐标原点,两次扫描使用不同的坐标系,需要将第一次扫描获取的所述观测点的点云数据转换到第二次扫描所使用的坐标系中。As mentioned in the foregoing embodiment, the scanning frequency of the single-line lidar can be set according to time or distance parameters. For example, according to the distance parameter setting, for example, the vehicle body travels 1 meter forward, and the starting position of the vehicle body is used as the starting point. During this period, the single-line lidar scans once every 0.1 meters, for a total of 10 scans. When the vehicle body travels 0.1 meters, the first scan is started, the first coordinate system information of the observation point is determined, and the position where the single-line laser class is located is the coordinate origin; when the vehicle body continues to travel forward 0.2 meters , Start the second scan, determine the second coordinate system information of the observation point, take the position of the single-line laser class as the origin of the coordinate, and use different coordinate systems for the two scans. The point cloud data of the observation point is converted into the coordinate system used in the second scan.
本公开实施例中,在转换的过程中,需要根据两个坐标系之间的变换关系,可以通过车体的位姿信息进行获取。可以通过轮速传感器,测量所述车体在第一次扫描到第二次扫描之间,车体旋转的角度,可以通过惯性传感器(IMU,Inertial Measurement Unit)获得,根据获取的距离和角度,对第一坐标系做相同的平移或旋转,将第一次扫描获取的观测点的点云数据转换到第二坐标系中。以此类推,将第九次扫描获取的观测点的点云数据转换到第十次扫描使用的坐标系中。In the embodiment of the present disclosure, in the conversion process, it is necessary to obtain the pose information of the vehicle body according to the conversion relationship between the two coordinate systems. The wheel speed sensor can be used to measure the rotation angle of the car body between the first scan and the second scan, which can be obtained by an inertial sensor (IMU, Inertial Measurement Unit). According to the obtained distance and angle, Perform the same translation or rotation on the first coordinate system, and convert the point cloud data of the observation point acquired in the first scan to the second coordinate system. By analogy, the point cloud data of the observation point acquired in the ninth scan is converted to the coordinate system used in the tenth scan.
在一种可能的实现方式中,所述点云特征信息的描述形式包括法线估计、点特征直方图、快速点特征直方图及旋转图像(spin image)中的一种或几种。In a possible implementation manner, the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image.
本公开实施例中,对于特征点较少的观测对象,可采用法线估计方法提取点云特征,法线估计方法的优点是,计算速度较快,对于较为复杂的场景可以使用点特征直方图方法,通过参数化查询点与邻域点之间的空间差异,并形成一个多维直方图对点的k邻域几何属性进行描述,直方图所在的高维超空间为特征表示提供了一个可度量的信息空间,对点云对应曲面的6维姿态来说它具有不变性,并且在不同的采样密度或邻域的噪音等级下具有鲁棒性;还可以采用计算量较小的快速点特征直方图以及抗分辨率变化旋转图像方法来提取点云特征信息。In the embodiments of the present disclosure, for observation objects with fewer feature points, the normal estimation method can be used to extract point cloud features. The advantage of the normal estimation method is that the calculation speed is faster, and the point feature histogram can be used for more complex scenes. Method, by parameterizing the spatial difference between the query point and the neighboring point, and forming a multi-dimensional histogram to describe the k-neighborhood geometric attributes of the point. The high-dimensional hyperspace where the histogram is located provides measurable information for the feature representation Space, it is invariant to the 6-dimensional posture of the corresponding surface of the point cloud, and it is robust under different sampling densities or noise levels in the neighborhood; fast point feature histograms with a small amount of calculation and Anti-resolution change rotating image method to extract point cloud feature information.
图5是根据一示例性实施例示出的一种车体定位方法的流程图,参考图5,与上述实施例不同的是,所述步骤S101中,利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据,包括步骤S112和步骤S113。Fig. 5 is a flowchart of a vehicle body positioning method according to an exemplary embodiment. Referring to Fig. 5, the difference from the above-mentioned embodiment is that in step S101, at least one single-line lidar is used to scan and acquire the vehicle body The three-dimensional point cloud data of the surrounding environment includes step S112 and step S113.
在步骤S112中,在车体上设置有至少两个单线激光雷达的情况下,获取所述单线激光雷达之间的相对位置关系;In step S112, when at least two single-line lidars are provided on the vehicle body, the relative position relationship between the single-line lidars is acquired;
在步骤S113中,根据所述相对位置关系,将所述观测点对应的点云数据转换到同一坐标系中。In step S113, the point cloud data corresponding to the observation point is converted into the same coordinate system according to the relative position relationship.
本公开实施例中,所述车体上有多个激光雷达设置时,比如,在车顶出有斜向下方向设置的单线激光雷达,在车底处有平行于车底平面设置的单线激光雷达,或者在车灯处有斜向上方向设置的单线激光雷达,其中,斜向下和斜向上均指的是,所述单线激光雷达发射的激光脉冲方向。在所述多个单线激光雷达安装时,所述单线激光雷达的相对位置关系已经确定。根据所述相对位置关系,利用所述多个激光雷达扫描并获取所述车体周围环境的三维点云数据,将所述单线激光雷达将所述观测点对应的点云数据通过上述平移和旋转的方法转换到统一坐标系中。In the embodiment of the present disclosure, when there are multiple lidars installed on the vehicle body, for example, there is a single-line lidar arranged diagonally downward on the roof of the vehicle, and a single-line laser arranged parallel to the plane of the vehicle bottom at the bottom of the vehicle Radar, or a single-line lidar with an oblique upward direction at the headlights, where diagonally downward and diagonally upward refer to the laser pulse direction emitted by the single-line lidar. When the multiple single-line lidars are installed, the relative positional relationship of the single-line lidars has been determined. According to the relative positional relationship, the multiple lidars are used to scan and acquire three-dimensional point cloud data of the surrounding environment of the vehicle body, and the single-line lidar is used to translate and rotate the point cloud data corresponding to the observation point. The method is converted to the unified coordinate system.
在一种可能的实现方式中,所述相对位置关系包括:In a possible implementation manner, the relative position relationship includes:
至少一个所述单线激光雷达设置于车体顶部,使得所述单线激光雷达发射的激光脉冲为斜向下方向;At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
至少一个所述单线激光雷达设置于车体底部,使得所述单线激光雷达发射的激光脉冲为平行于车体底部方向。At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
本公开实施例中,至少一个所述单线激光雷达设置于车体底部,使得所述单线激光雷达发射的激光脉冲为平行于车体底部方向。当所述单线激光雷达发射激光的方向与所述车体底部所在平面相平行时,单线激光雷达扫描的平面包括水平面,若车体平稳行驶,所述单线激光雷达扫描平面并没有发生变化,所获取的点云数据为二维点云数据。这种情况下,所述单线激光雷达能够扫描较远处的观测点,可实现80米远,与所述斜向下方向放置的单线激光雷达配合使用,所述斜向下放置的单线激光雷达用于扫描近处,如20米范围内的观测点,并将两种激光雷达获取的点云数据进行融合,能够达到较稳定的定位。In the embodiment of the present disclosure, at least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body. When the direction of the single-line lidar emitting laser light is parallel to the plane where the bottom of the vehicle body is located, the plane scanned by the single-line lidar includes a horizontal plane. If the vehicle body is running smoothly, the scanning plane of the single-line lidar does not change, so The acquired point cloud data is two-dimensional point cloud data. In this case, the single-line lidar can scan a relatively distant observation point, which can be 80 meters away, and is used in conjunction with the single-line lidar placed diagonally downward, and the single-line lidar placed diagonally downward It is used to scan close observation points, such as observation points within 20 meters, and merge the point cloud data obtained by the two kinds of lidars to achieve a more stable positioning.
图6是根据一示例性实施例示出的一种车体定位装置框图。参照图6,该装置包括激光雷达装置11,提取模块12和配准模块13。Fig. 6 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment. 6, the device includes a lidar device 11, an extraction module 12 and a registration module 13.
激光雷达装置11,包括至少一个单线激光雷达,用于扫描并获取车体周围环境的三维点云数据,且所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系;The lidar device 11 includes at least one single-line lidar for scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body, and the direction in which the at least one single-line lidar emits laser light is at least on the plane of the bottom of the vehicle body. An angle relationship;
提取模块12,用于提取所述三维点云数据中的点云特征信息;The extraction module 12 is used to extract point cloud feature information in the three-dimensional point cloud data;
配准模块13,用于将所述点云特征信息与预设高精地图进行配准,确定所述车体的位置信息。The registration module 13 is configured to register the point cloud feature information with a preset high-precision map to determine the position information of the vehicle body.
在一种可能的实现方式中,所述夹角关系包括:所述单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,所述单线激光雷达发射的激光脉冲为斜向上方向或斜向下方向。In a possible implementation, the included angle relationship includes: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar is in an oblique upward direction Or diagonally downward.
在一种可能的实现方式中,所述夹角关系包括:所述单线激光雷达按照斜向下方向设置于车体上半部,使得所述单线激光雷达发射的激光脉冲为斜向下方向。In a possible implementation manner, the included angle relationship includes: the single-line lidar is arranged on the upper half of the vehicle body in an obliquely downward direction, so that the laser pulse emitted by the single-line lidar is in an obliquely downward direction.
图7是根据一示例性实施例示出的一种车体定位装置框图。参照图7,所述激光雷达装置11包括:Fig. 7 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment. Referring to FIG. 7, the lidar device 11 includes:
第一获取模块14,用于利用至少一个单线激光雷达进行多次扫描,获取车体在不同扫描位置处周围环境的三维点云数据;The first acquisition module 14 is configured to use at least one single-line lidar to perform multiple scans to acquire three-dimensional point cloud data of the surrounding environment of the vehicle body at different scanning positions;
处理模块15,用于将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据。The processing module 15 is used for fusing the three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions to generate three-dimensional point cloud data based on the same coordinate system.
图8是根据一示例性实施例示出的一种车体定位装置框图。参照图8,所述处理模块15包括:Fig. 8 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment. Referring to FIG. 8, the processing module 15 includes:
确定子模块16,用于确定所述单线激光雷达在多次扫描中扫描到的周围环境中的观测点,并获取所述观测点的坐标位置;The determining sub-module 16 is used to determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
转换子模块17,用于基于所述观测点的坐标位置,将所述观测点对应的点云数据转换到同一坐标系中。The conversion sub-module 17 is configured to convert the point cloud data corresponding to the observation point into the same coordinate system based on the coordinate position of the observation point.
图9是根据一示例性实施例示出的一种车体定位装置框图。参照图9,所述转换单元17包括:Fig. 9 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment. Referring to FIG. 9, the conversion unit 17 includes:
确定单元18,用于确定多次扫描时所述观测点所在的坐标系信息;The determining unit 18 is used to determine the coordinate system information of the observation point during multiple scans;
获取单元19,获取多次扫描中相邻两次扫描之间所述车体的相对位姿信息;The acquiring unit 19 acquires the relative pose information of the vehicle body between two adjacent scans in multiple scans;
转换单元20,基于所述坐标系信息以及相对位姿信息,依次将上一次扫描时观测点对应的点云数据转换至下一次扫描对应的坐标系中,直至所述观测点对应的点云数据转移至最后一次扫描对应的坐标系中。The conversion unit 20, based on the coordinate system information and the relative pose information, sequentially converts the point cloud data corresponding to the observation point in the previous scan to the coordinate system corresponding to the next scan until the point cloud data corresponding to the observation point Transfer to the coordinate system corresponding to the last scan.
在一种可能的实现方式中,所述点云特征信息的描述形式包括法线估计、点特征直方图、快速点特征直方图及旋转图像(spin image)中的一种或几种。In a possible implementation manner, the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image.
图10是根据一示例性实施例示出的一种车体定位装置框图。参照图10,所述激光雷达装置11包括:Fig. 10 is a block diagram showing a vehicle body positioning device according to an exemplary embodiment. 10, the lidar device 11 includes:
第二获取模块21,用于在车体上设置有至少两个单线激光雷达的情况下,获取所述单线激光雷达之间的相对位置关系;The second acquisition module 21 is configured to acquire the relative position relationship between the single-line lidars when at least two single-line lidars are provided on the vehicle body;
转换模块22,用于根据所述相对位置关系,将所述单线激光雷达将所述观测点对应的点云数据转换到同一坐标系中。The conversion module 22 is configured to convert the point cloud data corresponding to the observation point by the single-line lidar to the same coordinate system according to the relative position relationship.
在一种可能的实现方式中,所述相对位置关系包括:In a possible implementation manner, the relative position relationship includes:
至少一个所述单线激光雷达设置于车体顶部,使得所述单线激光雷达发射的激光脉冲为斜向下方向;At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
至少一个所述单线激光雷达设置于车体底部,使得所述单线激光雷达发射的激光脉冲为平行于车体底部方向。At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。Regarding the device in the foregoing embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the method, and detailed description will not be given here.
图11是根据一示例性实施例示出的一种车体定位装置800的框图。例如,装置800可以是移动电话,计算机,数字广播终端,消息收发设备,游戏控制台,平板设备,医疗设备,健身设备,个人数字助理等。Fig. 11 is a block diagram showing a vehicle body positioning device 800 according to an exemplary embodiment. For example, the device 800 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
参照图11,装置800可以包括以下一个或多个组件:处理组件802,存储器804,电源组件806,多媒体组件808,音频组件810,输入/输出(I/O)的接口812,传感器组件814,以及通信组件816。11, the device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, And the communication component 816.
处理组件802通常控制装置800的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件802可以包括一个或多个处理器820来执行指令,以完成上述的方法的全部或部分步骤。此外,处理组件802可以包括一个或多个模块,便于处理组件802和其他组件之间的交互。例如,处理组件802可以包括多媒体模块,以方便多媒体组件808和处理组件802之间的交互。The processing component 802 generally controls the overall operations of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
存储器804被配置为存储各种类型的数据以支持在装置800的操作。这些数据的示例包括用于在装置800上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器804可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。The memory 804 is configured to store various types of data to support operations in the device 800. Examples of these data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
电源组件806为装置800的各种组件提供电力。电源组件806可以包括电源管理系统,一个或多 个电源,及其他与为装置800生成、管理和分配电力相关联的组件。The power supply component 806 provides power to various components of the device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the device 800.
多媒体组件808包括在所述装置800和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件808包括一个前置摄像头和/或后置摄像头。当装置800处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
音频组件810被配置为输出和/或输入音频信号。例如,音频组件810包括一个麦克风(MIC),当装置800处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器804或经由通信组件816发送。在一些实施例中,音频组件810还包括一个扬声器,用于输出音频信号。The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive external audio signals. The received audio signal may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 further includes a speaker for outputting audio signals.
I/O接口812为处理组件802和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module. The peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include but are not limited to: home button, volume button, start button, and lock button.
传感器组件814包括一个或多个传感器,用于为装置800提供各个方面的状态评估。例如,传感器组件814可以检测到装置800的打开/关闭状态,组件的相对定位,例如所述组件为装置800的显示器和小键盘,传感器组件814还可以检测装置800或装置800一个组件的位置改变,用户与装置800接触的存在或不存在,装置800方位或加速/减速和装置800的温度变化。传感器组件814可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件814还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件814还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。The sensor component 814 includes one or more sensors for providing the device 800 with various aspects of status assessment. For example, the sensor component 814 can detect the on/off status of the device 800 and the relative positioning of the components. For example, the component is the display and the keypad of the device 800. The sensor component 814 can also detect the position change of the device 800 or a component of the device 800. , The presence or absence of contact between the user and the device 800, the orientation or acceleration/deceleration of the device 800, and the temperature change of the device 800. The sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact. The sensor component 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.
通信组件816被配置为便于装置800和其他设备之间有线或无线方式的通信。装置800可以接入基于通信标准的无线网络,如WiFi,2G或3G,或它们的组合。在一个示例性实施例中,通信组件816经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信组件816还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
在示例性实施例中,装置800可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述方法。In an exemplary embodiment, the apparatus 800 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing equipment (DSPD), programmable logic devices (PLD), field programmable A gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器804,上述指令可由装置800的处理器820执行以完成上述方法。例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as the memory 804 including instructions, which can be executed by the processor 820 of the device 800 to complete the foregoing method. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
图12是根据一示例性实施例示出的一种车体定位装置1900的框图。例如,装置1900可以被提供为一服务器。参照图12,装置1900包括处理组件1922,其进一步包括一个或多个处理器,以及由存 储器1932所代表的存储器资源,用于存储可由处理组件1922的执行的指令,例如应用程序。存储器1932中存储的应用程序可以包括一个或一个以上的每一个对应于一组指令的模块。此外,处理组件1922被配置为执行指令,以执行上述方法。Fig. 12 is a block diagram showing a vehicle body positioning device 1900 according to an exemplary embodiment. For example, the device 1900 may be provided as a server. 12, the device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932, for storing instructions executable by the processing component 1922, such as application programs. The application program stored in the memory 1932 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above-described methods.
装置1900还可以包括一个电源组件1926被配置为执行装置1900的电源管理,一个有线或无线网络接口1950被配置为将装置1900连接到网络,和一个输入输出(I/O)接口1958。装置1900可以操作基于存储在存储器1932的操作系统,例如Windows ServerTM,Mac OS XTM,UnixTM,LinuxTM,FreeBSDTM或类似。The device 1900 may also include a power component 1926 configured to perform power management of the device 1900, a wired or wireless network interface 1950 configured to connect the device 1900 to the network, and an input output (I/O) interface 1958. The device 1900 can operate based on an operating system stored in the memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器1932,上述指令可由装置1900的处理组件1922执行以完成上述方法。例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as the memory 1932 including instructions, which may be executed by the processing component 1922 of the device 1900 to complete the foregoing method. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求指出。Those skilled in the art will easily think of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptive changes of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The description and the embodiments are to be regarded as exemplary only, and the true scope and spirit of the present disclosure are pointed out by the following claims.
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。It should be understood that the present disclosure is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is limited only by the appended claims.

Claims (20)

  1. 一种车体定位方法,其特征在于,包括:A vehicle body positioning method is characterized by comprising:
    利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据,且所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系;Using at least one single-line lidar to scan and obtain three-dimensional point cloud data of the surrounding environment of the vehicle body, and the directions of the at least one single-line lidar emitting laser light respectively have at least one angle relationship with the plane where the bottom of the vehicle body is located;
    提取所述三维点云数据中的点云特征信息;Extracting point cloud feature information in the three-dimensional point cloud data;
    将所述点云特征信息与预设高精地图进行配准,确定所述车体的位置信息。The point cloud feature information is registered with a preset high-precision map to determine the position information of the vehicle body.
  2. 根据权利要求1所述的方法,其特征在于,所述夹角关系包括:所述单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,所述单线激光雷达发射的激光脉冲为斜向上方向或斜向下方向。The method according to claim 1, wherein the angle relationship comprises: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar It is diagonally upward or diagonally downward.
  3. 根据权利要求1所述的方法,其特征在于,所述夹角关系包括:所述单线激光雷达按照斜向下方向设置于车体上半部,使得所述单线激光雷达发射的激光脉冲为斜向下方向。The method according to claim 1, wherein the angle relationship comprises: the single-line lidar is arranged on the upper half of the vehicle body in an oblique downward direction, so that the laser pulse emitted by the single-line lidar is oblique Down direction.
  4. 根据权利要求1所述的方法,其特征在于,所述利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据包括:The method according to claim 1, wherein the scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body using at least one single-line lidar comprises:
    利用至少一个单线激光雷达进行多次扫描,获取车体在不同扫描位置处周围环境的三维点云数据;Use at least one single-line lidar to perform multiple scans to obtain three-dimensional point cloud data of the surrounding environment of the vehicle body at different scan positions;
    将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据。The three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions are fused to generate three-dimensional point cloud data based on the same coordinate system.
  5. 根据权利要求4所述的方法,其特征在于,所述将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据,包括:The method according to claim 4, wherein the fusing three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions to generate three-dimensional point cloud data based on the same coordinate system comprises:
    确定所述单线激光雷达在多次扫描中扫描到的周围环境中的观测点,并获取所述观测点的坐标位置;Determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
    基于所述观测点的坐标位置,将所述观测点对应的点云数据转换到同一坐标系中。Based on the coordinate position of the observation point, the point cloud data corresponding to the observation point is converted into the same coordinate system.
  6. 根据权利要求5所述的方法,其特征在于,所述基于所述观测点的坐标位置,将所述观测点对应的点云数据转换到同一坐标系中,包括:The method according to claim 5, wherein said converting the point cloud data corresponding to the observation point to the same coordinate system based on the coordinate position of the observation point comprises:
    确定多次扫描时所述观测点所在的坐标系信息;Determining the coordinate system information of the observation point during multiple scans;
    获取多次扫描中相邻两次扫描之间所述车体的相对位姿信息;Acquiring relative pose information of the vehicle body between two adjacent scans in multiple scans;
    基于所述坐标系信息以及相对位姿信息,依次将上一次扫描时观测点对应的点云数据转换至下一次扫描对应的坐标系中,直至所述观测点对应的点云数据转移至最后一次扫描对应的坐标系中。Based on the coordinate system information and the relative pose information, the point cloud data corresponding to the observation point in the previous scan is sequentially converted to the coordinate system corresponding to the next scan, until the point cloud data corresponding to the observation point is transferred to the last scan Scan the corresponding coordinate system.
  7. 根据权利要求1所述的方法,其特征在于,所述点云特征信息的描述形式包括法线估计、点特征直方图、快速点特征直方图及旋转图像(spin image)中的一种或几种。The method according to claim 1, wherein the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image. Kind.
  8. 根据权利要求1所述的方法,其特征在于,所述利用至少一个单线激光雷达扫描并获取车体周围环境的三维点云数据,包括:The method according to claim 1, wherein the scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body using at least one single-line lidar comprises:
    在车体上设置有至少两个单线激光雷达的情况下,获取所述单线激光雷达之间的相对位置关系;In the case where at least two single-line lidars are provided on the vehicle body, acquiring the relative position relationship between the single-line lidars;
    根据所述相对位置关系,将所述观测点对应的点云数据转换到同一坐标系中。According to the relative position relationship, the point cloud data corresponding to the observation point is converted into the same coordinate system.
  9. 根据权利要求8所述的方法,其特征在于,所述相对位置关系包括:The method according to claim 8, wherein the relative position relationship comprises:
    至少一个所述单线激光雷达设置于车体顶部,使得所述单线激光雷达发射的激光脉冲为斜向下方向;At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
    至少一个所述单线激光雷达设置于车体底部,使得所述单线激光雷达发射的激光脉冲为平行于车体底部方向。At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
  10. 一种车体定位装置,其特征在于,包括:A vehicle body positioning device, characterized in that it comprises:
    激光雷达装置,包括至少一个单线激光雷达,用于扫描并获取车体周围环境的三维点云数据,且所述至少一个单线激光雷达发射激光的方向分别与所述车体底部所在平面呈至少一种夹角关系;The lidar device includes at least one single-line lidar for scanning and acquiring three-dimensional point cloud data of the surrounding environment of the vehicle body, and the direction in which the at least one single-line lidar emits laser light is at least the same as the plane where the bottom of the vehicle body is located. Kind of angle relationship;
    提取模块,用于提取所述三维点云数据中的点云特征信息;An extraction module for extracting point cloud feature information in the three-dimensional point cloud data;
    配准模块,用于将所述点云特征信息与预设高精地图进行配准,确定所述车体的位置信息。The registration module is used to register the point cloud feature information with a preset high-precision map to determine the position information of the vehicle body.
  11. 根据权利要求10所述的装置,其特征在于,所述夹角关系包括:所述单线激光雷达设置于车体上并位于车体底部所在平面以上的位置,所述单线激光雷达发射的激光脉冲为斜向上方向或斜向下方向。The device according to claim 10, wherein the angle relationship comprises: the single-line lidar is arranged on the vehicle body and located at a position above the plane of the bottom of the vehicle body, and the laser pulse emitted by the single-line lidar It is diagonally upward or diagonally downward.
  12. 根据权利要求10所述的装置,其特征在于,所述夹角关系包括:所述单线激光雷达按照斜向下方向设置于车体上半部,使得所述单线激光雷达发射的激光脉冲为斜向下方向。The device according to claim 10, wherein the included angle relationship comprises: the single-line lidar is arranged on the upper half of the vehicle body in an oblique downward direction, so that the laser pulse emitted by the single-line lidar is oblique Down direction.
  13. 根据权利要求10所述的装置,其特征在于,所述激光雷达装置包括:The device according to claim 10, wherein the lidar device comprises:
    第一获取模块,用于利用至少一个单线激光雷达进行多次扫描,获取车体在不同扫描位置处周围环境的三维点云数据;The first acquisition module is configured to use at least one single-line lidar to perform multiple scans to acquire three-dimensional point cloud data of the surrounding environment of the vehicle body at different scanning positions;
    处理模块,用于将所述车体在所述不同扫描位置处周围环境的三维点云数据进行融合,生成基于同一坐标系的三维点云数据。The processing module is used to fuse the three-dimensional point cloud data of the surrounding environment of the vehicle body at the different scanning positions to generate three-dimensional point cloud data based on the same coordinate system.
  14. 根据权利要求13所述的装置,其特征在于,所述处理模块包括:The device according to claim 13, wherein the processing module comprises:
    确定子模块,用于确定所述单线激光雷达在多次扫描中扫描到的周围环境中的观测点,并获取所述观测点的坐标位置;The determining sub-module is used to determine the observation point in the surrounding environment scanned by the single-line lidar in multiple scans, and obtain the coordinate position of the observation point;
    转换子模块,用于基于所述观测点的坐标位置,将所述观测点对应的点云数据转换到同一坐标系中。The conversion sub-module is used to convert the point cloud data corresponding to the observation point into the same coordinate system based on the coordinate position of the observation point.
  15. 根据权利要求14所述的装置,其特征在于,所述转换子模块包括:The device according to claim 14, wherein the conversion sub-module comprises:
    确定单元,用于确定多次扫描时所述观测点所在的坐标系信息;The determining unit is used to determine the coordinate system information of the observation point during multiple scans;
    获取单元,获取多次扫描中相邻两次扫描之间所述车体的相对位姿信息;An acquiring unit to acquire relative pose information of the vehicle body between two adjacent scans in multiple scans;
    转换单元,基于所述坐标系信息以及相对位姿信息,依次将上一次扫描时观测点对应的点云数据转换至下一次扫描对应的坐标系中,直至所述观测点对应的点云数据转移至最后一次扫描对应的坐标系中。The conversion unit, based on the coordinate system information and the relative pose information, sequentially converts the point cloud data corresponding to the observation point in the previous scan to the coordinate system corresponding to the next scan, until the point cloud data corresponding to the observation point is transferred To the coordinate system corresponding to the last scan.
  16. 根据权利要求10所述的装置,其特征在于,所述点云特征信息的描述形式包括法线估计、点特征直方图、快速点特征直方图及旋转图像(spin image)中的一种或几种。The device according to claim 10, wherein the description form of the point cloud feature information includes one or more of normal estimation, point feature histogram, fast point feature histogram, and spin image. Kind.
  17. 根据权利要求10所述的装置,其特征在于,所述激光雷达装置包括:The device according to claim 10, wherein the lidar device comprises:
    第二获取模块,用于在车体上设置有至少两个单线激光雷达的情况下,获取所述单线激光雷达之间的相对位置关系;The second acquisition module is configured to acquire the relative position relationship between the single-line laser radars when at least two single-line laser radars are provided on the vehicle body;
    转换模块,用于根据所述相对位置关系,将所述单线激光雷达将所述观测点对应的点云数据转换到同一坐标系中。The conversion module is configured to convert the point cloud data corresponding to the observation point by the single-line lidar into the same coordinate system according to the relative position relationship.
  18. 根据权利要求17所述的装置,其特征在于,所述相对位置关系包括:The device according to claim 17, wherein the relative position relationship comprises:
    至少一个所述单线激光雷达设置于车体顶部,使得所述单线激光雷达发射的激光脉冲为斜向下方向;At least one of the single-line lidar is arranged on the top of the vehicle body, so that the laser pulse emitted by the single-line lidar is obliquely downward;
    至少一个所述单线激光雷达设置于车体底部,使得所述单线激光雷达发射的激光脉冲为平行于车体底部方向。At least one of the single-line lidar is arranged at the bottom of the vehicle body, so that the laser pulse emitted by the single-line lidar is parallel to the direction of the bottom of the vehicle body.
  19. 一种车体定位装置,其特征在于,包括:A vehicle body positioning device, characterized in that it comprises:
    处理器;processor;
    用于存储处理器可执行指令的存储器;A memory for storing processor executable instructions;
    其中,所述处理器被配置为执行上述权利要求1至8所述的车体定位方法。Wherein, the processor is configured to execute the vehicle body positioning method described in claims 1 to 8.
  20. 一种非临时性计算机可读存储介质,当所述存储介质中的指令由处理器执行时,使得处理器能够执行根据权利要求1至8所述的车体定位方法。A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor, so that the processor can execute the vehicle body positioning method according to claims 1 to 8.
PCT/CN2019/115903 2019-02-20 2019-11-06 Method and device for vehicle body positioning WO2020168742A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910127565.9A CN109725330A (en) 2019-02-20 2019-02-20 A kind of Location vehicle method and device
CN201910127565.9 2019-02-20

Publications (1)

Publication Number Publication Date
WO2020168742A1 true WO2020168742A1 (en) 2020-08-27

Family

ID=66301526

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/115903 WO2020168742A1 (en) 2019-02-20 2019-11-06 Method and device for vehicle body positioning

Country Status (2)

Country Link
CN (1) CN109725330A (en)
WO (1) WO2020168742A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112731434A (en) * 2020-12-15 2021-04-30 武汉万集信息技术有限公司 Positioning method and system based on laser radar and marker
CN113534097A (en) * 2021-08-27 2021-10-22 北京工业大学 Optimization method suitable for rotating-axis laser radar
CN114506212A (en) * 2022-02-15 2022-05-17 国能神东煤炭集团有限责任公司 Space positioning auxiliary driving system and method for shuttle car
CN115937069A (en) * 2022-03-24 2023-04-07 北京小米移动软件有限公司 Part detection method, device, electronic device and storage medium

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109725330A (en) * 2019-02-20 2019-05-07 苏州风图智能科技有限公司 A kind of Location vehicle method and device
CN110276834B (en) * 2019-06-25 2023-04-11 达闼科技(北京)有限公司 Construction method of laser point cloud map, terminal and readable storage medium
CN110376595B (en) * 2019-06-28 2021-09-24 湖北大学 Vehicle measuring system of automatic loading machine
CN110789533B (en) * 2019-09-25 2021-08-13 华为技术有限公司 Data presentation method and terminal equipment
WO2021056339A1 (en) * 2019-09-26 2021-04-01 深圳市大疆创新科技有限公司 Positioning method and system, and movable platform
CN110677491B (en) * 2019-10-10 2021-10-19 郑州迈拓信息技术有限公司 Method for estimating position of vehicle
CN110827542A (en) * 2019-11-11 2020-02-21 江苏中路工程技术研究院有限公司 Highway safety vehicle distance early warning system
CN110988848B (en) * 2019-12-23 2022-04-26 潍柴动力股份有限公司 Vehicle-mounted laser radar relative pose monitoring method and device
CN111257903B (en) * 2020-01-09 2022-08-09 广州微牌智能科技有限公司 Vehicle positioning method and device, computer equipment and storage medium
CN111273270A (en) * 2020-03-17 2020-06-12 北京宸控科技有限公司 Positioning and orienting method of heading machine
CN111693043B (en) * 2020-06-18 2023-04-07 北京四维图新科技股份有限公司 Map data processing method and apparatus
CN112082484A (en) * 2020-09-11 2020-12-15 武汉理工大学 Device and method for detecting engineering vehicle body deviation based on single line laser radar
CN114252883B (en) * 2020-09-24 2022-08-23 北京万集科技股份有限公司 Target detection method, apparatus, computer device and medium
CN112904841B (en) * 2021-01-12 2023-11-03 北京布科思科技有限公司 Non-horizontal single-line positioning obstacle avoidance method, device, equipment and storage medium
CN115586511B (en) * 2022-11-25 2023-03-03 唐山百川工业服务有限公司 Laser radar two-dimensional positioning method based on array stand column

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4953502B2 (en) * 2000-10-02 2012-06-13 日本信号株式会社 Two-dimensional scanning optical radar sensor
CN104808192A (en) * 2015-04-15 2015-07-29 中国矿业大学 Three-dimensional laser scanning swing device and coordinate conversion method thereof
CN106323269A (en) * 2015-12-10 2017-01-11 上海思岚科技有限公司 Self-positioning and navigation device, positioning and navigation method and self-positioning and navigation system
CN106371105A (en) * 2016-08-16 2017-02-01 长春理工大学 Vehicle targets recognizing method, apparatus and vehicle using single-line laser radar
KR20170116305A (en) * 2016-04-08 2017-10-19 한국전자통신연구원 Objects recognition device for co-pilot vehicle based on tracking information from different multiple sensors
CN107957583A (en) * 2017-11-29 2018-04-24 江苏若博机器人科技有限公司 A kind of round-the-clock quick unmanned vehicle detection obstacle avoidance system of Multi-sensor Fusion
CN108072880A (en) * 2018-01-17 2018-05-25 上海禾赛光电科技有限公司 The method of adjustment of laser radar field of view center direction, medium, laser radar system
CN109725330A (en) * 2019-02-20 2019-05-07 苏州风图智能科技有限公司 A kind of Location vehicle method and device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108401461B (en) * 2017-12-29 2021-06-04 达闼机器人有限公司 Three-dimensional mapping method, device and system, cloud platform, electronic equipment and computer program product

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4953502B2 (en) * 2000-10-02 2012-06-13 日本信号株式会社 Two-dimensional scanning optical radar sensor
CN104808192A (en) * 2015-04-15 2015-07-29 中国矿业大学 Three-dimensional laser scanning swing device and coordinate conversion method thereof
CN106323269A (en) * 2015-12-10 2017-01-11 上海思岚科技有限公司 Self-positioning and navigation device, positioning and navigation method and self-positioning and navigation system
KR20170116305A (en) * 2016-04-08 2017-10-19 한국전자통신연구원 Objects recognition device for co-pilot vehicle based on tracking information from different multiple sensors
CN106371105A (en) * 2016-08-16 2017-02-01 长春理工大学 Vehicle targets recognizing method, apparatus and vehicle using single-line laser radar
CN107957583A (en) * 2017-11-29 2018-04-24 江苏若博机器人科技有限公司 A kind of round-the-clock quick unmanned vehicle detection obstacle avoidance system of Multi-sensor Fusion
CN108072880A (en) * 2018-01-17 2018-05-25 上海禾赛光电科技有限公司 The method of adjustment of laser radar field of view center direction, medium, laser radar system
CN109725330A (en) * 2019-02-20 2019-05-07 苏州风图智能科技有限公司 A kind of Location vehicle method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
WEI, CHONGYANG: "3D Feature Point Clouds-based Research on Mapping and Localization in Urban Environments", ELECTRONIC TECHNOLOGY & INFORMATION SCIENCE, CHINA DOCTORAL DISSERTATIONS FULL-TEXT DATABASE, no. 1, 15 January 2019 (2019-01-15), ISSN: 1674-022X, DOI: 20191231103617Y *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112731434A (en) * 2020-12-15 2021-04-30 武汉万集信息技术有限公司 Positioning method and system based on laser radar and marker
CN113534097A (en) * 2021-08-27 2021-10-22 北京工业大学 Optimization method suitable for rotating-axis laser radar
CN113534097B (en) * 2021-08-27 2023-11-24 北京工业大学 Optimization method suitable for rotation axis laser radar
CN114506212A (en) * 2022-02-15 2022-05-17 国能神东煤炭集团有限责任公司 Space positioning auxiliary driving system and method for shuttle car
CN114506212B (en) * 2022-02-15 2023-09-22 国能神东煤炭集团有限责任公司 Space positioning auxiliary driving system and method for shuttle car
CN115937069A (en) * 2022-03-24 2023-04-07 北京小米移动软件有限公司 Part detection method, device, electronic device and storage medium
CN115937069B (en) * 2022-03-24 2023-09-19 北京小米移动软件有限公司 Part detection method, device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN109725330A (en) 2019-05-07

Similar Documents

Publication Publication Date Title
WO2020168742A1 (en) Method and device for vehicle body positioning
US11100260B2 (en) Method and apparatus for interacting with a tag in a wireless communication area
WO2019179417A1 (en) Data fusion method and related device
EP3469306B1 (en) Geometric matching in visual navigation systems
US9646384B2 (en) 3D feature descriptors with camera pose information
CN105940429B (en) For determining the method and system of the estimation of equipment moving
CN110967011A (en) Positioning method, device, equipment and storage medium
CN109668551B (en) Robot positioning method, device and computer readable storage medium
WO2022078467A1 (en) Automatic robot recharging method and apparatus, and robot and storage medium
WO2022036980A1 (en) Pose determination method and apparatus, electronic device, storage medium, and program
KR20180044279A (en) System and method for depth map sampling
US20210158560A1 (en) Method and device for obtaining localization information and storage medium
US11893317B2 (en) Method and apparatus for associating digital content with wireless transmission nodes in a wireless communication area
WO2019019819A1 (en) Mobile electronic device and method for processing tasks in task region
CN111272172A (en) Unmanned aerial vehicle indoor navigation method, device, equipment and storage medium
WO2022110653A1 (en) Pose determination method and apparatus, electronic device and computer-readable storage medium
CN109696173A (en) A kind of car body air navigation aid and device
US20220237533A1 (en) Work analyzing system, work analyzing apparatus, and work analyzing program
US20120002044A1 (en) Method and System for Implementing a Three-Dimension Positioning
US20200164508A1 (en) System and Method for Probabilistic Multi-Robot Positioning
CN115407355B (en) Library position map verification method and device and terminal equipment
CN116385528A (en) Method and device for generating annotation information, electronic equipment, vehicle and storage medium
US20130155211A1 (en) Interactive system and interactive device thereof
CN113433566B (en) Map construction system and map construction method
CN113065392A (en) Robot tracking method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19916418

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19916418

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 19916418

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 18/03/2022)

122 Ep: pct application non-entry in european phase

Ref document number: 19916418

Country of ref document: EP

Kind code of ref document: A1