WO2023284705A1 - Procédé et appareil de regroupement de nuages de points de radar laser, radar laser et véhicule - Google Patents
Procédé et appareil de regroupement de nuages de points de radar laser, radar laser et véhicule Download PDFInfo
- Publication number
- WO2023284705A1 WO2023284705A1 PCT/CN2022/105047 CN2022105047W WO2023284705A1 WO 2023284705 A1 WO2023284705 A1 WO 2023284705A1 CN 2022105047 W CN2022105047 W CN 2022105047W WO 2023284705 A1 WO2023284705 A1 WO 2023284705A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- point
- distance
- obstacle
- lidar
- laser radar
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 238000001514 detection method Methods 0.000 claims description 129
- 238000004364 calculation method Methods 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 11
- 238000010276 construction Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000012545 processing Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
Definitions
- the present application relates to the technical field of radar imaging in perception, and in particular to a laser radar point cloud clustering method, device, laser radar and vehicle.
- the current vehicle-mounted radar (such as lidar) will form point cloud data when imaging a target.
- the present application provides a laser radar point cloud clustering method, device, laser radar and vehicle, the clustering process is simple, and the effect of saving computing power is achieved.
- the first aspect of the present application provides a laser radar point cloud clustering method, including:
- the first distance between the first point on the obstacle and the lidar, the second distance between the second point on the obstacle and the lidar, and the laser beam and obstacle corresponding to the first point on the obstacle Angle information between the laser beams corresponding to the second point on the obstacle; according to the first distance, the angle information between the laser beam corresponding to the first point on the obstacle and the laser beam corresponding to the second point on the obstacle , to obtain reference data from the pre-built clustering parameter table; wherein, the clustering parameter table is constructed according to the internal reference of the lidar; according to the reference data and the second distance, the second point on the obstacle and the first point on the obstacle Clustering at one point.
- the first aspect of the present application provides a laser radar point cloud clustering method, which constructs a clustering parameter table through the internal parameters of the laser radar, takes into account the physical characteristics of the laser radar itself, and can make the clustering more accurate. Secondly, based on the pre-built clustering parameter table, the amount of calculation in actual clustering can be simplified, which is very suitable for scenarios where computing resources are scarce.
- the first point and the second point are adjacent points.
- the internal parameters of the lidar include: angle information between adjacent laser beams of the lidar and the number of beams of the lidar.
- the clustering parameter table is constructed based on the internal parameters of the lidar, specifically including: obtaining the angle information between adjacent laser beams of the lidar and the detection multiple of the lidar; among them, the laser The detection multiple of the radar is determined according to the detection distance of the laser beam and the detection distance resolution of the laser radar; the index of the clustering parameter table is constructed with the angle information between adjacent laser beams as the first dimension and the detection multiple as the second dimension Information; obtain the reference data in the clustering parameter table based on the angle information between adjacent laser beams and the detection multiple.
- the clustering parameter table has the advantage of being simple to make.
- the included angle information includes the size of the longitudinal included angle and the size of the horizontal included angle.
- the number of elements in the first dimension is determined according to the number of beams of the laser radar.
- the number of elements in the second dimension is determined according to the detection multiple of the lidar.
- the detection multiple of the laser radar is determined according to the detection distance of the laser beam and the detection distance resolution of the laser radar, including: calculating the detection distance of the laser beam and the detection distance resolution of the laser radar , to get the detection multiple of lidar.
- the reference data includes a first threshold and a second threshold, where the first threshold is greater than the second threshold.
- the reference data in the clustering parameter table is calculated and obtained according to the angle information between adjacent laser beams and the detection multiple, including: determining according to the detection multiple and the detection distance resolution of the laser radar a third distance; determining the first threshold based on the third distance and a preset distance threshold; determining a second threshold based on the third distance, angle information between adjacent laser beams, and a preset angle threshold.
- a method for determining the first threshold and the second threshold in the reference data takes into account the detection distance of the laser radar, the angle information between adjacent laser beams, etc., so that the calculation process is scientific and reasonable.
- the angle information between the laser beam corresponding to the first point on the obstacle and the laser beam corresponding to the second point on the obstacle from the pre-built Obtain reference data in the class parameter table, including: obtain the first dimension according to the angle information between the laser beam corresponding to the first point on the obstacle and the laser beam corresponding to the second point on the obstacle; determine according to the first distance The detection multiple corresponding to the first distance, and obtain the second dimension according to the detection multiple corresponding to the first distance; based on the first dimension and the second dimension, obtain the corresponding reference data from the pre-built clustering parameter table lookup table.
- the first dimension of the clustering parameter table is located through the angle information between the laser beam corresponding to the first point and the laser beam corresponding to the second point. Through the first The second dimension of the clustering parameter table is located by the detection multiple corresponding to the distance, and accordingly, the reference data corresponding to the first dimension and the second dimension can be obtained.
- clustering the second point on the obstacle and the first point on the obstacle according to the reference data and the second distance includes: if the second distance is within the range of the reference data, Then the second point on the obstacle is of the same type as the first point on the obstacle; otherwise, the second point on the obstacle is not the same type as the first point on the obstacle.
- the second aspect of the present application provides a lidar point cloud clustering device, including: a first acquisition module, a second acquisition module and a clustering module.
- the first acquisition module is used to acquire the first distance between the first point on the obstacle and the laser radar, the second distance between the second point on the obstacle and the laser radar, and the first distance between the second point on the obstacle and the laser radar.
- the second acquisition module is used for the laser beam corresponding to the first point on the obstacle and the obstacle according to the first distance
- the angle information between the laser beams corresponding to the second point on the object and obtain reference data from the pre-built clustering parameter table; wherein, the clustering parameter table is constructed according to the internal parameters of the lidar; the clustering module uses The second point on the obstacle and the first point on the obstacle are clustered according to the reference data and the second distance.
- the internal parameters of the lidar in the second acquisition module include: angle information between adjacent laser beams of the lidar and the number of beams of the lidar.
- the clustering parameter table in the second acquisition module is constructed according to the internal parameters of the lidar, specifically including: an acquisition sub-module, used to acquire the gap between adjacent laser beams of the lidar The angle information and the detection multiple of the laser radar; wherein, the detection multiple of the laser radar is determined according to the detection distance of the laser beam and the detection distance resolution of the laser radar; the sub-module is constructed to use the angle information between adjacent laser beams as In the first dimension, the index information of the clustering parameter table is constructed with the detection multiple as the second dimension; the calculation sub-module is used to calculate and obtain the reference data in the clustering parameter table according to the angle information between adjacent laser beams and the detection multiple .
- the included angle information includes the size of the longitudinal included angle and the size of the horizontal included angle.
- the number of elements in the first dimension in the construction sub-module is determined according to the number of beams of the laser radar.
- the number of elements in the second dimension in the construction sub-module is determined according to the detection multiple of the lidar.
- the detection multiple of the laser radar is determined according to the detection distance of the laser beam and the detection distance resolution of the laser radar, including: the detection distance of the laser beam and the detection distance resolution of the laser radar are traded , to get the detection multiple of lidar.
- the reference data in the calculation submodule includes a first threshold and a second threshold, where the first threshold is greater than the second threshold.
- the calculation submodule is specifically used to: determine the third distance according to the detection multiple and the detection distance resolution of the laser radar; determine the first threshold based on the third distance and the preset distance threshold; The second threshold is determined by the third distance, angle information between adjacent laser beams and a preset angle threshold.
- the second acquisition module is specifically configured to: according to the angle information between the laser beam corresponding to the first point on the obstacle and the laser beam corresponding to the second point on the obstacle Obtain the first dimension; determine the detection multiple corresponding to the first distance according to the first distance, and obtain the second dimension according to the detection multiple corresponding to the first distance; based on the first dimension and the second dimension, check from the pre-built clustering parameter table Get the corresponding reference data from the table.
- the clustering module is specifically configured to: if the second distance is within the range of the reference data, the second point on the obstacle is of the same type as the first point on the obstacle.
- the third aspect of the present application provides a laser radar, including: a communication interface; at least one processor, which is connected to the communication interface; and at least one memory, which is connected to the processor and stores program instructions.
- a laser radar including: a communication interface; at least one processor, which is connected to the communication interface; and at least one memory, which is connected to the processor and stores program instructions.
- the program instructions are processed by at least one
- the processor is executed, at least one processor is made to execute a lidar point cloud clustering method according to any one of the first aspect.
- the fourth aspect of the present application provides a vehicle, including: a laser radar, used to collect point cloud data; a processor, used to use a laser radar point cloud clustering method according to any one of the first aspect point cloud data clustering.
- the fifth aspect of the present application provides a computing device, a computer-readable storage medium, on which program instructions are stored, and it is characterized in that, when the program instructions are executed by a computer, the computer executes any one of the above-mentioned first aspects. Lidar point cloud clustering method.
- the sixth aspect of the present application provides a computer program product, which is characterized in that, when the computer program product is run on the computing device, the computing device is made to execute a lidar point cloud clustering method according to any one of the above-mentioned first aspects.
- Figure 1(a) is the front view of the three-dimensional coordinate system constructed with the lidar as the origin;
- Figure 1(b) is a side view of the three-dimensional coordinate system constructed with the lidar as the origin;
- Figure 1(c) is a top view of the three-dimensional coordinate system constructed with the lidar as the origin;
- FIG. 2 is a schematic diagram of a scene applied by a lidar point cloud clustering method provided in an embodiment of the present application
- FIG. 3 is a schematic diagram of another scene applied by a lidar point cloud clustering method provided in the embodiment of the present application;
- FIG. 4 is a flowchart of a laser radar point cloud clustering method provided in an embodiment of the present application.
- Fig. 5 is the flow chart of constructing the clustering parameter table provided by the embodiment of the present application.
- Fig. 6 is the clustering parameter table provided by the embodiment of the present application.
- FIG. 7 is a schematic diagram of a point cloud data grid provided by an embodiment of the present application.
- FIG. 8 is a schematic structural diagram of a laser radar point cloud clustering device provided in an embodiment of the present application.
- FIG. 9 is a schematic structural diagram of a computing device provided by an embodiment of the present application.
- Lidar Lidar
- Lidar A radar system that emits laser beams to detect target-related feature quantities. Its working principle is to send a detection signal (laser beam) to the target, and then compare the received signal reflected from the target with the transmitted detection signal, and after proper processing, the relevant information of the target can be obtained, such as the distance of the target, Azimuth, altitude, etc.
- FIG. 1 is a three-dimensional coordinate system constructed with the lidar as the origin, where Figure 1(a) is the main view, and Figure 1(b) It is a side view, and Figure 1(c) is a top view.
- Point p is a point detected by the lidar.
- the angle between the projection line and the Y axis is the longitudinal angle, which is ⁇ in Figure 1.
- Horizontal angle that is, horizontal rotation angle (azimuth) or yaw angle (yaw): as shown in Figure 1, when point p is projected onto the X-Y plane, the angle between the projection line and the laser beam from the origin of the radar to point p angle, which is ⁇ in Figure 1.
- Number of beams that is, the number of laser lines that the laser radar can emit. For example: for a 16-line lidar, the corresponding number of bundles is 16; for a 64-line lidar, the corresponding number of bundles is 64; for an 8-line lidar, the corresponding number of bundles is 8, etc. .
- Point cloud clustering According to the characteristics, similarity or distance of the point cloud data points, the point cloud data points are grouped into several "classes" or “clusters”.
- the point cloud clustering method of this solution is as follows: First, convert the point cloud data collected by the lidar to the corresponding logical plane, wherein the logical plane is used to describe the origin of the lidar and the relationship between each point to be clustered Relative positional relationship; then, perform a breadth-first search on each point on the corresponding logical plane to find the same point of each point; finally output the clustering results.
- a laser radar point cloud clustering method provided in an embodiment of the present application can be applied to an autonomous vehicle (AV, Autonomous Vehicle) or an intelligent driving vehicle. Its application scenario can be to cluster the point cloud data collected by the vehicle lidar, and then use the clustered data to perform subsequent calculations. For example, the subsequent calculations can be target recognition calculations.
- AV autonomous vehicle
- AV Autonomous Vehicle
- the subsequent calculations can be target recognition calculations.
- FIG. 2 it is a scenario where a laser radar point cloud clustering method provided in the embodiment of the present application is applied.
- the lidar point cloud clustering method can be built into the lidar 10 entity. After the laser radar 10 collects point cloud data, the point cloud data is clustered in the laser radar 10 body, and then the clustered data is transmitted to the host terminal 20 through a protocol such as a network for subsequent processing.
- FIG. 3 it is another scenario in which a lidar point cloud clustering method provided in the embodiment of the present application is applied.
- the laser radar point cloud clustering method can be placed on the host end 20 .
- the laser radar 10 transmits the collected original point cloud data to the host terminal 20, and the laser radar point cloud clustering method provided by the embodiment of the application is used at the host terminal 20 to cluster the original point cloud data to obtain the clustered The data are used for subsequent calculations.
- Fig. 2 and Fig. 3 are only examples showing the scene where the lidar point cloud clustering method is applied, and the present application does not limit which component the lidar point cloud clustering method is stored in. In other applications In the scene, the storage location of the lidar point cloud clustering method can be changed arbitrarily according to actual needs.
- a laser radar point cloud clustering method provided in an embodiment of the present application will be described in detail below with reference to each figure.
- the laser radar is taken as an example for the following description.
- FIG. 4 it is a flow chart of the lidar point cloud clustering method provided by the embodiment of the present application.
- the process mainly includes steps S110-S130, each step will be introduced in sequence below:
- S110 Obtain the first distance between the first point on the obstacle and the laser radar, the second distance between the second point on the obstacle and the laser radar, and the correspondence between the first point on the obstacle Angle information between the laser beam and the laser beam corresponding to the second point on the obstacle.
- the first distance may be determined by the time difference between the emitted light emitted by the laser radar to the first point and the reflected light reflected from the first point back to the laser radar; similarly, the first distance
- the second distance can also be determined by the time difference between the emitted light emitted by the lidar to the second point and the reflected light reflected from the second point back to the lidar.
- Angle information between the laser beam corresponding to the first point and the laser beam corresponding to the second point can be obtained from the factory manual of the laser radar.
- the included angle information includes longitudinal included angle information and horizontal included angle information.
- the velodyne 16-line mechanical lidar can emit 16 laser beams, and a pitch angle (longitudinal angle) can be formed between every two laser beams, but the angle of each pitch angle is different; for the velodyne 16-line mechanical lidar, it also includes a fixed aimuth angle (horizontal angle).
- adjacent points have a higher probability of being of the same class, therefore, the first point and the second point in this embodiment may be selected as adjacent points.
- step S120 According to the first distance obtained in step S110, the angle information between the laser beam corresponding to the first point on the obstacle and the laser beam corresponding to the second point on the obstacle, from the pre-built Get the reference data in the cluster parameter table.
- the clustering can be determined in the form of table lookup One dimension of the parameter table; then according to the lidar detection multiple corresponding to the first distance, the other dimension of the clustering parameter table can be determined in the form of table lookup; based on the determined two dimensions, the second point and The corresponding clustering reference data in the clustering parameter table when the first point is clustered.
- the clustering parameter table is constructed according to the internal reference of the lidar, wherein the internal reference of the lidar includes: angle information between adjacent laser beams of the lidar and the number of beams of the lidar.
- the angle information includes the size of the longitudinal angle and the size of the horizontal angle; the number of beams of the laser radar is the number of laser beams that the laser radar can emit.
- the process of constructing the clustering parameter table may include steps S121-S123, as shown in FIG. 5 , the steps of constructing the clustering parameter table are introduced below:
- the angle information between adjacent laser beams of the lidar may include two aspects of information: the first aspect is the positional relationship between the angles between adjacent laser beams, that is, the adjacent laser beams are longitudinal The angle is still a horizontal angle; the second aspect is the size of the angle.
- the angle information between adjacent laser beams has been set when the laser radar leaves the factory, and it only needs to be determined according to the model of the laser radar.
- the detection multiple of the lidar refers to how many times the distance resolution of the lidar has been experienced from the origin of the lidar to each laser point.
- the detectable multiple of the lidar has been set when the lidar leaves the factory, and it only needs to be determined according to the model of the lidar.
- the detection multiple of the lidar is determined according to the detection distance of the laser beam and the detection distance resolution of the laser radar.
- S122 Construct index information of the clustering parameter table with angle information between adjacent laser beams as a first dimension and with the detection multiple as a second dimension. Wherein, the index information is used to index reference data in the clustering parameter table.
- the first dimension may be used as a row index dimension
- the second dimension may be used as a column index dimension.
- the first dimension and the second dimension may also be interchanged, that is, the first dimension is used as a column index dimension, and the second dimension is used as a row index dimension. This application does not limit it.
- the number of elements in the first dimension may be determined according to the number of beams of the lidar.
- the number of beams is 16, that is, the lidar can emit 16 laser beams, and each two laser beams form a longitudinal angle, then the lidar corresponds to 15 longitudinal angles Angle
- velodyne16-line mechanical lidar has a fixed horizontal angle, therefore, for velodyne16-line mechanical lidar, the number of elements in the first dimension is 16.
- S123 Calculate and obtain the reference data in the clustering parameter table according to the angle information between the adjacent laser beams and the detection multiple.
- the reference data includes a first threshold and a second threshold, wherein the first threshold is greater than the second threshold.
- the upper limit data may be used to replace the first threshold
- the lower limit data may be used to replace the second threshold.
- the range data is constituted by the upper limit data and the lower limit data to cluster related points.
- the detection multiple is multiplied by the resolution of the lidar to obtain the third distance. Then determine the upper limit data based on the third distance and a preset distance threshold; and determine the lower limit data based on the third distance, angle information between adjacent laser beams and a preset angle threshold.
- the upper limit data upper can be determined as follows:
- the lower limit data floor can be determined as follows:
- d 1 n*f
- d 1 is the detection distance corresponding to the point in the lidar point cloud, that is, the third distance
- n is the detection multiple of the lidar
- f is the detection distance resolution of the lidar
- ⁇ is the preset Distance threshold
- ⁇ is the angle between adjacent laser beams
- ⁇ is the preset angle threshold
- the second point on the obstacle is of the same type as the first point on the obstacle; correspondingly, when the second When the second distance is not within the upper and lower limits of the reference data, the second point on the obstacle is not of the same type as the first point on the obstacle.
- FIG. 6-FIG. 7 the specific implementation of a laser radar point cloud clustering method provided in the embodiment of the present application will be described in detail.
- the laser radar point cloud clustering method provided in the embodiment of the present application is clustering based on the clustering parameter table. Therefore, the construction process of the clustering parameter table is firstly introduced. It should be understood that the clustering parameter table may be pre-built and obtained.
- the clustering parameter table may include two dimensions, the first dimension may be angle information between adjacent laser beams, specifically, the angle information may include the size of the horizontal angle and the size of the vertical angle.
- the second dimension may be the detection multiple of the laser radar, wherein the detection multiple of the laser radar is determined according to the detection distance of the laser beam and the detection distance resolution of the laser radar. For example, the maximum detectable distance of the lidar is 120m, and the detection distance resolution of the lidar is 1m, so the corresponding detection multiple of the lidar is any integer value from 0 to 120.
- both the angle information and the detection multiple of the lidar can be obtained from the lidar factory manual.
- the first dimension of the velodyne 16-line mechanical radar includes 15 pitch angles and a fixed aimuth angle, that is, 16 data. Its second dimension includes 32500 data, therefore, for the velodyne 16-line mechanical radar, its clustering parameter table shares 16*32500 data (elements).
- FIG. 6 it is a schematic diagram of a clustering parameter table constructed based on the construction method of the above clustering parameter table.
- the column index dimension is the angle information between adjacent laser beams
- the row index dimension is the detection multiple of the laser radar, where 0-m is the detection multiple of the laser radar, which can also be understood as m times the laser
- the detection distance resolution of the radar the upper limit is the quotient of the maximum detectable distance and the distance resolution of the lidar
- pitch 1 -pitch m is the corresponding longitudinal angle between adjacent laser beams
- aimuth 1 -aimuth w is The corresponding horizontal angle between adjacent laser beams
- upper is the upper limit of the elements in the clustering parameter table
- floor is the lower limit of the elements in the clustering parameter table.
- the positions of the horizontal angle and the vertical angle in the clustering parameter table in this figure are just an example and do not constitute a limitation.
- the row and column indexes can also be interchanged, that is, the column index is the detection multiple of the lidar, and the row index is the angle information between adjacent laser beams.
- FIG. 7 it is a schematic diagram of the point cloud data grid collected by the lidar (only part of the data is shown).
- A is regarded as the first point on the obstacle, that is, the reference point
- the process of judging whether A1 and A2 are of the same type as A is as follows:
- the distance from the reference point A to the origin of the laser radar is converted into the detection multiple of the laser radar, and the row information corresponding to the reference point A can be determined from the clustering parameter table shown in FIG. 6 .
- the relationship between the point A1 to be clustered and the point A2 to be clustered is determined. Whether the reference point A is of the same class. If the distance is within the upper and lower limits of the corresponding element, the point is of the same class as the reference point, otherwise, the two are not of the same class.
- a radar point cloud clustering device which may be implemented by a software system, may also be implemented by a hardware device, and may also be implemented by a combination of a software system and a hardware device.
- FIG. 8 is only an exemplary structural diagram showing a lidar point cloud clustering device, and the present application does not limit the division of functional modules in the head pose measurement device.
- the lidar point cloud clustering device can be logically divided into multiple modules, each module can have different functions, and the functions of each module can be read and executed by the processor in the computing device memory Instructions in to achieve.
- the radar point cloud clustering device includes a first acquisition module 710 , a second acquisition module 720 and a clustering module 730 .
- the lidar point cloud clustering apparatus is used to execute the content described in steps S110-S130 shown in FIG. 4 .
- a first acquisition module 710 configured to acquire the first distance between the first point on the obstacle and the laser radar, and the second distance between the second point on the obstacle and the laser radar , and angle information between the laser beam corresponding to the first point on the obstacle and the laser beam corresponding to the second point on the obstacle.
- the second acquiring module 720 is configured to, according to the first distance, the angle information between the laser beam corresponding to the first point on the obstacle and the laser beam corresponding to the second point on the obstacle, from Obtain reference data from a pre-built clustering parameter table; wherein, the clustering parameter table is constructed according to the internal reference of the lidar.
- a clustering module 730 configured to cluster the second point on the obstacle and the first point on the obstacle according to the reference data and the second distance.
- the internal parameters of the lidar in the second acquisition module 720 include: angle information between adjacent laser beams of the lidar and the number of beams of the lidar.
- the clustering parameter table in the second acquisition module 720 is constructed according to the internal reference of the lidar, and specifically includes: an acquisition submodule 721 , a construction submodule 722 and a calculation submodule 723 .
- the obtaining sub-module 721 is used to obtain the angle information between adjacent laser beams of the lidar and the detection multiple of the laser radar; wherein, the detection multiple of the laser radar is based on the detection distance of the laser beam and the detection range resolution of the lidar is determined.
- the construction sub-module 722 is configured to construct the index information of the clustering parameter table with the angle information between the adjacent laser beams as the first dimension and the detection multiple as the second dimension.
- the calculation sub-module 723 is configured to calculate and obtain the reference data in the clustering parameter table according to the angle information between the adjacent laser beams and the detection multiple.
- the included angle information includes the size of the longitudinal included angle and the size of the horizontal included angle.
- the number of elements in the first dimension in the construction submodule 722 is determined according to the number of beams of the lidar.
- the number of elements in the second dimension of 722 in the construction submodule is determined according to the detection multiple of the lidar.
- the detection multiple of the laser radar is determined according to the detection distance of the laser beam and the detection distance resolution of the laser radar, including:
- the detection distance of the laser beam is multiplied by the detection distance resolution of the laser radar to obtain the detection multiple of the laser radar.
- the reference data in the calculation submodule 723 includes a first threshold and a second threshold, where the first threshold is greater than the second threshold.
- the calculation submodule 723 is specifically configured to: determine a third distance according to the detection multiple and the detection range resolution of the lidar; based on the third distance and a preset distance The threshold determines the first threshold; and determines the second threshold based on the third distance, angle information between adjacent laser beams and a preset angle threshold.
- the second acquisition module 720 is specifically configured to: according to the difference between the laser beam corresponding to the first point on the obstacle and the laser beam corresponding to the second point on the obstacle Obtain the first dimension from the angle information between them; determine the detection multiple corresponding to the first distance according to the first distance, and obtain the second dimension according to the detection multiple corresponding to the first distance; based on the For the first dimension and the second dimension, corresponding reference data are obtained from the pre-built clustering parameter table lookup table.
- the clustering module 730 is specifically configured to: if the second distance is within the range of the reference data, the second point on the obstacle is The first point is the same class.
- a laser radar which includes:
- At least one processor connected to the communication interface; and:
- At least one memory which is connected to the processor and stores program instructions, and when the program instructions are executed by the at least one processor, the at least one processor executes the laser radar described in the above embodiments
- this embodiment does not repeat the lidar point cloud clustering method.
- Another embodiment of the present application provides a vehicle, which may include the laser radar and the processor in the previous embodiment.
- the processor is used to cluster the point cloud data collected by the laser radar by using the laser radar point cloud clustering method described in the above embodiment. This application will not repeat it.
- FIG. 9 is a schematic structural diagram of a computing device 900 provided by an embodiment of the present application.
- the computing device 900 includes: a processor 910 , a memory 920 , and a communication interface 930 .
- the communication interface 930 in the computing device 900 shown in FIG. 9 can be used to communicate with other devices.
- the processor 910 may be connected to the memory 920 .
- the memory 920 can be used to store the program codes and data. Therefore, the memory 920 may be a storage unit inside the processor 910, or an external storage unit independent of the processor 910, or may include a storage unit inside the processor 910 and an external storage unit independent of the processor 910. part.
- computing device 900 may further include a bus.
- the memory 920 and the communication interface 930 may be connected to the processor 910 through a bus.
- the bus may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (Extended Industry Standard Architecture, EISA) bus or the like.
- PCI Peripheral Component Interconnect
- EISA Extended Industry Standard Architecture
- the bus can be divided into address bus, data bus, control bus and so on.
- the processor 910 may be a central processing unit (central processing unit, CPU).
- the processor can also be other general-purpose processors, digital signal processors (digital signal processor, DSP), application specific integrated circuits (Application specific integrated circuit, ASIC), off-the-shelf programmable gate matrix (field programmable gate Array, FPGA) or other Programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
- a general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.
- the processor 910 adopts one or more integrated circuits for executing related programs, so as to implement the technical solutions provided by the embodiments of the present application.
- the memory 920 may include read-only memory and random-access memory, and provides instructions and data to the processor 910 .
- a portion of processor 910 may also include non-volatile random access memory.
- processor 910 may also store device type information.
- the processor 910 executes the computer-executed instructions in the memory 920 to perform the operation steps of the above method.
- the computing device 900 may correspond to a corresponding body executing the methods according to the various embodiments of the present application, and the above-mentioned and other operations and/or functions of the modules in the computing device 900 are for realizing the present invention For the sake of brevity, the corresponding processes of the methods in the embodiments are not repeated here.
- the disclosed systems, devices and methods may be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the units is only a logical function division. In actual implementation, there may be other division methods.
- multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented.
- the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
- the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium.
- the computer software products are stored in a storage medium, and include several instructions to make a computer device (which can It is a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.
- the aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disc and other media that can store program codes. .
- the embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, it is used to perform a method for clustering a laser radar point cloud. At least one of the described programs.
- the computer storage medium in the embodiments of the present application may use any combination of one or more computer-readable media.
- the computer readable medium may be a computer readable signal medium or a computer readable storage medium.
- a computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer readable storage media include: electrical connections with one or more leads, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), Erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
- a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
- a computer readable signal medium may include a data signal carrying computer readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
- a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. .
- Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wires, optical cables, radio, etc., or any suitable combination of the foregoing.
- Computer program code for performing the operations of the present application may be written in one or more programming languages or combinations thereof, including object-oriented programming languages—such as Java, Smalltalk, C++, and conventional Procedural Programming Language - such as "C" or a similar programming language.
- the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as via the Internet using an Internet service provider). connect).
- LAN local area network
- WAN wide area network
- connect such as via the Internet using an Internet service provider
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Electromagnetism (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
La présente invention concerne un procédé et un appareil de regroupement de nuages de points de radar laser (10), un radar laser (10) et un véhicule. Le procédé consiste à : obtenir une première distance entre un premier point sur un obstacle et le radar laser (10), une seconde distance entre un second point sur l'obstacle et le radar laser (10), et des informations d'angle inclus entre un faisceau laser correspondant au premier point sur l'obstacle et un faisceau laser correspondant au second point sur l'obstacle ; obtenir des données de référence à partir d'une table de paramètres de regroupement préalablement construite en fonction de la première distance et des informations d'angle inclus entre le faisceau laser correspondant au premier point sur l'obstacle et le faisceau laser correspondant au second point sur l'obstacle (S120, S130), la table de paramètres de regroupement étant construite sur la base de paramètres intrinsèques du radar laser ; et regrouper le second point sur l'obstacle et le premier point sur l'obstacle en fonction des données de référence et de la seconde distance. Lors du regroupement de données de nuages de points d'origine collectées par le radar laser (10), une grande quantité de puissance de calcul est économisée.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110791099.1 | 2021-07-13 | ||
CN202110791099.1A CN115685224A (zh) | 2021-07-13 | 2021-07-13 | 一种激光雷达点云聚类方法、装置、激光雷达及车辆 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023284705A1 true WO2023284705A1 (fr) | 2023-01-19 |
Family
ID=84919901
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/105047 WO2023284705A1 (fr) | 2021-07-13 | 2022-07-12 | Procédé et appareil de regroupement de nuages de points de radar laser, radar laser et véhicule |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN115685224A (fr) |
WO (1) | WO2023284705A1 (fr) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115792944A (zh) * | 2023-01-29 | 2023-03-14 | 深圳煜炜光学科技有限公司 | 一种配合激光雷达的道路快速定标方法和系统 |
CN115877373A (zh) * | 2023-02-20 | 2023-03-31 | 上海几何伙伴智能驾驶有限公司 | 结合激光雷达信息实现点云雷达聚类参数设计的方法 |
CN118072360A (zh) * | 2024-04-19 | 2024-05-24 | 浙江华是科技股份有限公司 | 一种周界入侵单个人体完整识别方法及系统 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170248693A1 (en) * | 2016-02-26 | 2017-08-31 | Hyundai Motor Company | Vehicle and controlling method thereof integrating radar and lidar |
CN110458055A (zh) * | 2019-07-29 | 2019-11-15 | 江苏必得科技股份有限公司 | 一种障碍物检测方法及系统 |
CN111060923A (zh) * | 2019-11-26 | 2020-04-24 | 武汉乐庭软件技术有限公司 | 一种多激光雷达的汽车驾驶障碍物检测方法及系统 |
CN111144228A (zh) * | 2019-12-05 | 2020-05-12 | 山东超越数控电子股份有限公司 | 基于3d点云数据的障碍物识别方法和计算机设备 |
CN111337941A (zh) * | 2020-03-18 | 2020-06-26 | 中国科学技术大学 | 一种基于稀疏激光雷达数据的动态障碍物追踪方法 |
CN112379673A (zh) * | 2020-11-26 | 2021-02-19 | 广东盈峰智能环卫科技有限公司 | 基于单线激光雷达的机器人自跟随方法、装置、机器人 |
-
2021
- 2021-07-13 CN CN202110791099.1A patent/CN115685224A/zh active Pending
-
2022
- 2022-07-12 WO PCT/CN2022/105047 patent/WO2023284705A1/fr active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170248693A1 (en) * | 2016-02-26 | 2017-08-31 | Hyundai Motor Company | Vehicle and controlling method thereof integrating radar and lidar |
CN110458055A (zh) * | 2019-07-29 | 2019-11-15 | 江苏必得科技股份有限公司 | 一种障碍物检测方法及系统 |
CN111060923A (zh) * | 2019-11-26 | 2020-04-24 | 武汉乐庭软件技术有限公司 | 一种多激光雷达的汽车驾驶障碍物检测方法及系统 |
CN111144228A (zh) * | 2019-12-05 | 2020-05-12 | 山东超越数控电子股份有限公司 | 基于3d点云数据的障碍物识别方法和计算机设备 |
CN111337941A (zh) * | 2020-03-18 | 2020-06-26 | 中国科学技术大学 | 一种基于稀疏激光雷达数据的动态障碍物追踪方法 |
CN112379673A (zh) * | 2020-11-26 | 2021-02-19 | 广东盈峰智能环卫科技有限公司 | 基于单线激光雷达的机器人自跟随方法、装置、机器人 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115792944A (zh) * | 2023-01-29 | 2023-03-14 | 深圳煜炜光学科技有限公司 | 一种配合激光雷达的道路快速定标方法和系统 |
CN115792944B (zh) * | 2023-01-29 | 2023-04-25 | 深圳煜炜光学科技有限公司 | 一种配合激光雷达的道路快速定标方法和系统 |
CN115877373A (zh) * | 2023-02-20 | 2023-03-31 | 上海几何伙伴智能驾驶有限公司 | 结合激光雷达信息实现点云雷达聚类参数设计的方法 |
CN115877373B (zh) * | 2023-02-20 | 2023-04-28 | 上海几何伙伴智能驾驶有限公司 | 结合激光雷达信息实现点云雷达聚类参数设计的方法 |
CN118072360A (zh) * | 2024-04-19 | 2024-05-24 | 浙江华是科技股份有限公司 | 一种周界入侵单个人体完整识别方法及系统 |
Also Published As
Publication number | Publication date |
---|---|
CN115685224A (zh) | 2023-02-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2023284705A1 (fr) | Procédé et appareil de regroupement de nuages de points de radar laser, radar laser et véhicule | |
WO2022156176A1 (fr) | Procédé, système et dispositif d'étalonnage conjoint de multiples radars et de caméra, et support de stockage | |
WO2022156175A1 (fr) | Procédé, système et dispositif de détection basés sur une fusion d'informations d'image et de nuage de points, et support de stockage | |
US10853687B2 (en) | Method and apparatus for determining matching relationship between point cloud data | |
CN109059902B (zh) | 相对位姿确定方法、装置、设备和介质 | |
JP6745328B2 (ja) | 点群データを復旧するための方法及び装置 | |
WO2021104497A1 (fr) | Procédé et système de positionnement basés sur un radar laser, ainsi que support de stockage et processeur | |
US11295144B2 (en) | Obstacle classification method and apparatus based on unmanned vehicle, device, and storage medium | |
US20210263138A1 (en) | Position detecting method, device and storage medium for vehicle ladar | |
CN111563450B (zh) | 数据处理方法、装置、设备及存储介质 | |
WO2022213632A1 (fr) | Procédé et appareil d'étalonnage d'un radar à ondes millimétriques, et dispositif électronique et dispositif de bord de route | |
WO2023040737A1 (fr) | Procédé et appareil de détermination d'emplacement cible, dispositif électronique et support de stockage | |
CN113762003B (zh) | 一种目标对象的检测方法、装置、设备和存储介质 | |
WO2022007858A1 (fr) | Procédé et appareil de reconnaissance à base d'images et véhicule | |
Cheng et al. | SLBAF-Net: Super-Lightweight bimodal adaptive fusion network for UAV detection in low recognition environment | |
CN113569958A (zh) | 激光点云数据聚类方法、装置、设备及介质 | |
CN112465908B (zh) | 一种物体定位方法、装置、终端设备及存储介质 | |
CN113325388A (zh) | 一种自动驾驶中激光雷达泛光噪点的过滤方法和装置 | |
CN115147333A (zh) | 一种目标检测方法及装置 | |
KR20230036960A (ko) | 장애물 검출 방법, 장치, 자율 주행 차량, 기기 및 기록 매체 | |
WO2022083529A1 (fr) | Procédé et appareil de traitement de données | |
CN112418316B (zh) | 机器人重定位方法、装置、激光机器人及可读存储介质 | |
CN114386481A (zh) | 一种车辆感知信息融合方法、装置、设备及存储介质 | |
US20230358547A1 (en) | Map matching method and apparatus, electronic device and storage medium | |
WO2022016355A1 (fr) | Procédé et appareil de détermination d'informations d'étiquetage |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22841341 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22841341 Country of ref document: EP Kind code of ref document: A1 |