WO2021051726A1 - Method and apparatus for processing point cloud data, storage medium, and lidar system - Google Patents

Method and apparatus for processing point cloud data, storage medium, and lidar system Download PDF

Info

Publication number
WO2021051726A1
WO2021051726A1 PCT/CN2020/070459 CN2020070459W WO2021051726A1 WO 2021051726 A1 WO2021051726 A1 WO 2021051726A1 CN 2020070459 W CN2020070459 W CN 2020070459W WO 2021051726 A1 WO2021051726 A1 WO 2021051726A1
Authority
WO
WIPO (PCT)
Prior art keywords
lidar
point cloud
cloud data
vehicle
collect
Prior art date
Application number
PCT/CN2020/070459
Other languages
French (fr)
Chinese (zh)
Inventor
张腾
Original Assignee
深圳市速腾聚创科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市速腾聚创科技有限公司 filed Critical 深圳市速腾聚创科技有限公司
Priority to CN202080005479.1A priority Critical patent/CN113366341B/en
Priority to PCT/CN2020/070459 priority patent/WO2021051726A1/en
Publication of WO2021051726A1 publication Critical patent/WO2021051726A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems

Definitions

  • This application relates to the field of detection, and in particular to a point cloud data processing method, device, storage medium, and lidar system.
  • Lidar can create a 3D image of the surroundings.
  • Lidar uses a micro-electro-mechanical system (MEMS) micro galvanometer as a beam scanning structure, which is a method of lidar. Its working principle is to first launch a detection laser beam to the target, and then compare the received signal reflected from the target with the transmitted signal. After proper processing, relevant information of the target can be obtained, such as target distance, azimuth, height, Parameters such as speed, attitude, and even shape.
  • MEMS micro-electro-mechanical system
  • 32-line lidar In unmanned vehicles or transportation vehicles that require driving assistance, 32-line lidar is usually used. Since the detection field of view of a single lidar is limited, it cannot detect both short and medium-to-long distances at the same time. A certain blind zone is formed on the left and right sides of the car; in addition, there are not enough harnesses in the center lidar, and there will still be missed detections.
  • the point cloud data processing method, device, storage medium, and lidar system provided in the embodiments of the present application can solve the problem of blind spots in vehicle detection of surrounding objects in related technologies.
  • the technical solution is as follows:
  • an embodiment of the present application provides a method for processing point cloud data, and the method includes:
  • the fifth point cloud data is collected by the fifth lidar; wherein, the first lidar is arranged on the top of the vehicle, the second lidar is arranged on the left side of the vehicle, and the third lidar is arranged on On the right side of the vehicle, the fourth lidar is arranged in front of the vehicle, and the fifth lidar is arranged at the rear of the vehicle;
  • the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are fused to obtain panoramic point cloud data.
  • an embodiment of the present application provides a point cloud data processing device, and the processing device includes:
  • the collection unit is used to collect the first point cloud data through the first lidar
  • the fifth point cloud data is collected by the fifth lidar; wherein, the first lidar is installed on the top of the vehicle, the second lidar is installed on the left side of the vehicle, and the third lidar is installed on the On the right side of the vehicle, the fourth lidar is arranged in front of the vehicle, and the fifth lidar is arranged at the rear of the vehicle;
  • a fusion unit for fusing the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data to obtain a panoramic point cloud data.
  • an embodiment of the present application provides a computer storage medium, the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the above method steps.
  • an embodiment of the present application provides a point cloud data processing device, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded and executed by the processor The above method steps.
  • an embodiment of the present application provides a lidar system, including the aforementioned processing device, a first lidar, a second lidar, a third lidar, a fourth lidar, and a fifth lidar.
  • a lidar is installed on the top, left, right, front, and rear of the vehicle.
  • the lidar on the top is used for long-distance field of view detection.
  • the lidar on the left and right sides is used for short-distance left and right field of view detection.
  • Lidar is used for short-distance front and rear field of view detection.
  • the point cloud data collected by the above five lidars are merged to obtain panoramic point cloud data, which avoids blind areas in the front, rear, left, and right of the vehicle during the detection process, and improves the accuracy of detection And the functional safety of the autonomous driving system.
  • FIG. 1 is a schematic diagram of the architecture of a lidar system provided by an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a point cloud data processing method provided by an embodiment of the present application
  • FIG. 3A is a schematic diagram of the distribution position of the lidar provided by an embodiment of the present application on a vehicle
  • 3B is a schematic diagram of the field of view of the lidar provided by an embodiment of the present application.
  • 3C is a schematic diagram of the field of view of the lidar provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of point cloud data splicing provided by an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of a point cloud data processing device provided by the present application.
  • Fig. 6 is another schematic structural diagram of a point cloud data processing device provided by the present application.
  • Fig. 1 shows a schematic diagram of the architecture of the lidar system.
  • the lidar system includes: a processing device 0, a lidar 1, a lidar 2, a lidar 3, a lidar 4, and a lidar 5.
  • Lidar 1, Lidar 2, Lidar 3, Lidar 4, and Lidar 5 are each connected to processing device 0.
  • Lidars 1 to 5 can be connected to processing device 0 in a wired manner, for example: Lidars 1 to 5 pass through Ethernet
  • the network interface, universal serial bus interface or CAN interface is connected to the processing device 0.
  • Lidar includes laser transmitters, laser receivers and optoelectronic devices.
  • Lidar 1-5 emits outgoing laser light, which irradiates the object to form reflected laser light.
  • Lidar generates point cloud data according to the position of the reflected laser light and laser intensity.
  • the generated point cloud data is output to the processing device 0 for processing.
  • Lidar 1 is installed on the top of the vehicle
  • Lidar 2 is installed on the left side of the vehicle
  • Lidar 3 is installed on the right side of the vehicle
  • Lidar 4 is installed on the front of the vehicle
  • Lidar 5 is installed on the rear of the vehicle
  • the point cloud data collected by lidar 1 to lidar 5 are fused to obtain panoramic point cloud data.
  • FIG. 2 provides a schematic flowchart of a method for calibrating a multi-channel lidar according to an embodiment of this application.
  • the method of the embodiment of the present application may include the following steps:
  • S201 Collect first point cloud data by using the first lidar.
  • the first lidar emits outgoing laser light, and the outgoing laser light irradiates the object to form a reflected laser.
  • the first lidar obtains the spatial position information and laser intensity information of the illuminated point on the object according to the reflected laser, and the spatial position information indicates the illuminated point on the object
  • the laser intensity information indicates the laser intensity of the reflected laser that is reflected after the outgoing laser is irradiated on the irradiation point; the first lidar generates the first point cloud data according to the spatial position information and laser intensity information of multiple irradiation points on the object.
  • the point cloud data is a collection of multiple irradiation points, and each irradiation point has spatial position information and laser intensity information.
  • S202 Collect second point cloud data by using the second lidar.
  • the second point cloud data includes the spatial position information and laser intensity information of the multiple irradiation points.
  • S201 For the collection process of the second point cloud data, refer to the description of S201, which will not be repeated here.
  • the third point cloud data includes the spatial position information and laser intensity information of multiple irradiation points.
  • S201 For the collection process of the third point cloud data, refer to the description of S201, which will not be repeated here.
  • the fourth point cloud data includes the spatial position information and laser intensity information of the multiple irradiation points.
  • S201 For the collection process of the fourth point cloud data, refer to the description of S201, which will not be repeated here.
  • the fifth point cloud data includes the spatial position information and laser intensity information of multiple irradiation points.
  • the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar are distributed and arranged at different positions of the vehicle.
  • the first lidar 20 is installed on the top of the vehicle; the second lidar 21 is installed on the left side of the vehicle, the third lidar 22 is installed on the right side of the vehicle, and the fourth lidar 23 is installed on the right side of the vehicle.
  • the fifth lidar 24 is installed at the rear of the vehicle.
  • the vertical field of view of the first lidar ranges from -25° to +15°
  • the horizontal field of view of the first lidar is 0° to 360°; that is, the vertical field of view of the first lidar is 40°. °
  • the horizontal field of view angle is 360 degrees.
  • the vertical field of view of the second lidar, the third lidar, the fourth lidar and the fifth lidar ranges from -90° ⁇ +90°
  • the horizontal field angle ranges from -90° ⁇ +90°, which is the above
  • the vertical field of view of the four lidars is 180 degrees
  • the horizontal field of view is 180 degrees.
  • the first lidar is used for long-range detection
  • the second lidar, third lidar, fourth lidar, and fifth lidar are used for short-range detection.
  • the vertical field of view of the laser parallel to the horizontal direction is 0 degrees
  • the vertical field of view of the first lidar 20 ranges from -25° to +25 °
  • -25° means an upward shift of 25 degrees based on the horizontal direction
  • +15 degrees means a downward shift of 15 degrees based on the horizontal direction
  • the horizontal field of view of the first lidar 20 ranges from 0° to 360° , Which means that the first lidar 20 can rotate one circle in the horizontal direction.
  • the horizontal field of view of the second lidar 21, the third lidar 22, the fourth lidar 23, and the fifth lidar 24 is -90° ⁇ +90°
  • the vertical view angle is -90° ⁇ +90° That is, the scanning range of the first lidar 21, the second lidar 22, the third lidar 23, and the fourth lidar 24 in the horizontal direction and the vertical direction is a hemisphere.
  • the horizontal central axis of the second lidar, the third lidar, the fourth lidar and the fifth lidar are located on the same plane, and the horizontal central axis of the first lidar is not located on this plane.
  • the second lidar and the third lidar are located in the first line segment
  • the fourth lidar and the fifth lidar are located in the second line segment
  • the first line segment is perpendicular to the second line segment and passes through the center point of the second line segment
  • the projection of the first lidar on the plane where the horizontal central axis of the second lidar, the third lidar, the fourth lidar and the fifth lidar are located is on the second line segment.
  • the first point cloud data is collected by the first lidar on the top of the vehicle
  • the second point cloud data is collected by the second lidar on the left side of the vehicle
  • the third point cloud data is the third lidar on the right side of the vehicle.
  • the fourth point cloud data is collected by the fourth lidar in front of the vehicle
  • the fifth point cloud data is collected by the fifth lidar behind the vehicle.
  • the first lidar, the second lidar, and the third The lidar, the fourth lidar and the fifth lidar keep time synchronization, and the processing device controls the first lidar, the second lidar, the third lidar, the fourth lidar and the fifth lidar to use the same sampling period to collect points Cloud data, that is, within a sampling period, the first lidar scans from -25 degrees to +15 degrees in the vertical direction, and scans 0 degrees to 360 degrees in the horizontal direction.
  • the second lidar and the third lidar The lidar, the fourth lidar, and the fifth lidar scan from -90 degrees to +90 degrees in the horizontal and vertical directions.
  • the processing device fuses the point cloud data collected by each lidar to obtain panoramic point cloud data, which is generated by each lidar collecting objects around the vehicle.
  • said fusing the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data and the fifth point cloud data to obtain a panoramic point Cloud data including:
  • the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are respectively spliced with the first point cloud data Then generate panoramic point cloud data.
  • each lidar will collect point cloud data according to its own coordinate system.
  • the position of each lidar on the vehicle is fixed.
  • the processing device obtains the spatial position of each lidar to determine the relative relationship between each lidar.
  • the positional relationship for example, take the first lidar as the origin coordinates, and obtain the coordinates of the second lidar, the third lidar, the fourth lidar, and the fifth lidar, which are equivalent to the coordinates of the first lidar.
  • the point cloud coordinate system of the first lidar is used as the reference coordinate system, and the point cloud data collected by the second lidar, the third lidar, the fourth lidar and the fifth lidar are converted To the reference coordinate system.
  • the first point cloud According to the position of the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar on the vehicle, the vertical field of view range and the horizontal field of view range, it can be known that the first point cloud
  • the data and the second point cloud data have overlapping point cloud data
  • the first point cloud data and the third point cloud data have overlapping point cloud data
  • the first point cloud data and the fourth point cloud data have overlapping point cloud data
  • the processing device merges the two overlapping point cloud data to obtain the point cloud data after the overlapping point cloud data is spliced. For example: referring to Figure 4, there is overlapping point cloud data 42 between the first point cloud data 40 and the second point cloud data 41, and the first point cloud data 40 and the second point cloud data 41 are combined to obtain a spliced set. Point cloud data.
  • the processing device respectively splices the first point cloud data and the second point cloud data, the first point cloud data and the third point cloud data are spliced, the first point cloud data and the fourth point cloud data are spliced, and the first point cloud data is spliced.
  • the cloud data and the fifth point cloud data are spliced to obtain panoramic point cloud data.
  • a lidar is provided on the top, left, right, front, and rear of the vehicle.
  • the lidar on the top is used for long-distance field of view detection, and the lidar on the left and right sides is used for short-distance left and right vision.
  • Field detection the front lidar is used for short-distance front and rear field of view detection.
  • the point cloud data collected by the above 5 lidars are merged to obtain panoramic point cloud data, so as to avoid blind spots in the front, rear, left, and right of the vehicle during the detection process. Improve the accuracy of detection and the functional safety of the automatic driving system.
  • FIG. 5 shows a schematic structural diagram of a point cloud data processing device provided by an exemplary embodiment of the present application, which is referred to as the processing device 5 hereinafter.
  • the processing device 5 can be implemented as all or part of the laser radar through software, hardware or a combination of the two.
  • the processing device 5 includes: an acquisition unit 501 and a fusion unit 502.
  • the collecting unit 501 is configured to collect the first point cloud data through the first lidar
  • the fifth point cloud data is collected by the fifth lidar; wherein, the first lidar is installed on the top of the vehicle, the second lidar is installed on the left side of the vehicle, and the third lidar is installed on the On the right side of the vehicle, the fourth lidar is arranged in front of the vehicle, and the fifth lidar is arranged at the rear of the vehicle;
  • the fusion unit 502 is configured to merge the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data to obtain a complete Scenic spot cloud data.
  • the vertical field of view of the first lidar ranges from -25° to +15°, and the horizontal field of view ranges from 0° to 360°;
  • the vertical field angle range of the third lidar, the fourth lidar, and the fifth lidar is -90° ⁇ +90°, and the horizontal field angle range is -90° ⁇ +90°.
  • the second lidar, the third lidar, the fourth lidar, and the fifth lidar are located on the same plane, and the first lidar is not located on the same plane. on flat surface.
  • the second lidar and the third lidar are located on a first line segment
  • the fourth lidar and the fifth lidar are located on a second line segment
  • the first lidar The line segment is perpendicular to the second line segment and passes through the center point of the second line segment.
  • the acquisition time of the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar are kept synchronized.
  • the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are combined
  • Data is fused to obtain panoramic point cloud data, including:
  • the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are respectively spliced with the first point cloud data Then generate panoramic point cloud data.
  • the processing device 5 further includes:
  • the embodiment of the present application also provides a computer storage medium.
  • the computer storage medium may store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps of the embodiments shown in FIGS. 2 to 4 above.
  • the specific execution process please refer to the specific description of the embodiment shown in FIG. 2 to FIG. 4, which will not be repeated here.
  • the present application also provides a computer program product that stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the point cloud data processing method described in each of the above embodiments.
  • FIG. 6 provides a schematic structural diagram of a point cloud data processing device according to an embodiment of the present application.
  • the processing device 6 is below.
  • the processing device 6 may include: at least one processor 601, a memory 602, and at least one communication bus 603.
  • the communication bus 603 is used to implement connection and communication between these components.
  • the processor 601 may include one or more processing cores.
  • the processor 601 uses various interfaces and lines to connect various parts of the entire correction device 6, and executes by running or executing instructions, programs, code sets, or instruction sets stored in the memory 602, and calling data stored in the memory 602.
  • the processor 601 may use at least one of digital signal processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA).
  • DSP Digital Signal Processing
  • FPGA Field-Programmable Gate Array
  • PLA Programmable Logic Array
  • the processor 601 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), a modem, and the like.
  • the CPU mainly processes the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the display; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 601, but may be implemented by a chip alone.
  • the memory 602 may include random access memory (RAM) or read-only memory (Read-Only Memory).
  • the memory 602 includes a non-transitory computer-readable storage medium.
  • the memory 602 may be used to store instructions, programs, codes, code sets or instruction sets.
  • the memory 602 may include a storage program area and a storage data area, where the storage program area may store instructions for implementing the operating system and instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), Instructions used to implement the foregoing method embodiments, etc.; the storage data area can store data and the like involved in the foregoing method embodiments.
  • the memory 602 may also be at least one storage device located far away from the foregoing processor 601.
  • the processor 601 may be used to call the touch operation response application program stored in the memory 602 and specifically execute the steps shown in the method embodiment of FIG. 2.
  • FIG. 6 and the method embodiment of FIG. 2 are based on the same concept, and the technical effects brought about by them are also the same.
  • FIG. 6 For the specific implementation process of FIG. 6, reference may be made to the description of FIG. 2 and will not be repeated here.
  • the program can be stored in a computer readable storage medium, and the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments.
  • the storage medium can be a magnetic disk, an optical disc, a read-only storage memory or a random storage memory, etc.

Abstract

Disclosed in the embodiments of the present application are a method and an apparatus for processing point cloud data, a storage medium, and a LIDAR system, relating to the field of detection. In the embodiments of the present application, the top, the left side, the right side, the front, and the back of a vehicle are respectively provided with a LIDAR. The LIDAR on the top is used for remote-distance field of view detection, the LIDARs on the left and right sides are used for near-distance left and right field of view detection, and the LIDARs on the front and back are used for near-distance front and back field of view detection. Point cloud data collected by the five LIDARs above is fused to obtain panoramic point cloud data, preventing blind spots from appearing in the front, back, left, or right of the vehicle during a detection process, and improving the accuracy of detection and the functional safety of an autonomous driving system.

Description

点云数据的处理方法、装置、存储介质及激光雷达系统Point cloud data processing method, device, storage medium and lidar system 技术领域Technical field
本申请涉及检测领域,尤其涉及一种点云数据的处理方法、装置、存储介质及激光雷达系统。This application relates to the field of detection, and in particular to a point cloud data processing method, device, storage medium, and lidar system.
背景技术Background technique
激光雷达可以建立周围的3D图像,激光雷达利用微机械系统(micro-electro-mechanical system,MEMS)微振镜作为光束扫描结构是激光雷达的一种方。其工作原理是先向目标发射探测激光光束,然后将接收到的从目标反射回来的信号与发射信号进行比较,作适当处理后,就可获得目标的有关信息,例如目标距离、方位、高度、速度、姿态、甚至形状等参数。Lidar can create a 3D image of the surroundings. Lidar uses a micro-electro-mechanical system (MEMS) micro galvanometer as a beam scanning structure, which is a method of lidar. Its working principle is to first launch a detection laser beam to the target, and then compare the received signal reflected from the target with the transmitted signal. After proper processing, relevant information of the target can be obtained, such as target distance, azimuth, height, Parameters such as speed, attitude, and even shape.
在无人驾驶汽车或需要驾驶辅助的运输工具上,通常使用32线的激光雷达,由于单个激光雷达的探测视场是有限的,无法同时探测到近距离和中远距离的,所以在无人驾驶汽车的左、右两侧形成一定的盲区;此外,中心激光雷达的线束不够多,仍然会有漏检测的情况发生。In unmanned vehicles or transportation vehicles that require driving assistance, 32-line lidar is usually used. Since the detection field of view of a single lidar is limited, it cannot detect both short and medium-to-long distances at the same time. A certain blind zone is formed on the left and right sides of the car; in addition, there are not enough harnesses in the center lidar, and there will still be missed detections.
发明内容Summary of the invention
本申请实施例提供了的点云数据的处理方法、装置、存储介质及激光雷达系统,可以解决相关技术中车辆探测周围物体存在盲区的问题。所述技术方案如下:The point cloud data processing method, device, storage medium, and lidar system provided in the embodiments of the present application can solve the problem of blind spots in vehicle detection of surrounding objects in related technologies. The technical solution is as follows:
第一方面,本申请实施例提供了一种点云数据的处理方法,所述方法包括:In the first aspect, an embodiment of the present application provides a method for processing point cloud data, and the method includes:
通过第一激光雷达采集第一点云数据;Collect the first point cloud data through the first lidar;
通过第二激光雷达采集第二点云数据;Collect the second point cloud data through the second lidar;
通过第三激光雷达采集第三点云数据;Collect the third point cloud data through the third lidar;
通过第四激光雷达采集第四点云数据;Collect the fourth point cloud data through the fourth lidar;
通过第五激光雷达采集采集第五点云数据;其中,所述第一激光雷达设置于车辆的顶部,所述第二激光雷达设置于所述车辆的左侧,所述第三激光雷达 设置于所述车辆的右侧,所述第四激光雷达设置于所述车辆的前方,所述第五激光雷达设置于所述车辆的后方;The fifth point cloud data is collected by the fifth lidar; wherein, the first lidar is arranged on the top of the vehicle, the second lidar is arranged on the left side of the vehicle, and the third lidar is arranged on On the right side of the vehicle, the fourth lidar is arranged in front of the vehicle, and the fifth lidar is arranged at the rear of the vehicle;
将所述第一点云数据、所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据进行融合得到全景点云数据。The first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are fused to obtain panoramic point cloud data.
第二方面,本申请实施例提供了一种点云数据的处理装置,所述处理装置包括:In the second aspect, an embodiment of the present application provides a point cloud data processing device, and the processing device includes:
采集单元,用于通过第一激光雷达采集第一点云数据;The collection unit is used to collect the first point cloud data through the first lidar;
通过第二激光雷达采集第二点云数据;Collect the second point cloud data through the second lidar;
通过第三激光雷达采集第三点云数据;Collect the third point cloud data through the third lidar;
通过第四激光雷达采集第四点云数据;Collect the fourth point cloud data through the fourth lidar;
通过第五激光雷达采集第五点云数据;其中,所述第一激光雷达设置于车辆的顶部,所述第二激光雷达设置于所述车辆的左侧,所述第三激光雷达设置于所述车辆的右侧,所述第四激光雷达设置于所述车辆的前方,所述第五激光雷达设置于所述车辆的后方;The fifth point cloud data is collected by the fifth lidar; wherein, the first lidar is installed on the top of the vehicle, the second lidar is installed on the left side of the vehicle, and the third lidar is installed on the On the right side of the vehicle, the fourth lidar is arranged in front of the vehicle, and the fifth lidar is arranged at the rear of the vehicle;
融合单元,用于将所述第一点云数据、所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据融合得到全景点云数据。A fusion unit for fusing the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data to obtain a panoramic point cloud data.
第三方面,本申请实施例提供一种计算机存储介质,所述计算机存储介质存储有多条指令,所述指令适于由处理器加载并执行上述的方法步骤。In a third aspect, an embodiment of the present application provides a computer storage medium, the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the above method steps.
第四方面,本申请实施例提供一种点云数据的处理装置,可包括:处理器和存储器;其中,所述存储器存储有计算机程序,所述计算机程序适于由所述处理器加载并执行上述的方法步骤。In a fourth aspect, an embodiment of the present application provides a point cloud data processing device, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded and executed by the processor The above method steps.
第五方面,本申请实施例提供了一种激光雷达系统,包括上述的处理装置、第一激光雷达、第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达。In a fifth aspect, an embodiment of the present application provides a lidar system, including the aforementioned processing device, a first lidar, a second lidar, a third lidar, a fourth lidar, and a fifth lidar.
本申请一些实施例提供的技术方案带来的有益效果至少包括:The beneficial effects brought by the technical solutions provided by some embodiments of the present application include at least:
车辆的顶部、左侧、右侧、前方和后方分别设置有一个激光雷达,顶部的激光雷达用于远距离视场探测,左右侧的激光雷达用于近距离的左右视场探测,前后方的激光雷达用于近距离的前后视场探测,将上述的5个激光雷达采集到 的点云数据进行融合得到全景点云数据,避免探测过程中车辆的前后左右出现盲区,提高了探测的准确性和自动驾驶系统的功能安全性。A lidar is installed on the top, left, right, front, and rear of the vehicle. The lidar on the top is used for long-distance field of view detection. The lidar on the left and right sides is used for short-distance left and right field of view detection. Lidar is used for short-distance front and rear field of view detection. The point cloud data collected by the above five lidars are merged to obtain panoramic point cloud data, which avoids blind areas in the front, rear, left, and right of the vehicle during the detection process, and improves the accuracy of detection And the functional safety of the autonomous driving system.
附图说明Description of the drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1是本申请实施例提供的激光雷达系统的架构示意图;FIG. 1 is a schematic diagram of the architecture of a lidar system provided by an embodiment of the present application;
图2是本申请实施例提供的点云数据的处理方法的流程示意图;2 is a schematic flowchart of a point cloud data processing method provided by an embodiment of the present application;
图3A是本申请实施例提供的激光雷达在车辆上的分布位置示意图;FIG. 3A is a schematic diagram of the distribution position of the lidar provided by an embodiment of the present application on a vehicle;
图3B是本申请实施例提供的激光雷达的视场示意图;3B is a schematic diagram of the field of view of the lidar provided by an embodiment of the present application;
图3C是本申请实施例提供的激光雷达的视场示意图;3C is a schematic diagram of the field of view of the lidar provided by an embodiment of the present application;
图4是本申请实施例提供的点云数据拼接的示意图;FIG. 4 is a schematic diagram of point cloud data splicing provided by an embodiment of the present application;
图5是本申请提供的一种点云数据的处理装置的结构示意图;FIG. 5 is a schematic structural diagram of a point cloud data processing device provided by the present application;
图6是本申请提供的一种点云数据的处理装置的另一结构示意图。Fig. 6 is another schematic structural diagram of a point cloud data processing device provided by the present application.
具体实施方式detailed description
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施例方式作进一步地详细描述。In order to make the purpose, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.
图1示出了激光雷达系统的架构示意图,激光雷达系统包括:处理装置0、激光雷达1、激光雷达2、激光雷达3、激光雷达4和激光雷达5。激光雷达1、激光雷达2、激光雷达3、激光雷达4和激光雷达5各自与处理装置0相连,激光雷达1~5可以采用有线方式与处理装置0相连,例如:激光雷达1~5通过以太网接口、通用串行总线接口或CAN接口与处理装置0相连。激光雷达包括激光发射器、激光接收器和光电器件等,激光雷达1~-5发射出射激光,出射激光照射到物体上形成反射激光,激光雷达根据反射激光的位置和激光强度生成点云数据,将生成的点云数据输出到处理装置0进行处理。激光雷达1设置于车辆的顶部,激光雷达2设置于车辆的左侧,激光雷达3设置于车辆的 右侧,激光雷达4设置于车辆的前方,激光雷达5设置于车辆的后方,处理装置0将激光雷达1~激光雷达5采集到的点云数据进行融合得到全景点云数据。Fig. 1 shows a schematic diagram of the architecture of the lidar system. The lidar system includes: a processing device 0, a lidar 1, a lidar 2, a lidar 3, a lidar 4, and a lidar 5. Lidar 1, Lidar 2, Lidar 3, Lidar 4, and Lidar 5 are each connected to processing device 0. Lidars 1 to 5 can be connected to processing device 0 in a wired manner, for example: Lidars 1 to 5 pass through Ethernet The network interface, universal serial bus interface or CAN interface is connected to the processing device 0. Lidar includes laser transmitters, laser receivers and optoelectronic devices. Lidar 1-5 emits outgoing laser light, which irradiates the object to form reflected laser light. Lidar generates point cloud data according to the position of the reflected laser light and laser intensity. The generated point cloud data is output to the processing device 0 for processing. Lidar 1 is installed on the top of the vehicle, Lidar 2 is installed on the left side of the vehicle, Lidar 3 is installed on the right side of the vehicle, Lidar 4 is installed on the front of the vehicle, Lidar 5 is installed on the rear of the vehicle, and the processing device 0 The point cloud data collected by lidar 1 to lidar 5 are fused to obtain panoramic point cloud data.
下面将结合附图2-附图4,对本申请实施例提供的多通道激光雷达的校正方法进行详细介绍。In the following, the correction method of the multi-channel lidar provided by the embodiment of the present application will be described in detail with reference to FIG. 2 to FIG. 4. FIG.
请参见图2,为本申请实施例提供了一种多通道激光雷达的校正方法的流程示意图。如图2所示,本申请实施例的所述方法可以包括以下步骤:Please refer to FIG. 2, which provides a schematic flowchart of a method for calibrating a multi-channel lidar according to an embodiment of this application. As shown in Figure 2, the method of the embodiment of the present application may include the following steps:
S201、通过第一激光雷达采集第一点云数据。S201. Collect first point cloud data by using the first lidar.
其中,第一激光雷达发射出射激光,出射激光照射到物体的形成反射激光,第一激光雷达根据反射激光得到物体上照射点的空间位置信息和激光强度信息,空间位置信息表示物体上的照射点的位置,激光强度信息表示出射激光照射到该照射点后反射得到的反射激光的激光强度;第一激光雷达根据物体上多个照射点的空间位置信息和激光强度信息生成第一点云数据。Among them, the first lidar emits outgoing laser light, and the outgoing laser light irradiates the object to form a reflected laser. The first lidar obtains the spatial position information and laser intensity information of the illuminated point on the object according to the reflected laser, and the spatial position information indicates the illuminated point on the object The laser intensity information indicates the laser intensity of the reflected laser that is reflected after the outgoing laser is irradiated on the irradiation point; the first lidar generates the first point cloud data according to the spatial position information and laser intensity information of multiple irradiation points on the object.
点云数据为多个照射点的集合,每个照射点具有空间位置信息和激光强度信息。The point cloud data is a collection of multiple irradiation points, and each irradiation point has spatial position information and laser intensity information.
S202、通过第二激光雷达采集第二点云数据。S202: Collect second point cloud data by using the second lidar.
其中,第二点云数据包括多个照射点的空间位置信息和激光强度信息,第二点云数据的采集过程可参照S201的描述,此处不再赘述。Wherein, the second point cloud data includes the spatial position information and laser intensity information of the multiple irradiation points. For the collection process of the second point cloud data, refer to the description of S201, which will not be repeated here.
S203、通过第三激光雷达采集第三点云数据。S203. Collect third point cloud data by using a third lidar.
其中,第三点云数据包括多个照射点的空间位置信息和激光强度信息,第三点云数据的采集过程可参照S201的描述,此处不再赘述。Among them, the third point cloud data includes the spatial position information and laser intensity information of multiple irradiation points. For the collection process of the third point cloud data, refer to the description of S201, which will not be repeated here.
S204、通过第四激光雷达采集第四点云数据。S204. Collect fourth point cloud data through the fourth lidar.
其中,第四点云数据包括多个照射点的空间位置信息和激光强度信息,第四点云数据的采集过程可参照S201的描述,此处不再赘述。Among them, the fourth point cloud data includes the spatial position information and laser intensity information of the multiple irradiation points. For the collection process of the fourth point cloud data, refer to the description of S201, which will not be repeated here.
S305、通过第五激光雷达采集第五点云数据。S305. Collect fifth point cloud data through the fifth lidar.
其中,第五点云数据包括多个照射点的空间位置信息和激光强度信息,第五点云数据的采集过程可参照S201的描述,此处不再赘述。第一激光雷达、第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达分布设置于车辆的不同位置。Wherein, the fifth point cloud data includes the spatial position information and laser intensity information of multiple irradiation points. For the collection process of the fifth point cloud data, please refer to the description of S201, which will not be repeated here. The first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar are distributed and arranged at different positions of the vehicle.
例如:参见图3A所示,第一激光雷达20设置于车辆的顶部;第二激光雷达21设置于车辆的左侧,第三激光雷达22设置于车辆的右侧,第四激光雷达23设置于车辆的前方,第五激光雷达24设置于车辆的后方。For example: as shown in FIG. 3A, the first lidar 20 is installed on the top of the vehicle; the second lidar 21 is installed on the left side of the vehicle, the third lidar 22 is installed on the right side of the vehicle, and the fourth lidar 23 is installed on the right side of the vehicle. In the front of the vehicle, the fifth lidar 24 is installed at the rear of the vehicle.
进一步的,第一激光雷达的垂直视场角范围为-25°~+15°,第一激光雷达的水平视场角为0°~360°;即第一激光雷达的垂直视场角为40°,水平视场角为360度。第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达的垂直视场角范围为-90°~+90°,水平视场角范围为-90°~+90°,即上述4个激光雷达的垂直视场角为180度,水平视场角为180度。第一激光雷达用于远距离探测,第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达用于近距离探测。Further, the vertical field of view of the first lidar ranges from -25° to +15°, and the horizontal field of view of the first lidar is 0° to 360°; that is, the vertical field of view of the first lidar is 40°. °, the horizontal field of view angle is 360 degrees. The vertical field of view of the second lidar, the third lidar, the fourth lidar and the fifth lidar ranges from -90°~+90°, and the horizontal field angle ranges from -90°~+90°, which is the above The vertical field of view of the four lidars is 180 degrees, and the horizontal field of view is 180 degrees. The first lidar is used for long-range detection, and the second lidar, third lidar, fourth lidar, and fifth lidar are used for short-range detection.
例如:参见图3B和图3C所示的视场示意图,平行于水平方向的激光在垂直方向上的发射角为0度,第一激光雷达20的垂直视场角范围为-25°~+25°,-25°表示以水平方向为基准向上偏移25度,+15度表示以水平方向为基准向下偏移15度;第一激光雷达20的水平视场角范围为0°~360°,表示第一激光雷达20能在水平方向上转动一圈。第二激光雷达21、第三激光雷达22、第四激光雷达23和第五激光雷达24的水平视场角范围为-90°~+90°,垂直视场角为-90°~+90°,即第一激光雷达21、第二激光雷达22、第三激光雷达23和第四激光雷达24在水平方向和垂直方向上的扫描范围为一个半球形。For example: referring to the schematic diagrams of the field of view shown in Figures 3B and 3C, the vertical field of view of the laser parallel to the horizontal direction is 0 degrees, and the vertical field of view of the first lidar 20 ranges from -25° to +25 °, -25° means an upward shift of 25 degrees based on the horizontal direction, +15 degrees means a downward shift of 15 degrees based on the horizontal direction; the horizontal field of view of the first lidar 20 ranges from 0° to 360° , Which means that the first lidar 20 can rotate one circle in the horizontal direction. The horizontal field of view of the second lidar 21, the third lidar 22, the fourth lidar 23, and the fifth lidar 24 is -90°~+90°, and the vertical view angle is -90°~+90° That is, the scanning range of the first lidar 21, the second lidar 22, the third lidar 23, and the fourth lidar 24 in the horizontal direction and the vertical direction is a hemisphere.
进一步的,第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达的水平中轴线位于同一平面上,第一激光雷达的水平中轴线不位于该平面上。Further, the horizontal central axis of the second lidar, the third lidar, the fourth lidar and the fifth lidar are located on the same plane, and the horizontal central axis of the first lidar is not located on this plane.
进一步的,第二激光雷达和第三激光雷达位于第一线段,第四激光雷达和第五激光雷达位于第二线段,第一线段垂直于第二线段且经过第二线段的中心点,第一激光雷达在所述第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达的水平中轴线所在的平面上的投影位于第二线段上。Further, the second lidar and the third lidar are located in the first line segment, the fourth lidar and the fifth lidar are located in the second line segment, the first line segment is perpendicular to the second line segment and passes through the center point of the second line segment, The projection of the first lidar on the plane where the horizontal central axis of the second lidar, the third lidar, the fourth lidar and the fifth lidar are located is on the second line segment.
S306、将第一点云数据、第二点云数据、第三点云数据、第四点云数据和第五点云数据进行融合得到全景点云数据。S306. Fusion of the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data to obtain panoramic point cloud data.
其中,第一点云数据是车辆顶部的第一激光雷达采集的,第二点云数据是车辆的左侧的第二激光雷达采集的,第三点云数据是车辆右侧的第三激光雷达采集的,第四点云数据是车辆前方的第四激光雷达采集的,第五点云数据是车 辆的后方的第五激光雷达采集的,其中,第一激光雷达、第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达保持时间同步,处理装置控制第一激光雷达、第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达采用相同的采样周期采集点云数据,即在一个采样周期内,第一激光雷达在垂直方向上从-25度扫描到+15度,在水平方向上扫描0度~360度,与此同时,第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达在水平方向和垂直方向上从-90度扫描到+90度。处理装置将各个激光雷达采集到的点云数据进行融合得到全景点云数据,全景点云数据是各个激光雷达采集车辆四周的物体生成的。Among them, the first point cloud data is collected by the first lidar on the top of the vehicle, the second point cloud data is collected by the second lidar on the left side of the vehicle, and the third point cloud data is the third lidar on the right side of the vehicle. The fourth point cloud data is collected by the fourth lidar in front of the vehicle, and the fifth point cloud data is collected by the fifth lidar behind the vehicle. Among them, the first lidar, the second lidar, and the third The lidar, the fourth lidar and the fifth lidar keep time synchronization, and the processing device controls the first lidar, the second lidar, the third lidar, the fourth lidar and the fifth lidar to use the same sampling period to collect points Cloud data, that is, within a sampling period, the first lidar scans from -25 degrees to +15 degrees in the vertical direction, and scans 0 degrees to 360 degrees in the horizontal direction. At the same time, the second lidar and the third lidar The lidar, the fourth lidar, and the fifth lidar scan from -90 degrees to +90 degrees in the horizontal and vertical directions. The processing device fuses the point cloud data collected by each lidar to obtain panoramic point cloud data, which is generated by each lidar collecting objects around the vehicle.
进一步的,所述将所述第一点云数据、所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据进行融合得到全景点云数据,包括:Further, said fusing the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data and the fifth point cloud data to obtain a panoramic point Cloud data, including:
获取所述第一激光雷达、所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷达的空间位置;Acquiring the spatial positions of the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar;
根据所述空间位置将所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据转换到所述第一点云数据的坐标系中;Convert the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data into the coordinate system of the first point cloud data according to the spatial position ;
在所述坐标系中,确定所述第二点云数据、所述第三点云数据、所述第四点云数据、所述第五点云数据各自与所述第一点云数据之间的重合点云数据;In the coordinate system, determine the distance between each of the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data and the first point cloud data Coincident point cloud data;
根据所述重合点云数据将所述第二点云数据、所述第三点云数据、所述第四点云数据、所述第五点云数据分别于所述第一点云数据进行拼接后生成全景点云数据。According to the coincident point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are respectively spliced with the first point cloud data Then generate panoramic point cloud data.
其中,各个激光雷达会根据自身的坐标系采集点云数据,各个激光雷达设置在车辆上的位置是固定不变的,处理装置获取各个激光雷达的空间位置,从而确定各个激光雷达之间的相对位置关系,例如:以第一激光雷达为原点坐标,获取第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达相当于第一激光雷达的坐标。根据各个激光雷达的空间位置,将第一激光雷达的点云坐标系作为参考坐标系,将第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达采集到的点云数据转换到参考坐标系中。Among them, each lidar will collect point cloud data according to its own coordinate system. The position of each lidar on the vehicle is fixed. The processing device obtains the spatial position of each lidar to determine the relative relationship between each lidar. The positional relationship, for example, take the first lidar as the origin coordinates, and obtain the coordinates of the second lidar, the third lidar, the fourth lidar, and the fifth lidar, which are equivalent to the coordinates of the first lidar. According to the spatial position of each lidar, the point cloud coordinate system of the first lidar is used as the reference coordinate system, and the point cloud data collected by the second lidar, the third lidar, the fourth lidar and the fifth lidar are converted To the reference coordinate system.
根据第一激光雷达、第二激光雷达、第三激光雷达、第四激光雷达和第五 激光雷达在车辆上的位置、垂直视场角范围和水平视场角范围可以得知,第一点云数据和第二点云数据存在重合点云数据,第一点云数据和第三点云数据之间存在重合点云数据,第一点云数据和第四点云数据之间存在重合点云数据,第一点云数据和第五点云数据之间存在重合点云数据。处理装置将存在重合的两个点云数据取并集得到重合的点云数据拼接后的点云数据。例如:参见图4所示,第一点云数据40和第二点云数据41之间存在重合点云数据42,将第一点云数据40和第二点云数据41取并集得到拼接后的点云数据。According to the position of the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar on the vehicle, the vertical field of view range and the horizontal field of view range, it can be known that the first point cloud The data and the second point cloud data have overlapping point cloud data, the first point cloud data and the third point cloud data have overlapping point cloud data, and the first point cloud data and the fourth point cloud data have overlapping point cloud data , There is overlap point cloud data between the first point cloud data and the fifth point cloud data. The processing device merges the two overlapping point cloud data to obtain the point cloud data after the overlapping point cloud data is spliced. For example: referring to Figure 4, there is overlapping point cloud data 42 between the first point cloud data 40 and the second point cloud data 41, and the first point cloud data 40 and the second point cloud data 41 are combined to obtain a spliced set. Point cloud data.
处理装置分别将第一点云数据和第二点云数据进行拼接,第一点云数据和第三点云数据进行拼接,第一点云数据和第四点云数据进行拼接,以及第一点云数据和第五点云数据进行拼接后得到全景点云数据。The processing device respectively splices the first point cloud data and the second point cloud data, the first point cloud data and the third point cloud data are spliced, the first point cloud data and the fourth point cloud data are spliced, and the first point cloud data is spliced. The cloud data and the fifth point cloud data are spliced to obtain panoramic point cloud data.
实施本申请实施例,车辆的顶部、左侧、右侧、前方和后方分别设置有一个激光雷达,顶部的激光雷达用于远距离视场探测,左右侧的激光雷达用于近距离的左右视场探测,前方方的激光雷达用于近距离的前后视场探测,将上述的5个激光雷达采集到的点云数据进行融合得到全景点云数据,避免探测过程中车辆的前后左右出现盲区,提高了探测的准确性和自动驾驶系统的功能安全性。To implement the embodiments of this application, a lidar is provided on the top, left, right, front, and rear of the vehicle. The lidar on the top is used for long-distance field of view detection, and the lidar on the left and right sides is used for short-distance left and right vision. Field detection, the front lidar is used for short-distance front and rear field of view detection. The point cloud data collected by the above 5 lidars are merged to obtain panoramic point cloud data, so as to avoid blind spots in the front, rear, left, and right of the vehicle during the detection process. Improve the accuracy of detection and the functional safety of the automatic driving system.
下述为本申请装置实施例,可以用于执行本申请方法实施例。对于本申请装置实施例中未披露的细节,请参照本申请方法实施例。The following are device embodiments of this application, which can be used to execute the method embodiments of this application. For details not disclosed in the device embodiment of this application, please refer to the method embodiment of this application.
请参见图5,其示出了本申请一个示例性实施例提供的点云数据的处理装置的结构示意图,以下简称处理装置5。该处理装置5可以通过软件、硬件或者两者的结合实现成为激光雷达的全部或一部分。处理装置5包括:采集单元501和融合单元502。Please refer to FIG. 5, which shows a schematic structural diagram of a point cloud data processing device provided by an exemplary embodiment of the present application, which is referred to as the processing device 5 hereinafter. The processing device 5 can be implemented as all or part of the laser radar through software, hardware or a combination of the two. The processing device 5 includes: an acquisition unit 501 and a fusion unit 502.
采集单元501,用于通过第一激光雷达采集第一点云数据;The collecting unit 501 is configured to collect the first point cloud data through the first lidar;
通过第二激光雷达采集第二点云数据;Collect the second point cloud data through the second lidar;
通过第三激光雷达采集第三点云数据;Collect the third point cloud data through the third lidar;
通过第四激光雷达采集第四点云数据;Collect the fourth point cloud data through the fourth lidar;
通过第五激光雷达采集第五点云数据;其中,所述第一激光雷达设置于车辆的顶部,所述第二激光雷达设置于所述车辆的左侧,所述第三激光雷达设置于所述车辆的右侧,所述第四激光雷达设置于所述车辆的前方,所述第五激光 雷达设置于所述车辆的后方;The fifth point cloud data is collected by the fifth lidar; wherein, the first lidar is installed on the top of the vehicle, the second lidar is installed on the left side of the vehicle, and the third lidar is installed on the On the right side of the vehicle, the fourth lidar is arranged in front of the vehicle, and the fifth lidar is arranged at the rear of the vehicle;
融合单元502,用于将所述第一点云数据、所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据进行融合得到全景点云数据。The fusion unit 502 is configured to merge the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data to obtain a complete Scenic spot cloud data.
在一种可能的实施方式中,所述第一激光雷达的垂直视场角范围为-25°~+15°,水平视场角范围为0°~360°;所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷达的垂直视场角范围为-90°~+90°,水平视场角范围为-90°~+90°。In a possible implementation manner, the vertical field of view of the first lidar ranges from -25° to +15°, and the horizontal field of view ranges from 0° to 360°; The vertical field angle range of the third lidar, the fourth lidar, and the fifth lidar is -90°~+90°, and the horizontal field angle range is -90°~+90°.
在一种可能的实施方式中,所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷达位于同一平面上,所述第一激光雷达不位于该平面上。In a possible implementation manner, the second lidar, the third lidar, the fourth lidar, and the fifth lidar are located on the same plane, and the first lidar is not located on the same plane. on flat surface.
在一种可能的实施方式中,所述第二激光雷达和所述第三激光雷达位于第一线段,所述第四激光雷达和所述第五激光雷达位于第二线段,所述第一线段垂直于所述第二线段,且经过所述第二线段的中心点。In a possible implementation manner, the second lidar and the third lidar are located on a first line segment, the fourth lidar and the fifth lidar are located on a second line segment, and the first lidar The line segment is perpendicular to the second line segment and passes through the center point of the second line segment.
在一种可能的实施方式中,所述第一激光雷达、所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷达的采集时间保持同步。In a possible implementation manner, the acquisition time of the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar are kept synchronized.
在一种可能的实施方式中,所述将所述第一点云数据、所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据进行融合得到全景点云数据,包括:In a possible implementation manner, the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are combined Data is fused to obtain panoramic point cloud data, including:
获取所述第一激光雷达、所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷达的空间位置;Acquiring the spatial positions of the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar;
根据所述空间位置将所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据转换到所述第一点云数据的坐标系中;Convert the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data into the coordinate system of the first point cloud data according to the spatial position ;
在所述坐标系中,确定所述第二点云数据、所述第三点云数据、所述第四点云数据、所述第五点云数据各自与所述第一点云数据之间的重合点云数据;In the coordinate system, determine the distance between each of the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data and the first point cloud data Coincident point cloud data;
根据所述重合点云数据将所述第二点云数据、所述第三点云数据、所述第四点云数据、所述第五点云数据分别于所述第一点云数据进行拼接后生成全景点云数据。According to the coincident point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are respectively spliced with the first point cloud data Then generate panoramic point cloud data.
在一种可能的实施方式中,处理装置5还包括:In a possible implementation manner, the processing device 5 further includes:
定位单元,用于根据所述全景点云数据绘制地图;A positioning unit for drawing a map according to the panoramic point cloud data;
确定所述车辆在所述地图中的位置。Determine the location of the vehicle on the map.
需要说明的是,上述实施例提供的处理5在执行点云数据的处理方法时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将设备的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的点云数据的处理装置与点云数据的处理方法实施例属于同一构思,其体现实现过程详见方法实施例,这里不再赘述。It should be noted that when processing point cloud data is executed in the processing 5 provided in the above embodiment, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be assigned to different functions according to needs. Module completion, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the point cloud data processing device provided in the foregoing embodiment and the point cloud data processing method embodiment belong to the same concept, and the implementation process is detailed in the method embodiment, which will not be repeated here.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.
本申请实施例还提供了一种计算机存储介质,所述计算机存储介质可以存储有多条指令,所述指令适于由处理器加载并执行如上述图2-图4所示实施例的方法步骤,具体执行过程可以参见图2-图4所示实施例的具体说明,在此不进行赘述。The embodiment of the present application also provides a computer storage medium. The computer storage medium may store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps of the embodiments shown in FIGS. 2 to 4 above. For the specific execution process, please refer to the specific description of the embodiment shown in FIG. 2 to FIG. 4, which will not be repeated here.
本申请还提供了一种计算机程序产品,该计算机程序产品存储有至少一条指令,所述至少一条指令由所述处理器加载并执行以实现如上各个实施例所述的点云数据的处理方法。The present application also provides a computer program product that stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the point cloud data processing method described in each of the above embodiments.
请参见图6,为本申请实施例提供了一种点云数据的处理装置的结构示意图,以下处理装置6。如图6所示,所述处理装置6可以包括:至少一个处理器601、存储器602和至少一个通信总线603。Please refer to FIG. 6, which provides a schematic structural diagram of a point cloud data processing device according to an embodiment of the present application. The processing device 6 is below. As shown in FIG. 6, the processing device 6 may include: at least one processor 601, a memory 602, and at least one communication bus 603.
其中,通信总线603用于实现这些组件之间的连接通信。Among them, the communication bus 603 is used to implement connection and communication between these components.
其中,处理器601可以包括一个或者多个处理核心。处理器601利用各种接口和线路连接整个校正装置6内的各个部分,通过运行或执行存储在存储器602内的指令、程序、代码集或指令集,以及调用存储在存储器602内的数据,执行校正装置6的各种功能和处理数据。可选的,处理器601可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器601可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics Processing Unit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作系统、用户界面和应用程序等;GPU用于负责显示屏所需要显示的内容的渲染 和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器601中,单独通过一块芯片进行实现。The processor 601 may include one or more processing cores. The processor 601 uses various interfaces and lines to connect various parts of the entire correction device 6, and executes by running or executing instructions, programs, code sets, or instruction sets stored in the memory 602, and calling data stored in the memory 602. Various functions and processing data of the correction device 6. Optionally, the processor 601 may use at least one of digital signal processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). A kind of hardware form to realize. The processor 601 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), a modem, and the like. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the display; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 601, but may be implemented by a chip alone.
其中,存储器602可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory)。可选的,该存储器602包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器602可用于存储指令、程序、代码、代码集或指令集。存储器602可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作系统的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现上述各个方法实施例的指令等;存储数据区可存储上面各个方法实施例中涉及到的数据等。存储器602可选的还可以是至少一个位于远离前述处理器601的存储装置。The memory 602 may include random access memory (RAM) or read-only memory (Read-Only Memory). Optionally, the memory 602 includes a non-transitory computer-readable storage medium. The memory 602 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 602 may include a storage program area and a storage data area, where the storage program area may store instructions for implementing the operating system and instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), Instructions used to implement the foregoing method embodiments, etc.; the storage data area can store data and the like involved in the foregoing method embodiments. Optionally, the memory 602 may also be at least one storage device located far away from the foregoing processor 601.
在图6所示的校正装置6中,处理器601可以用于调用存储器602中存储的触摸操作响应应用程序,并具体执行图2的方法实施例所示的步骤。In the correction device 6 shown in FIG. 6, the processor 601 may be used to call the touch operation response application program stored in the memory 602 and specifically execute the steps shown in the method embodiment of FIG. 2.
其中,图6的实施例和图2的方法实施例基于相同的构思,其带来的技术效果也相同,图6的具体实现过程可参照图2的描述,此处不再赘述。Among them, the embodiment of FIG. 6 and the method embodiment of FIG. 2 are based on the same concept, and the technical effects brought about by them are also the same. For the specific implementation process of FIG. 6, reference may be made to the description of FIG. 2 and will not be repeated here.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体或随机存储记忆体等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium, and the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium can be a magnetic disk, an optical disc, a read-only storage memory or a random storage memory, etc.
以上所揭露的仅为本申请较佳实施例而已,当然不能以此来限定本申请之权利范围,因此依本申请权利要求所作的等同变化,仍属本申请所涵盖的范围。The above-disclosed are only preferred embodiments of this application, and of course the scope of rights of this application cannot be limited by this. Therefore, equivalent changes made in accordance with the claims of this application still fall within the scope of this application.

Claims (10)

  1. 一种点云数据的处理方法,其特征在于,所述方法包括:A method for processing point cloud data, characterized in that the method includes:
    通过第一激光雷达采集第一点云数据;Collect the first point cloud data through the first lidar;
    通过第二激光雷达采集第二点云数据;Collect the second point cloud data through the second lidar;
    通过第三激光雷达采集第三点云数据;Collect the third point cloud data through the third lidar;
    通过第四激光雷达采集第四点云数据;Collect the fourth point cloud data through the fourth lidar;
    通过第五激光雷达采集第五点云数据;其中,所述第一激光雷达设置于车辆的顶部,所述第二激光雷达设置于所述车辆的左侧,所述第三激光雷达设置于所述车辆的右侧,所述第四激光雷达设置于所述车辆的前方,所述第五激光雷达设置于所述车辆的后方;The fifth point cloud data is collected by the fifth lidar; wherein, the first lidar is arranged on the top of the vehicle, the second lidar is arranged on the left side of the vehicle, and the third lidar is arranged on the top of the vehicle. On the right side of the vehicle, the fourth lidar is arranged in front of the vehicle, and the fifth lidar is arranged at the rear of the vehicle;
    将所述第一点云数据、所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据进行融合得到全景点云数据。The first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are fused to obtain panoramic point cloud data.
  2. 根据权利要求1所述的处理方法,其特征在于,所述第一激光雷达的垂直视场角范围为-25°~+15°,水平视场角范围为0°~360°;所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷达的垂直视场角范围为-90°~+90°,水平视场角范围为-90°~+90°。The processing method according to claim 1, wherein the vertical field of view of the first lidar ranges from -25° to +15°, and the horizontal field of view ranges from 0° to 360°; The vertical field of view angle range of the second lidar, the third lidar, the fourth lidar, and the fifth lidar is -90°~+90°, and the horizontal field angle range is -90°~+ 90°.
  3. 根据权利要求1所述的处理方法,其特征在于,所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷达的水平中轴线位于同一平面上,所述第一激光雷达的水平中轴线不位于该平面上。The processing method according to claim 1, wherein the horizontal central axes of the second lidar, the third lidar, the fourth lidar, and the fifth lidar are located on the same plane, and The horizontal central axis of the first lidar is not located on this plane.
  4. 根据权利要求3所述的处理方法,其特征在于,所述第二激光雷达和所述第三激光雷达位于第一线段,所述第四激光雷达和所述第五激光雷达位于第二线段,所述第一线段垂直于所述第二线段,且经过所述第二线段的中心点。The processing method according to claim 3, wherein the second lidar and the third lidar are located in a first line segment, and the fourth lidar and the fifth lidar are located in a second line segment , The first line segment is perpendicular to the second line segment and passes through the center point of the second line segment.
  5. 根据权利要求1所述的处理方法,其特征在于,所述第一激光雷达、所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷 达的采集时间保持同步。The processing method according to claim 1, wherein the acquisition of the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar The time stays in sync.
  6. 根据权利要求1所述的处理方法,其特征在于,所述将所述第一点云数据、所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据进行融合得到全景点云数据,包括:The processing method according to claim 1, wherein the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the The fifth point cloud data is fused to obtain panoramic point cloud data, including:
    获取所述第一激光雷达、所述第二激光雷达、所述第三激光雷达、所述第四激光雷达和所述第五激光雷达的空间位置;Acquiring the spatial positions of the first lidar, the second lidar, the third lidar, the fourth lidar, and the fifth lidar;
    根据所述空间位置将所述第二点云数据、所述第三点云数据、所述第四点云数据和所述第五点云数据转换到所述第一点云数据的坐标系中;Convert the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data into the coordinate system of the first point cloud data according to the spatial position ;
    在所述坐标系中,确定所述第二点云数据、所述第三点云数据、所述第四点云数据、所述第五点云数据各自与所述第一点云数据之间的重合点云数据;In the coordinate system, determine the distance between each of the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data and the first point cloud data Coincident point cloud data;
    根据所述重合点云数据将所述第二点云数据、所述第三点云数据、所述第四点云数据、所述第五点云数据分别于所述第一点云数据进行拼接后生成全景点云数据。According to the coincident point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data are respectively spliced with the first point cloud data Then generate panoramic point cloud data.
  7. 根据权利要求1所述的处理方法,其特征在于,还包括:The processing method according to claim 1, further comprising:
    根据所述全景点云数据绘制地图;Drawing a map according to the panoramic point cloud data;
    确定所述车辆在所述地图中的位置。Determine the location of the vehicle on the map.
  8. 一种点云数据的处理装置,其特征在于,所述处理装置包括:A processing device for point cloud data, characterized in that the processing device comprises:
    采集单元,用于通过第一激光雷达采集第一点云数据;The collection unit is used to collect the first point cloud data through the first lidar;
    通过第二激光雷达采集第二点云数据;Collect the second point cloud data through the second lidar;
    通过第三激光雷达采集第三点云数据;Collect the third point cloud data through the third lidar;
    通过第四激光雷达采集第四点云数据;Collect the fourth point cloud data through the fourth lidar;
    通过第五激光雷达采集第五点云数据;其中,所述第一激光雷达设置于车辆的顶部,所述第二激光雷达设置于所述车辆的左侧,所述第三激光雷达设置于所述车辆的右侧,所述第四激光雷达设置于所述车辆的前方,所述第五激光雷达设置于所述车辆的后方;The fifth point cloud data is collected by the fifth lidar; wherein, the first lidar is arranged on the top of the vehicle, the second lidar is arranged on the left side of the vehicle, and the third lidar is arranged on the top of the vehicle. On the right side of the vehicle, the fourth lidar is arranged in front of the vehicle, and the fifth lidar is arranged at the rear of the vehicle;
    融合单元,用于将所述第一点云数据、所述第二点云数据、所述第三点云 数据、所述第四点云数据和所述第五点云数据进行融合得到全景点云数据。A fusion unit for fusing the first point cloud data, the second point cloud data, the third point cloud data, the fourth point cloud data, and the fifth point cloud data to obtain a panoramic point Cloud data.
  9. 一种计算机存储介质,其特征在于,所述计算机存储介质存储有多条指令,所述指令适于由处理器加载并执行如权利要求1~7任意一项的方法步骤。A computer storage medium, wherein the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps according to any one of claims 1-7.
  10. 一种激光雷达系统,其特征在于,包括:处理装置、第一激光雷达、第二激光雷达、第三激光雷达、第四激光雷达和第五激光雷达;A lidar system, characterized by comprising: a processing device, a first lidar, a second lidar, a third lidar, a fourth lidar, and a fifth lidar;
    其中,所述处理装置包括:处理器和存储器;所述存储器存储有计算机程序,所述计算机程序适于由所述处理器加载并执行如权利要求1~7任意一项的方法步骤。The processing device includes a processor and a memory; the memory stores a computer program, and the computer program is adapted to be loaded by the processor and execute the method steps according to any one of claims 1-7.
PCT/CN2020/070459 2020-01-06 2020-01-06 Method and apparatus for processing point cloud data, storage medium, and lidar system WO2021051726A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080005479.1A CN113366341B (en) 2020-01-06 Point cloud data processing method and device, storage medium and laser radar system
PCT/CN2020/070459 WO2021051726A1 (en) 2020-01-06 2020-01-06 Method and apparatus for processing point cloud data, storage medium, and lidar system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/070459 WO2021051726A1 (en) 2020-01-06 2020-01-06 Method and apparatus for processing point cloud data, storage medium, and lidar system

Publications (1)

Publication Number Publication Date
WO2021051726A1 true WO2021051726A1 (en) 2021-03-25

Family

ID=74883412

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/070459 WO2021051726A1 (en) 2020-01-06 2020-01-06 Method and apparatus for processing point cloud data, storage medium, and lidar system

Country Status (1)

Country Link
WO (1) WO2021051726A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108196260A (en) * 2017-12-13 2018-06-22 北京汽车集团有限公司 The test method and device of automatic driving vehicle multi-sensor fusion system
CN109410301A (en) * 2018-10-16 2019-03-01 张亮 High-precision semanteme map production method towards pilotless automobile
CN109709575A (en) * 2018-07-20 2019-05-03 深圳市速腾聚创科技有限公司 Laser radar sensory perceptual system and laser radar sensory perceptual system detection method
US20190178974A1 (en) * 2017-12-12 2019-06-13 Waymo Llc Systems and Methods for LIDARs With Adjustable Resolution and Failsafe Operation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190178974A1 (en) * 2017-12-12 2019-06-13 Waymo Llc Systems and Methods for LIDARs With Adjustable Resolution and Failsafe Operation
CN108196260A (en) * 2017-12-13 2018-06-22 北京汽车集团有限公司 The test method and device of automatic driving vehicle multi-sensor fusion system
CN109709575A (en) * 2018-07-20 2019-05-03 深圳市速腾聚创科技有限公司 Laser radar sensory perceptual system and laser radar sensory perceptual system detection method
CN109410301A (en) * 2018-10-16 2019-03-01 张亮 High-precision semanteme map production method towards pilotless automobile

Also Published As

Publication number Publication date
CN113366341A (en) 2021-09-07

Similar Documents

Publication Publication Date Title
US20210080575A1 (en) Apparatus for acquiring 3-dimensional maps of a scene
JP7291158B2 (en) Information processing method, system, device, program and computer storage medium
US20200293058A1 (en) Data processing method, apparatus and terminal
EP3540464B1 (en) Ranging method based on laser radar system, device and readable storage medium
EP2706377B1 (en) Object detection apparatus and method
JP2017215940A (en) Information processor, vehicle, information processing method and program
JP2017215939A (en) Information processor, vehicle, information processing method and program
WO2021014954A1 (en) Display control device and display control program
JP2000009422A (en) Distance measuring apparatus for traveling vehicle
JP2018147052A (en) Information processing device, information processing method, information processing program, and mobile body
WO2021051726A1 (en) Method and apparatus for processing point cloud data, storage medium, and lidar system
EP3430486B1 (en) Method and apparatus for monitoring a position
EP3540693A1 (en) Optimized disparity calculation
CN113366341B (en) Point cloud data processing method and device, storage medium and laser radar system
WO2022206373A1 (en) Laser emission method and apparatus, detection apparatus and mobile platform
US20150287207A1 (en) Registering of a scene disintegrating into clusters with pairs of scans
CN105182360A (en) Non-scanning high-speed laser three-dimensional imaging method and system
KR102071720B1 (en) Method for matching radar target list and target of vision image
JP7173090B2 (en) Display control device and display control program
EP4318027A1 (en) Synchronous control device and method for lidar
JP2021047120A (en) Recognition device, control system, recognition method and program
EP4163669A1 (en) Abnormal field of view recognition method and device, storage medium and mems lidar
WO2023065313A1 (en) Shielding relationship determination method and apparatus, and storage medium and electronic device
US20230080973A1 (en) Data processing apparatus, data processing system, and data processing method
WO2023123150A1 (en) Control method, lidar and terminal device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20866074

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09/11/2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20866074

Country of ref document: EP

Kind code of ref document: A1