CN113702927A - Vehicle sensor calibration method and device and storage medium - Google Patents

Vehicle sensor calibration method and device and storage medium Download PDF

Info

Publication number
CN113702927A
CN113702927A CN202110880407.8A CN202110880407A CN113702927A CN 113702927 A CN113702927 A CN 113702927A CN 202110880407 A CN202110880407 A CN 202110880407A CN 113702927 A CN113702927 A CN 113702927A
Authority
CN
China
Prior art keywords
calibrated
loss value
matrix
calibration
parameter matrix
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110880407.8A
Other languages
Chinese (zh)
Inventor
李丰军
周剑光
童悍操
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Automotive Innovation Corp
Original Assignee
China Automotive Innovation Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Automotive Innovation Corp filed Critical China Automotive Innovation Corp
Priority to CN202110880407.8A priority Critical patent/CN113702927A/en
Publication of CN113702927A publication Critical patent/CN113702927A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/40Means for monitoring or calibrating
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/497Means for monitoring or calibrating

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

本发明公开一种车辆传感器标定方法、装置及存储介质,该方法包括:获取激光雷达和待标定传感器针对标定工具的位置测量数据;根据待标定外参矩阵对所述激光雷达的位置测量数据进行转换,得到转换位置数据;根据所述转换位置数据和所述待标定传感器对应的位置测量数据,确定损失值;根据所述损失值反向调整所述待标定外参矩阵,直至所述损失值满足预设条件。利用本发明提供的技术方案至少可以实现对激光雷达和毫米波雷达、相机的车辆传感器的精确标定,为传感器进行融合做了良好的铺垫。

Figure 202110880407

The invention discloses a vehicle sensor calibration method, device and storage medium. The method includes: acquiring position measurement data of a laser radar and a sensor to be calibrated for a calibration tool; Convert to obtain converted position data; determine a loss value according to the converted position data and the position measurement data corresponding to the sensor to be calibrated; reversely adjust the external parameter matrix to be calibrated according to the loss value until the loss value meet the preset conditions. The technical solution provided by the present invention can at least realize the accurate calibration of the vehicle sensors of the laser radar, the millimeter-wave radar and the camera, which makes a good foundation for the fusion of the sensors.

Figure 202110880407

Description

Vehicle sensor calibration method and device and storage medium
Technical Field
The invention relates to the technical field of automatic driving, in particular to a vehicle sensor calibration method, a vehicle sensor calibration device and a storage medium.
Background
The calibration of the vehicle sensor is a very important function in automatic driving, a sensing system is equivalent to 'eyes' of the automatic driving system, a laser radar and a millimeter wave radar are used, a camera is an extremely important sensor in the sensing system, and the point calibration between the sensors directly influences the fusion effect of the sensors. The millimeter wave radar is a very important sensor in automatic driving, and has the advantages of high ranging and speed measuring precision and no environmental influence, but due to the characteristics of the millimeter wave radar, a target object is difficult to be accurately positioned, so that the laser radar and the millimeter wave radar are difficult to be accurately positioned in the calibration process, and the sensor fusion is difficult to meet. Secondly, for the calibration result, there is no more intuitive way to display the measurement result, except for the physical measurement. Finally, since there are numerous unmanned sensors and calibration thereof is extremely cumbersome, there are few fast and accurate calibration methods in the industry at present.
Therefore, a vehicle sensor calibration method is urgently needed to solve the problems of complex calibration process calculation and low calibration accuracy of the traditional sensor calibration method.
Disclosure of Invention
In order to solve the problems in the prior art, the embodiment of the invention provides a vehicle sensor calibration method, a vehicle sensor calibration device and a storage medium, and the technical scheme is as follows:
in one aspect, a vehicle sensor calibration method is provided, and the method includes:
acquiring position measurement data of a laser radar and a sensor to be calibrated aiming at a calibration tool;
converting the position measurement data of the laser radar according to the external parameter matrix to be calibrated to obtain converted position data;
determining a loss value according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
and reversely adjusting the external parameter matrix to be calibrated according to the loss value until the loss value meets a preset condition.
In another aspect, a vehicle sensor calibration apparatus is provided, the apparatus comprising:
a position measurement data acquisition module: the device is used for acquiring position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool;
a conversion location data determination module: the position measurement data of the laser radar are converted according to the external parameter matrix to be calibrated to obtain conversion position data;
a loss value determination module: the loss value is determined according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
a reverse adjustment module: and the external parameter matrix to be calibrated is reversely adjusted according to the loss value until the loss value meets a preset condition.
Further, when the sensor to be calibrated is a millimeter wave radar, the external reference matrix to be calibrated is a first external reference matrix;
the loss value determination module includes:
a first sum determination module: for determining a sum of the converted position data and a first origin translation amount; the first origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the millimeter wave radar coordinate system;
a first loss value determination module: and the first loss value is determined according to the square of the first difference value.
Further, when the sensor to be calibrated is a millimeter wave radar, a precision improving component is arranged on the calibration tool, and the precision improving component is used for improving the calibration precision of the millimeter wave radar.
Further, when the sensor to be calibrated is a camera, the external reference matrix to be calibrated is a second external reference matrix;
the loss value determination module further includes:
a second sum determination module: for determining a sum of the converted position data and a second origin translation amount; the second origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the camera coordinate system;
a second loss value determination module: and the device is used for determining a second difference value between the position measurement data corresponding to the camera and the sum value, and determining a second loss value according to the square of the second difference value.
Further, the apparatus further comprises:
a first rotation matrix and translation matrix determination module: the first rotating matrix and the first translation matrix are determined according to the first external parameter matrix when the first loss value meets the preset condition;
a second rotation matrix and translation matrix determination module: the second rotation matrix and the second translation matrix are determined according to the second external parameter matrix when the second loss value meets the preset condition;
a third rotation matrix determination module: for determining a third rotation matrix from the first and second rotation matrices;
a third translation matrix determination module: the device comprises a first translation matrix, a second translation matrix and a third translation matrix, wherein the first translation matrix and the second translation matrix are used for determining the first translation matrix and the second translation matrix;
a third external parameter matrix determination module: the third external parameter matrix is determined according to the third rotation matrix and the third translation matrix; and the third external parameter matrix represents an external parameter matrix for calibrating the camera by the millimeter wave radar.
Further, the apparatus further comprises:
a calibration result determination module: the calibration method comprises the steps of determining a calibration result according to a first external parameter matrix when the first loss value meets a preset condition, a second external parameter matrix when the second loss value meets a preset condition, and a third external parameter matrix; and visualizing the calibration result;
if the calibration result is within a preset error range, ending calibration;
and if the calibration result is not within the preset error range, re-executing the step of obtaining the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool until the calibration result is within the preset error range.
Another aspect provides a storage medium having stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by a processor to implement the vehicle sensor calibration method as described above.
The invention provides a vehicle sensor calibration method, a vehicle sensor calibration device and a storage medium, which have the following technical effects:
according to the embodiment of the invention, position measurement data of a laser radar and a sensor to be calibrated aiming at a calibration tool are obtained, wherein the sensor to be calibrated is a millimeter wave radar and a camera; secondly, the position measurement data of the laser radar is converted according to the external parameter matrix to be calibrated to obtain the conversion position data of the position coordinate of the laser radar projected to the millimeter wave radar and the camera, the position of the sensor to be calibrated is converted by the same sensor, the precision of the combined calibration of the sensor is improved, then, according to the obtained conversion position data and the position measurement data of the sensor to be calibrated, determining a loss value, iterative calculation is carried out on the loss value to obtain an optimal loss value, and then the external parameter matrix to be calibrated is reversely adjusted according to the optimal loss value, calibrating the vehicle sensor according to the adjusted external parameter matrix to be calibrated, visualizing the calibration result, the calibration result can be rapidly and visually displayed, the observation is convenient, the accurate calibration of the vehicle sensor is realized through the technical scheme, and a good cushion is made for the fusion of the sensor.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic flow chart illustrating a method for calibrating a vehicle sensor according to an embodiment of the present invention;
fig. 2 is a block diagram of a vehicle sensor calibration apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
It is noted that the present specification provides the method steps as described in the examples or flowcharts, but may include more or less steps based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. In practice, the system or server product may be implemented in a sequential or parallel manner (e.g., parallel processor or multi-threaded environment) according to the embodiments or methods shown in the figures.
Example (b):
referring to fig. 1, a schematic flow chart of a vehicle sensor calibration method according to an embodiment of the present invention is shown, where the method specifically includes the following steps:
s101: acquiring position measurement data of a laser radar and a sensor to be calibrated aiming at a calibration tool;
in the embodiment of the invention, the position measurement data of a calibration tool are respectively obtained according to a laser radar and a sensor to be calibrated, wherein the sensor to be calibrated is a millimeter wave radar and a camera, the position measurement data of the laser radar is converted according to an external parameter matrix to be calibrated to obtain the conversion position data in the sensor to be calibrated, a loss value is determined according to the conversion position data and the position measurement data of the sensor to be calibrated, iterative calculation is carried out on the loss value to obtain the loss value meeting a preset condition, the external parameter matrix to be calibrated is reversely adjusted according to the loss value meeting the preset condition, and the vehicle sensor is calibrated according to the adjusted external parameter matrix to be calibrated.
S102: converting the position measurement data of the laser radar according to the external parameter matrix to be calibrated to obtain converted position data;
in the embodiment of the invention, when the sensor to be calibrated is a millimeter wave radar, the calibration tool is provided with the precision improving component, the precision improving component is arranged for improving the calibration precision of the millimeter wave radar, at the moment, the corresponding external parameter matrix to be calibrated is a first external parameter matrix, and the position measurement data of the laser radar is converted according to the first external parameter matrix, so that the converted position data of the position measurement data of the laser radar converted into the millimeter wave radar is obtained.
And when the sensor to be calibrated is a camera, the corresponding external parameter matrix to be calibrated is a second external parameter matrix, and the position measurement data of the laser radar is converted according to the second external parameter matrix to obtain the conversion position data of the position measurement data of the laser radar converted into the camera.
S103: determining a loss value according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
in an optional implementation manner, when the sensor to be calibrated is a millimeter wave radar, it is determined that position measurement data of the laser radar is converted into conversion position data in the millimeter wave radar, a position coordinate value of the position measurement data of the laser radar converted into the millimeter wave radar is determined according to a sum of the conversion position data converted into the millimeter wave radar and a translation amount of a first origin, wherein the translation amount of the first origin represents a translation amount from an origin of a coordinate system of the laser radar to the origin of the coordinate system of the millimeter wave radar, the position coordinate value is subtracted from the position measurement data corresponding to the millimeter wave radar to obtain a first difference value, and the first difference value is squared to obtain a first loss value. It should be noted that, the first loss value is determined by summing the first difference values of the plurality of positions, which are brought in the process of calculating the first loss value, and the range, which can be measured by the laser radar, the millimeter wave radar and the camera together, should be covered as much as possible in the selection of the plurality of positions, which avoids the situation that the calculation of the first loss value is inaccurate due to too dense distance of the selected positions to a certain extent.
Specifically, the first loss value may be expressed as the following equation:
Figure BDA0003192020570000081
wherein L is1Is a first loss value, xradarAnd yradarPosition measurement, x, for a millimeter-wave radar for a calibration toollidarAnd ylidarFor position measurements of the lidar to a calibration tool,
Figure BDA0003192020570000082
a first rotation matrix corresponding to the conversion position data for converting the lidar to the millimeter wave radar, theta is a rotation angle of the lidar projected to the millimeter wave radar,
Figure BDA0003192020570000083
for the first origin translation amount, it should be noted that the first origin translation amount is equal to the first translation matrix in value.
By performing iterative calculation on the first loss value and stopping the iterative calculation until the first loss value meets the preset condition, and then reversely adjusting the first external reference matrix, specifically, obtaining an initial first loss value through the sum value of the position measurement data corresponding to the millimeter wave radar and the converted position data converted from the laser radar to the millimeter wave radar obtained by calculation and the first origin translation amount, judging whether the initial first loss value meets a preset condition or not, if not, then the rotation angle projected by the laser radar to the millimeter wave radar and the translation amount of the first origin are readjusted, the first loss value is repeatedly calculated until the preset condition is met, the iterative calculation is ended, and determining a first external parameter matrix through the rotation angle projected to the millimeter-wave radar by the corresponding laser radar when the iteration is finished and the translation amount of the first origin, and calibrating the millimeter-wave radar by the laser radar according to the adjusted first external parameter matrix.
In an optional embodiment, when the sensor to be calibrated is a camera, determining that position measurement data of the laser radar is converted into conversion position data in the camera, determining that the position measurement data of the laser radar is converted into a position coordinate value in the camera according to a sum of the conversion position data converted into the camera by the position measurement data of the laser radar and a second origin translation amount, wherein the second origin translation amount represents a translation amount from an origin of a coordinate system of the laser radar to the origin of the coordinate system of the camera, subtracting the position coordinate value from the position measurement data corresponding to the camera to obtain a second difference value, and squaring the second difference value to obtain a second loss value. It should be noted that, the second loss value is determined by summing the second differences at the plurality of positions, which are brought in during the second loss value calculation.
Specifically, the second loss value may be expressed as the following equation:
Figure BDA0003192020570000091
wherein L is2For the second loss value, Z and K are adjustable parameters, u and v, l are position measurements of the camera for the calibration tool, xlidarAnd ylidar、zlidarThe position measurement value of the laser radar for the calibration tool is obtained, R is a second rotation matrix corresponding to conversion position data converted from the laser radar to the camera, and T is a second origin point translation amount.
The iterative calculation is stopped until the second loss value meets the preset condition, and then adjusting the second external parameter matrix reversely, specifically, obtaining an initial second loss value through the position measurement data corresponding to the camera and the sum value of the converted position data converted from the laser radar to the camera and the second origin translation amount, judging whether the initial second loss value meets the preset condition or not, if not, readjusting the rotation angle projected to the camera by the laser radar and the translation amount of the second origin, repeatedly calculating a second loss value until a preset condition is met, ending iterative calculation, and determining a second appearance parameter matrix through the rotation angle projected to the camera by the corresponding laser radar when the iteration is finished and the second origin point translation amount, and calibrating the camera by the laser radar according to the adjusted second appearance parameter matrix.
S104: and reversely adjusting the external parameter matrix to be calibrated according to the loss value until the loss value meets a preset condition.
In the embodiment of the invention, the first external parameter matrix is reversely adjusted according to the first loss value to obtain the first loss value meeting the preset condition, the reverse adjustment method comprises the steps of carrying out iterative calculation on the first loss value by using a gradient descent method until the first loss value meets the preset condition, further determining the first external parameter matrix when the preset condition is met, and calibrating the millimeter wave radar by the laser radar according to the adjusted first external parameter matrix.
Similar to the calibration of the millimeter wave radar by the laser radar, the calibration of the camera by the laser radar is to reverse the second appearance parameter matrix according to the second loss value to obtain a second loss value meeting the preset condition, the reverse adjustment method is to perform iterative calculation on the second loss value by using a gradient descent method until the second loss value meets the preset condition, further determine the second appearance parameter matrix when the preset condition is met, and realize the calibration of the camera by the laser radar according to the adjusted second appearance parameter matrix.
In an optional implementation manner, after the millimeter wave radar and the camera are calibrated by the laser radar, a third external parameter matrix is determined according to the adjusted first external parameter matrix and the adjusted second external parameter matrix, wherein the third external parameter matrix represents the external parameter matrix for the millimeter wave radar to calibrate the camera. Specifically, a corresponding first rotation matrix and a corresponding first translation matrix are determined according to the adjusted first external parameter matrix, a corresponding second rotation matrix and a corresponding second translation matrix are determined according to the adjusted second external parameter matrix, a third rotation matrix is determined according to the first rotation matrix and the second rotation matrix, a third translation matrix is further determined according to the first translation matrix and the second translation matrix, and a third external parameter matrix is determined according to the third rotation matrix and the third translation matrix, so that calibration of the millimeter wave radar on the camera is realized, and further, combined calibration of the laser radar, the millimeter wave radar and the camera is realized.
Specifically, the adjusted first rotation matrix is denoted as R1And the adjusted second rotation matrix is denoted as R2And the adjusted second translation matrix is recorded as T1And the adjusted second translation matrix is recorded as T2And the third rotation matrix is denoted as R3And the third translation matrix is denoted as T3Then R is3=R2*R1 -1
T3=T2-R1 -1*T1
And further calibrating the camera by the millimeter wave radar according to the third external parameter matrix obtained by calculation.
Specifically, after the laser radar, the millimeter wave radar and the camera are calibrated to obtain calibration, the calibration result is verified, whether the calibration process is finished or not is judged according to the verification result, the verification process is to visualize the calibration result through a visualization tool to obtain a macroscopic calibration result, and whether the calibration process is finished or not is judged according to the result displayed on the visualization tool. Specifically, whether the calibration result is within a preset error range or not is judged, if the calibration result is within the preset error range, the calibration is finished, if the calibration result is not within the preset error range, the step of acquiring the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool is executed again, until the calibration result is within the preset error range, the calibration time of the vehicle sensor is reduced due to the implementation of the visual calibration result, the calibration process is simplified, meanwhile, an observer can conveniently and quickly acquire the calibration result, the efficiency and the accuracy of the calibration of the vehicle sensor are improved, and a good cushion is made for the fusion of the sensor.
According to the technical scheme of the embodiment of the invention, the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool are obtained, wherein the sensor to be calibrated is a millimeter wave radar and a camera; secondly, the position measurement data of the laser radar is converted according to the external parameter matrix to be calibrated to obtain the conversion position data of the position coordinate of the laser radar projected to the millimeter wave radar and the camera, the position of the sensor to be calibrated is converted by the same sensor, the precision of the combined calibration of the sensor is improved, then, according to the obtained conversion position data and the position measurement data of the sensor to be calibrated, determining a loss value, iterative calculation is carried out on the loss value to obtain an optimal loss value, and then the external parameter matrix to be calibrated is reversely adjusted according to the optimal loss value, calibrating the vehicle sensor according to the adjusted external parameter matrix to be calibrated, visualizing the calibration result, the calibration result can be rapidly and visually displayed, the observation is convenient, the accurate calibration of the vehicle sensor is realized through the technical scheme, and a good cushion is made for the fusion of the sensor.
The embodiment of the present invention further provides a vehicle sensor calibration apparatus, as shown in fig. 2, which is a structural block diagram of the vehicle sensor calibration apparatus provided in the embodiment of the present invention, and the apparatus includes:
position measurement data acquisition module 10: the device is used for acquiring position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool;
the conversion position data determination module 20: the position measurement data of the laser radar are converted according to the external parameter matrix to be calibrated to obtain conversion position data;
loss value determination module 30: the loss value is determined according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
the reverse adjustment module 40: and the external parameter matrix to be calibrated is reversely adjusted according to the loss value until the loss value meets a preset condition.
Further, when the sensor to be calibrated is a millimeter wave radar, the external reference matrix to be calibrated is a first external reference matrix;
the loss value determination module 30 includes:
a first sum determination module: for determining a sum of the converted position data and a first origin translation amount; the first origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the millimeter wave radar coordinate system;
a first loss value determination module: and the first loss value is determined according to the square of the first difference value.
Further, when the sensor to be calibrated is a millimeter wave radar, a precision improving component is arranged on the calibration tool, and the precision improving component is used for improving the calibration precision of the millimeter wave radar.
Further, when the sensor to be calibrated is a camera, the external reference matrix to be calibrated is a second external reference matrix;
the loss value determination module 30 further includes:
a second sum determination module: for determining a sum of the converted position data and a second origin translation amount; the second origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the camera coordinate system;
a second loss value determination module: and the device is used for determining a second difference value between the position measurement data corresponding to the camera and the sum value, and determining a second loss value according to the square of the second difference value.
Further, the apparatus further comprises:
a first rotation matrix and translation matrix determination module: the first rotating matrix and the first translation matrix are determined according to the first external parameter matrix when the first loss value meets the preset condition;
a second rotation matrix and translation matrix determination module: the second rotation matrix and the second translation matrix are determined according to the second external parameter matrix when the second loss value meets the preset condition;
a third rotation matrix determination module: for determining a third rotation matrix from the first and second rotation matrices;
a third translation matrix determination module: the device comprises a first translation matrix, a second translation matrix and a third translation matrix, wherein the first translation matrix and the second translation matrix are used for determining the first translation matrix and the second translation matrix;
a third external parameter matrix determination module: the third external parameter matrix is determined according to the third rotation matrix and the third translation matrix; and the third external parameter matrix represents an external parameter matrix for calibrating the camera by the millimeter wave radar.
Further, the apparatus further comprises:
a calibration result determination module: the calibration method comprises the steps of determining a calibration result according to a first external parameter matrix when the first loss value meets a preset condition, a second external parameter matrix when the second loss value meets a preset condition, and a third external parameter matrix; and visualizing the calibration result;
if the calibration result is within a preset error range, ending calibration;
and if the calibration result is not within the preset error range, re-executing the step of obtaining the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool until the calibration result is within the preset error range.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Embodiments of the present invention also provide a storage medium for implementing at least one instruction, at least one program, a code set, or a set of instructions related to a vehicle sensor calibration method in the method embodiments, where the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the vehicle sensor calibration method provided in the above method embodiments.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1.一种车辆传感器标定方法,其特征在于,所述方法包括:1. A vehicle sensor calibration method, wherein the method comprises: 获取激光雷达和待标定传感器针对标定工具的位置测量数据;Obtain the position measurement data of the lidar and the sensor to be calibrated for the calibration tool; 根据待标定外参矩阵对所述激光雷达的位置测量数据进行转换,得到转换位置数据;Convert the position measurement data of the lidar according to the external parameter matrix to be calibrated to obtain the converted position data; 根据所述转换位置数据和所述待标定传感器对应的位置测量数据,确定损失值;Determine the loss value according to the converted position data and the position measurement data corresponding to the to-be-calibrated sensor; 根据所述损失值反向调整所述待标定外参矩阵,直至所述损失值满足预设条件。The external parameter matrix to be calibrated is adjusted inversely according to the loss value until the loss value satisfies a preset condition. 2.根据权利要求1所述的一种车辆传感器标定方法,其特征在于,当所述待标定传感器为毫米波雷达时,所述待标定外参矩阵为第一外参矩阵;2. A vehicle sensor calibration method according to claim 1, wherein when the to-be-calibrated sensor is a millimeter-wave radar, the to-be-calibrated external parameter matrix is the first external parameter matrix; 所述根据所述转换位置数据和所述待标定传感器对应的位置测量数据,确定损失值,包括:The determining the loss value according to the converted position data and the position measurement data corresponding to the sensor to be calibrated includes: 确定所述转换位置数据与第一原点平移量的和值;所述第一原点平移量表征激光雷达坐标系原点到毫米波雷达坐标系原点的平移量;determining the sum of the converted position data and the first origin shift; the first origin shift represents the shift from the origin of the lidar coordinate system to the origin of the millimeter-wave radar coordinate system; 确定所述毫米波雷达对应的位置测量数据与所述和值的第一差值,根据所述第一差值的平方确定第一损失值。A first difference between the position measurement data corresponding to the millimeter-wave radar and the sum is determined, and a first loss value is determined according to the square of the first difference. 3.根据权利要求2所述的一种车辆传感器标定方法,其特征在于,当所述待标定传感器为毫米波雷达时,在所述标定工具上设置精度提升部件,所述精度提升部件用于提高所述毫米波雷达的标定精度。3. A vehicle sensor calibration method according to claim 2, characterized in that, when the to-be-calibrated sensor is a millimeter-wave radar, an accuracy improvement component is provided on the calibration tool, and the accuracy improvement component is used for The calibration accuracy of the millimeter wave radar is improved. 4.根据权利要求3所述的一种车辆传感器标定方法,其特征在于,当所述待标定传感器为相机时,所述待标定外参矩阵为第二外参矩阵;4. A vehicle sensor calibration method according to claim 3, wherein when the to-be-calibrated sensor is a camera, the to-be-calibrated external parameter matrix is a second external parameter matrix; 所述根据所述转换位置数据和所述待标定传感器对应的位置测量数据,确定损失值,还包括:The determining the loss value according to the converted position data and the position measurement data corresponding to the to-be-calibrated sensor further includes: 确定所述转换位置数据与第二原点平移量的和值;所述第二原点平移量表征激光雷达坐标系原点到相机坐标系原点的平移量;determining the sum of the converted position data and the second origin translation; the second origin translation represents the translation from the origin of the lidar coordinate system to the origin of the camera coordinate system; 确定所述相机对应的位置测量数据与所述和值的第二差值,根据所述第二差值的平方确定第二损失值。A second difference between the position measurement data corresponding to the camera and the sum is determined, and a second loss value is determined according to the square of the second difference. 5.根据权利要求4所述的一种车辆传感器标定方法,其特征在于,所述方法还包括:5. A vehicle sensor calibration method according to claim 4, wherein the method further comprises: 根据所述第一损失值满足预设条件时的第一外参矩阵,确定第一旋转矩阵和第一平移矩阵;determining a first rotation matrix and a first translation matrix according to the first extrinsic parameter matrix when the first loss value satisfies a preset condition; 根据所述第二损失值满足预设条件时的第二外参矩阵,确定第二旋转矩阵和第二平移矩阵;determining a second rotation matrix and a second translation matrix according to the second extrinsic parameter matrix when the second loss value satisfies a preset condition; 根据所述第一旋转矩阵和所述第二旋转矩阵确定第三旋转矩阵;determining a third rotation matrix according to the first rotation matrix and the second rotation matrix; 根据所述第一平移矩阵和所述第二平移矩阵确定第三平移矩阵;determining a third translation matrix according to the first translation matrix and the second translation matrix; 根据所述第三旋转矩阵和所述第三平移矩阵,确定第三外参矩阵;所述第三外参矩阵表征所述毫米波雷达对所述相机进行标定的外参矩阵。A third extrinsic parameter matrix is determined according to the third rotation matrix and the third translation matrix; the third extrinsic parameter matrix represents an extrinsic parameter matrix used by the millimeter-wave radar to calibrate the camera. 6.根据权利要求5所述的一种车辆传感器标定方法,其特征在于,所述方法还包括:6. A vehicle sensor calibration method according to claim 5, wherein the method further comprises: 根据所述第一损失值满足预设条件时的第一外参矩阵、所述第二损失值满足预设条件时的第二外参矩阵和所述第三外参矩阵,确定标定结果;并将所述标定结果可视化;determining the calibration result according to the first extrinsic parameter matrix when the first loss value satisfies the preset condition, the second extrinsic parameter matrix and the third extrinsic parameter matrix when the second loss value satisfies the preset condition; and visualizing the calibration results; 若所述标定结果在预设的误差范围内,则结束标定;If the calibration result is within the preset error range, end the calibration; 若所述标定结果不在预设的误差范围内,则重新执行所述获取激光雷达和待标定传感器针对标定工具的位置测量数据的步骤,直至所述标定结果在预设的误差范围内。If the calibration result is not within the preset error range, the step of acquiring the position measurement data of the laser radar and the sensor to be calibrated with respect to the calibration tool is performed again until the calibration result is within the preset error range. 7.一种车辆传感器标定装置,其特征在于,所述装置包括:7. A vehicle sensor calibration device, wherein the device comprises: 位置测量数据获取模块:用于获取激光雷达和待标定传感器针对标定工具的位置测量数据;Position measurement data acquisition module: used to obtain the position measurement data of the laser radar and the sensor to be calibrated for the calibration tool; 转换位置数据确定模块:用于根据待标定外参矩阵对所述激光雷达的位置测量数据进行转换,得到转换位置数据;Conversion position data determination module: used to convert the position measurement data of the lidar according to the external parameter matrix to be calibrated to obtain converted position data; 损失值确定模块:用于根据所述转换位置数据和所述待标定传感器对应的位置测量数据,确定损失值;Loss value determination module: used to determine the loss value according to the converted position data and the position measurement data corresponding to the to-be-calibrated sensor; 反向调整模块:用于根据所述损失值反向调整所述待标定外参矩阵,直至所述损失值满足预设条件。Reverse adjustment module: used to reversely adjust the external parameter matrix to be calibrated according to the loss value until the loss value satisfies a preset condition. 8.根据权利要求7所述的一种车辆传感器标定装置,其特征在于,当所述待标定传感器为毫米波雷达时,所述待标定外参矩阵为第一外参矩阵;8 . The vehicle sensor calibration device according to claim 7 , wherein when the to-be-calibrated sensor is a millimeter-wave radar, the to-be-calibrated external parameter matrix is the first external parameter matrix; 8 . 所述损失值确定模块包括:The loss value determination module includes: 第一和值确定模块:用于确定所述转换位置数据与第一原点平移量的和值;所述第一原点平移量表征激光雷达坐标系原点到毫米波雷达坐标系原点的平移量;The first sum value determination module: used to determine the sum value of the converted position data and the first origin translation amount; the first origin translation amount represents the translation amount from the origin of the lidar coordinate system to the origin of the millimeter wave radar coordinate system; 第一损失值确定模块:用于确定所述毫米波雷达对应的位置测量数据与所述和值的第一差值,根据所述第一差值的平方确定第一损失值。A first loss value determination module: configured to determine a first difference between the position measurement data corresponding to the millimeter wave radar and the sum, and determine a first loss according to the square of the first difference. 9.根据权利要求7所述的一种车辆传感器标定装置,其特征在于,当所述待标定传感器为相机时,所述待标定外参矩阵为第二外参矩阵;9 . The vehicle sensor calibration device according to claim 7 , wherein when the to-be-calibrated sensor is a camera, the to-be-calibrated extrinsic parameter matrix is a second extrinsic parameter matrix; 10 . 所述损失值确定模块还包括:The loss value determination module further includes: 第二和值确定模块:用于确定所述转换位置数据与第二原点平移量的和值;所述第二原点平移量表征激光雷达坐标系原点到相机坐标系原点的平移量;The second sum value determination module is used to determine the sum of the converted position data and the second origin translation amount; the second origin translation amount represents the translation amount from the origin of the lidar coordinate system to the origin of the camera coordinate system; 第二损失值确定模块:用于确定所述相机对应的位置测量数据与所述和值的第二差值,根据所述第二差值的平方确定第二损失值。The second loss value determination module is configured to determine the second difference between the position measurement data corresponding to the camera and the sum value, and determine the second loss value according to the square of the second difference. 10.一种存储介质,所述存储介质中存储有至少一条指令或者至少一段程序,所述至少一条指令或者所述至少一段程序由处理器加载并执行以实现如权利要求1~6任一项所述的车辆传感器标定方法。10. A storage medium, wherein at least one instruction or at least one piece of program is stored in the storage medium, and the at least one instruction or at least one piece of program is loaded and executed by a processor to implement any one of claims 1 to 6 The described vehicle sensor calibration method.
CN202110880407.8A 2021-08-02 2021-08-02 Vehicle sensor calibration method and device and storage medium Pending CN113702927A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110880407.8A CN113702927A (en) 2021-08-02 2021-08-02 Vehicle sensor calibration method and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110880407.8A CN113702927A (en) 2021-08-02 2021-08-02 Vehicle sensor calibration method and device and storage medium

Publications (1)

Publication Number Publication Date
CN113702927A true CN113702927A (en) 2021-11-26

Family

ID=78651226

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110880407.8A Pending CN113702927A (en) 2021-08-02 2021-08-02 Vehicle sensor calibration method and device and storage medium

Country Status (1)

Country Link
CN (1) CN113702927A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114442074A (en) * 2022-01-30 2022-05-06 中国第一汽车股份有限公司 Vehicle calibration device and calibration method thereof
CN114994623A (en) * 2022-05-27 2022-09-02 北京京深深向科技有限公司 External parameter calibration method, device, electronic device, and storage medium for vehicle-mounted millimeter-wave radar
CN115436919A (en) * 2022-09-16 2022-12-06 中汽创智科技有限公司 External parameter determining method, device, equipment and medium for road-end laser radar
CN115480235A (en) * 2022-08-30 2022-12-16 中汽创智科技有限公司 A roadside laser radar calibration method, device and electronic equipment
CN115542277A (en) * 2022-11-30 2022-12-30 南京慧尔视智能科技有限公司 Radar normal calibration method, device, system, equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106405555A (en) * 2016-09-23 2017-02-15 百度在线网络技术(北京)有限公司 Obstacle detecting method and device used for vehicle-mounted radar system
CN108226906A (en) * 2017-11-29 2018-06-29 深圳市易成自动驾驶技术有限公司 A kind of scaling method, device and computer readable storage medium
CN109767475A (en) * 2018-12-28 2019-05-17 广州小鹏汽车科技有限公司 A kind of method for calibrating external parameters and system of sensor
CN110488234A (en) * 2019-08-30 2019-11-22 北京百度网讯科技有限公司 Outer ginseng scaling method, device, equipment and the medium of vehicle-mounted millimeter wave radar
CN111815717A (en) * 2020-07-15 2020-10-23 西北工业大学 A Multi-sensor Fusion External Reference Joint Semi-autonomous Calibration Method
CN112241989A (en) * 2019-08-22 2021-01-19 北京新能源汽车技术创新中心有限公司 External parameter calibration method and device, computer equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106405555A (en) * 2016-09-23 2017-02-15 百度在线网络技术(北京)有限公司 Obstacle detecting method and device used for vehicle-mounted radar system
CN108226906A (en) * 2017-11-29 2018-06-29 深圳市易成自动驾驶技术有限公司 A kind of scaling method, device and computer readable storage medium
CN109767475A (en) * 2018-12-28 2019-05-17 广州小鹏汽车科技有限公司 A kind of method for calibrating external parameters and system of sensor
CN112241989A (en) * 2019-08-22 2021-01-19 北京新能源汽车技术创新中心有限公司 External parameter calibration method and device, computer equipment and storage medium
CN110488234A (en) * 2019-08-30 2019-11-22 北京百度网讯科技有限公司 Outer ginseng scaling method, device, equipment and the medium of vehicle-mounted millimeter wave radar
CN111815717A (en) * 2020-07-15 2020-10-23 西北工业大学 A Multi-sensor Fusion External Reference Joint Semi-autonomous Calibration Method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114442074A (en) * 2022-01-30 2022-05-06 中国第一汽车股份有限公司 Vehicle calibration device and calibration method thereof
CN114994623A (en) * 2022-05-27 2022-09-02 北京京深深向科技有限公司 External parameter calibration method, device, electronic device, and storage medium for vehicle-mounted millimeter-wave radar
CN115480235A (en) * 2022-08-30 2022-12-16 中汽创智科技有限公司 A roadside laser radar calibration method, device and electronic equipment
CN115436919A (en) * 2022-09-16 2022-12-06 中汽创智科技有限公司 External parameter determining method, device, equipment and medium for road-end laser radar
CN115542277A (en) * 2022-11-30 2022-12-30 南京慧尔视智能科技有限公司 Radar normal calibration method, device, system, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN113702927A (en) Vehicle sensor calibration method and device and storage medium
US8659752B2 (en) Automated warm-up and stability check for laser trackers
Chao et al. Calibration of laser beam direction for optical coordinate measuring system
CN111208493B (en) Quick calibration method of vehicle-mounted laser radar in whole vehicle coordinate system
KR101613815B1 (en) System and method for image-based structural health monitoring suitable for structures having uncertain load conditions and support conditions
CN109655079B (en) Method for measuring coordinate system from star sensor to prism coordinate system
WO2022001325A1 (en) Point cloud data fusion method and apparatus, electronic device, storage medium, and computer program
EP3607264B1 (en) Machine vision system
CN104730802A (en) Optical axis included angle calibrating and focusing method and system and double-camera equipment
CN108871373B (en) A star sensor calibration method based on pitch-roll table and nonlinear optimization
CN104990501A (en) Three-dimensional laser scanning device system parameter calibration method
CN113567964A (en) Laser radar automatic test method, device and system
CN105807271A (en) Laser radar calibration system and method
TW201514441A (en) System and method for adjusting line laser probes of measurement machine
CN110018491B (en) Laser scanning method, device and lidar
CN108375352A (en) The method of adjustment of two plan-positions based on the depth of parallelism, apparatus and system
CN117321442A (en) Pose deviation acquisition method and device, storage medium and electronic equipment
CN102467113A (en) Controller with parameter learning of mechanical device and its parameter learning method
CN108286946A (en) The method and system of sensing station mark fixed sum data splicing
EP2905595A1 (en) Gauge Testing Device
CN113256734B (en) Calibration method, system and electronic equipment for vehicle perception sensor
CN113628117B (en) Depth image rotation transformation method and device
CN108592838B (en) Calibration method and device of tool coordinate system and computer storage medium
CN106908010A (en) A kind of curvature measurement method and device
CN117372535A (en) Method, system, equipment and medium for simulation analysis of external parameter calibration of vehicle-mounted camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20211126

RJ01 Rejection of invention patent application after publication