CN113702927A - Vehicle sensor calibration method and device and storage medium - Google Patents
Vehicle sensor calibration method and device and storage medium Download PDFInfo
- Publication number
- CN113702927A CN113702927A CN202110880407.8A CN202110880407A CN113702927A CN 113702927 A CN113702927 A CN 113702927A CN 202110880407 A CN202110880407 A CN 202110880407A CN 113702927 A CN113702927 A CN 113702927A
- Authority
- CN
- China
- Prior art keywords
- calibrated
- loss value
- matrix
- calibration
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 239000011159 matrix material Substances 0.000 claims abstract description 165
- 238000005259 measurement Methods 0.000 claims abstract description 62
- 238000006243 chemical reaction Methods 0.000 claims abstract description 28
- 238000013519 translation Methods 0.000 claims description 81
- 230000004927 fusion Effects 0.000 abstract description 6
- 238000004364 calculation method Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000011478 gradient descent method Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 1
- 238000000053 physical method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/40—Means for monitoring or calibrating
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Radar Systems Or Details Thereof (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
The invention discloses a vehicle sensor calibration method, a vehicle sensor calibration device and a storage medium, wherein the method comprises the following steps: acquiring position measurement data of a laser radar and a sensor to be calibrated aiming at a calibration tool; converting the position measurement data of the laser radar according to the external parameter matrix to be calibrated to obtain converted position data; determining a loss value according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated; and reversely adjusting the external parameter matrix to be calibrated according to the loss value until the loss value meets a preset condition. By utilizing the technical scheme provided by the invention, the accurate calibration of the vehicle sensors of the laser radar, the millimeter wave radar and the camera can be realized at least, and a good cushion is made for the fusion of the sensors.
Description
Technical Field
The invention relates to the technical field of automatic driving, in particular to a vehicle sensor calibration method, a vehicle sensor calibration device and a storage medium.
Background
The calibration of the vehicle sensor is a very important function in automatic driving, a sensing system is equivalent to 'eyes' of the automatic driving system, a laser radar and a millimeter wave radar are used, a camera is an extremely important sensor in the sensing system, and the point calibration between the sensors directly influences the fusion effect of the sensors. The millimeter wave radar is a very important sensor in automatic driving, and has the advantages of high ranging and speed measuring precision and no environmental influence, but due to the characteristics of the millimeter wave radar, a target object is difficult to be accurately positioned, so that the laser radar and the millimeter wave radar are difficult to be accurately positioned in the calibration process, and the sensor fusion is difficult to meet. Secondly, for the calibration result, there is no more intuitive way to display the measurement result, except for the physical measurement. Finally, since there are numerous unmanned sensors and calibration thereof is extremely cumbersome, there are few fast and accurate calibration methods in the industry at present.
Therefore, a vehicle sensor calibration method is urgently needed to solve the problems of complex calibration process calculation and low calibration accuracy of the traditional sensor calibration method.
Disclosure of Invention
In order to solve the problems in the prior art, the embodiment of the invention provides a vehicle sensor calibration method, a vehicle sensor calibration device and a storage medium, and the technical scheme is as follows:
in one aspect, a vehicle sensor calibration method is provided, and the method includes:
acquiring position measurement data of a laser radar and a sensor to be calibrated aiming at a calibration tool;
converting the position measurement data of the laser radar according to the external parameter matrix to be calibrated to obtain converted position data;
determining a loss value according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
and reversely adjusting the external parameter matrix to be calibrated according to the loss value until the loss value meets a preset condition.
In another aspect, a vehicle sensor calibration apparatus is provided, the apparatus comprising:
a position measurement data acquisition module: the device is used for acquiring position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool;
a conversion location data determination module: the position measurement data of the laser radar are converted according to the external parameter matrix to be calibrated to obtain conversion position data;
a loss value determination module: the loss value is determined according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
a reverse adjustment module: and the external parameter matrix to be calibrated is reversely adjusted according to the loss value until the loss value meets a preset condition.
Further, when the sensor to be calibrated is a millimeter wave radar, the external reference matrix to be calibrated is a first external reference matrix;
the loss value determination module includes:
a first sum determination module: for determining a sum of the converted position data and a first origin translation amount; the first origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the millimeter wave radar coordinate system;
a first loss value determination module: and the first loss value is determined according to the square of the first difference value.
Further, when the sensor to be calibrated is a millimeter wave radar, a precision improving component is arranged on the calibration tool, and the precision improving component is used for improving the calibration precision of the millimeter wave radar.
Further, when the sensor to be calibrated is a camera, the external reference matrix to be calibrated is a second external reference matrix;
the loss value determination module further includes:
a second sum determination module: for determining a sum of the converted position data and a second origin translation amount; the second origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the camera coordinate system;
a second loss value determination module: and the device is used for determining a second difference value between the position measurement data corresponding to the camera and the sum value, and determining a second loss value according to the square of the second difference value.
Further, the apparatus further comprises:
a first rotation matrix and translation matrix determination module: the first rotating matrix and the first translation matrix are determined according to the first external parameter matrix when the first loss value meets the preset condition;
a second rotation matrix and translation matrix determination module: the second rotation matrix and the second translation matrix are determined according to the second external parameter matrix when the second loss value meets the preset condition;
a third rotation matrix determination module: for determining a third rotation matrix from the first and second rotation matrices;
a third translation matrix determination module: the device comprises a first translation matrix, a second translation matrix and a third translation matrix, wherein the first translation matrix and the second translation matrix are used for determining the first translation matrix and the second translation matrix;
a third external parameter matrix determination module: the third external parameter matrix is determined according to the third rotation matrix and the third translation matrix; and the third external parameter matrix represents an external parameter matrix for calibrating the camera by the millimeter wave radar.
Further, the apparatus further comprises:
a calibration result determination module: the calibration method comprises the steps of determining a calibration result according to a first external parameter matrix when the first loss value meets a preset condition, a second external parameter matrix when the second loss value meets a preset condition, and a third external parameter matrix; and visualizing the calibration result;
if the calibration result is within a preset error range, ending calibration;
and if the calibration result is not within the preset error range, re-executing the step of obtaining the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool until the calibration result is within the preset error range.
Another aspect provides a storage medium having stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by a processor to implement the vehicle sensor calibration method as described above.
The invention provides a vehicle sensor calibration method, a vehicle sensor calibration device and a storage medium, which have the following technical effects:
according to the embodiment of the invention, position measurement data of a laser radar and a sensor to be calibrated aiming at a calibration tool are obtained, wherein the sensor to be calibrated is a millimeter wave radar and a camera; secondly, the position measurement data of the laser radar is converted according to the external parameter matrix to be calibrated to obtain the conversion position data of the position coordinate of the laser radar projected to the millimeter wave radar and the camera, the position of the sensor to be calibrated is converted by the same sensor, the precision of the combined calibration of the sensor is improved, then, according to the obtained conversion position data and the position measurement data of the sensor to be calibrated, determining a loss value, iterative calculation is carried out on the loss value to obtain an optimal loss value, and then the external parameter matrix to be calibrated is reversely adjusted according to the optimal loss value, calibrating the vehicle sensor according to the adjusted external parameter matrix to be calibrated, visualizing the calibration result, the calibration result can be rapidly and visually displayed, the observation is convenient, the accurate calibration of the vehicle sensor is realized through the technical scheme, and a good cushion is made for the fusion of the sensor.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic flow chart illustrating a method for calibrating a vehicle sensor according to an embodiment of the present invention;
fig. 2 is a block diagram of a vehicle sensor calibration apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
It is noted that the present specification provides the method steps as described in the examples or flowcharts, but may include more or less steps based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. In practice, the system or server product may be implemented in a sequential or parallel manner (e.g., parallel processor or multi-threaded environment) according to the embodiments or methods shown in the figures.
Example (b):
referring to fig. 1, a schematic flow chart of a vehicle sensor calibration method according to an embodiment of the present invention is shown, where the method specifically includes the following steps:
s101: acquiring position measurement data of a laser radar and a sensor to be calibrated aiming at a calibration tool;
in the embodiment of the invention, the position measurement data of a calibration tool are respectively obtained according to a laser radar and a sensor to be calibrated, wherein the sensor to be calibrated is a millimeter wave radar and a camera, the position measurement data of the laser radar is converted according to an external parameter matrix to be calibrated to obtain the conversion position data in the sensor to be calibrated, a loss value is determined according to the conversion position data and the position measurement data of the sensor to be calibrated, iterative calculation is carried out on the loss value to obtain the loss value meeting a preset condition, the external parameter matrix to be calibrated is reversely adjusted according to the loss value meeting the preset condition, and the vehicle sensor is calibrated according to the adjusted external parameter matrix to be calibrated.
S102: converting the position measurement data of the laser radar according to the external parameter matrix to be calibrated to obtain converted position data;
in the embodiment of the invention, when the sensor to be calibrated is a millimeter wave radar, the calibration tool is provided with the precision improving component, the precision improving component is arranged for improving the calibration precision of the millimeter wave radar, at the moment, the corresponding external parameter matrix to be calibrated is a first external parameter matrix, and the position measurement data of the laser radar is converted according to the first external parameter matrix, so that the converted position data of the position measurement data of the laser radar converted into the millimeter wave radar is obtained.
And when the sensor to be calibrated is a camera, the corresponding external parameter matrix to be calibrated is a second external parameter matrix, and the position measurement data of the laser radar is converted according to the second external parameter matrix to obtain the conversion position data of the position measurement data of the laser radar converted into the camera.
S103: determining a loss value according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
in an optional implementation manner, when the sensor to be calibrated is a millimeter wave radar, it is determined that position measurement data of the laser radar is converted into conversion position data in the millimeter wave radar, a position coordinate value of the position measurement data of the laser radar converted into the millimeter wave radar is determined according to a sum of the conversion position data converted into the millimeter wave radar and a translation amount of a first origin, wherein the translation amount of the first origin represents a translation amount from an origin of a coordinate system of the laser radar to the origin of the coordinate system of the millimeter wave radar, the position coordinate value is subtracted from the position measurement data corresponding to the millimeter wave radar to obtain a first difference value, and the first difference value is squared to obtain a first loss value. It should be noted that, the first loss value is determined by summing the first difference values of the plurality of positions, which are brought in the process of calculating the first loss value, and the range, which can be measured by the laser radar, the millimeter wave radar and the camera together, should be covered as much as possible in the selection of the plurality of positions, which avoids the situation that the calculation of the first loss value is inaccurate due to too dense distance of the selected positions to a certain extent.
Specifically, the first loss value may be expressed as the following equation:
wherein L is1Is a first loss value, xradarAnd yradarPosition measurement, x, for a millimeter-wave radar for a calibration toollidarAnd ylidarFor position measurements of the lidar to a calibration tool,
a first rotation matrix corresponding to the conversion position data for converting the lidar to the millimeter wave radar, theta is a rotation angle of the lidar projected to the millimeter wave radar,
for the first origin translation amount, it should be noted that the first origin translation amount is equal to the first translation matrix in value.
By performing iterative calculation on the first loss value and stopping the iterative calculation until the first loss value meets the preset condition, and then reversely adjusting the first external reference matrix, specifically, obtaining an initial first loss value through the sum value of the position measurement data corresponding to the millimeter wave radar and the converted position data converted from the laser radar to the millimeter wave radar obtained by calculation and the first origin translation amount, judging whether the initial first loss value meets a preset condition or not, if not, then the rotation angle projected by the laser radar to the millimeter wave radar and the translation amount of the first origin are readjusted, the first loss value is repeatedly calculated until the preset condition is met, the iterative calculation is ended, and determining a first external parameter matrix through the rotation angle projected to the millimeter-wave radar by the corresponding laser radar when the iteration is finished and the translation amount of the first origin, and calibrating the millimeter-wave radar by the laser radar according to the adjusted first external parameter matrix.
In an optional embodiment, when the sensor to be calibrated is a camera, determining that position measurement data of the laser radar is converted into conversion position data in the camera, determining that the position measurement data of the laser radar is converted into a position coordinate value in the camera according to a sum of the conversion position data converted into the camera by the position measurement data of the laser radar and a second origin translation amount, wherein the second origin translation amount represents a translation amount from an origin of a coordinate system of the laser radar to the origin of the coordinate system of the camera, subtracting the position coordinate value from the position measurement data corresponding to the camera to obtain a second difference value, and squaring the second difference value to obtain a second loss value. It should be noted that, the second loss value is determined by summing the second differences at the plurality of positions, which are brought in during the second loss value calculation.
Specifically, the second loss value may be expressed as the following equation:
wherein L is2For the second loss value, Z and K are adjustable parameters, u and v, l are position measurements of the camera for the calibration tool, xlidarAnd ylidar、zlidarThe position measurement value of the laser radar for the calibration tool is obtained, R is a second rotation matrix corresponding to conversion position data converted from the laser radar to the camera, and T is a second origin point translation amount.
The iterative calculation is stopped until the second loss value meets the preset condition, and then adjusting the second external parameter matrix reversely, specifically, obtaining an initial second loss value through the position measurement data corresponding to the camera and the sum value of the converted position data converted from the laser radar to the camera and the second origin translation amount, judging whether the initial second loss value meets the preset condition or not, if not, readjusting the rotation angle projected to the camera by the laser radar and the translation amount of the second origin, repeatedly calculating a second loss value until a preset condition is met, ending iterative calculation, and determining a second appearance parameter matrix through the rotation angle projected to the camera by the corresponding laser radar when the iteration is finished and the second origin point translation amount, and calibrating the camera by the laser radar according to the adjusted second appearance parameter matrix.
S104: and reversely adjusting the external parameter matrix to be calibrated according to the loss value until the loss value meets a preset condition.
In the embodiment of the invention, the first external parameter matrix is reversely adjusted according to the first loss value to obtain the first loss value meeting the preset condition, the reverse adjustment method comprises the steps of carrying out iterative calculation on the first loss value by using a gradient descent method until the first loss value meets the preset condition, further determining the first external parameter matrix when the preset condition is met, and calibrating the millimeter wave radar by the laser radar according to the adjusted first external parameter matrix.
Similar to the calibration of the millimeter wave radar by the laser radar, the calibration of the camera by the laser radar is to reverse the second appearance parameter matrix according to the second loss value to obtain a second loss value meeting the preset condition, the reverse adjustment method is to perform iterative calculation on the second loss value by using a gradient descent method until the second loss value meets the preset condition, further determine the second appearance parameter matrix when the preset condition is met, and realize the calibration of the camera by the laser radar according to the adjusted second appearance parameter matrix.
In an optional implementation manner, after the millimeter wave radar and the camera are calibrated by the laser radar, a third external parameter matrix is determined according to the adjusted first external parameter matrix and the adjusted second external parameter matrix, wherein the third external parameter matrix represents the external parameter matrix for the millimeter wave radar to calibrate the camera. Specifically, a corresponding first rotation matrix and a corresponding first translation matrix are determined according to the adjusted first external parameter matrix, a corresponding second rotation matrix and a corresponding second translation matrix are determined according to the adjusted second external parameter matrix, a third rotation matrix is determined according to the first rotation matrix and the second rotation matrix, a third translation matrix is further determined according to the first translation matrix and the second translation matrix, and a third external parameter matrix is determined according to the third rotation matrix and the third translation matrix, so that calibration of the millimeter wave radar on the camera is realized, and further, combined calibration of the laser radar, the millimeter wave radar and the camera is realized.
Specifically, the adjusted first rotation matrix is denoted as R1And the adjusted second rotation matrix is denoted as R2And the adjusted second translation matrix is recorded as T1And the adjusted second translation matrix is recorded as T2And the third rotation matrix is denoted as R3And the third translation matrix is denoted as T3Then R is3＝R2*R1 -1
T3＝T2-R1 -1*T1
And further calibrating the camera by the millimeter wave radar according to the third external parameter matrix obtained by calculation.
Specifically, after the laser radar, the millimeter wave radar and the camera are calibrated to obtain calibration, the calibration result is verified, whether the calibration process is finished or not is judged according to the verification result, the verification process is to visualize the calibration result through a visualization tool to obtain a macroscopic calibration result, and whether the calibration process is finished or not is judged according to the result displayed on the visualization tool. Specifically, whether the calibration result is within a preset error range or not is judged, if the calibration result is within the preset error range, the calibration is finished, if the calibration result is not within the preset error range, the step of acquiring the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool is executed again, until the calibration result is within the preset error range, the calibration time of the vehicle sensor is reduced due to the implementation of the visual calibration result, the calibration process is simplified, meanwhile, an observer can conveniently and quickly acquire the calibration result, the efficiency and the accuracy of the calibration of the vehicle sensor are improved, and a good cushion is made for the fusion of the sensor.
According to the technical scheme of the embodiment of the invention, the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool are obtained, wherein the sensor to be calibrated is a millimeter wave radar and a camera; secondly, the position measurement data of the laser radar is converted according to the external parameter matrix to be calibrated to obtain the conversion position data of the position coordinate of the laser radar projected to the millimeter wave radar and the camera, the position of the sensor to be calibrated is converted by the same sensor, the precision of the combined calibration of the sensor is improved, then, according to the obtained conversion position data and the position measurement data of the sensor to be calibrated, determining a loss value, iterative calculation is carried out on the loss value to obtain an optimal loss value, and then the external parameter matrix to be calibrated is reversely adjusted according to the optimal loss value, calibrating the vehicle sensor according to the adjusted external parameter matrix to be calibrated, visualizing the calibration result, the calibration result can be rapidly and visually displayed, the observation is convenient, the accurate calibration of the vehicle sensor is realized through the technical scheme, and a good cushion is made for the fusion of the sensor.
The embodiment of the present invention further provides a vehicle sensor calibration apparatus, as shown in fig. 2, which is a structural block diagram of the vehicle sensor calibration apparatus provided in the embodiment of the present invention, and the apparatus includes:
position measurement data acquisition module 10: the device is used for acquiring position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool;
the conversion position data determination module 20: the position measurement data of the laser radar are converted according to the external parameter matrix to be calibrated to obtain conversion position data;
loss value determination module 30: the loss value is determined according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
the reverse adjustment module 40: and the external parameter matrix to be calibrated is reversely adjusted according to the loss value until the loss value meets a preset condition.
Further, when the sensor to be calibrated is a millimeter wave radar, the external reference matrix to be calibrated is a first external reference matrix;
the loss value determination module 30 includes:
a first sum determination module: for determining a sum of the converted position data and a first origin translation amount; the first origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the millimeter wave radar coordinate system;
a first loss value determination module: and the first loss value is determined according to the square of the first difference value.
Further, when the sensor to be calibrated is a millimeter wave radar, a precision improving component is arranged on the calibration tool, and the precision improving component is used for improving the calibration precision of the millimeter wave radar.
Further, when the sensor to be calibrated is a camera, the external reference matrix to be calibrated is a second external reference matrix;
the loss value determination module 30 further includes:
a second sum determination module: for determining a sum of the converted position data and a second origin translation amount; the second origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the camera coordinate system;
a second loss value determination module: and the device is used for determining a second difference value between the position measurement data corresponding to the camera and the sum value, and determining a second loss value according to the square of the second difference value.
Further, the apparatus further comprises:
a first rotation matrix and translation matrix determination module: the first rotating matrix and the first translation matrix are determined according to the first external parameter matrix when the first loss value meets the preset condition;
a second rotation matrix and translation matrix determination module: the second rotation matrix and the second translation matrix are determined according to the second external parameter matrix when the second loss value meets the preset condition;
a third rotation matrix determination module: for determining a third rotation matrix from the first and second rotation matrices;
a third translation matrix determination module: the device comprises a first translation matrix, a second translation matrix and a third translation matrix, wherein the first translation matrix and the second translation matrix are used for determining the first translation matrix and the second translation matrix;
a third external parameter matrix determination module: the third external parameter matrix is determined according to the third rotation matrix and the third translation matrix; and the third external parameter matrix represents an external parameter matrix for calibrating the camera by the millimeter wave radar.
Further, the apparatus further comprises:
a calibration result determination module: the calibration method comprises the steps of determining a calibration result according to a first external parameter matrix when the first loss value meets a preset condition, a second external parameter matrix when the second loss value meets a preset condition, and a third external parameter matrix; and visualizing the calibration result;
if the calibration result is within a preset error range, ending calibration;
and if the calibration result is not within the preset error range, re-executing the step of obtaining the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool until the calibration result is within the preset error range.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Embodiments of the present invention also provide a storage medium for implementing at least one instruction, at least one program, a code set, or a set of instructions related to a vehicle sensor calibration method in the method embodiments, where the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the vehicle sensor calibration method provided in the above method embodiments.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A vehicle sensor calibration method, the method comprising:
acquiring position measurement data of a laser radar and a sensor to be calibrated aiming at a calibration tool;
converting the position measurement data of the laser radar according to the external parameter matrix to be calibrated to obtain converted position data;
determining a loss value according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
and reversely adjusting the external parameter matrix to be calibrated according to the loss value until the loss value meets a preset condition.
2. The vehicle sensor calibration method according to claim 1, wherein when the sensor to be calibrated is a millimeter wave radar, the external reference matrix to be calibrated is a first external reference matrix;
determining a loss value according to the converted position data and the position measurement data corresponding to the sensor to be calibrated, including:
determining a sum of the conversion position data and the first origin translation amount; the first origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the millimeter wave radar coordinate system;
and determining a first difference value between the position measurement data corresponding to the millimeter wave radar and the sum value, and determining a first loss value according to the square of the first difference value.
3. The vehicle sensor calibration method according to claim 2, wherein when the sensor to be calibrated is a millimeter wave radar, a precision improving component is arranged on the calibration tool, and the precision improving component is used for improving the calibration precision of the millimeter wave radar.
4. The vehicle sensor calibration method according to claim 3, wherein when the sensor to be calibrated is a camera, the extrinsic parameter matrix to be calibrated is a second extrinsic parameter matrix;
determining a loss value according to the converted position data and the position measurement data corresponding to the sensor to be calibrated, and further comprising:
determining a sum of the conversion position data and a second origin translation amount; the second origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the camera coordinate system;
and determining a second difference value between the position measurement data corresponding to the camera and the sum value, and determining a second loss value according to the square of the second difference value.
5. A vehicle sensor calibration method according to claim 4, characterized in that the method further comprises:
determining a first rotation matrix and a first translation matrix according to a first external parameter matrix when the first loss value meets a preset condition;
determining a second rotation matrix and a second translation matrix according to a second external parameter matrix when the second loss value meets a preset condition;
determining a third rotation matrix according to the first rotation matrix and the second rotation matrix;
determining a third translation matrix according to the first translation matrix and the second translation matrix;
determining a third external parameter matrix according to the third rotation matrix and the third translation matrix; and the third external parameter matrix represents an external parameter matrix for calibrating the camera by the millimeter wave radar.
6. A vehicle sensor calibration method according to claim 5, characterized in that said method further comprises:
determining a calibration result according to a first external parameter matrix when the first loss value meets a preset condition, a second external parameter matrix when the second loss value meets a preset condition and a third external parameter matrix; and visualizing the calibration result;
if the calibration result is within a preset error range, ending calibration;
and if the calibration result is not within the preset error range, re-executing the step of obtaining the position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool until the calibration result is within the preset error range.
7. A vehicle sensor calibration apparatus, said apparatus comprising:
a position measurement data acquisition module: the device is used for acquiring position measurement data of the laser radar and the sensor to be calibrated aiming at the calibration tool;
a conversion location data determination module: the position measurement data of the laser radar are converted according to the external parameter matrix to be calibrated to obtain conversion position data;
a loss value determination module: the loss value is determined according to the conversion position data and the position measurement data corresponding to the sensor to be calibrated;
a reverse adjustment module: and the external parameter matrix to be calibrated is reversely adjusted according to the loss value until the loss value meets a preset condition.
8. The vehicle sensor calibration device according to claim 7, wherein when the sensor to be calibrated is a millimeter wave radar, the external reference matrix to be calibrated is a first external reference matrix;
the loss value determination module includes:
a first sum determination module: for determining a sum of the converted position data and a first origin translation amount; the first origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the millimeter wave radar coordinate system;
a first loss value determination module: and the first loss value is determined according to the square of the first difference value.
9. The vehicle sensor calibration device according to claim 7, wherein when the sensor to be calibrated is a camera, the extrinsic parameter matrix to be calibrated is a second extrinsic parameter matrix;
the loss value determination module further includes:
a second sum determination module: for determining a sum of the converted position data and a second origin translation amount; the second origin translation amount represents the translation amount from the origin of the laser radar coordinate system to the origin of the camera coordinate system;
a second loss value determination module: and the device is used for determining a second difference value between the position measurement data corresponding to the camera and the sum value, and determining a second loss value according to the square of the second difference value.
10. A storage medium having at least one instruction or at least one program stored therein, the at least one instruction or the at least one program being loaded and executed by a processor to implement a vehicle sensor calibration method as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110880407.8A CN113702927A (en) | 2021-08-02 | 2021-08-02 | Vehicle sensor calibration method and device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110880407.8A CN113702927A (en) | 2021-08-02 | 2021-08-02 | Vehicle sensor calibration method and device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113702927A true CN113702927A (en) | 2021-11-26 |
Family
ID=78651226
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110880407.8A Pending CN113702927A (en) | 2021-08-02 | 2021-08-02 | Vehicle sensor calibration method and device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113702927A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114442074A (en) * | 2022-01-30 | 2022-05-06 | 中国第一汽车股份有限公司 | Vehicle calibration device and calibration method thereof |
| CN115436919A (en) * | 2022-09-16 | 2022-12-06 | 中汽创智科技有限公司 | External parameter determining method, device, equipment and medium for road-end laser radar |
| CN115480235A (en) * | 2022-08-30 | 2022-12-16 | 中汽创智科技有限公司 | Road-end laser radar calibration method and device and electronic equipment |
| CN115542277A (en) * | 2022-11-30 | 2022-12-30 | 南京慧尔视智能科技有限公司 | Radar normal calibration method, device, system, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106405555A (en) * | 2016-09-23 | 2017-02-15 | 百度在线网络技术（北京）有限公司 | Obstacle detecting method and device used for vehicle-mounted radar system |
| CN108226906A (en) * | 2017-11-29 | 2018-06-29 | 深圳市易成自动驾驶技术有限公司 | A kind of scaling method, device and computer readable storage medium |
| CN109767475A (en) * | 2018-12-28 | 2019-05-17 | 广州小鹏汽车科技有限公司 | A kind of method for calibrating external parameters and system of sensor |
| CN110488234A (en) * | 2019-08-30 | 2019-11-22 | 北京百度网讯科技有限公司 | Outer ginseng scaling method, device, equipment and the medium of vehicle-mounted millimeter wave radar |
| CN111815717A (en) * | 2020-07-15 | 2020-10-23 | 西北工业大学 | Multi-sensor fusion external parameter combination semi-autonomous calibration method |
| CN112241989A (en) * | 2019-08-22 | 2021-01-19 | 北京新能源汽车技术创新中心有限公司 | External parameter calibration method and device, computer equipment and storage medium |
-
2021
- 2021-08-02 CN CN202110880407.8A patent/CN113702927A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106405555A (en) * | 2016-09-23 | 2017-02-15 | 百度在线网络技术（北京）有限公司 | Obstacle detecting method and device used for vehicle-mounted radar system |
| CN108226906A (en) * | 2017-11-29 | 2018-06-29 | 深圳市易成自动驾驶技术有限公司 | A kind of scaling method, device and computer readable storage medium |
| CN109767475A (en) * | 2018-12-28 | 2019-05-17 | 广州小鹏汽车科技有限公司 | A kind of method for calibrating external parameters and system of sensor |
| CN112241989A (en) * | 2019-08-22 | 2021-01-19 | 北京新能源汽车技术创新中心有限公司 | External parameter calibration method and device, computer equipment and storage medium |
| CN110488234A (en) * | 2019-08-30 | 2019-11-22 | 北京百度网讯科技有限公司 | Outer ginseng scaling method, device, equipment and the medium of vehicle-mounted millimeter wave radar |
| CN111815717A (en) * | 2020-07-15 | 2020-10-23 | 西北工业大学 | Multi-sensor fusion external parameter combination semi-autonomous calibration method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114442074A (en) * | 2022-01-30 | 2022-05-06 | 中国第一汽车股份有限公司 | Vehicle calibration device and calibration method thereof |
| CN115480235A (en) * | 2022-08-30 | 2022-12-16 | 中汽创智科技有限公司 | Road-end laser radar calibration method and device and electronic equipment |
| CN115436919A (en) * | 2022-09-16 | 2022-12-06 | 中汽创智科技有限公司 | External parameter determining method, device, equipment and medium for road-end laser radar |
| CN115542277A (en) * | 2022-11-30 | 2022-12-30 | 南京慧尔视智能科技有限公司 | Radar normal calibration method, device, system, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113702927A (en) | Vehicle sensor calibration method and device and storage medium | |
| CN107967701B (en) | Calibration method, device and equipment of depth camera equipment | |
| Chao et al. | Calibration of laser beam direction for optical coordinate measuring system | |
| CN111208493B (en) | Quick calibration method of vehicle-mounted laser radar in whole vehicle coordinate system | |
| CN109655079B (en) | Method for measuring coordinate system from star sensor to prism coordinate system | |
| WO2022001325A1 (en) | Point cloud data fusion method and apparatus, electronic device, storage medium, and computer program | |
| WO2020168685A1 (en) | Three-dimensional scanning viewpoint planning method, device, and computer readable storage medium | |
| EP3607264B1 (en) | Machine vision system | |
| CN104730802A (en) | Optical axis included angle calibrating and focusing method and system and double-camera equipment | |
| CN111025032B (en) | Aerial beam measuring system and method based on lift-off platform | |
| CN105807271A (en) | Laser radar calibration system and method | |
| CN108286946B (en) | Method and system for sensor position calibration and data splicing | |
| CN113567964A (en) | Laser radar automatic test method, device and system | |
| CN114994641A (en) | Parameter calibration method and device, electronic equipment and storage medium | |
| CN110018491B (en) | Laser scanning method and device and laser radar | |
| JPH09311021A (en) | Method for measuring three-dimensional shape using light wave range finder | |
| CN108375352A (en) | The method of adjustment of two plan-positions based on the depth of parallelism, apparatus and system | |
| CN109827607A (en) | The scaling method and device of line-structured light weld seam tracking sensor | |
| CN102269581A (en) | Machining precision evaluation method of architectural component | |
| CN113628117B (en) | Depth image rotation transformation method and device | |
| CN115840186A (en) | Direction and distance measuring and alignment method and device based on cloud RTK radio monitoring equipment | |
| CN115950356A (en) | Bucket coordinate calibration method and device, updating method and equipment and excavator | |
| CN113256734B (en) | Vehicle-mounted sensing sensor calibration method and system and electronic equipment | |
| CN114879168A (en) | Laser radar and IMU calibration method and system | |
| CN117321442A (en) | Pose deviation acquisition method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |