WO2021051439A1 - Calibration method, apparatus, storage medium and multi-channel lidar - Google Patents

Calibration method, apparatus, storage medium and multi-channel lidar Download PDF

Info

Publication number
WO2021051439A1
WO2021051439A1 PCT/CN2019/108216 CN2019108216W WO2021051439A1 WO 2021051439 A1 WO2021051439 A1 WO 2021051439A1 CN 2019108216 W CN2019108216 W CN 2019108216W WO 2021051439 A1 WO2021051439 A1 WO 2021051439A1
Authority
WO
WIPO (PCT)
Prior art keywords
view
field
fields
echo intensity
corrected
Prior art date
Application number
PCT/CN2019/108216
Other languages
French (fr)
Chinese (zh)
Inventor
罗斯特
刘夏
Original Assignee
深圳市速腾聚创科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市速腾聚创科技有限公司 filed Critical 深圳市速腾聚创科技有限公司
Priority to CN201980051815.3A priority Critical patent/CN112955778B/en
Priority to PCT/CN2019/108216 priority patent/WO2021051439A1/en
Publication of WO2021051439A1 publication Critical patent/WO2021051439A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/497Means for monitoring or calibrating
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Definitions

  • This application relates to the field of lidar, and in particular to a method, device, storage medium and multi-channel lidar for calibrating multi-channel lidar.
  • Lidar can create 3D images of the surroundings.
  • Lidar uses micro-electro-mechanical system (MEMS) micro galvanometer as a beam scanning structure. It is a way of lidar. In order to achieve a larger detection area, it is generally used The method of splicing multiple fields of view expands the area. Multiple fields of view correspond to multiple channels, and each field of view corresponds to a channel.
  • Each channel is composed of a set of laser transmitters, laser receivers, hardware circuits, and optical components. It is an independent unit, and there are differences between each channel. This difference will cause the lidar to scan the same object, and the information in the detected echo laser will be inconsistent, which will make it difficult to identify the contour of the object.
  • the multi-channel lidar calibration method, device, storage medium, and multi-channel lidar provided in the embodiments of the present application can solve the problem of inaccurate object recognition caused by differences in different channels.
  • the technical solution is as follows:
  • an embodiment of the present application provides a method for calibrating a multi-channel lidar, and the method includes:
  • N fields of view include 1 reference field of view and N-1 fields of view to be corrected, and N fields of view are field of view 1, field of view 2, ..., the field of view N, any two adjacent fields of view in the N fields of view form N-1 overlapping areas, and the N-1 overlapping areas are respectively S 12 , S 23 , S 34 , ..., S ( N-1)N , S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N, and N is an integer greater than or equal to 2;
  • K (N-1)N is based on the echo intensity of S (N-1)N in the field of view N and S (N -1) N is obtained by the error between the echo intensities in the field of view N-1;
  • the field of view j to be corrected is corrected according to the correction coefficient P j.
  • an embodiment of the present application provides a multi-channel lidar calibration device, the calibration device includes:
  • the determining unit is used to determine the echo intensity of each illumination point in the N fields of view, where the N fields of view include 1 reference field of view and N-1 fields of view to be corrected, and the N fields of view are respectively the field of view 1 , Field of view 2,..., field of view N, any two adjacent fields of view in the N fields of view form N-1 overlapping areas, and the N-1 overlapping areas are respectively S 12 , S 23 , S 34 ,..., S (N-1)N , S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N, and N is an integer greater than or equal to 2;
  • the calculation unit is used to calculate the difference coefficients K 12 , K 23 , ..., K (N-1)N , where K (N-1)N is the echo in the field of view N according to S (N-1)N The error between the intensity and the echo intensity of S (N-1)N in the field of view N-1;
  • an embodiment of the present application provides a computer storage medium, the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the above method steps.
  • an embodiment of the present application provides a multi-channel lidar calibration device, which may include a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded and loaded by the processor. Perform the above method steps.
  • an embodiment of the present application provides a multi-channel lidar, including the above-mentioned multi-channel lidar calibration device.
  • the embodiment of the present application achieves the consistency of multiple channels by correcting multiple channels, so that when the lidar uses multiple channels to detect objects, the contour can be accurately reflected, the difficulty of object recognition is reduced, and the detection accuracy is improved.
  • FIG. 1 is a schematic diagram of scanning of a multi-channel lidar provided by an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a method for calibrating a multi-channel lidar provided by an embodiment of the present application
  • FIG. 3 is a schematic diagram of the field of view distribution of a multi-channel lidar provided by an embodiment of the present application
  • FIG. 4 is a schematic diagram of the field of view distribution of a multi-channel lidar provided by an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of a multi-channel lidar calibration device provided by the present application.
  • Fig. 6 is a schematic diagram of another structure of a multi-channel lidar calibration device provided by the present application.
  • FIG. 1 shows a schematic diagram of the scanning principle that can be applied to the multi-channel lidar provided by the embodiments of this application.
  • the lidar uses 6 fields of view to form the overall field of view of the lidar to detect objects.
  • the 6 fields of view are respectively For field of view 1, field of view 2, field of view 3, field of view 4, field of view 5, and field of view 6, the lidar is equipped with a MEMS micro galvanometer as a scanning device, and one channel is scanned by the MEMS micro galvanometer to form a corresponding Field of view, Lidar controls the deflection angle of the MEMS micro galvanometer to control the scanning angle of each field of view.
  • the 6 channels are scanned by the MEMS micro galvanometer to form 6 fields of view.
  • Each channel includes a laser transmitter and a laser receiver.
  • the manufacturing differences of laser transmitters and laser receivers lead to differences in transmitting power and receiving efficiency.
  • the manufacturing differences in optical circuit components lead to differences in optical efficiency.
  • the superposition of multiple device differences in the channel leads to differences in the channel. Inconsistency between.
  • Lidar detection determines the reflectivity of an object by the intensity of the echo. Lidar scans the same object. The echo intensity of different channels varies greatly due to the inconsistency of the channels, resulting in the same object (same reflectivity) measured in different fields of view The reflectivity is different, which makes it difficult to identify the contour of the object.
  • FIG. 2 provides a schematic flowchart of a method for calibrating a multi-channel lidar according to an embodiment of this application.
  • the method of the embodiment of the present application may include the following steps:
  • each of the N fields of view corresponds to a channel of the lidar, and N ⁇ 2 and an integer, that is, the lidar is provided with N channels.
  • the field of view is the area covered by the laser radar that emits multiple outgoing lasers and receives the echo laser.
  • the outgoing laser encounters an object in the field of view and is reflected by the object and then returns to the echo laser, that is, an outgoing laser is directed to the field of view If there is an object at a specific location in the illuminating point, it will return to the echo laser after being reflected by the object.
  • the intensity of the echo can determine the reflectivity of the object. For the illumination point at the same position in the field of view, the echo intensity of the echo laser received by different channels is the same in an ideal state.
  • Each field of view corresponds to a scanning angle in the horizontal direction, and the scanning angles of the N fields of view may be the same or different, which is not limited in the embodiment of the present application.
  • N fields of view are composed of 1 reference field of view and N-1 fields of view to be corrected.
  • the reference field of view can be any of the N fields of view.
  • the reference field of view can be preset, which can be The random selection before performing the calibration is not limited in the embodiment of the present application.
  • the reference field of view may be the first field of view among the N fields of view, or the last field of view among the N fields of view, or a field of view located at an intermediate position among the N fields of view.
  • the N-1 field of view to be corrected and the reference field of view are used as a reference to calibrate the illumination point, so that the same object in any of the N fields of view will have the same echo intensity when detecting the same object.
  • the reference field of view satisfies the following conditions:
  • the 6 fields of view from left to right are: field of view 1, field of view 2, field of view 3, field of view 4, field of view 5 and field of view 6, then the reference field of view is the field of view Field 3 or Field of View 4.
  • the 7 fields of view from left to right are: field of view 1, field of view 2, field of view 3, field of view 4, field of view 5, field of view 6, and field of view 7, then
  • the reference field of view is field of view 4.
  • N fields of view are respectively field of view 1, field of view 2, ..., field of view N, any two adjacent fields of view of N fields of view form N-1 overlapping areas, namely field of view 1 and field of view 2 is adjacent, the field of view 1 and the field of view 2 have an overlapping area; the field of view 2 and the field of view 3 are adjacent, the field of view 2 and the field of view 3 have an overlapping area; the field of view 3 and the field of view 4 are adjacent, and the field of view 3 and The field of view 4 has an overlapping area, ..., the field of view N-1 and the field of view N are adjacent, and the field of view N-1 and the field of view N have an overlapping area.
  • the N-1 overlapping areas are represented as S 12 , S 23 , S 34 , ..., S (N-1)N , and S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N. It should be understood that the number of the field of view and the number of the overlapping area in the embodiment of the present application are only used to distinguish different fields of view and overlapping areas, and are not limited to the embodiments of the present application. The embodiments of the present application may also use other methods to determine the field of view and the overlapping area.
  • the field of view is numbered in the manner of field of view 0, field of view 1,..., field of view N-1, and correspondingly, the overlapping area uses S 01 , S 12 , S 23 , S 34 , ..., S ( N-2)(N-1) .
  • the 6 fields of view are respectively the field of view 1, the field of view 2, the field of view 3, Field of view 4, field of view 5 and field of view 6, there is an overlap area S 12 between field of view 1 and field of view 2, and there is an overlap area S 23 between field of view 2 and field of view 3, between field of view 3 and field of view 4
  • There is an overlap area S 34 between the field of view 4 and the field of view 5 there is an overlap area S 45
  • the method of determining the overlapping area between two adjacent fields of view includes:
  • the horizontal coincidence and vertical offset of the two fields of view are determined according to the scanning angles of the two adjacent fields of view; the overlap area between the two fields of view is determined according to the horizontal coincidence and the vertical offset.
  • the lidar performs scanning in the horizontal and vertical directions
  • the lidar performs fast-axis scanning in the horizontal direction
  • the scanning angle determines the scanning range of the field of view in the horizontal and vertical directions.
  • the lidar can determine the horizontal coincidence and vertical offset between the two fields of view according to the scanning angle between the two fields of view, and the vertical offset Indicates the vertical misalignment of the two adjacent fields of view of the lidar.
  • the misalignment can be negative or positive.
  • the lidar is provided with 6 fields of view: field of view 1 to field of view 6, and the illumination point of each field of view runs from left to right in the horizontal direction, and then back to left from right to left. Scanning, after each line scan is completed, scan the next line up a certain distance.
  • Each field of view has 38 line scans, that is, the illumination points at the boundary of each field of view are numbered from bottom to top: No. 1 to No. 38.
  • the horizontal overlap between field of view 1 and field of view 2 is 4 columns, that is, the two rightmost columns of field of view 1 and the leftmost two columns of field of view 2 coincide;
  • the vertical offset between the field of view 1 and the field of view 2 is 2 lines.
  • the irradiation points No. 3 to No. 38 of the field of view 1 coincide with the irradiation points No. 1 to No. 36 of the field of view 2.
  • the lidar can be based on the above horizontal coincidence. And the vertical offset determine the overlap area.
  • the angle between each channel and MEMS micro galvanometer can be adjusted to ensure that the edges of the two adjacent fields of view are Coincident; further, at least one row of the edges of two adjacent fields of view are coincident.
  • the difference coefficient represents the measurement difference produced when two adjacent fields of view (ie, two channels) detect objects with the same reflectivity
  • the difference coefficient can be represented by a ratio value, a difference value or other types of values.
  • K (N-1)N represents the difference coefficient between the N-1th field of view and the Nth field of view
  • the difference coefficient K (N-1)N represents the overlapping area S (N-1)N in the field of view N -1 is the echo intensity and the difference between the echo intensity of the overlapping area in the field of view N is obtained.
  • the echo intensity of the overlapping area S 23 in the field of view 2 is obtained as P1, and the overlap is obtained
  • the echo intensity of the area S23 in the field of view 3 is P2
  • the method for calculating the difference coefficient includes: the first field of view and the second field of view are two adjacent fields of view, and there is an overlapping area between the first field of view and the second field of view, Determine the designated irradiation point in the overlapping area, the number of designated irradiation points is one or more, obtain the first echo intensity of the designated irradiation point in the first field of view, and obtain the first echo intensity of the designated irradiation point in the second field of view.
  • the second echo intensity, the coefficient of difference between the first field of view and the second field of view is determined according to the ratio of the first echo intensity to the second echo intensity.
  • the designated irradiation point is the irradiation point A in the overlapping area between the field of view 2 and the field of view 3, and the echo intensity of the irradiation point A in the field of view 2 is obtained as P1.
  • the echo intensity of the irradiation point A in the field of view 3 is P2, and the ratio of the echo intensity P1 to the echo intensity P2 is taken as the coefficient of difference between the field of view 2 and the field of view 3.
  • the method for calculating the difference coefficient includes: the first field of view and the second field of view are two adjacent fields of view, and there is an overlap area between the first field of view and the second field of view , Determine all the illumination points included in the overlapping area, obtain the average echo intensity of all illumination points in the first field of view, and obtain the average echo intensity of all illumination points in the second field of view, according to the two average echo intensities The ratio of determines the coefficient of difference between the first field of view and the second field of view.
  • the difference coefficient is determined by the relative position between the overlap area and the reference area, and the overlap area of the first field of view and the second field of view is located in the reference field of view.
  • the echo intensity of the overlap area in the first field of view is P1
  • the echo intensity of the overlap area in the second field of view is P2
  • the coefficient of difference between the first field of view and the second field of view is equal to P2 /P1.
  • the echo intensity of the overlapping area in the first field of view is P1
  • the echo intensity of the overlapping area in the second field of view is P2
  • the coefficient of difference between the first field of view and the second field of view is equal to P1/P2.
  • the reference field of view is field of view 3
  • the overlapping area between field of view 1 and field of view 2 is denoted as S 12 (not shown in the figure)
  • the field of view 2 and field of view 3 are
  • the overlap area between field of view 3 and field of view 4 is denoted as S 23
  • the overlap area between field of view 3 and field of view 4 is denoted as S 34
  • the overlap area between field of view 4 and field of view 5 is denoted as S 45
  • the overlapping area between is denoted as S 56 .
  • the overlapping area S 12 and the overlapping area S 23 are located on the left side of the reference field of view
  • the overlapping areas S 34 , S 45 and S 56 are located on the right side of the reference field of view.
  • the echo intensity of the overlapping area S 12 in the field of view 1 is obtained as
  • the echo intensity of the overlapping area in the field of view 2 is Difference coefficient between field of view 1 and field of view 2
  • the echo intensity of the overlapping area S 23 in the field of view 3 Then the coefficient of difference between field of view 2 and field of view 3
  • the echo intensity of the overlapping area S34 in the field of view 4 Then the coefficient of difference between field of view 3 and field of view 4
  • the coefficient of difference between field of view 4 and field of view 5 Obtain the echo intensity of the overlapping area S56 in the field of view 5
  • j represents the number of the field of view to be corrected
  • P j represents the correction coefficient of the j-th field of view to be corrected
  • i represents the number of the reference field of view
  • the reference field of view is any one of the N fields of view, that is, 1 ⁇ i ⁇ N
  • P j is related to K i(i-1) , K (i-1)(i-2) ,..., K (j-1)j ; when j ⁇ i, P j is related to K j(j-1) , K (j-1)(j-2) ,..., K (i-1)i are related.
  • N 6, the N fields of view are field of view 1, field of view 2, field of view 3, field of view 4, field of view 5, and field of view 6, field of view 3 is the reference field of view, field of view 1 and
  • the field of view 2 is located on the left of the field of view 3, that is, it satisfies j ⁇ i; the field of view 4, the field of view 5, and the field of view 6 are located on the right of the field of view 3, that is, j>i is satisfied.
  • the correction coefficient P 1 represents the correction coefficient of the field of view 1
  • the correction coefficient P 2 represents the correction coefficient of the field of view 2
  • the correction coefficient P 4 represents the correction coefficient of the field of view 4
  • the correction coefficient P 5 represents the correction coefficient of the field of view 5.
  • P 6 represents the correction coefficient of the field of view 6.
  • the coefficient of difference between field of view 1 and field of view 2 is K 12
  • the coefficient of difference between field of view 2 and field of view 3 is K 23
  • the coefficient of difference between field of view 3 and field of view 4 is K 34
  • the coefficient of difference between field 4 and field of view 5 is K 45
  • the coefficient of difference between field of view 5 and field of view 6 is K 56 .
  • each field of view to be corrected multiplies the correction coefficients to obtain the corrected field of view.
  • the field of view 1 to be corrected is composed of the irradiation points of 38 line scans.
  • the correction coefficient of the field of view 1 to be corrected is P 1
  • the echo intensities of all the irradiation points in the field of view 1 to be corrected are multiplied by the correction coefficient After P 1 , the echo intensity of all irradiated points in the corrected field of view 1 is obtained.
  • the embodiment of this application to determine the relative positional relationship between the various fields of view in multiple fields of view, and quantitatively measure the echo intensities of the overlapping areas between two adjacent fields of view in the two fields of view.
  • the error of the echo intensity between two adjacent fields of view is then determined according to the reference field of view in multiple fields of view and the error between the two adjacent fields of view to determine the correction coefficient of the field of view to be corrected, based on the correction
  • the coefficient is used to correct the echo intensity of the field of view to be calibrated to realize the correction of the reflectivity of the detected object, so as to solve the hardware difference between the multiple channels of the lidar in the related technology, which leads to the reflectivity of the same object detected Different, so that the object cannot be accurately identified, the embodiment of the application achieves the consistency of multiple channels by correcting multiple channels, so that when the lidar uses multiple channels to detect objects, the outline can be accurately reflected and the difficulty of object identification is reduced. Improve detection accuracy.
  • FIG. 5 shows a schematic structural diagram of a correction device for a multi-channel radar provided by an exemplary embodiment of the present application, which is referred to as the correction device 5 hereinafter.
  • the correction device 5 can be implemented as all or part of the lidar through software, hardware or a combination of the two.
  • the correction device 5 includes: a determination unit 501, a calculation unit 502, and a correction unit 503.
  • N is an odd number
  • i (N+1)/2
  • the K (N-1) N represents S (N-1) N echo intensities in the field of view of N and the S (N-1) of the N field in the N-1 The value of the ratio between the intensities of the echoes.
  • the echo intensity of the S (N-1)N in the field of view N-1 represents the magnitude of all the illumination points in the S (N-1)N in the field of view N-1
  • the average echo intensity, the echo intensity of the S (N-1)N in the field of view N represents the average echo of all the illumination points in the S (N-1)N in the field of view N strength.
  • the echo intensity of the S (N-1)N in the field of view N represents the echo intensity of a designated illumination point in the field of view N, and the S (N-1)N is in the field of view N.
  • the echo intensity in the field of view N-1 represents the echo intensity of the designated irradiation point in the field of view N-1, and the designated irradiation point is located in the last column of the field of view N-1; or
  • the designated illumination point is located in the first column of the field of view N.
  • the determining unit 501 is further configured to:
  • the overlapping area between the two fields of view is determined according to the horizontal coincidence degree and the vertical offset.
  • the scanning angles of the N fields of view are the same.
  • the device 5 provided in the foregoing embodiment executes the multi-channel lidar calibration method
  • only the division of the foregoing functional modules is used as an example for illustration. In practical applications, the foregoing functional assignments can be assigned to different types according to needs.
  • the function module is completed, that is, the internal structure of the device is divided into different function modules to complete all or part of the functions described above.
  • the multi-channel lidar calibration device provided in the above embodiment and the multi-channel lidar calibration method embodiment belong to the same concept, and the implementation process is detailed in the method embodiment, which will not be repeated here.
  • the embodiment of the present application also provides a computer storage medium.
  • the computer storage medium may store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps of the embodiments shown in FIGS. 2 to 4 above.
  • the specific execution process please refer to the specific description of the embodiment shown in FIG. 2 to FIG. 4, which will not be repeated here.
  • the present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the multi-channel radar calibration method described in each of the above embodiments.
  • FIG. 6 provides a schematic structural diagram of a correction device for a multi-channel lidar according to an embodiment of the present application.
  • the correction and correction device 6 is described below.
  • the correction device 6 may include: at least one processor 601, a memory 602, and at least one communication bus 603.
  • the communication bus 603 is used to implement connection and communication between these components.
  • the processor 601 may include one or more processing cores.
  • the processor 601 uses various interfaces and lines to connect various parts of the entire correction device 6, and executes by running or executing instructions, programs, code sets, or instruction sets stored in the memory 602, and calling data stored in the memory 602.
  • the processor 601 may use at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA) Realize in the form of hardware.
  • DSP Digital Signal Processing
  • FPGA Field-Programmable Gate Array
  • PDA Programmable Logic Array
  • the processor 601 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), a modem, and the like.
  • the CPU mainly processes the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the display; the modem is used to process wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 601, but may be implemented by a chip alone.
  • the memory 602 may include random access memory (RAM) or read-only memory (Read-Only Memory).
  • the memory 602 includes a non-transitory computer-readable storage medium.
  • the memory 602 may be used to store instructions, programs, codes, code sets or instruction sets.
  • the memory 602 may include a storage program area and a storage data area, where the storage program area may store instructions for implementing the operating system and instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), Instructions used to implement the foregoing method embodiments, etc.; the storage data area can store data and the like involved in the foregoing method embodiments.
  • the memory 602 may also be at least one storage device located far away from the foregoing processor 601.
  • the processor 601 may be used to call the touch operation response application program stored in the memory 602, and specifically execute the following steps:
  • the N fields of view include 1 reference field of view and N-1 fields of view to be corrected, and the N fields of view are respectively the field of view 1, Field of view 2, ..., field of view N, any two adjacent fields of view in the N fields of view form N-1 overlapping areas, and the N-1 overlapping areas are respectively S 12 , S 23 , S 34 , ..., S (N-1)N , S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N, where N ⁇ 2 and N is an integer;
  • K (N-1)N is based on the return of the S (N-1)N in the field of view N-1 Obtained from the difference between the wave intensity and the echo intensity of the S (N-1)N in the field of view N;
  • the field of view j to be corrected is corrected according to the correction coefficient P j.
  • the K (N-1)N represents the echo intensity of S (N-1)N in the field of view N and the S (N-1)N in the field of view N The value of the ratio between the intensities of the echoes in the field of view N-1.
  • the echo intensity of the S (N-1)N in the field of view N-1 indicates that all the illumination points in the S (N-1)N are in the field of view.
  • the average echo intensity in N-1, the echo intensity of the S (N-1)N in the field of view N indicates that all the illumination points in the S (N-1)N are in the field of view N.
  • the echo intensity of the S (N-1)N in the field of view N represents the echo intensity of a designated illumination point in the field of view N
  • the echo intensity of N in the field of view N-1 represents the echo intensity of the designated irradiation point in the field of view N-1
  • the designated irradiation point is located in the field of view N-1
  • the designated illumination point is located in the first column of the field of view N.
  • the processor 601 is further configured to execute:
  • the overlapping area between the two fields of view is determined according to the horizontal coincidence degree and the vertical offset.
  • the scanning angles of the N fields of view are the same.
  • FIG. 6 and the method embodiment of FIG. 2 are based on the same concept, and the technical effects brought about by them are also the same.
  • FIG. 6 For the specific implementation process of FIG. 6, reference may be made to the description of FIG. 2 and will not be repeated here.
  • the program can be stored in a computer readable storage medium, and the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments.
  • the storage medium can be a magnetic disk, an optical disc, a read-only storage memory or a random storage memory, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

A multi-channel LIDAR calibration method, an apparatus, a storage medium and a station, in the LIDAR field. According to an echo intensity of an overlap region of two adjacent fields of view in each of the fields of view, quantitatively measuring an error between two adjacent fields of view, then, determining a calibration coefficient of a field of view to be calibrated according to a reference field of view among multiple fields of view and an error between two adjacent fields of view, and performing calibration of the field of view to be calibrated on the basis of the calibration coefficient, realizing consistency of multiple channels. In this way, LIDAR may accurately reflect a contour of an object when using multiple channels to detect an object.

Description

校正方法、装置、存储介质及多通道激光雷达Calibration method, device, storage medium and multi-channel lidar 技术领域Technical field
本申请涉及激光雷达领域,尤其涉及一种多通道激光雷达的校正方法、装置、存储介质及多通道激光雷达。This application relates to the field of lidar, and in particular to a method, device, storage medium and multi-channel lidar for calibrating multi-channel lidar.
背景技术Background technique
激光雷达可以建立周围的3D图像,激光雷达利用微机械系统(micro-electro-mechanical system,MEMS)微振镜作为光束扫描结构是激光雷达的一种方式,为了实现更大的探测面积,一般使用多个视场拼接的方法扩大区域,多个视场对应多个通道,每个视场对应一个通道,每个通道由一组激光发射器、激光接收器、硬件电路和光学元件组成,通道之间是独立的单元,各个通道之间存在差异性,这种差异会造成激光雷达对同一物体进行扫描,探测得到的回波激光中的信息不一致,给识别物体轮廓造成困难。Lidar can create 3D images of the surroundings. Lidar uses micro-electro-mechanical system (MEMS) micro galvanometer as a beam scanning structure. It is a way of lidar. In order to achieve a larger detection area, it is generally used The method of splicing multiple fields of view expands the area. Multiple fields of view correspond to multiple channels, and each field of view corresponds to a channel. Each channel is composed of a set of laser transmitters, laser receivers, hardware circuits, and optical components. It is an independent unit, and there are differences between each channel. This difference will cause the lidar to scan the same object, and the information in the detected echo laser will be inconsistent, which will make it difficult to identify the contour of the object.
发明内容Summary of the invention
本申请实施例提供了的多通道激光雷达的校正方法、装置、存储介质及多通道激光雷达,可以解决不同通道的差异造成识别物体不准确的问题。所述技术方案如下:The multi-channel lidar calibration method, device, storage medium, and multi-channel lidar provided in the embodiments of the present application can solve the problem of inaccurate object recognition caused by differences in different channels. The technical solution is as follows:
第一方面,本申请实施例提供了一种多通道激光雷达的校正方法,所述方法包括:In the first aspect, an embodiment of the present application provides a method for calibrating a multi-channel lidar, and the method includes:
确定N个视场中各个照射点的回波强度,其中,N个视场包括1个基准视场和N-1个待校正视场,N个视场分别为视场1、视场2、…、视场N,所述N个视场中任意相邻的两个视场形成N-1个重叠区域,N-1个重叠区域分别为S 12、S 23、S 34、…、S (N-1)N,S (N-1)N表示视场N-1和视场N之间的重叠区域,N为大于或等于2的整数; Determine the echo intensity of each illumination point in N fields of view, where N fields of view include 1 reference field of view and N-1 fields of view to be corrected, and N fields of view are field of view 1, field of view 2, ..., the field of view N, any two adjacent fields of view in the N fields of view form N-1 overlapping areas, and the N-1 overlapping areas are respectively S 12 , S 23 , S 34 , ..., S ( N-1)N , S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N, and N is an integer greater than or equal to 2;
计算差异系数K 12、K 23、…、K (N-1)N,其中,K (N-1)N是根据S (N-1)N在视场N中的回波强度和S (N-1)N在视场N-1中的回波强度之间的误差得到的; Calculate the difference coefficients K 12 , K 23 , ..., K (N-1)N , where K (N-1)N is based on the echo intensity of S (N-1)N in the field of view N and S (N -1) N is obtained by the error between the echo intensities in the field of view N-1;
计算待校正视场j的校正系数P j;其中,i≠j,j=1、2、…、N,1≤i≤N, i为所述基准视场的编号;在j>i时,K i(i-1)、K (i-1)(i-2)、...、K (j-1)j有关;在j<i时,P j与K j(j-1)、K (j-1)(j-2)、...、K (i-1)i有关; Calculate the correction coefficient P j of the field of view j to be corrected; where i≠j, j=1, 2,..., N, 1≤i≤N, and i is the number of the reference field of view; when j>i, K i(i-1) , K (i-1)(i-2) ,..., K (j-1)j are related; when j<i, P j is related to K j(j-1) , K (j-1)(j-2) ,..., K (i-1)i are related;
根据校正系数P j对待校正视场j进行校正。 The field of view j to be corrected is corrected according to the correction coefficient P j.
第二方面,本申请实施例提供了一种多通道激光雷达的校正装置,所述校正装置包括:In a second aspect, an embodiment of the present application provides a multi-channel lidar calibration device, the calibration device includes:
确定单元,用于确定N个视场中各个照射点的回波强度,其中,N个视场包括1个基准视场和N-1个待校正视场,N个视场分别为视场1、视场2、…、视场N,所述N个视场中任意相邻的两个视场形成N-1个重叠区域,N-1个重叠区域分别为S 12、S 23、S 34、…、S (N-1)N,S (N-1)N表示视场N-1和视场N之间的重叠区域,N为大于或等于2的整数; The determining unit is used to determine the echo intensity of each illumination point in the N fields of view, where the N fields of view include 1 reference field of view and N-1 fields of view to be corrected, and the N fields of view are respectively the field of view 1 , Field of view 2,..., field of view N, any two adjacent fields of view in the N fields of view form N-1 overlapping areas, and the N-1 overlapping areas are respectively S 12 , S 23 , S 34 ,..., S (N-1)N , S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N, and N is an integer greater than or equal to 2;
计算单元,用于计算差异系数K 12、K 23、…、K (N-1)N,其中,K (N-1)N是根据S (N-1)N在视场N中的回波强度和S (N-1)N在视场N-1中的回波强度之间的误差得到的; The calculation unit is used to calculate the difference coefficients K 12 , K 23 , ..., K (N-1)N , where K (N-1)N is the echo in the field of view N according to S (N-1)N The error between the intensity and the echo intensity of S (N-1)N in the field of view N-1;
计算单元,还用于计算待校正视场j的校正系数P j;其中,i≠j,j=1、2、…、N,1≤i≤N,i为所述基准视场的编号;在j>i时,K i(i-1)、K (i-1)(i-2)、...、K (j-1)j有关;在j<i时,P j与K j(j-1)、K (j-1)(j-2)、...、K (i-1)i有关; The calculation unit is also used to calculate the correction coefficient P j of the field of view j to be corrected; where i≠j, j=1, 2,..., N, 1≤i≤N, and i is the number of the reference field of view; When j>i, K i(i-1) , K (i-1)(i-2) ,..., K (j-1)j are related; when j<i, P j is related to K j (j-1) , K (j-1)(j-2) ,..., K (i-1)i are related;
校正单元,用于根据校正系数P j对待校正视场j进行校正 A correction unit for correcting the field of view j to be corrected according to the correction coefficient P j
第三方面,本申请实施例提供一种计算机存储介质,所述计算机存储介质存储有多条指令,所述指令适于由处理器加载并执行上述的方法步骤。In a third aspect, an embodiment of the present application provides a computer storage medium, the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the above method steps.
第四方面,本申请实施例提供一种多通道激光雷达的校正装置,可包括:处理器和存储器;其中,所述存储器存储有计算机程序,所述计算机程序适于由所述处理器加载并执行上述的方法步骤。In a fourth aspect, an embodiment of the present application provides a multi-channel lidar calibration device, which may include a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded and loaded by the processor. Perform the above method steps.
第五方面,本申请实施例提供了一种多通道激光雷达,包括上述的多通道激光雷达的校正装置。In a fifth aspect, an embodiment of the present application provides a multi-channel lidar, including the above-mentioned multi-channel lidar calibration device.
本申请一些实施例提供的技术方案带来的有益效果至少包括:The beneficial effects brought by the technical solutions provided by some embodiments of the present application include at least:
确定多个视场中各个视场之间的相对位置关系,根据相邻的两个视场之间的重叠区域分别在两个视场中的回波强度,定量的测量相邻的两个视场之间的回波强度的差异,然后根据多个视场中的基准视场以及相邻的两个视场之间的 差异确定待校正视场的校正系数,基于校正系数对待校正视场的回波强度进行校正,以实现对探测到的物体的反射率进行校正,这样解决相关技术中激光雷达的多个通道之间的硬件差异导致对同一物体探测到的反射率不同,从而无法准确识别物体的问题,本申请实施例通过对多个通道进行校正实现多个通道的一致性,这样激光雷达使用多通道探测物体时能准确的反映其轮廓,降低物体识别难度,提高探测准确性。Determine the relative positional relationship between the various fields of view in the multiple fields of view, and quantitatively measure the echo intensities of the two adjacent fields of view according to the overlap area between the two adjacent fields of view. The difference in the echo intensity between the fields, and then determine the correction coefficient of the field of view to be corrected based on the difference between the reference field of view in the multiple fields of view and the difference between the two adjacent fields of view, and the correction coefficient of the field of view to be corrected based on the correction coefficient The echo intensity is corrected to correct the reflectivity of the detected object. This solves the hardware difference between the multiple channels of the lidar in the related technology, which leads to the different reflectivity detected on the same object, which makes it impossible to accurately identify For the problem of objects, the embodiment of the present application achieves the consistency of multiple channels by correcting multiple channels, so that when the lidar uses multiple channels to detect objects, the contour can be accurately reflected, the difficulty of object recognition is reduced, and the detection accuracy is improved.
附图说明Description of the drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1是本申请实施例提供的多通道激光雷达的扫描示意图;FIG. 1 is a schematic diagram of scanning of a multi-channel lidar provided by an embodiment of the present application;
图2是本申请实施例提供的多通道激光雷达的校正方法的流程示意图;2 is a schematic flowchart of a method for calibrating a multi-channel lidar provided by an embodiment of the present application;
图3是本申请实施例提供的多通道激光雷达的视场分布示意图;3 is a schematic diagram of the field of view distribution of a multi-channel lidar provided by an embodiment of the present application;
图4是本申请实施例提供的多通道激光雷达的视场分布示意图;4 is a schematic diagram of the field of view distribution of a multi-channel lidar provided by an embodiment of the present application;
图5是本申请提供的一种多通道激光雷达的校正装置的结构示意图;FIG. 5 is a schematic structural diagram of a multi-channel lidar calibration device provided by the present application;
图6是本申请提供的一种多通道激光雷达的校正装置的另一结构示意图。Fig. 6 is a schematic diagram of another structure of a multi-channel lidar calibration device provided by the present application.
具体实施方式detailed description
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施例方式作进一步地详细描述。In order to make the purpose, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.
图1示出了可以应用于本申请实施例提供的多通道激光雷达的扫描原理示意图,激光雷达采用6个视场拼接后形成激光雷达的整体视场,对物体进行探测,6个视场分别为视场1、视场2、视场3、视场4、视场5和视场6,激光雷达内设置有MEMS微振镜作为扫描装置,一个通道通过MEMS微振镜进行扫描对应形成一个视场,激光雷达控制MEMS微振镜的偏转角度来控制每个视场的扫描角度,6个通道通过MEMS微振镜扫描分别对应形成6个视场,每个通道包括激光发射器、激光接收器、硬件电路和光路器件等,激光发射器、 激光接收器的制造差异导致发射功率和接收效率有差异,光路器件的制造差异导致光学效率有差异,通道内的多个器件差异叠加导致通道之间的不一致性。激光雷达探测通过回波强度确定物体反射率,激光雷达对同一物体进行扫描,不同通道的回波强度由于通道不一致性存在较大差异,导致同一物体(相同反射率)在不同视场中测得的反射率不同,给识别物体轮廓造成困难。Figure 1 shows a schematic diagram of the scanning principle that can be applied to the multi-channel lidar provided by the embodiments of this application. The lidar uses 6 fields of view to form the overall field of view of the lidar to detect objects. The 6 fields of view are respectively For field of view 1, field of view 2, field of view 3, field of view 4, field of view 5, and field of view 6, the lidar is equipped with a MEMS micro galvanometer as a scanning device, and one channel is scanned by the MEMS micro galvanometer to form a corresponding Field of view, Lidar controls the deflection angle of the MEMS micro galvanometer to control the scanning angle of each field of view. The 6 channels are scanned by the MEMS micro galvanometer to form 6 fields of view. Each channel includes a laser transmitter and a laser receiver. The manufacturing differences of laser transmitters and laser receivers lead to differences in transmitting power and receiving efficiency. The manufacturing differences in optical circuit components lead to differences in optical efficiency. The superposition of multiple device differences in the channel leads to differences in the channel. Inconsistency between. Lidar detection determines the reflectivity of an object by the intensity of the echo. Lidar scans the same object. The echo intensity of different channels varies greatly due to the inconsistency of the channels, resulting in the same object (same reflectivity) measured in different fields of view The reflectivity is different, which makes it difficult to identify the contour of the object.
下面将结合附图2-附图4,对本申请实施例提供的多通道激光雷达的校正方法进行详细介绍。In the following, the correction method of the multi-channel lidar provided by the embodiment of the present application will be described in detail with reference to FIG. 2 to FIG. 4. FIG.
请参见图2,为本申请实施例提供了一种多通道激光雷达的校正方法的流程示意图。如图2所示,本申请实施例的所述方法可以包括以下步骤:Please refer to FIG. 2, which provides a schematic flowchart of a method for calibrating a multi-channel lidar according to an embodiment of this application. As shown in Figure 2, the method of the embodiment of the present application may include the following steps:
S201、确定N个视场中各个照射点的回波强度。S201. Determine the echo intensity of each illumination point in the N fields of view.
一般的,N个视场各自对应激光雷达的一个通道,N≥2且为整数,即激光雷达设置有N个通道。视场是激光雷达向外发射多个出射激光并接收回波激光所能够覆盖的区域,出射激光遇到视场中的物体后被物体反射后返回回波激光,即一个出射激光射向视场中特定位置的照射点,若该照射点处有物体,被物体反射后返回回波激光。回波强度可以确定物体的反射率,对于视场中同一位置的照射点,不同通道接收回波激光的回波强度在理想状态下是相同。每个视场对应一个水平方向上的扫描角度,N个视场的扫描角度可以相同,也可以不相同,本申请实施例不作限制。Generally, each of the N fields of view corresponds to a channel of the lidar, and N≥2 and an integer, that is, the lidar is provided with N channels. The field of view is the area covered by the laser radar that emits multiple outgoing lasers and receives the echo laser. The outgoing laser encounters an object in the field of view and is reflected by the object and then returns to the echo laser, that is, an outgoing laser is directed to the field of view If there is an object at a specific location in the illuminating point, it will return to the echo laser after being reflected by the object. The intensity of the echo can determine the reflectivity of the object. For the illumination point at the same position in the field of view, the echo intensity of the echo laser received by different channels is the same in an ideal state. Each field of view corresponds to a scanning angle in the horizontal direction, and the scanning angles of the N fields of view may be the same or different, which is not limited in the embodiment of the present application.
其中,N个视场由1个基准视场和N-1个待校正视场组成,基准视场可以是N个视场中的任意一个视场,基准视场可以预先设置的,可以是在执行校正之前随机选择的,本申请实施例不作限制。例如:基准视场可以是N个视场中的首个视场,也可以是N个视场中的最后一个视场,或N个视场中的位于中间位置的一个视场。N-1个待校正视场与基准视场为基准对照射点进行校正,使位于N个视场中的任意个视场内的相同物体进行探测时得到的回波强度相同。Among them, N fields of view are composed of 1 reference field of view and N-1 fields of view to be corrected. The reference field of view can be any of the N fields of view. The reference field of view can be preset, which can be The random selection before performing the calibration is not limited in the embodiment of the present application. For example, the reference field of view may be the first field of view among the N fields of view, or the last field of view among the N fields of view, or a field of view located at an intermediate position among the N fields of view. The N-1 field of view to be corrected and the reference field of view are used as a reference to calibrate the illumination point, so that the same object in any of the N fields of view will have the same echo intensity when detecting the same object.
在一种可能的实施方式中,基准视场满足以下条件:In a possible implementation, the reference field of view satisfies the following conditions:
N为奇数时,基准视场的编号i=(N+1)2;N为偶数时,基准视场的编号为i=N/2或N/2+1。When N is an odd number, the number of the reference field of view is i=(N+1)2; when N is an even number, the number of the reference field of view is i=N/2 or N/2+1.
举例来说:N=6时,6个视场从左往右依次为:视场1、视场2、视场3、视场4、视场5和视场6,那么基准视场为视场3或视场4。For example: when N=6, the 6 fields of view from left to right are: field of view 1, field of view 2, field of view 3, field of view 4, field of view 5 and field of view 6, then the reference field of view is the field of view Field 3 or Field of View 4.
又举例来说:N=7时,7个视场从左往右依次为:视场1、视场2、视场3、视场4、视场5、视场6和视场7,那么基准视场为视场4。For another example: when N=7, the 7 fields of view from left to right are: field of view 1, field of view 2, field of view 3, field of view 4, field of view 5, field of view 6, and field of view 7, then The reference field of view is field of view 4.
其中,N个视场分别为视场1、视场2、…、视场N,N个视场中任意相邻的两个视场形成N-1个重叠区域,即视场1和视场2相邻,视场1和视场2存在重叠区域;视场2和视场3相邻,视场2和视场3存在重叠区域;视场3和视场4相邻,视场3和视场4存在重叠区域、…、视场N-1和视场N相邻,视场N-1和视场N存在重叠区域。N-1个重叠区域表示为S 12、S 23、S 34、…、S (N-1)N,S (N-1)N表示视场N-1和视场N之间的重叠区域。应理解,本申请实施例中视场的编号和重叠区域的编号仅仅为了区分不同的视场和重叠区域,并非对本申请实施例进行限定,本申请实施例也可以采用其他方式对视场和重叠区域进行编号,例如:视场采用视场0、视场1、…、视场N-1的方式进行编号,相应的,重叠区域采用S 01、S 12、S 23、S 34、…、S (N-2)(N-1)Among them, N fields of view are respectively field of view 1, field of view 2, ..., field of view N, any two adjacent fields of view of N fields of view form N-1 overlapping areas, namely field of view 1 and field of view 2 is adjacent, the field of view 1 and the field of view 2 have an overlapping area; the field of view 2 and the field of view 3 are adjacent, the field of view 2 and the field of view 3 have an overlapping area; the field of view 3 and the field of view 4 are adjacent, and the field of view 3 and The field of view 4 has an overlapping area, ..., the field of view N-1 and the field of view N are adjacent, and the field of view N-1 and the field of view N have an overlapping area. The N-1 overlapping areas are represented as S 12 , S 23 , S 34 , ..., S (N-1)N , and S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N. It should be understood that the number of the field of view and the number of the overlapping area in the embodiment of the present application are only used to distinguish different fields of view and overlapping areas, and are not limited to the embodiments of the present application. The embodiments of the present application may also use other methods to determine the field of view and the overlapping area. For numbering, for example: the field of view is numbered in the manner of field of view 0, field of view 1,..., field of view N-1, and correspondingly, the overlapping area uses S 01 , S 12 , S 23 , S 34 , ..., S ( N-2)(N-1) .
举例来说,参见图3所示,N=6,激光雷达使用6个通道进行扫描得到包括6个视场的扫描图像,6个视场分别为视场1、视场2、视场3、视场4、视场5和视场6,视场1和视场2之间存在重叠区域S 12,视场2和视场3之间存在重叠区域S 23,视场3和视场4之间存在重叠区域S 34,视场4和视场5之间存在重叠区域S 45,视场5和视场6之间存在重叠区域S 56For example, as shown in Figure 3, N=6, the lidar uses 6 channels to scan to obtain a scanned image including 6 fields of view. The 6 fields of view are respectively the field of view 1, the field of view 2, the field of view 3, Field of view 4, field of view 5 and field of view 6, there is an overlap area S 12 between field of view 1 and field of view 2, and there is an overlap area S 23 between field of view 2 and field of view 3, between field of view 3 and field of view 4 There is an overlap area S 34 between the field of view 4 and the field of view 5 there is an overlap area S 45 , and there is an overlap area S 56 between the field of view 5 and the field of view 6.
在一个或多个可能的实施例方式中,确定相邻的两个视场之间的重叠区域的方法包括:In one or more possible embodiments, the method of determining the overlapping area between two adjacent fields of view includes:
根据相邻的两个视场的扫描角度确定两个视场的水平重合度,以及垂直偏移量;根据水平重合度和垂直偏移量确定两个视场之间的重叠区域。The horizontal coincidence and vertical offset of the two fields of view are determined according to the scanning angles of the two adjacent fields of view; the overlap area between the two fields of view is determined according to the horizontal coincidence and the vertical offset.
其中,激光雷达在水平方向和垂直方向上进行扫描,激光雷达在水平方向上执行快轴扫描,在垂直方向上执行慢轴扫描。扫描角度决定视场在水平方向和垂直方向上的扫描范围,激光雷达可以根据两个视场之间的扫描角度确定两个视场之间的水平重合度和垂直偏移量,垂直偏移量表示激光雷达相邻两个视场在垂直方向上的错位量,错位量可以是负值,也可以是正值。Among them, the lidar performs scanning in the horizontal and vertical directions, the lidar performs fast-axis scanning in the horizontal direction, and slow-axis scanning in the vertical direction. The scanning angle determines the scanning range of the field of view in the horizontal and vertical directions. The lidar can determine the horizontal coincidence and vertical offset between the two fields of view according to the scanning angle between the two fields of view, and the vertical offset Indicates the vertical misalignment of the two adjacent fields of view of the lidar. The misalignment can be negative or positive.
举例来说,参见图4所示,激光雷达设置有6个视场:视场1~视场6,每 个视场的照射点在水平方向从左至右、再从右回到左进行行扫描,每一行扫描完成后向上一定距离进行下一行扫描,每个视场有38个行扫描,即每个视场边界处的照射点从下到上进行编号为:1号~38号。以视场1和视场2进行举例,视场1和视场2之间的水平重合度为4列,即视场1的最右侧2列和视场2的最左侧2列重合;视场1和视场2的垂直偏移量为2行,视场1的3号~38号照射点和视场2的1号~36号照射点重合,激光雷达可以根据上述的水平重合度和垂直偏移量确定重叠区域。For example, as shown in Figure 4, the lidar is provided with 6 fields of view: field of view 1 to field of view 6, and the illumination point of each field of view runs from left to right in the horizontal direction, and then back to left from right to left. Scanning, after each line scan is completed, scan the next line up a certain distance. Each field of view has 38 line scans, that is, the illumination points at the boundary of each field of view are numbered from bottom to top: No. 1 to No. 38. Taking field of view 1 and field of view 2 as an example, the horizontal overlap between field of view 1 and field of view 2 is 4 columns, that is, the two rightmost columns of field of view 1 and the leftmost two columns of field of view 2 coincide; The vertical offset between the field of view 1 and the field of view 2 is 2 lines. The irradiation points No. 3 to No. 38 of the field of view 1 coincide with the irradiation points No. 1 to No. 36 of the field of view 2. The lidar can be based on the above horizontal coincidence. And the vertical offset determine the overlap area.
应理解,在实际工程中,多个通道和MEMS微振镜在组装后进行光调时,通过调整每个通道和MEMS微振镜之间的角度,可以保证相邻的两个视场边缘是重合的;进一步的,相邻的两个视场边缘至少有一列是重合的。It should be understood that in actual engineering, when multiple channels and MEMS micro galvanometer are assembled, the angle between each channel and MEMS micro galvanometer can be adjusted to ensure that the edges of the two adjacent fields of view are Coincident; further, at least one row of the edges of two adjacent fields of view are coincident.
S202、计算差异系数K 12、K 23、…、K (N-1)NS202. Calculate difference coefficients K 12 , K 23 , ..., K (N-1)N .
其中,差异系数表示相邻的两个视场(即两个通道)探测相同反射率的物体时产生的测量差异,差异系数可以使用比例值、差值或其他类型的数值来表示。K (N-1)N表示第N-1个视场和第N个视场之间的差异系数,差异系数K (N-1)N表示重叠区域S (N-1)N在视场N-1中的回波强度,以及重叠区域在视场N中的回波强度之间的差异得到的。 Among them, the difference coefficient represents the measurement difference produced when two adjacent fields of view (ie, two channels) detect objects with the same reflectivity, and the difference coefficient can be represented by a ratio value, a difference value or other types of values. K (N-1)N represents the difference coefficient between the N-1th field of view and the Nth field of view, and the difference coefficient K (N-1)N represents the overlapping area S (N-1)N in the field of view N -1 is the echo intensity and the difference between the echo intensity of the overlapping area in the field of view N is obtained.
举例来说:参见图3所示,以计算视场2和视场3之间的差异系数为例进行说明,获取到重叠区域S 23在视场2中的回波强度为P1,获取到重叠区域S23在视场3中的回波强度为P2,视场2和视场3之间的差异系数K 23=P1/P2,或K 23=P1-P2,或K 23=P2/P1,或K 23=P2-P1。 For example: referring to Figure 3, taking the calculation of the difference coefficient between the field of view 2 and the field of view 3 as an example , the echo intensity of the overlapping area S 23 in the field of view 2 is obtained as P1, and the overlap is obtained The echo intensity of the area S23 in the field of view 3 is P2, and the coefficient of difference between the field of view 2 and the field of view 3 is K 23 =P1/P2, or K 23 =P1-P2, or K 23 =P2/P1, or K 23 = P2-P1.
在一种可能的实施方式中,计算差异系数的方法包括:第一视场和第二视场为相邻的两个视场,且第一视场和第二视场之间存在重叠区域,在重叠区域中确定指定照射点,指定照射点的数量为一个或多个,获取指定照射点在第一视场中的第一回波强度,以及获取指定照射点在第二视场中的第二回波强度,根据第一回波强度和第二回波强度的比例值确定第一视场和第二视场之间的差异系数。In a possible implementation manner, the method for calculating the difference coefficient includes: the first field of view and the second field of view are two adjacent fields of view, and there is an overlapping area between the first field of view and the second field of view, Determine the designated irradiation point in the overlapping area, the number of designated irradiation points is one or more, obtain the first echo intensity of the designated irradiation point in the first field of view, and obtain the first echo intensity of the designated irradiation point in the second field of view. The second echo intensity, the coefficient of difference between the first field of view and the second field of view is determined according to the ratio of the first echo intensity to the second echo intensity.
举例来说,参见图3所示,指定照射点为位于视场2和视场3之间的重叠区域中的照射点A,获取照射点A在视场2中的回波强度为P1,获取照射点A在视场3中的回波强度为P2,将回波强度P1和回波强度P2的比例值作为 视场2和视场3之间的差异系数。For example, referring to Figure 3, the designated irradiation point is the irradiation point A in the overlapping area between the field of view 2 and the field of view 3, and the echo intensity of the irradiation point A in the field of view 2 is obtained as P1. The echo intensity of the irradiation point A in the field of view 3 is P2, and the ratio of the echo intensity P1 to the echo intensity P2 is taken as the coefficient of difference between the field of view 2 and the field of view 3.
在另一种可能的实施方式中,计算差异系数的方法包括:第一视场和第二视场为相邻的两个视场,且第一视场和第二视场之间存在重合区域,确定重叠区域包括的所有照射点,获取所有照射点在第一视场中的平均回波强度,以及获取所有照射点在第二视场中的平均回波强度,根据两个平均回波强度的比例值确定第一视场和第二视场的差异系数。In another possible implementation manner, the method for calculating the difference coefficient includes: the first field of view and the second field of view are two adjacent fields of view, and there is an overlap area between the first field of view and the second field of view , Determine all the illumination points included in the overlapping area, obtain the average echo intensity of all illumination points in the first field of view, and obtain the average echo intensity of all illumination points in the second field of view, according to the two average echo intensities The ratio of determines the coefficient of difference between the first field of view and the second field of view.
其中,在使用比例值来表示两个视场之间的差异系数时,差异系数由重叠区域与基准区域之间的相对位置决定,第一视场和第二视场的重叠区域位于基准视场的左边时,重叠区域在第一视场中的回波强度为P1,重叠区域在第二视场中的回波强度为P2,第一视场和第二视场之间的差异系数等于P2/P1。第一视场和第二视场的重叠区域位于基准视场的右边时,重叠区域在第一视场中的回波强度为P1,重叠区域在第二视场中的回波强度为P2,第一视场和第二视场之间的差异系数等于P1/P2。Among them, when the ratio value is used to represent the difference coefficient between the two fields of view, the difference coefficient is determined by the relative position between the overlap area and the reference area, and the overlap area of the first field of view and the second field of view is located in the reference field of view. The echo intensity of the overlap area in the first field of view is P1, the echo intensity of the overlap area in the second field of view is P2, and the coefficient of difference between the first field of view and the second field of view is equal to P2 /P1. When the overlapping area of the first field of view and the second field of view is located to the right of the reference field of view, the echo intensity of the overlapping area in the first field of view is P1, and the echo intensity of the overlapping area in the second field of view is P2, The coefficient of difference between the first field of view and the second field of view is equal to P1/P2.
举例来说,参见图3所示,基准视场为视场3,视场1和视场2之间的重叠区域记为S 12(图中未示出),视场2和视场3之间的重叠区域记为S 23,视场3和视场4之间的重叠区域记为S 34,视场4和视场5之间的重叠区域记为S 45,视场5和视场6之间的重叠区域记为S 56。重叠区域S 12和重叠区域S 23位于基准视场的左边,重叠区域S 34、S 45和S 56位于基准视场的右边。 For example, referring to Figure 3, the reference field of view is field of view 3, the overlapping area between field of view 1 and field of view 2 is denoted as S 12 (not shown in the figure), and the field of view 2 and field of view 3 are The overlap area between field of view 3 and field of view 4 is denoted as S 23 , the overlap area between field of view 3 and field of view 4 is denoted as S 34 , the overlap area between field of view 4 and field of view 5 is denoted as S 45 , field of view 5 and field of view 6 The overlapping area between is denoted as S 56 . The overlapping area S 12 and the overlapping area S 23 are located on the left side of the reference field of view, and the overlapping areas S 34 , S 45 and S 56 are located on the right side of the reference field of view.
获取到重叠区域S 12在视场1中的回波强度为
Figure PCTCN2019108216-appb-000001
重叠区域在视场2中的回波强度为
Figure PCTCN2019108216-appb-000002
视场1和视场2之间的差异系数
Figure PCTCN2019108216-appb-000003
获取到重叠区域S 23在视场2中的回波强度
Figure PCTCN2019108216-appb-000004
重叠区域S 23在视场3中的回波强度
Figure PCTCN2019108216-appb-000005
那么视场2和视场3之间的差异系数
Figure PCTCN2019108216-appb-000006
获取到重叠区域S34在视场3中的回波强度
Figure PCTCN2019108216-appb-000007
重叠区域S34在视场4中的回波强度
Figure PCTCN2019108216-appb-000008
那么视场3和视场4之间的差异系数
Figure PCTCN2019108216-appb-000009
获取重叠区域S 45在视场4中的回波强度
Figure PCTCN2019108216-appb-000010
获取重叠区域S 45在视场5中的回波强度
Figure PCTCN2019108216-appb-000011
那么视场4和视场5之间的差异系数
Figure PCTCN2019108216-appb-000012
获取重叠区域S56在视场5中的回波强度
Figure PCTCN2019108216-appb-000013
获取重叠区域S56在视场6中的回波强度
Figure PCTCN2019108216-appb-000014
那么视场5和视场6之间的差异系数
Figure PCTCN2019108216-appb-000015
The echo intensity of the overlapping area S 12 in the field of view 1 is obtained as
Figure PCTCN2019108216-appb-000001
The echo intensity of the overlapping area in the field of view 2 is
Figure PCTCN2019108216-appb-000002
Difference coefficient between field of view 1 and field of view 2
Figure PCTCN2019108216-appb-000003
Obtain the echo intensity of the overlapping area S 23 in the field of view 2
Figure PCTCN2019108216-appb-000004
The echo intensity of the overlapping area S 23 in the field of view 3
Figure PCTCN2019108216-appb-000005
Then the coefficient of difference between field of view 2 and field of view 3
Figure PCTCN2019108216-appb-000006
Obtain the echo intensity of the overlapping area S34 in the field of view 3
Figure PCTCN2019108216-appb-000007
The echo intensity of the overlapping area S34 in the field of view 4
Figure PCTCN2019108216-appb-000008
Then the coefficient of difference between field of view 3 and field of view 4
Figure PCTCN2019108216-appb-000009
Obtain the echo intensity of the overlapping area S 45 in the field of view 4
Figure PCTCN2019108216-appb-000010
Obtain the echo intensity of the overlapping area S 45 in the field of view 5
Figure PCTCN2019108216-appb-000011
Then the coefficient of difference between field of view 4 and field of view 5
Figure PCTCN2019108216-appb-000012
Obtain the echo intensity of the overlapping area S56 in the field of view 5
Figure PCTCN2019108216-appb-000013
Obtain the echo intensity of the overlapping area S56 in the field of view 6
Figure PCTCN2019108216-appb-000014
Then the coefficient of difference between field of view 5 and field of view 6
Figure PCTCN2019108216-appb-000015
S203、计算待校正视场j的校正系数P jS203: Calculate the correction coefficient P j of the field of view j to be corrected.
其中,j表示待校正视场的编号,P j表示第j个待校正视场的校正系数,i表示基准视场的编号,基准视场是N个视场中的任意一个,即1≤i≤N,且i为整数,j≠i,j=1、2、…、N。j>i时,P j与K i(i-1)、K (i-1)(i-2)、...、K (j-1)j有关;在j<i时,P j与K j(j-1)、K (j-1)(j-2)、...、K (i-1)i有关。 Among them, j represents the number of the field of view to be corrected, P j represents the correction coefficient of the j-th field of view to be corrected, i represents the number of the reference field of view, and the reference field of view is any one of the N fields of view, that is, 1≤i ≤N, and i is an integer, j≠i, j=1, 2,...,N. When j>i, P j is related to K i(i-1) , K (i-1)(i-2) ,..., K (j-1)j ; when j<i, P j is related to K j(j-1) , K (j-1)(j-2) ,..., K (i-1)i are related.
举例来说,N=6,N个视场分别为视场1、视场2、视场3、视场4、视场5和视场6,视场3为基准视场,视场1和视场2位于视场3的左边,即满足j<i;视场4、视场5和视场6位于视场3的右边,即满足j>i。校正系数P 1表示视场1的校正系数,校正系数P 2表示视场2的校正系数,校正系数P 4表示视场4的校正系数,校正系数P 5表示视场5的校正系数,校正系数P 6表示视场6的校正系数。假设视场1和视场2之间的差异系数为K 12,视场2和视场3之间的差异系数为K 23,视场3和视场4之间的差异系数为K 34,视场4和视场5之间的差异系数为K 45,视场5和视场6之间的差异系数为K 56。那么校正系数P 1与差异系数K 12和K 23有关,例如:校正系数P 1=K 12×K 23。校正系数P 2与差异系数K 23有关,例如:校正系数P 2=K 23。校正系数P 4与差异系数K 34有关,例如:校正系数P 4=K 34。校正系数P 5和差异系数K 34和K 45有关,例如:校正系数=K 34×K 45。校正系数P 6和与差异系数K 34、K 45和K 56有关,例如:校正系数=K 34×K 45×K 56For example, N=6, the N fields of view are field of view 1, field of view 2, field of view 3, field of view 4, field of view 5, and field of view 6, field of view 3 is the reference field of view, field of view 1 and The field of view 2 is located on the left of the field of view 3, that is, it satisfies j<i; the field of view 4, the field of view 5, and the field of view 6 are located on the right of the field of view 3, that is, j>i is satisfied. The correction coefficient P 1 represents the correction coefficient of the field of view 1, the correction coefficient P 2 represents the correction coefficient of the field of view 2, the correction coefficient P 4 represents the correction coefficient of the field of view 4, the correction coefficient P 5 represents the correction coefficient of the field of view 5. P 6 represents the correction coefficient of the field of view 6. Assuming that the coefficient of difference between field of view 1 and field of view 2 is K 12 , the coefficient of difference between field of view 2 and field of view 3 is K 23 , and the coefficient of difference between field of view 3 and field of view 4 is K 34 , The coefficient of difference between field 4 and field of view 5 is K 45 , and the coefficient of difference between field of view 5 and field of view 6 is K 56 . Then the correction coefficient P 1 is related to the difference coefficients K 12 and K 23 , for example: the correction coefficient P 1 =K 12 ×K 23 . The correction coefficient P 2 is related to the difference coefficient K 23 , for example: the correction coefficient P 2 =K 23 . The correction coefficient P 4 is related to the difference coefficient K 34 , for example: the correction coefficient P 4 =K 34 . The correction coefficient P 5 is related to the difference coefficients K 34 and K 45 , for example: correction coefficient = K 34 × K 45 . The correction coefficient P 6 is related to the difference coefficients K 34 , K 45 and K 56 , for example: correction coefficient = K 34 × K 45 × K 56 .
S204、根据校正系数P j对待校正视场j进行校正。 S204: Correct the field of view j to be corrected according to the correction coefficient P j.
其中,各个待校正视场将校正系数相乘后得到校正后的视场。例如:待校正视场1由38次行扫描的照射点组成,根据S203得到待校正视场1的校正系数为P 1,将待校正视场1中所有照射点的回波强度乘以校正系数P 1后得到校正后的视场1中所有照射点的回波强度。 Among them, each field of view to be corrected multiplies the correction coefficients to obtain the corrected field of view. For example: the field of view 1 to be corrected is composed of the irradiation points of 38 line scans. According to S203, the correction coefficient of the field of view 1 to be corrected is P 1 , and the echo intensities of all the irradiation points in the field of view 1 to be corrected are multiplied by the correction coefficient After P 1 , the echo intensity of all irradiated points in the corrected field of view 1 is obtained.
实施本申请实施例,确定多个视场中各个视场之间的相对位置关系,根据相邻的两个视场之间的重叠区域分别在两个视场中的回波强度,定量的测量相邻的两个视场之间的回波强度的误差,然后根据多个视场中的基准视场以及相邻的两个视场之间的误差确定待校正视场的校正系数,基于校正系数对待校正视场的回波强度进行校正,以实现对探测到的物体的反射率的校正,这样解决相关技术中激光雷达的多个通道之间的硬件差异导致对同一物体探测到的反射率不同,从而无法准确识别物体的问题,本申请实施例通过对多个通道进行 校正实现多个通道的一致性,这样激光雷达使用多通道探测物体时能准确的反映其轮廓,降低物体识别难度,提高探测准确性。Implement the embodiment of this application to determine the relative positional relationship between the various fields of view in multiple fields of view, and quantitatively measure the echo intensities of the overlapping areas between two adjacent fields of view in the two fields of view. The error of the echo intensity between two adjacent fields of view is then determined according to the reference field of view in multiple fields of view and the error between the two adjacent fields of view to determine the correction coefficient of the field of view to be corrected, based on the correction The coefficient is used to correct the echo intensity of the field of view to be calibrated to realize the correction of the reflectivity of the detected object, so as to solve the hardware difference between the multiple channels of the lidar in the related technology, which leads to the reflectivity of the same object detected Different, so that the object cannot be accurately identified, the embodiment of the application achieves the consistency of multiple channels by correcting multiple channels, so that when the lidar uses multiple channels to detect objects, the outline can be accurately reflected and the difficulty of object identification is reduced. Improve detection accuracy.
下述为本申请装置实施例,可以用于执行本申请方法实施例。对于本申请装置实施例中未披露的细节,请参照本申请方法实施例。The following are device embodiments of this application, which can be used to execute the method embodiments of this application. For details not disclosed in the device embodiment of this application, please refer to the method embodiment of this application.
请参见图5,其示出了本申请一个示例性实施例提供的多通道雷达的校正装置的结构示意图,以下简称校正装置5。该校正装置5可以通过软件、硬件或者两者的结合实现成为激光雷达的全部或一部分。校正装置5包括:确定单元501、计算单元502和校正单元503。Please refer to FIG. 5, which shows a schematic structural diagram of a correction device for a multi-channel radar provided by an exemplary embodiment of the present application, which is referred to as the correction device 5 hereinafter. The correction device 5 can be implemented as all or part of the lidar through software, hardware or a combination of the two. The correction device 5 includes: a determination unit 501, a calculation unit 502, and a correction unit 503.
可选的,在N为奇数时,i=(N+1)/2;或Optionally, when N is an odd number, i=(N+1)/2; or
在N为偶数时,i=N/2或N/2+1。When N is an even number, i=N/2 or N/2+1.
可选的,所述K (N-1)N表示S (N-1)N在所述视场N中的回波强度和所述S (N-1)N在所述视场N-1中的回波强度之间的比例值。 Alternatively, the K (N-1) N represents S (N-1) N echo intensities in the field of view of N and the S (N-1) of the N field in the N-1 The value of the ratio between the intensities of the echoes.
可选的,所述S (N-1)N在所述视场N-1中的回波强度表示所述S (N-1)N中所有照射点在所述视场N-1中的平均回波强度,所述S (N-1)N在所述视场N中的回波强度表示所述S (N-1)N中所有照射点在所述视场N中的平均回波强度。 Optionally, the echo intensity of the S (N-1)N in the field of view N-1 represents the magnitude of all the illumination points in the S (N-1)N in the field of view N-1 The average echo intensity, the echo intensity of the S (N-1)N in the field of view N represents the average echo of all the illumination points in the S (N-1)N in the field of view N strength.
可选的,所述S (N-1)N在所述视场N中的回波强度表示指定照射点在所述视场N中的回波强度,所述S (N-1)N在所述视场N-1中的回波强度表示所述指定照射点在所述视场N-1中的回波强度,所述指定照射点位于所述视场N-1的最后一列;或所述指定照射点位于所述视场N的第一列。 Optionally, the echo intensity of the S (N-1)N in the field of view N represents the echo intensity of a designated illumination point in the field of view N, and the S (N-1)N is in the field of view N. The echo intensity in the field of view N-1 represents the echo intensity of the designated irradiation point in the field of view N-1, and the designated irradiation point is located in the last column of the field of view N-1; or The designated illumination point is located in the first column of the field of view N.
可选的,确定单元501还用于:Optionally, the determining unit 501 is further configured to:
根据相邻的两个视场的扫描角度确定所述两个视场之间的水平重合度和垂直偏移量;Determining the horizontal coincidence degree and the vertical offset between the two adjacent fields of view according to the scanning angles of the two adjacent fields of view;
根据所述水平重合度和所述所述垂直偏移量确定所述两个视场之间的重叠区域。The overlapping area between the two fields of view is determined according to the horizontal coincidence degree and the vertical offset.
可选的,所述N个视场的扫描角度相同。Optionally, the scanning angles of the N fields of view are the same.
需要说明的是,上述实施例提供的装置5在执行多通道激光雷达的校正方法时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将设备的内部结构划分成不同的 功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的多通道激光雷达的校正装置与多通道激光雷达的校正方法实施例属于同一构思,其体现实现过程详见方法实施例,这里不再赘述。It should be noted that when the device 5 provided in the foregoing embodiment executes the multi-channel lidar calibration method, only the division of the foregoing functional modules is used as an example for illustration. In practical applications, the foregoing functional assignments can be assigned to different types according to needs. The function module is completed, that is, the internal structure of the device is divided into different function modules to complete all or part of the functions described above. In addition, the multi-channel lidar calibration device provided in the above embodiment and the multi-channel lidar calibration method embodiment belong to the same concept, and the implementation process is detailed in the method embodiment, which will not be repeated here.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.
本申请实施例还提供了一种计算机存储介质,所述计算机存储介质可以存储有多条指令,所述指令适于由处理器加载并执行如上述图2-图4所示实施例的方法步骤,具体执行过程可以参见图2-图4所示实施例的具体说明,在此不进行赘述。The embodiment of the present application also provides a computer storage medium. The computer storage medium may store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps of the embodiments shown in FIGS. 2 to 4 above. For the specific execution process, please refer to the specific description of the embodiment shown in FIG. 2 to FIG. 4, which will not be repeated here.
本申请还提供了一种计算机程序产品,该计算机程序产品存储有至少一条指令,所述至少一条指令由所述处理器加载并执行以实现如上各个实施例所述的多通道雷达的校正方法。The present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the multi-channel radar calibration method described in each of the above embodiments.
请参见图6,为本申请实施例提供了一种多通道激光雷达的校正装置的结构示意图,以下校正校正装置6。如图6所示,所述校正装置6可以包括:至少一个处理器601、存储器602和至少一个通信总线603。Please refer to FIG. 6, which provides a schematic structural diagram of a correction device for a multi-channel lidar according to an embodiment of the present application. The correction and correction device 6 is described below. As shown in FIG. 6, the correction device 6 may include: at least one processor 601, a memory 602, and at least one communication bus 603.
其中,通信总线603用于实现这些组件之间的连接通信。Among them, the communication bus 603 is used to implement connection and communication between these components.
其中,处理器601可以包括一个或者多个处理核心。处理器601利用各种接口和线路连接整个校正装置6内的各个部分,通过运行或执行存储在存储器602内的指令、程序、代码集或指令集,以及调用存储在存储器602内的数据,执行校正装置6的各种功能和处理数据。可选的,处理器601可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable LogicArray,PLA)中的至少一种硬件形式来实现。处理器601可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics Processing Unit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作系统、用户界面和应用程序等;GPU用于负责显示屏所需要显示的内容的渲染和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器601中,单独通过一块芯片进行实现。The processor 601 may include one or more processing cores. The processor 601 uses various interfaces and lines to connect various parts of the entire correction device 6, and executes by running or executing instructions, programs, code sets, or instruction sets stored in the memory 602, and calling data stored in the memory 602. Various functions and processing data of the correction device 6. Optionally, the processor 601 may use at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA) Realize in the form of hardware. The processor 601 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), a modem, and the like. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the display; the modem is used to process wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 601, but may be implemented by a chip alone.
其中,存储器602可以包括随机存储器(RandomAccess Memory,RAM),也可以包括只读存储器(Read-Only Memory)。可选的,该存储器602包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器602可用于存储指令、程序、代码、代码集或指令集。存储器602可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作系统的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现上述各个方法实施例的指令等;存储数据区可存储上面各个方法实施例中涉及到的数据等。存储器602可选的还可以是至少一个位于远离前述处理器601的存储装置。The memory 602 may include random access memory (RAM) or read-only memory (Read-Only Memory). Optionally, the memory 602 includes a non-transitory computer-readable storage medium. The memory 602 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 602 may include a storage program area and a storage data area, where the storage program area may store instructions for implementing the operating system and instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), Instructions used to implement the foregoing method embodiments, etc.; the storage data area can store data and the like involved in the foregoing method embodiments. Optionally, the memory 602 may also be at least one storage device located far away from the foregoing processor 601.
在图6所示的校正装置6中,处理器601可以用于调用存储器602中存储的触摸操作响应应用程序,并具体执行以下步骤步骤:In the correction device 6 shown in FIG. 6, the processor 601 may be used to call the touch operation response application program stored in the memory 602, and specifically execute the following steps:
确定N个视场中各个照射点的回波强度;其中,所述N个视场包括1个基准视场和N-1个待校正视场,所述N个视场分别为视场1、视场2、…、视场N,所述N个视场中任意相邻的两个视场形成N-1个重叠区域,N-1个重叠区域分别为S 12、S 23、S 34、…、S (N-1)N,S (N-1)N表示视场N-1和视场N之间的重叠区域,N≥2且N为整数; Determine the echo intensity of each illumination point in the N fields of view; wherein, the N fields of view include 1 reference field of view and N-1 fields of view to be corrected, and the N fields of view are respectively the field of view 1, Field of view 2, ..., field of view N, any two adjacent fields of view in the N fields of view form N-1 overlapping areas, and the N-1 overlapping areas are respectively S 12 , S 23 , S 34 , …, S (N-1)N , S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N, where N≥2 and N is an integer;
计算差异系数K 12、K 23、…、K (N-1)N;其中,K (N-1)N是根据所述S (N-1)N在所述视场N-1中的回波强度和所述S (N-1)N在所述视场N中的回波强度之间的差异得到的; Calculate the difference coefficients K 12 , K 23 , ..., K (N-1)N ; where K (N-1)N is based on the return of the S (N-1)N in the field of view N-1 Obtained from the difference between the wave intensity and the echo intensity of the S (N-1)N in the field of view N;
计算待校正视场j的校正系数P j;其中,j=1、2、…、N,i≠j,1≤i≤N,i为所述基准视场的编号;在j>i时,P j与K i(i-1)、K (i-1)(i-2)、...、K (j-1)j有关;在j<i时,P j与K j(j-1)、K (j-1)(j-2)、...、K (i-1)i有关; Calculate the correction coefficient P j of the field of view j to be corrected; where j = 1, 2, ..., N, i≠j, 1≤i≤N, and i is the number of the reference field of view; when j>i, P j is related to K i(i-1) , K (i-1)(i-2) ,..., K (j-1)j ; when j<i, P j and K j(j- 1) , K (j-1)(j-2) ,..., K (i-1)i are related;
根据所述校正系数P j对所述待校正视场j进行校正。 The field of view j to be corrected is corrected according to the correction coefficient P j.
在一个或多个实施例中,在N为奇数时,i=(N+1)/2;或In one or more embodiments, when N is an odd number, i=(N+1)/2; or
在N为偶数时,i=N/2或N/2+1。When N is an even number, i=N/2 or N/2+1.
在一个或多个实施例中,所述K (N-1)N表示S (N-1)N在所述视场N中的回波强度和所述S (N-1)N在所述视场N-1中的回波强度之间的比例值。 In one or more embodiments, the K (N-1)N represents the echo intensity of S (N-1)N in the field of view N and the S (N-1)N in the field of view N The value of the ratio between the intensities of the echoes in the field of view N-1.
在一个或多个实施例中,所述S (N-1)N在所述视场N-1中的回波强度表示所述S (N-1)N中所有照射点在所述视场N-1中的平均回波强度,所述S (N-1)N在所述 视场N中的回波强度表示所述S (N-1)N中所有照射点在所述视场N中的平均回波强度。 In one or more embodiments , the echo intensity of the S (N-1)N in the field of view N-1 indicates that all the illumination points in the S (N-1)N are in the field of view. The average echo intensity in N-1, the echo intensity of the S (N-1)N in the field of view N indicates that all the illumination points in the S (N-1)N are in the field of view N The average echo strength in.
在一个或多个实施例中,所述S (N-1)N在所述视场N中的回波强度表示指定照射点在所述视场N中的回波强度,所述S (N-1)N在所述视场N-1中的回波强度表示所述指定照射点在所述视场N-1中的回波强度,所述指定照射点位于所述视场N-1的最后一列;或所述指定照射点位于所述视场N的第一列。 In one or more embodiments , the echo intensity of the S (N-1)N in the field of view N represents the echo intensity of a designated illumination point in the field of view N, and the S (N -1) The echo intensity of N in the field of view N-1 represents the echo intensity of the designated irradiation point in the field of view N-1, and the designated irradiation point is located in the field of view N-1 Or the designated illumination point is located in the first column of the field of view N.
在一个或多个实施例中,处理器601还用于执行:In one or more embodiments, the processor 601 is further configured to execute:
根据相邻的两个视场的扫描角度确定所述两个视场之间的水平重合度和垂直偏移量;Determining the horizontal coincidence degree and the vertical offset between the two adjacent fields of view according to the scanning angles of the two adjacent fields of view;
根据所述水平重合度和所述所述垂直偏移量确定所述两个视场之间的重叠区域。The overlapping area between the two fields of view is determined according to the horizontal coincidence degree and the vertical offset.
在一个或多个实施例中,所述N个视场的扫描角度相同。In one or more embodiments, the scanning angles of the N fields of view are the same.
其中,图6的实施例和图2的方法实施例基于相同的构思,其带来的技术效果也相同,图6的具体实现过程可参照图2的描述,此处不再赘述。Among them, the embodiment of FIG. 6 and the method embodiment of FIG. 2 are based on the same concept, and the technical effects brought about by them are also the same. For the specific implementation process of FIG. 6, reference may be made to the description of FIG. 2 and will not be repeated here.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体或随机存储记忆体等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium, and the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium can be a magnetic disk, an optical disc, a read-only storage memory or a random storage memory, etc.
以上所揭露的仅为本申请较佳实施例而已,当然不能以此来限定本申请之权利范围,因此依本申请权利要求所作的等同变化,仍属本申请所涵盖的范围。The above-disclosed are only preferred embodiments of this application, and of course the scope of rights of this application cannot be limited by this. Therefore, equivalent changes made in accordance with the claims of this application still fall within the scope of this application.

Claims (11)

  1. 一种多通道激光雷达的校正方法,其特征在于,所述方法包括:A method for calibrating multi-channel lidar, characterized in that the method includes:
    确定N个视场中各个照射点的回波强度;其中,所述N个视场包括1个基准视场和N-1个待校正视场,所述N个视场分别为视场1、视场2、…、视场N,所述N个视场中任意相邻的两个视场形成N-1个重叠区域,N-1个重叠区域分别为S 12、S 23、S 34、…、S (N-1)N,S (N-1)N表示视场N-1和视场N之间的重叠区域,N≥2且N为整数; Determine the echo intensity of each illumination point in the N fields of view; wherein, the N fields of view include 1 reference field of view and N-1 fields of view to be corrected, and the N fields of view are respectively the field of view 1, Field of view 2, ..., field of view N, any two adjacent fields of view in the N fields of view form N-1 overlapping areas, and the N-1 overlapping areas are respectively S 12 , S 23 , S 34 , …, S (N-1)N , S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N, where N≥2 and N is an integer;
    计算差异系数K 12、K 23、…、K (N-1)N;其中,K (N-1)N是根据所述S (N-1)N在所述视场N-1中的回波强度和所述S (N-1)N在所述视场N中的回波强度之间的差异得到的; Calculate the difference coefficients K 12 , K 23 , ..., K (N-1)N ; where K (N-1)N is based on the return of the S (N-1)N in the field of view N-1 Obtained from the difference between the wave intensity and the echo intensity of the S (N-1)N in the field of view N;
    计算待校正视场j的校正系数P j;其中,j=1、2、…、N,i≠j,1≤i≤N,i为所述基准视场的编号;在j>i时,P j与K i(i-1)、K (i-1)(i-2)、...、K (j-1)j有关;在j<i时,P j与K j(j-1)、K (j-1)(j-2)、...、K (i-1)i有关; Calculate the correction coefficient P j of the field of view j to be corrected; where j = 1, 2, ..., N, i≠j, 1≤i≤N, and i is the number of the reference field of view; when j>i, P j is related to K i(i-1) , K (i-1)(i-2) ,..., K (j-1)j ; when j<i, P j and K j(j- 1) , K (j-1)(j-2) ,..., K (i-1)i are related;
    根据所述校正系数P j对所述待校正视场j进行校正。 The field of view j to be corrected is corrected according to the correction coefficient P j.
  2. 根据权利要求1所述的方法,其特征在于,The method of claim 1, wherein:
    在N为奇数时,i=(N+1)/2;或When N is an odd number, i=(N+1)/2; or
    在N为偶数时,i=N/2或N/2+1。When N is an even number, i=N/2 or N/2+1.
  3. 根据权利要求1或2所述的方法,其特征在于,所述K (N-1)N表示S (N-1)N在所述视场N中的回波强度和所述S (N-1)N在所述视场N-1中的回波强度之间的比例值。 The method according to claim 1 or 2, wherein the K (N-1)N represents the echo intensity of S (N-1)N in the field of view N and the S (N- 1) N is the ratio of the echo intensities in the field of view N-1.
  4. 根据权利要求3所述的方法,其特征在于,所述S (N-1)N在所述视场N-1中的回波强度表示所述S (N-1)N中所有照射点在所述视场N-1中的平均回波强度,所述S (N-1)N在所述视场N中的回波强度表示所述S (N-1)N中所有照射点在所述视场N中的平均回波强度。 The method according to claim 3, wherein the echo intensity of the S (N-1)N in the field of view N-1 indicates that all the illumination points in the S (N-1)N are The average echo intensity in the field of view N-1, the echo intensity of the S (N-1)N in the field of view N indicates that all the illumination points in the S (N-1)N are in the The average echo intensity in the field of view N.
  5. 根据权利要求3所述的方法,其特征在于,所述S (N-1)N在所述视场N中的回波强度表示指定照射点在所述视场N中的回波强度,所述S (N-1)N在所述视场N-1中的回波强度表示所述指定照射点在所述视场N-1中的回波强度,所述指定照射点位于所述视场N-1的最后一列;或所述指定照射点位于所述视场N的第一列。 The method according to claim 3, wherein the echo intensity of the S(N-1)N in the field of view N represents the echo intensity of a designated illumination point in the field of view N, so The echo intensity of S (N-1)N in the field of view N-1 represents the echo intensity of the designated illumination point in the field of view N-1, and the designated illumination point is located in the field of view N-1. The last column of the field N-1; or the designated illumination point is located in the first column of the field of view N.
  6. 根据权利要求4或5所述的方法,其特征在于,还包括:The method according to claim 4 or 5, further comprising:
    根据相邻的两个视场的扫描角度确定所述两个视场之间的水平重合度和垂直偏移量;Determining the horizontal coincidence degree and the vertical offset between the two adjacent fields of view according to the scanning angles of the two adjacent fields of view;
    根据所述水平重合度和所述所述垂直偏移量确定所述两个视场之间的重叠区域。The overlapping area between the two fields of view is determined according to the horizontal coincidence degree and the vertical offset.
  7. 根据权利要求6所述的方法,其特征在于,所述N个视场的扫描角度相同。The method according to claim 6, wherein the scanning angles of the N fields of view are the same.
  8. 一种多通道激光雷达的校正装置,其特征在于,所述装置包括:A correction device for multi-channel lidar, characterized in that the device comprises:
    确定单元,用于确定N个视场中各个照射点的回波强度;其中,所述N个视场包括1个基准视场和N-1个待校正视场,所述N个视场分别为视场1、视场2、…视场N,所述N个视场中任意两个相邻的视场形成N-1个重叠区域,N-1个重叠区域分别为S 12、S 23、S 34、…、S (N-1)N,S (N-1)N表示视场N-1和视场N之间的重叠区域,N≥2且N为整数; The determining unit is used to determine the echo intensity of each illumination point in the N fields of view; wherein the N fields of view include 1 reference field of view and N-1 fields of view to be corrected, and the N fields of view are respectively Is the field of view 1, the field of view 2, ... the field of view N, any two adjacent fields of view in the N fields of view form N-1 overlapping areas, and the N-1 overlapping areas are respectively S 12 and S 23 , S 34 , ..., S (N-1)N , S (N-1)N represents the overlapping area between the field of view N-1 and the field of view N, N≥2 and N is an integer;
    计算单元,用于计算差异系数K 12、K 23、…、K (N-1)N;其中,K (N-1)N是根据S (N-1)N在所述视场N中的回波强度和所述S (N-1)N在所述视场N-1中的回波强度之间的误差得到的; The calculation unit is used to calculate the difference coefficients K 12 , K 23 , ..., K (N-1)N ; where K (N-1)N is based on S (N-1)N in the field of view N Obtained by the error between the echo intensity and the echo intensity of the S (N-1)N in the field of view N-1;
    所述计算单元,还用于计算待校正视场j的校正系数P j;其中,i≠j,1≤i≤N,j=1、2、…、N,i为基准视场的编号;j>i时,校正系数P j与K i(i-1)、K (i-1)(i-2)、...、K (j-1)j有关;或j<i时,校正系数P j与K j(j-1)、K (j-1)(j-2)、...、K (i-1)(i)有关; The calculation unit is also used to calculate the correction coefficient P j of the field of view j to be corrected; where i≠j, 1≤i≤N, j=1, 2,...,N, and i is the number of the reference field of view; When j>i, the correction coefficient P j is related to K i(i-1) , K (i-1)(i-2) ,..., K (j-1)j ; or when j<i, correct The coefficient P j is related to K j(j-1) , K (j-1)(j-2) ,..., K (i-1)(i) ;
    校正单元,用于根据校正系数P j对待校正视场j中各个照射点的回波强度 进行校正。 The correction unit is configured to correct the echo intensity of each irradiation point in the field of view j to be corrected according to the correction coefficient P j.
  9. 一种计算机存储介质,其特征在于,所述计算机存储介质存储有多条指令,所述指令适于由处理器加载并执行如权利要求1~7任意一项的方法步骤。A computer storage medium, wherein the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps according to any one of claims 1-7.
  10. 一种多通道激光雷达的校正装置,其特征在于,包括:处理器和存储器;其中,所述存储器存储有计算机程序,所述计算机程序适于由所述处理器加载并执行如权利要求1~7任意一项的方法步骤。A calibration device for multi-channel lidar, which is characterized by comprising: a processor and a memory; wherein the memory stores a computer program, and the computer program is adapted to be loaded by the processor and executed as claimed in claim 1 to 7 Any one of the method steps.
  11. 一种多通道激光雷达,其特征在于,包括如权利要求8或10所述的校正装置。A multi-channel lidar, which is characterized by comprising the correction device according to claim 8 or 10.
PCT/CN2019/108216 2019-09-26 2019-09-26 Calibration method, apparatus, storage medium and multi-channel lidar WO2021051439A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980051815.3A CN112955778B (en) 2019-09-26 2019-09-26 Correction method, correction device, storage medium and multichannel laser radar
PCT/CN2019/108216 WO2021051439A1 (en) 2019-09-26 2019-09-26 Calibration method, apparatus, storage medium and multi-channel lidar

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/108216 WO2021051439A1 (en) 2019-09-26 2019-09-26 Calibration method, apparatus, storage medium and multi-channel lidar

Publications (1)

Publication Number Publication Date
WO2021051439A1 true WO2021051439A1 (en) 2021-03-25

Family

ID=74883112

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/108216 WO2021051439A1 (en) 2019-09-26 2019-09-26 Calibration method, apparatus, storage medium and multi-channel lidar

Country Status (2)

Country Link
CN (1) CN112955778B (en)
WO (1) WO2021051439A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116413693A (en) * 2021-12-30 2023-07-11 上海禾赛科技有限公司 Laser radar detection method and laser radar
CN116755100B (en) * 2023-08-17 2024-02-02 深圳市速腾聚创科技有限公司 Laser radar device and ranging adjustment method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103489176A (en) * 2012-06-13 2014-01-01 中国科学院电子学研究所 Method for extracting TPs from SAR image of serious geometric distortion
US20150160332A1 (en) * 2012-08-13 2015-06-11 Digital Signal Corporation System and Method for Calibrating Video and Lidar Subsystems
CN106291512A (en) * 2016-07-29 2017-01-04 中国科学院光电研究院 A kind of method of array push-broom type laser radar range Nonuniformity Correction
CN109839624A (en) * 2017-11-27 2019-06-04 北京万集科技股份有限公司 A kind of multilasered optical radar position calibration method and device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6230507B2 (en) * 2014-08-20 2017-11-15 オムロンオートモーティブエレクトロニクス株式会社 Laser radar equipment
CN110268283B (en) * 2016-11-16 2023-09-01 应诺维思科技有限公司 Lidar system and method
KR102657365B1 (en) * 2017-05-15 2024-04-17 아우스터, 인크. Brightness Enhanced Optical Imaging Transmitter
CN108267746A (en) * 2018-01-17 2018-07-10 上海禾赛光电科技有限公司 Laser radar system, the processing method of laser radar point cloud data, readable medium
CN108681525B (en) * 2018-05-16 2020-12-25 福州大学 Road surface point cloud intensity enhancing method based on vehicle-mounted laser scanning data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103489176A (en) * 2012-06-13 2014-01-01 中国科学院电子学研究所 Method for extracting TPs from SAR image of serious geometric distortion
US20150160332A1 (en) * 2012-08-13 2015-06-11 Digital Signal Corporation System and Method for Calibrating Video and Lidar Subsystems
CN106291512A (en) * 2016-07-29 2017-01-04 中国科学院光电研究院 A kind of method of array push-broom type laser radar range Nonuniformity Correction
CN109839624A (en) * 2017-11-27 2019-06-04 北京万集科技股份有限公司 A kind of multilasered optical radar position calibration method and device

Also Published As

Publication number Publication date
CN112955778A (en) 2021-06-11
CN112955778B (en) 2023-08-04

Similar Documents

Publication Publication Date Title
JP6835914B2 (en) Distance measurement method based on laser radar system, distance measurement device based on laser radar system and computer readable storage medium
US10764487B2 (en) Distance image acquisition apparatus and application thereof
CN108377380B (en) Image scanning system and method thereof
CN111161358B (en) Camera calibration method and device for structured light depth measurement
US10107899B1 (en) System and method for calibrating light intensity
WO2021051439A1 (en) Calibration method, apparatus, storage medium and multi-channel lidar
US11593960B2 (en) Determining the relative position between a point cloud generating camera and another camera
CN111913169B (en) Laser radar internal reference and point cloud data correction method, device and storage medium
US20220221584A1 (en) Laser radar and method for generating laser point could data
US20200018727A1 (en) Control method, inspection system, and storage medium
CN115376000A (en) Underwater measurement method, device and computer readable storage medium
KR101559458B1 (en) Apparatus and method for detecting object
US10215628B2 (en) Image calibrating method and device of testing apparatus for thin film transistor substrate
CN113740876B (en) Three-dimensional laser radar light path adjusting method and device and electronic equipment
CN110602486A (en) Detection method, detection device, depth camera and computer readable storage medium
US20220237824A1 (en) Distortion calibration method for ultra-wide angle imaging apparatus, system and photographing device including same
JP7363545B2 (en) Calibration judgment result presentation device, calibration judgment result presentation method and program
CN114581314A (en) Galvanometer calibration method, device and computer readable storage medium
KR102570059B1 (en) Method and apparatus for sensing
KR20160148735A (en) The apparatus for measuring camera principal point and the method thereof
JPH07286827A (en) Optical displacement measuring instrument
US20230204741A1 (en) Ranging method and device, storage medium, and lidar
US20230041567A1 (en) Calibration of a Solid-State Lidar Device
JP2002286425A (en) Displacement sensor
JP2019090758A (en) Shape measurement system for floor, and measurement method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19945530

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19945530

Country of ref document: EP

Kind code of ref document: A1