WO2021102689A1 - Guardrail detection method and device, storage medium, and movable platform - Google Patents

Guardrail detection method and device, storage medium, and movable platform Download PDF

Info

Publication number
WO2021102689A1
WO2021102689A1 PCT/CN2019/120981 CN2019120981W WO2021102689A1 WO 2021102689 A1 WO2021102689 A1 WO 2021102689A1 CN 2019120981 W CN2019120981 W CN 2019120981W WO 2021102689 A1 WO2021102689 A1 WO 2021102689A1
Authority
WO
WIPO (PCT)
Prior art keywords
guardrail
distance
reflection point
target
reflection
Prior art date
Application number
PCT/CN2019/120981
Other languages
French (fr)
Chinese (zh)
Inventor
卜运成
李怡强
陆新飞
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2019/120981 priority Critical patent/WO2021102689A1/en
Priority to CN201980039524.2A priority patent/CN112313539B/en
Publication of WO2021102689A1 publication Critical patent/WO2021102689A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/89Radar or analogous systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/932Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles using own vehicle data, e.g. ground speed, steering wheel direction
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327Sensor installation details
    • G01S2013/93271Sensor installation details in the front of the vehicles

Definitions

  • the invention relates to the technical field of guardrail detection and fitting, and more specifically to a guardrail detection method and equipment based on millimeter wave radar, a storage medium and a movable platform.
  • millimeter-wave radar has been used more and more in the field of auto driving due to its unique all-time and all-weather characteristics, plus the advantages of long range and high speed measurement accuracy.
  • the detection and fitting of the guardrail on both sides of the road by the millimeter wave radar can provide a lot of help for automatic driving or assisted driving, such as the calculation of the probability of the target vehicle in its own lane, the detection of the vehicle passable area, and the reduction of false alarms of targets outside the guardrail.
  • the guardrail appears as a large number of reflection points in the detection result of the millimeter wave radar. If all these guardrail reflection points are output, it will bring greater data output pressure.
  • the shape of the guardrail changes with the curve of the road, so a single guardrail fitting model cannot meet the demand.
  • the present invention is proposed in order to solve at least one of the above-mentioned problems.
  • the present invention provides a guardrail detection method and equipment based on millimeter wave radar, a storage medium and a movable platform, which replace the current guardrail with characterization parameters of the current guardrail, thereby effectively reducing the data output pressure of the guardrail reflection point.
  • the embodiment of the present invention provides a guardrail detection method based on millimeter wave radar, which includes:
  • the guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
  • the embodiment of the present invention also provides a guardrail detection device based on millimeter wave radar, which includes:
  • Millimeter wave radar sensor the millimeter wave radar sensor is used to transmit millimeter waves to the target area, and receive the millimeter wave echo signals reflected back by objects in the target area;
  • a processor the processor is configured to process the echo signal to obtain a guardrail reflection point
  • the guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
  • An embodiment of the present invention also provides a storage medium, and a computer program is stored on the storage medium, and the computer program executes the above-mentioned method when running.
  • the embodiment of the present invention also provides a movable platform, which includes the guardrail fitting system described above.
  • the embodiment of the present invention provides a guardrail detection method and equipment based on millimeter wave radar, a storage medium, and a movable platform, which replace the current guardrail with the characteristic parameters of the current guardrail, thereby effectively reducing the data output pressure of the guardrail reflection point .
  • Fig. 1 shows a schematic block diagram of an exemplary electronic device for implementing a millimeter-wave radar-based guardrail fitting method and system according to an embodiment of the present invention
  • FIG. 2 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to an embodiment of the present invention
  • Figure 3 shows a schematic diagram of radar sensors detecting guardrails on both sides
  • FIG. 4 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to another embodiment of the present invention
  • Figure 5 shows a schematic diagram of the reflection points of the guardrail in the radar detection result
  • FIG. 6 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to another embodiment of the present invention
  • Fig. 7 shows a schematic diagram of the coordinate system definition in the fitting method shown in Fig. 6;
  • FIG. 8 shows a schematic diagram of calculating the distance and speed of the reflection point of the guardrail in the detection method shown in FIG. 6;
  • FIG. 9 shows a schematic diagram of filtering the guardrail recognition area of the distance Doppler image
  • Fig. 10 shows a schematic diagram of performing coordinate transformation on the filtered pixels in Fig. 9;
  • FIG. 11 shows a schematic flowchart of a method for evaluating a target own lane based on guardrail recognition according to another embodiment of the present invention
  • Fig. 12 shows a schematic block diagram of a guardrail detection device based on millimeter wave radar according to an embodiment of the present invention.
  • the electronic device 100 includes one or more processors 102, one or more storage devices 104, an input/output device 106, a communication interface 108, and a radar sensor 110. These components pass through a bus system 112 and/or other components. A form of connection mechanism (not shown) is interconnected. It should be noted that the components and structure of the electronic device 100 shown in FIG. 1 are only exemplary and not restrictive. According to needs, the electronic device may also have other components and structures, or may not include some of the aforementioned components.
  • the processor 102 generally represents any type or form of processing unit capable of processing data or interpreting and executing instructions.
  • the processor can be a central processing unit (CPU), an image processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), an encoder, an image signal processor (ISP), or Other forms of processing units having data processing capabilities and/or instruction execution capabilities, and can control other components in the electronic device 100 to perform desired functions.
  • the processor 102 can include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware finite state machines (FSM), digital signal processors (DSP), or combinations thereof.
  • the processor 102 may receive instructions from software applications or modules. These instructions may cause the processor 102 to complete the method described and/or shown herein for hybrid navigation of a degree device and the self-moving device and method.
  • the storage device 104 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory.
  • the volatile memory may include random access memory, for example
  • the non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, and the like.
  • One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 102 may run the program instructions to implement the client functions (implemented by the processor) in the embodiments of the present invention described below. And/or other desired functions.
  • client functions implemented by the processor
  • Various application programs and various data can also be stored in the computer-readable storage medium.
  • the input/output device 106 may be a device used by the user to input instructions and output various information to the outside.
  • the input device may include one or more of a keyboard, a mouse, a microphone, and a touch screen.
  • the output device may include one or more of a display, a speaker, and the like.
  • the communication interface 108 broadly represents any type or form of adapter or communication device capable of facilitating communication between the example electronic device 100 and one or more additional devices.
  • the communication interface 108 can facilitate communication between the electronic device 100 and a front-end or accessory electronic device, and a back-end server or cloud.
  • Examples of the communication interface 108 include, but are not limited to, a wired network interface (such as a network interface card), a wireless network interface (such as a wireless network interface card), a modem, a universal serial interface (USB), an HDMI interface, and any other suitable interface.
  • the communication interface 108 provides a direct connection to a remote server/remote head-end device through a direct connection to a network such as the Internet.
  • the communication interface 108 provides a direct connection to a remote server/remote front-end device through a direct connection to a network such as a private network.
  • the communication interface 108 may also indirectly provide such a connection through any other suitable connection.
  • the radar sensor 110 may be various suitable radar sensors.
  • the radar sensor 110 is a millimeter wave radar sensor.
  • the millimeter wave radar sensor includes, for example, a line, a transceiver module, and a signal processing module.
  • the transceiver module includes, for example, a linear VCO, an amplifier, a balanced mixer, etc., of course.
  • the millimeter wave radar sensor may also include other structures, and the structure of the radar sensor 110 is not particularly limited in this application.
  • the guardrail beside the road will form a large number of reflection points in the millimeter wave radar.
  • the millimeter wave radar system is limited by the processing power and memory capacity, and the number of reflection points that can detect the output is limited. Scattering points on the guardrail will reduce the ability to detect other objects of interest (for example, vehicles in blind spots). At the same time, too many reflection points will bring greater data output pressure.
  • this application proposes a guardrail fitting method based on millimeter wave radar to reduce data output pressure. The following describes the guardrail detection method based on the millimeter wave radar according to the embodiment of the present invention with reference to FIGS. 2 to 5.
  • the guardrail in this application can include continuous obstacles on one or both sides of the road, or on one or both sides of the middle lane of the road, and specifically can be, for example, stone piers on both sides of a highway,
  • the fences separated in the middle of the two-way lanes, the continuous warning roadblocks placed for temporary road maintenance, etc., the present invention does not limit the specific form of the guardrails.
  • Fig. 2 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to an embodiment of the present invention
  • Fig. 3 shows a schematic diagram of a radar sensor detecting guardrails on both sides.
  • the method disclosed in this embodiment includes:
  • Step 201 Transmit a millimeter wave radar signal, and receive an echo signal reflected by the target.
  • the millimeter wave signal is transmitted by the millimeter wave radar sensor and the echo signal reflected by the target is received.
  • the detection range of the millimeter wave radar sensor is shown in FIG. 3.
  • step 202 the echo signal is processed to obtain the reflection point of the guardrail.
  • the guardrail reflection point based on the echo signal may include parameters such as the coordinates of the guardrail in the radar detection coordinate system or the distance from the vehicle.
  • Step 203 Determine the guardrail model according to the guardrail reflection point, and then determine and output the characteristic parameters of the current guardrail to represent the current guardrail.
  • step S202 fitting is performed according to the parameters of the guardrail reflection point, such as coordinates and other data, so as to obtain the determined guardrail model and the parameters of the model, and then output the characteristic parameters of the guardrail to indicate the current guardrail.
  • the parameters of the guardrail reflection point such as coordinates and other data
  • the characterizing parameter includes the parameters of the guardrail model and the coordinates of the starting point and the ending point in the reflection point of the guardrail.
  • the parameters of the guardrail model include, for example, the size of each coefficient in the model.
  • the shape and position of the current guardrail can be determined by the guardrail parameters and the coordinates of the starting point and the end point in the guardrail reflection point. Because there is no need to output all reflection points to indicate the detected guardrail, the data output pressure is greatly reduced to avoid affecting the radar sensor's ability to detect other targets of interest.
  • Fig. 4 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to another embodiment of the present invention
  • Fig. 5 shows a schematic diagram of reflection points of the guardrail in the radar detection result.
  • the method disclosed in this embodiment includes:
  • Step 401 Transmit a millimeter wave radar signal, and receive an echo signal reflected by the target.
  • the millimeter wave signal is transmitted by the millimeter wave radar sensor and the echo signal reflected by the target is received.
  • the detection range of the millimeter wave radar sensor is shown in FIG. 3.
  • Step 402 Process the echo signal to obtain a detection result of the target, and the detection result includes a plurality of reflection points.
  • a processing method commonly used in the art can be used to process the echo signal to obtain the detection result of the target.
  • the guardrail appears as a large number of reflection points in the detection result of the millimeter wave radar sensor. . Some of these reflection points are guardrail reflection points, and some are not.
  • Step 403 Filter reflection points of the guardrail from the detection result according to the characteristics of the guardrail.
  • the reflection points of the guardrail need to be filtered from the detection result according to the characteristics of the guardrail.
  • the method for screening the reflection points of the guardrail from the detection results according to the characteristics of the guardrail is as follows: First, determine whether the reflection point is stationary relative to the ground according to the information of the echo signal corresponding to the reflection point. Since the guardrail is stationary relative to the ground, the reflection point of the guardrail is also stationary relative to the ground. The speed of the reflection point can be determined according to the information of the echo signal corresponding to the reflection point, and then the speed of the reflection point relative to the ground can be determined according to the speed and the vehicle speed. If the relative ground speed of the reflection point is 0, it means that the reflection point is 0. The reflection point may be a guardrail reflection point; otherwise, it means that the reflection point is not a guardrail reflection point.
  • the distance information of the reflection point can be determined according to the information of the echo signal corresponding to the reflection point, such as the distance information from the vehicle, and then the distance between the reflection point and the adjacent reflection point can be obtained according to the distance information of each reflection point. If the distance between the reflection point and the adjacent reflection point is greater than the set threshold, it means that the reflection point is far away from the adjacent reflection point, which may not be the reflection point of the guardrail, otherwise it is the possibility of the reflection point of the guardrail Larger.
  • the above analysis is combined to determine whether the reflection point is a guardrail reflection point. For example, if the reflection point is stationary relative to the ground and the distance between the reflection point and the adjacent reflection point is less than a set threshold, it is determined that the reflection point is a guardrail reflection point.
  • Step 404 Determine a guardrail model according to the guardrail reflection point, and then determine and output the characteristic parameters of the current guardrail to represent the current guardrail.
  • step 403 After determining the reflection point of the guardrail from the reflection point, fit according to the parameters of the reflection point of the guardrail, such as coordinates, etc., to obtain the determined guardrail model and the parameters of the model, and then output the characteristic parameters of the guardrail to indicate the current Guardrail.
  • the characterizing parameter includes the parameters of the guardrail model and the coordinates of the starting point and the ending point in the reflection point of the guardrail.
  • the parameters of the guardrail model include, for example, the size of each coefficient in the model.
  • the shape and position of the current guardrail can be determined by the guardrail parameters and the coordinates of the starting point and the end point in the guardrail reflection point. Because there is no need to output all reflection points to indicate the detected guardrail, the data output pressure is greatly reduced to avoid affecting the radar sensor's ability to detect other targets of interest.
  • guardrail models are preset and fitted separately, and then the optimal guardrail model is selected.
  • the method for determining the guardrail model according to the guardrail reflection point is:
  • the screened guardrail reflection points are respectively fitted according to the preset guardrail models to obtain the parameters and fitting residuals of each guardrail model. That is, according to the parameters of the guardrail reflection point, such as coordinates, the preset guardrail models are respectively fitted to obtain the parameters of each guardrail model, and then the fitting residual of each guardrail model is calculated.
  • the preset guardrail model includes a straight line model, a quadratic polynomial model, a circular curve model, or a clothoid curve model.
  • the guardrail model with the smallest fitting residual is selected from all guardrail models as the currently detected guardrail model. After the fitting residuals of each guardrail model are obtained, the guardrail model with the smallest fitting residual is selected as the previously detected guardrail model.
  • a schematic diagram of the guardrail can be generated based on the parameters of the guardrail model with the smallest fitting residual and the coordinates of the starting point and the end point in the reflection point of the guardrail, thereby facilitating the user
  • the straight pipe knows the shape and position of the guardrail.
  • the guardrail detection method based on millimeter wave radar realizes the parametrization and automation of guardrail fitting, and replaces all guardrail reflection points with guardrail model parameters and the coordinates of the starting point and end point of the guardrail reflection point to represent the guardrail. Effectively reduce the data output pressure of the guardrail reflection point, and preset multiple guardrail models to fit separately and select the optimal model from them.
  • the optimal guardrail fitting model can be automatically selected to adapt to a variety of scenarios and improve the accuracy of guardrail fitting And robustness.
  • the guardrail fitting is mainly by clustering the static reflection points, and then fitting the guardrail curve.
  • the clustering effect of static reflection points is seriously affected by the accuracy of radar angle measurement and multipath effects.
  • the accuracy of the radar angle measurement is not high or there is a multipath effect (the angle measurement results will have a large deviation)
  • the static reflection points are difficult to be clustered, and this will make the guardrail difficult to be identified and fitted.
  • this method first needs to perform CFAR, MUSIC angle measurement, clustering and other algorithms for static reflection points. The computational complexity of these algorithms is high, which will increase the performance requirements of the processor and cause costs. high.
  • the present application also provides a guardrail detection method based on millimeter wave radar, which uses distance Doppler information and the hidden relationship between the guardrail space position and the vehicle speed to detect and fit the guardrail.
  • Using this detection method can greatly improve the radar's ability to detect and fit guardrails without increasing the cost of radar hardware and antenna performance.
  • the computational complexity of the detection method is far less than that of the traditional method.
  • the guardrail detection method will be described below with reference to FIGS. 6 to 10.
  • FIG. 6 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to another embodiment of the present invention
  • FIG. 7 shows a schematic diagram of the coordinate system definition in the fitting method shown in FIG. 6
  • Fig. 9 shows a schematic diagram of filtering the guardrail recognition area of the distance Doppler image
  • Fig. 10 shows the coordinate transformation of the filtered pixels in Fig. 9 Schematic.
  • the method for calculating the lateral distance of the guardrail reflection point is:
  • the true relative speed V real between it and the radar is the speed of the vehicle.
  • the size and direction of the vehicle are opposite to the direction of the speed of the vehicle. That is, the following relationship is satisfied:
  • the radar reflection point velocity V doppier actually measured by the radar is the component of V real between the radar center and the reflection point. This velocity is called the radial velocity.
  • the distance R radial of the guardrail reflection point actually measured by the radar is the distance between the guardrail reflection point and the center of the radar. This distance is called the radial distance.
  • the lateral distance R x of the reflection point of the guardrail, the radial distance R radial , the radial speed V doppier and the self-vehicle speed V vehicle satisfy the following relationship (sine and cosine formula)
  • the lateral distance R x can be calculated by the following formula:
  • the method disclosed in this embodiment includes:
  • Step 401 Process the echo signal to obtain a range Doppler image.
  • the range Doppler image is an image obtained by performing two-dimensional FFT processing on the radar receiving end intermediate frequency time domain signal modulated according to the fast sawtooth waveform, as shown in the left image in Figure 9, the horizontal axis represents the distance, The vertical axis represents speed.
  • the x coordinate of each pixel represents the radial distance between the reflection point and the radar, the y coordinate represents the radial relative velocity between the reflection point and the radar (Doppler effect), and the value represents the reflection intensity of the reflection point .
  • the color in the range Doppler image represents the reflection intensity.
  • red and blue are used as an example. The redder means the stronger the reflection intensity, and the bluer means the weaker the reflection intensity.
  • Step 402 Determine a guardrail recognition area on the distance Doppler image based on the vehicle speed.
  • the curve in the box is generated by the guardrail, and the curve equation can be derived from Equation 1.
  • Equation 3 the curve relationship between V doppier and R radial can be obtained. It can also be seen from Equation 3 that the guardrail curve on the range Doppler image is determined by two parameters, R x and V vehicle.
  • the method for determining the guardrail recognition area on the distance Doppler image based on the vehicle speed is: firstly, define the maximum speed of the pixels in the guardrail recognition area based on the vehicle speed; then, based on the vehicle speed Speed defines the minimum speed of pixels in the guardrail recognition area; next, set the maximum distance of pixels in the guardrail recognition area; next, set the minimum distance of pixels in the guardrail recognition area; finally, according to the maximum speed, minimum speed, The maximum distance and the minimum distance determine the guardrail recognition area.
  • the maximum speed V max of the pixel in the guardrail recognition area is the vehicle speed V vehicle minus the preset value V offset
  • the minimum speed is the vehicle speed V vehicle multiplied by the preset value A
  • the set maximum distance and minimum are R max and R min respectively
  • the guardrail recognition area is expressed as:
  • V max V vehicle -V offset
  • V min V vehicle *A
  • V offset , A, B, and C are preset values, which can be determined based on experience or experiment.
  • V offset is set to 2m/s, 3m/s, 4m/s, etc.
  • A is set to 0.4
  • B is 3, 4, 5, 6, and C is 50, 60, 70, 80, etc.
  • the specific values of V offset , A, B, and C are not limited here.
  • the guardrail recognition area can be determined on the distance Doppler image through the above-mentioned relational expression.
  • the box area in the left figure in FIG. 9 is the guardrail recognition area.
  • Some of the pixels in this area are reflection points of the guardrail, and some are not.
  • Step 403 Perform filtering processing on the pixels in the guardrail recognition area on the range Doppler image according to the reflection intensity, so as to retain the pixels whose reflection intensity exceeds a threshold value as the guardrail reflection points.
  • the pixels in the guardrail recognition area are filtered according to the reflection intensity, so as to retain the pixels whose reflection intensity exceeds the threshold as the guardrail Reflection point.
  • the reflection intensity filtering is performed according to the distance-reflection intensity characteristic curve of the guardrail, and only the pixels whose reflection intensity exceeds the threshold are left. point.
  • the guardrail reflection point can be obtained by filtering the pixel points in the guardrail recognition area on the distance Doppler image according to the reflection intensity.
  • Step 404 Map the pixel points whose reflection intensity exceeds the threshold value to map the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin.
  • the reflection point of the guardrail is mapped according to formula 2, and the pixel point representing the reflection point of the guardrail is mapped from the distance Doppler coordinate system to the vehicle-mounted radar as shown in Figure 7.
  • the Cartesian coordinate system in order to finally do curve fitting to the mapped pixels for guardrail fitting.
  • the lateral distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin is determined according to the speed of the guardrail reflection point measured by the radar, the driving speed of the vehicle, and the distance between the guardrail reflection point measured by the radar and the radar center.
  • R x and the longitudinal distance R y are determined according to the speed of the guardrail reflection point measured by the radar, the driving speed of the vehicle, and the distance between the guardrail reflection point measured by the radar and the radar center.
  • the lateral distance R x of each guardrail reflection point in the Cartesian coordinate system with the radar as the origin is determined according to the following formula,
  • R radial is the radial distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin (that is, the distance from the guardrail reflection point to the radar center measured by the radar), and V doppier is the speed of the guardrail reflection point measured by the radar , V vehicle is the driving speed of the vehicle.
  • Step 405 Fit the guardrail according to the lateral distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin to determine the guardrail model.
  • the curve model can be a straight line, a circle, or a clothoid curve.
  • the guardrail detection method according to this embodiment can realize the detection and recognition of the guardrail by the radar without increasing the cost of radar hardware and the complexity of antenna design. Compared with traditional methods, this scheme has the advantages of low computational complexity, strong robustness, and does not rely on angle measurement accuracy, and can greatly improve the radar's ability to detect guardrails. Compared with the traditional method, the guardrail fitting method according to this embodiment greatly increases the detection accuracy of the guardrail and greatly reduces the computational complexity.
  • this application proposes a new vehicle-mounted millimeter-wave radar to determine whether the target is in its own lane, without adding radar hardware and processors, and without relying on other sensors (such as visual sensors such as cameras)
  • the vehicle-mounted millimeter-wave radar can greatly improve the accuracy of determining whether the target is in the lane in a curve.
  • FIG. 11 shows a schematic flowchart of a method for evaluating a target own lane based on guardrail recognition according to another embodiment of the present invention.
  • the method disclosed in this embodiment includes:
  • step 501 the curve parameter is obtained by fitting a cyclotron curve model according to the reflection point of the guardrail.
  • the guardrail reflection point can be obtained based on the radar echo signal according to the method disclosed in the foregoing embodiment or other methods.
  • the curve parameters are obtained by fitting according to the cyclotron curve model.
  • the curve parameters are obtained by performing curve fitting, for example, by the least square method or the like.
  • each guardrail reflection point in the Cartesian coordinate system of the car body (the center of the front is the origin, the forward direction of the car is the positive direction of the y-axis, and the right side of the car is the positive direction of the x-axis to establish the coordinate system) and
  • the number of reflection points of the guardrail is fitted according to the cyclotron curve model to obtain the curve parameters a, b and c.
  • Step 502 Calculate the distance between the vehicle and the guardrail fitting curve.
  • the distance between the vehicle and the guardrail fitting curve is determined according to the curve parameter.
  • the distance between the vehicle and the guardrail fitting curve is equal to the curve equal to c.
  • Step 503 Calculate the distance between the target and the fitting curve of the guardrail.
  • the distance between the target and the fitting curve of the guardrail is determined according to the clothoid curve model and curve parameters, as well as the ordinate and abscissa of the target.
  • Step 504 Calculate the current cycle lane evaluation value of the target according to the distance between the vehicle and the guardrail fitting curve and the distance between the target and the guardrail fitting curve.
  • the vehicle lane evaluation value of the current update cycle of the target is determined according to the distance between the vehicle and the guardrail fitting curve, the distance between the target and the guardrail fitting curve, and the lane distance determination threshold.
  • the threshold for determining the distance of the self-lane can be determined based on experience, such as 1.5 meters, 1.64 meters, 1.75 meters, 1.82 meters, and so on.
  • Step 505 Smooth the evaluation value of the target's current cycle self-lane to obtain the target current cycle smooth value.
  • the smoothing coefficient can be determined empirically, for example, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8 or 0.9.
  • Step 506 Determine whether the target is in the lane where the vehicle is located according to the current cycle smooth value of the target.
  • the target current cycle smoothing value is greater than the set threshold, it is determined that the target is in the lane where the vehicle is located, otherwise it is considered that the target is not in the lane where the vehicle is located.
  • the set threshold can be determined based on experience or experiment, for example, it can be 50, 60, 70, or 80.
  • the ability to judge whether the target is in the own lane in a curve scene has been greatly improved, and the rate of false alarms and missed detections has been greatly reduced. That is, the vehicle-mounted millimeter-wave radar has greatly increased its ability to judge whether the target is in its own lane when turning, thereby improving the robustness of the entire ADAS and AD system and improving the user experience.
  • Fig. 12 shows a schematic block diagram of a guardrail detection device based on millimeter wave radar according to an embodiment of the present invention.
  • the guardrail detection device 600 based on millimeter wave radar of this embodiment includes a millimeter wave radar sensor 610, a memory 620 and a processor 630.
  • the millimeter wave radar sensor 610 is used to transmit millimeter waves to the target area and receive the millimeter wave echo signals reflected by objects in the target area.
  • the millimeter wave radar sensor 610 can also process the echo signal to obtain the detection result or the reflection point of the guardrail.
  • the millimeter wave radar sensor 610 includes, for example, a line, a transceiver module, and a signal processing module.
  • the transceiver module includes, for example, a linear VCO, an amplifier, a balanced mixer, and the like.
  • the millimeter wave radar sensor may also include other structures.
  • One or more memories 620 are used to store one or more computer programs.
  • the one or more memories 530 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory.
  • the volatile memory may include random access memory (RAM) and/or cache memory (cache), for example.
  • the non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory and other permanent memories.
  • One or more computer program instructions can be stored on the computer-readable storage medium, and the processor can run the program instructions to implement the control method in the above-mentioned embodiment of the present invention (implemented by the processor) and / Or other desired functions.
  • Various application programs and various data such as various data used and/or generated by the application program, can also be stored in the computer-readable storage medium.
  • the one or more processors 630 may be a central processing unit (CPU) or other forms of processing units with data processing capability and/or instruction execution capability, such as a microcontroller (MCU), and may control the guardrail fitting system 600 Other components to perform the desired functions.
  • CPU central processing unit
  • MCU microcontroller
  • the processor 630 may be the processor of the millimeter-wave radar sensor 610 itself; and in some embodiments, the processor 630 may also be a processor external to the millimeter-wave radar sensor 610, which is different from the millimeter wave radar sensor 610.
  • the wave radar sensor 610 is connected and processes the data generated by the millimeter wave radar sensor 610.
  • the processor 630 is the processor of the vehicle itself, rather than the processor inside the millimeter wave radar sensor 610.
  • the one or more processors 630 execute the following steps:
  • the guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
  • determining the guardrail model according to the guardrail reflection point includes:
  • the guardrail model with the smallest fitting residual is selected from all guardrail models as the currently detected guardrail model.
  • the characterizing parameter includes the parameters of the guardrail model and the coordinates of the starting point and the ending point in the reflection point of the guardrail.
  • processing the echo signal to obtain the reflection point of the guardrail includes:
  • the reflection points of the guardrail are screened out from the detection results according to the characteristics of the guardrail.
  • screening out the reflection points of the guardrail from the detection result according to the characteristics of the guardrail includes:
  • the reflection point is stationary with respect to the ground and the distance between the reflection point and the adjacent reflection point is less than the set threshold, it is determined that the reflection point is a guardrail reflection point.
  • processing the echo signal to obtain the reflection point of the guardrail includes:
  • Filtering processing is performed on the pixel points in the guardrail recognition area on the distance Doppler image according to the reflection intensity, so as to retain the pixel points whose reflection intensity exceeds a threshold value as the guardrail reflection point.
  • determining the guardrail recognition area on the distance Doppler image based on the vehicle speed includes:
  • the guardrail recognition area is determined according to the maximum speed, minimum speed, maximum distance and minimum distance.
  • the pixel points whose reflection intensity exceeds the threshold value are mapped to map the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin.
  • mapping the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin includes:
  • the method further includes: fitting the guardrail according to the lateral distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin to determine the guardrail model.
  • the processor is further configured to:
  • the curve parameters are obtained by fitting the cyclotron curve model
  • the target current cycle smoothing value is greater than the set threshold, it is determined that the target is in the lane where the vehicle is located, otherwise it is considered that the target is not in the lane where the vehicle is located.
  • the curve parameters are obtained by fitting according to the cyclotron curve model
  • the distance between the target and the fitting curve of the guardrail is determined according to the clothoid curve model and curve parameters, as well as the ordinate and abscissa of the target.
  • the self-lane evaluation value of the current update cycle of the target is determined according to the distance between the vehicle and the guardrail fitting curve, the distance between the target and the guardrail fitting curve, and the self-lane distance determination threshold.
  • the target current period smoothing value is determined according to the evaluation value of the own lane in the current update period, the smooth value of the previous period, and the smoothing coefficient.
  • the preset guardrail model includes a straight line model, a quadratic polynomial model, a circular curve model or a clothoid curve model.
  • the processor is further configured to:
  • a schematic diagram of the guardrail is generated based on the parameters of the guardrail model with the smallest fitting residual and the coordinates of the start point and the end point in the reflection point of the guardrail.
  • the current guardrail is represented by the characteristic parameters of the current guardrail, so that the data output pressure of the reflection point of the guardrail can be effectively reduced.
  • the guardrail detection device can realize effective radar detection of the guardrail, the detection accuracy response is improved, and the calculation complexity response is reduced.
  • the detection device has a great improvement in its ability to judge whether the target is in its own lane in a curve scene, and the rate of false alarms and missed detections has been greatly reduced.
  • a guardrail detection device based on millimeter wave radar includes a storage device and a processor.
  • a computer program run by the processor, and the computer program executes the method provided in the foregoing embodiment of the present invention when the computer program is run by the processor.
  • a storage medium on which program instructions are stored, which are used to execute the control method of the embodiment of the present invention when the program instructions are run by a computer or a processor.
  • the corresponding steps are used to implement the corresponding modules in the devices of the control system according to the embodiment of the present invention.
  • the storage medium may include, for example, a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), USB memory, or any combination of the above storage media.
  • the computer-readable storage medium may be any combination of one or more computer-readable storage media.
  • the computer program instructions execute the following steps when run by the computer: transmit millimeter wave radar signals and receive echo signals reflected by the target; process the echo signals to obtain the guardrail reflection point;
  • the guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
  • the computer program instructions execute the following steps when being run by a computer: process the echo signal to obtain a range Doppler image; determine guardrail recognition on the range Doppler image based on the vehicle speed Area; filtering the pixels in the guardrail recognition area on the distance Doppler image according to the reflection intensity, so as to retain the pixel points whose reflection intensity exceeds a threshold value as the guardrail reflection point.
  • the computer program instructions execute the following steps when being run by a computer: according to the reflection point of the guardrail, fitting the curve model to obtain the curve parameters; calculating the distance between the vehicle and the guardrail fitting curve; calculating the target and the guardrail simulation Calculate the current cycle self-lane evaluation value of the target according to the distance between the vehicle and the guardrail fitting curve and the distance between the target and the guardrail fitting curve; smooth the current cycle self-lane evaluation value P of the target to obtain the current cycle of the target Smoothing value; judge whether the target is in the lane where the vehicle is located according to the current period smooth value of the target. If the current period smoothing value of the target is greater than the set threshold, it is determined that the target is in the lane where the vehicle is located, otherwise the target is considered not where the vehicle is located On the driveway.
  • the modules in the control system according to the embodiment of the present invention can be implemented by the processor of the electronic device according to the embodiment of the present invention running computer program instructions stored in the memory, or can be implemented in the computer program product according to the embodiment of the present invention.
  • the computer instructions stored in the computer-readable storage medium are implemented when the computer runs.
  • a movable platform which includes the guardrail fitting system or guardrail fitting device according to the embodiment of the present invention.
  • the movable platform includes a car.
  • the current guardrail is represented by the current guardrail characteristic parameters, thereby effectively reducing the data output pressure of the guardrail reflection point.
  • the disclosed device and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another device, or some features can be ignored or not implemented.
  • the various component embodiments of the present invention may be implemented by hardware, or by software modules running on one or more processors, or by a combination of them.
  • a microprocessor or a digital signal processor may be used in practice to implement some or all of the functions of some modules according to the embodiments of the present invention.
  • the present invention can also be implemented as a device program (for example, a computer program and a computer program product) for executing part or all of the methods described herein.
  • a program for realizing the present invention may be stored on a computer-readable medium, or may have the form of one or more signals.
  • Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

Abstract

A millimeter wave radar-based guardrail detection method and device (100), a storage medium, and a movable platform. The guardrail fitting method comprises: emitting a millimeter wave radar signal, and receiving an echo signal reflected by a target (201); processing the echo signal to obtain a guardrail reflection point (202); and determining a guardrail model according to the guardrail reflection point, and then determining and outputting a characterization parameter of the current guardrail for representing the current guardrail (203). According to the method, the current guardrail is represented by the characterization parameter of the current guardrail, so that the data output pressure of the guardrail reflection point can be effectively reduced.

Description

护栏检测方法及设备、存储介质和可移动平台Guardrail detection method and equipment, storage medium and movable platform
说明书Manual
技术领域Technical field
本发明涉及护栏检测和拟合技术领域,更具体地涉及一种基于毫米波雷达的护栏检测方法及设备、存储介质和可移动平台。The invention relates to the technical field of guardrail detection and fitting, and more specifically to a guardrail detection method and equipment based on millimeter wave radar, a storage medium and a movable platform.
背景技术Background technique
近年来毫米波雷达凭借其独特的全天时、全天候特点,加上作用距离远和测速精度高等优点,在汽车自动驾驶领域的应用越来越多。毫米波雷达对于道路两侧护栏的检测和拟合能够为自动驾驶或辅助驾驶提供诸多帮助,例如目标车位于自车道概率的计算、车辆可通行区域检测、降低护栏外目标虚警等作用。而护栏在毫米波雷达检测结果中呈现为数量很多的反射点,若全部输出这些护栏反射点会带来较大的数据输出压力。另一方面,护栏的形状随道路弯曲变化而变化,因此单一的护栏拟合模型无法满足需求。In recent years, millimeter-wave radar has been used more and more in the field of auto driving due to its unique all-time and all-weather characteristics, plus the advantages of long range and high speed measurement accuracy. The detection and fitting of the guardrail on both sides of the road by the millimeter wave radar can provide a lot of help for automatic driving or assisted driving, such as the calculation of the probability of the target vehicle in its own lane, the detection of the vehicle passable area, and the reduction of false alarms of targets outside the guardrail. However, the guardrail appears as a large number of reflection points in the detection result of the millimeter wave radar. If all these guardrail reflection points are output, it will bring greater data output pressure. On the other hand, the shape of the guardrail changes with the curve of the road, so a single guardrail fitting model cannot meet the demand.
发明内容Summary of the invention
为了解决上述问题中的至少一个而提出了本发明。本发明提供一种基于毫米波雷达的护栏检测方法及设备、存储介质和可移动平台,其以当前护栏的表征参数代替来表示当前护栏,从而能够有效降低护栏反射点的数据输出压力。The present invention is proposed in order to solve at least one of the above-mentioned problems. The present invention provides a guardrail detection method and equipment based on millimeter wave radar, a storage medium and a movable platform, which replace the current guardrail with characterization parameters of the current guardrail, thereby effectively reducing the data output pressure of the guardrail reflection point.
具体地,本发明实施例提供一种基于毫米波雷达的护栏检测方法,其包括:Specifically, the embodiment of the present invention provides a guardrail detection method based on millimeter wave radar, which includes:
发射毫米波雷达信号,并接收目标反射的回波信号;Transmit millimeter-wave radar signals and receive echo signals reflected by the target;
对所述回波信号进行处理,以得到护栏反射点;Processing the echo signal to obtain the reflection point of the guardrail;
根据所述护栏反射点确定护栏模型,进而确定并输出当前护栏的表征参数来表示当前护栏。The guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
本发明实施例还提供一种基于毫米波雷达的护栏检测设备,其包括:The embodiment of the present invention also provides a guardrail detection device based on millimeter wave radar, which includes:
毫米波雷达传感器,所述毫米波雷达传感器用于向目标区域发射毫米波,并接收目标区域内的物体反射回的毫米波回波信号;Millimeter wave radar sensor, the millimeter wave radar sensor is used to transmit millimeter waves to the target area, and receive the millimeter wave echo signals reflected back by objects in the target area;
处理器,所述处理器配置为对所述回波信号进行处理,以得到护栏反射点;A processor, the processor is configured to process the echo signal to obtain a guardrail reflection point;
根据所述护栏反射点确定护栏模型,进而确定并输出当前护栏的表征参数来表示当前护栏。The guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
本发明实施例还提供一种存储介质,所述存储介质上存储有计算机程序,所述计算机程序在运行时执行如上所述的方法。An embodiment of the present invention also provides a storage medium, and a computer program is stored on the storage medium, and the computer program executes the above-mentioned method when running.
本发明实施例还提供一种可移动平台,其包括上述的护栏拟合系统。The embodiment of the present invention also provides a movable platform, which includes the guardrail fitting system described above.
本发明实施例提供了一种基于毫米波雷达的护栏检测方法及设备、存储介质和可移动平台,其以当前护栏的表征参数代替来表示当前护栏,从而能够有效降低护栏反射点的数据输出压力。The embodiment of the present invention provides a guardrail detection method and equipment based on millimeter wave radar, a storage medium, and a movable platform, which replace the current guardrail with the characteristic parameters of the current guardrail, thereby effectively reducing the data output pressure of the guardrail reflection point .
附图说明Description of the drawings
图1示出用于实现根据本发明实施例的基于毫米波雷达的护栏拟合方法及系统的示例电子设备的示意性框图;Fig. 1 shows a schematic block diagram of an exemplary electronic device for implementing a millimeter-wave radar-based guardrail fitting method and system according to an embodiment of the present invention;
图2示出根据本发明一实施例的基于毫米波雷达的护栏检测方法的示意性流程图;2 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to an embodiment of the present invention;
图3示出雷达传感器检测两侧护栏的示意图;Figure 3 shows a schematic diagram of radar sensors detecting guardrails on both sides;
图4示出根据本发明另一实施例的基于毫米波雷达的护栏检测方法的示意性流程图;4 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to another embodiment of the present invention;
图5示出护栏在雷达检测结果中呈现的反射点的示意图;Figure 5 shows a schematic diagram of the reflection points of the guardrail in the radar detection result;
图6示出根据本发明又一实施例的基于毫米波雷达的护栏检测方法的示意性流程图;6 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to another embodiment of the present invention;
图7示出图6所示拟合方法中坐标系定义示意图;Fig. 7 shows a schematic diagram of the coordinate system definition in the fitting method shown in Fig. 6;
图8示出图6所示检测方法中护栏反射点距离和速度的计算示意图;FIG. 8 shows a schematic diagram of calculating the distance and speed of the reflection point of the guardrail in the detection method shown in FIG. 6;
图9示出对距离多普勒图像的护栏识别区域进行滤波的示意图;FIG. 9 shows a schematic diagram of filtering the guardrail recognition area of the distance Doppler image;
图10示出对图9中经过滤波的像素进行坐标变换的示意图;Fig. 10 shows a schematic diagram of performing coordinate transformation on the filtered pixels in Fig. 9;
图11示出根据本发明又一实施例的基于护栏识别的目标自车道评价方法的示意性流程图;FIG. 11 shows a schematic flowchart of a method for evaluating a target own lane based on guardrail recognition according to another embodiment of the present invention;
图12示出根据本发明一实施例的基于毫米波雷达的护栏检测设备的示意性框图。Fig. 12 shows a schematic block diagram of a guardrail detection device based on millimeter wave radar according to an embodiment of the present invention.
具体实施方式Detailed ways
为了使得本发明的目的、技术方案和优点更为明显,下面将参照附图详细描述根据本发明的示例实施例。显然,所描述的实施例仅仅是本发明的一部分实施例,而不是本发明的全部实施例,应理解,本发明不受这里描述的示例实施例的限制。基于本发明中描述的本发明实施例,本领域技术人员在没有付出创造性劳动的情况下所得到的所有其它实施例都应落入本发明的保护范围之内。In order to make the objectives, technical solutions, and advantages of the present invention more obvious, the exemplary embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments of the present invention, and it should be understood that the present invention is not limited by the exemplary embodiments described herein. Based on the embodiments of the present invention described in the present invention, all other embodiments obtained by those skilled in the art without creative work should fall within the protection scope of the present invention.
在下文的描述中,给出了大量具体的细节以便提供对本发明更为彻底的理解。然而,对于本领域技术人员而言显而易见的是,本发明可以无需一个或多个这些细节而得以实施。在其他的例子中,为了避免与本发明发生混淆,对于本领域公知的一些技术特征未进行描述。In the following description, a lot of specific details are given in order to provide a more thorough understanding of the present invention. However, it is obvious to those skilled in the art that the present invention can be implemented without one or more of these details. In other examples, in order to avoid confusion with the present invention, some technical features known in the art are not described.
应当理解的是,本发明能够以不同形式实施,而不应当解释为局限于这里提出的实施例。相反地,提供这些实施例将使公开彻底和完全,并且将本发明的范围完全地传递给本领域技术人员。It should be understood that the present invention can be implemented in different forms and should not be construed as being limited to the embodiments presented here. On the contrary, the provision of these embodiments will make the disclosure thorough and complete, and will fully convey the scope of the present invention to those skilled in the art.
在此使用的术语的目的仅在于描述具体实施例并且不作为本发明的限制。在此使用时,单数形式的“一”、“一个”和“所述/该”也意图包括复数形式,除非上下文清楚指出另外的方式。还应明白术语“组成”和/或“包括”,当在该说明书中使用时,确定所述特征、整数、步骤、操作、元件和/或部件的存在,但不排除一个或更多其它的特征、整数、步骤、操作、元件、部件和/或组的存在或添加。在此使用时,术语“和/或”包括相关所列项目的任何及所有组合。The purpose of the terms used here is only to describe specific embodiments and not as a limitation of the present invention. When used herein, the singular forms "a", "an" and "the/the" are also intended to include plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "composition" and/or "including", when used in this specification, determine the existence of the described features, integers, steps, operations, elements and/or components, but do not exclude one or more other The existence or addition of features, integers, steps, operations, elements, parts, and/or groups. As used herein, the term "and/or" includes any and all combinations of related listed items.
为了彻底理解本发明,将在下列的描述中提出详细的步骤以及详细的结构,以便阐释本发明提出的技术方案,然而除了这些详细描述外,本发明还可以具有其他实施方式。In order to thoroughly understand the present invention, detailed steps and detailed structures will be presented in the following description to explain the technical solutions proposed by the present invention. However, in addition to these detailed descriptions, the present invention may also have other embodiments.
首先,参照图1来描述用于实现根据本发明实施例的基于毫米波雷达的护栏检测方法及设备的示例电子设备的示例电子设备100。如图1所示,电子设备100包括一个或多个处理器102、一个或多个存储装置104、输入 /输出装置106、通信接口108以及雷达传感器110,这些组件通过总线系统112和/或其它形式的连接机构(未示出)互连。应当注意,图1所示的电子设备100的组件和结构只是示例性的,而非限制性的,根据需要,所述电子设备也可以具有其他组件和结构,也可以不包括前述的部分组件。First, with reference to FIG. 1, an example electronic device 100 for implementing an example electronic device of a millimeter wave radar-based guardrail detection method and device according to an embodiment of the present invention will be described. As shown in FIG. 1, the electronic device 100 includes one or more processors 102, one or more storage devices 104, an input/output device 106, a communication interface 108, and a radar sensor 110. These components pass through a bus system 112 and/or other components. A form of connection mechanism (not shown) is interconnected. It should be noted that the components and structure of the electronic device 100 shown in FIG. 1 are only exemplary and not restrictive. According to needs, the electronic device may also have other components and structures, or may not include some of the aforementioned components.
所述处理器102一般表示任何类型或形式的能够处理数据或解释和执行指令的处理单元。一般而言,处理器可以是中央处理单元(CPU)、图像处理单元(GPU)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)、编码器、图像信号处理器(ISP),或者具有数据处理能力和/或指令执行能力的其它形式的处理单元,并且可以控制所述电子设备100中的其它组件以执行期望的功能。例如,处理器102能够包括一个或多个嵌入式处理器、处理器核心、微型处理器、逻辑电路、硬件有限状态机(FSM)、数字信号处理器(DSP)或它们的组合。在特定实施例中,处理器102可以接收来自软件应用或模块的指令。这些指令可以导致处理器102完成本文描述和/或示出的用于度设备混合导航的方法和自移动设备与方法。The processor 102 generally represents any type or form of processing unit capable of processing data or interpreting and executing instructions. Generally speaking, the processor can be a central processing unit (CPU), an image processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), an encoder, an image signal processor (ISP), or Other forms of processing units having data processing capabilities and/or instruction execution capabilities, and can control other components in the electronic device 100 to perform desired functions. For example, the processor 102 can include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware finite state machines (FSM), digital signal processors (DSP), or combinations thereof. In certain embodiments, the processor 102 may receive instructions from software applications or modules. These instructions may cause the processor 102 to complete the method described and/or shown herein for hybrid navigation of a degree device and the self-moving device and method.
所述存储装置104可以包括一个或多个计算机程序产品,所述计算机程序产品可以包括各种形式的计算机可读存储介质,例如易失性存储器和/或非易失性存储器。所述易失性存储器例如可以包括随机存取存储器The storage device 104 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include random access memory, for example
(RAM)和/或高速缓冲存储器(cache)等。所述非易失性存储器例如可以包括只读存储器(ROM)、硬盘、闪存等。在所述计算机可读存储介质上可以存储一个或多个计算机程序指令,处理器102可以运行所述程序指令,以实现下文所述的本发明实施例中(由处理器实现)的客户端功能以及/或者其它期望的功能。在所述计算机可读存储介质中还可以存储各种应用程序和各种数据,例如所述应用程序使用和/或产生的各种数据等。(RAM) and/or high-speed buffer memory (cache), etc. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 102 may run the program instructions to implement the client functions (implemented by the processor) in the embodiments of the present invention described below. And/or other desired functions. Various application programs and various data, such as various data used and/or generated by the application program, can also be stored in the computer-readable storage medium.
所述输入/输出装置106可以是用户用来输入指令和向外部输出各种信息的装置,例如输入装置可以包括键盘、鼠标、麦克风和触摸屏等中的一个或多个。输出装置可以包括显示器、扬声器等中的一个或多个。The input/output device 106 may be a device used by the user to input instructions and output various information to the outside. For example, the input device may include one or more of a keyboard, a mouse, a microphone, and a touch screen. The output device may include one or more of a display, a speaker, and the like.
通信接口108广泛地表示任何类型或形式的能够促进示例电子设备100和一个或多个附加设备之间的通信的适配器或通信设备。例如,通信接口108可以促进电子设备100和前端或附件电子设备以及后端服务器或云端的通信。通信接口108的示例包括但不限于有线网络接口(诸如网络 接口卡)、无线网络接口(诸如无线网络接口卡)、调制解调器、通用串行接口(USB)、HDMI接口和任何其他合适的接口。在一实施例中,通信接口108通过与诸如因特网的网络的直连提供到远程服务器/远程前端设备的直连。在特定实施例中,通信接口108通过与专用网络等网络的直连提供到远程服务器/远程前端设备的直连。通信接口108还可以间接提供这种通过任何其它合适连接的连接。The communication interface 108 broadly represents any type or form of adapter or communication device capable of facilitating communication between the example electronic device 100 and one or more additional devices. For example, the communication interface 108 can facilitate communication between the electronic device 100 and a front-end or accessory electronic device, and a back-end server or cloud. Examples of the communication interface 108 include, but are not limited to, a wired network interface (such as a network interface card), a wireless network interface (such as a wireless network interface card), a modem, a universal serial interface (USB), an HDMI interface, and any other suitable interface. In an embodiment, the communication interface 108 provides a direct connection to a remote server/remote head-end device through a direct connection to a network such as the Internet. In a specific embodiment, the communication interface 108 provides a direct connection to a remote server/remote front-end device through a direct connection to a network such as a private network. The communication interface 108 may also indirectly provide such a connection through any other suitable connection.
雷达传感器110可以为各种合适的雷达传感器。示例性地,在本实施例中,雷达传感器110为毫米波雷达传感器,毫米波雷达传感器例如包括线、收发模块和信号处理模块,收发模块例如包括线性VCO、放大器、平衡混频器等,当然毫米波雷达传感器还可以包括其它结构,本申请对雷达传感器110的结构不做特别限定。The radar sensor 110 may be various suitable radar sensors. Exemplarily, in this embodiment, the radar sensor 110 is a millimeter wave radar sensor. The millimeter wave radar sensor includes, for example, a line, a transceiver module, and a signal processing module. The transceiver module includes, for example, a linear VCO, an amplifier, a balanced mixer, etc., of course. The millimeter wave radar sensor may also include other structures, and the structure of the radar sensor 110 is not particularly limited in this application.
如前所述,道路旁的护栏会在毫米波雷达中形成数量很多的反射点,通常来说毫米波雷达系统受限于处理能力和内存容量,能够检测输出的反射点数目有限,过多的护栏散射点会减少对其他感兴趣目标(例如位于盲区的车辆)的检测能力。同时,过多的反射点数目会带来较大的数据输出压力。本申请基于此,提出一种基于毫米波雷达的护栏拟合方法,以降低数据输出压力。下面结合图2至图5对本发明实施例的基于毫米波雷达的护栏检测方法进行描述。As mentioned above, the guardrail beside the road will form a large number of reflection points in the millimeter wave radar. Generally speaking, the millimeter wave radar system is limited by the processing power and memory capacity, and the number of reflection points that can detect the output is limited. Scattering points on the guardrail will reduce the ability to detect other objects of interest (for example, vehicles in blind spots). At the same time, too many reflection points will bring greater data output pressure. Based on this, this application proposes a guardrail fitting method based on millimeter wave radar to reduce data output pressure. The following describes the guardrail detection method based on the millimeter wave radar according to the embodiment of the present invention with reference to FIGS. 2 to 5.
需要说明的是,本申请中的护栏,可以包括道路一侧或两侧的,或道路中间车道一侧或两侧的,延续状的障碍物,具体的可以例如高速公路两侧的石墩、双向车道中间分隔的栅栏、道路临时维修所摆放的连续警示路障等,本发明对护栏的具体形式并不作限制。It should be noted that the guardrail in this application can include continuous obstacles on one or both sides of the road, or on one or both sides of the middle lane of the road, and specifically can be, for example, stone piers on both sides of a highway, The fences separated in the middle of the two-way lanes, the continuous warning roadblocks placed for temporary road maintenance, etc., the present invention does not limit the specific form of the guardrails.
图2示出根据本发明一实施例的基于毫米波雷达的护栏检测方法的示意性流程图;图3示出雷达传感器检测两侧护栏的示意图。Fig. 2 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to an embodiment of the present invention; Fig. 3 shows a schematic diagram of a radar sensor detecting guardrails on both sides.
如图2所示,本实施公开的方法包括:As shown in Figure 2, the method disclosed in this embodiment includes:
步骤201,发射毫米波雷达信号,并接收目标反射的回波信号。Step 201: Transmit a millimeter wave radar signal, and receive an echo signal reflected by the target.
示例性地,通过毫米波雷达传感器发射毫米波信号,并接收目标反射的回波信号,毫米波雷达传感器的检测范围如图3所示。Exemplarily, the millimeter wave signal is transmitted by the millimeter wave radar sensor and the echo signal reflected by the target is received. The detection range of the millimeter wave radar sensor is shown in FIG. 3.
步骤202,对所述回波信号进行处理,以得到护栏反射点。In step 202, the echo signal is processed to obtain the reflection point of the guardrail.
示例性地,采用各种合适的回波信号处理方法,从而基于回波信号得 到护栏反射点。得到的护栏反射点可以包括护栏在雷达检测坐标系中的坐标或者与车辆的距离等参数。Exemplarily, various suitable echo signal processing methods are used to obtain the guardrail reflection point based on the echo signal. The obtained reflection point of the guardrail may include parameters such as the coordinates of the guardrail in the radar detection coordinate system or the distance from the vehicle.
步骤203,根据所述护栏反射点确定护栏模型,进而确定并输出当前护栏的表征参数来表示当前护栏。Step 203: Determine the guardrail model according to the guardrail reflection point, and then determine and output the characteristic parameters of the current guardrail to represent the current guardrail.
当在步骤S202中得到护栏反射点,根据护栏反射点的参数,例如坐标等数据进行拟合,从而得到确定护栏模型以及该模型的参数,然后输出护栏的表征参数来表示当前护栏。When the guardrail reflection point is obtained in step S202, fitting is performed according to the parameters of the guardrail reflection point, such as coordinates and other data, so as to obtain the determined guardrail model and the parameters of the model, and then output the characteristic parameters of the guardrail to indicate the current guardrail.
示例性地,所述表征参数包括所述护栏模型的参数以所述护栏反射点中起始点和结束点的坐标。所述护栏模型的参数例如包括模型中的各系数的大小,示例性地,护栏模型为直线型y=ax+b,所述护栏参数包括a和b的大小,以及护栏反射点中起始点和结束点的坐标。通过护栏参数以及护栏反射点中起始点和结束点的坐标即可确定当前护栏的形状和位置。因为无需输出全部反射点来表示检测到的护栏,大大降低了数据输出压力,以避免影响雷达传感器对其他感兴趣目标的检测能力。Exemplarily, the characterizing parameter includes the parameters of the guardrail model and the coordinates of the starting point and the ending point in the reflection point of the guardrail. The parameters of the guardrail model include, for example, the size of each coefficient in the model. Illustratively, the guardrail model is linear y=ax+b, and the guardrail parameters include the sizes of a and b, and the starting point and The coordinates of the end point. The shape and position of the current guardrail can be determined by the guardrail parameters and the coordinates of the starting point and the end point in the guardrail reflection point. Because there is no need to output all reflection points to indicate the detected guardrail, the data output pressure is greatly reduced to avoid affecting the radar sensor's ability to detect other targets of interest.
图4示出根据本发明另一实施例的基于毫米波雷达的护栏检测方法的示意性流程图;图5示出护栏在雷达检测结果中呈现的反射点的示意图。Fig. 4 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to another embodiment of the present invention; Fig. 5 shows a schematic diagram of reflection points of the guardrail in the radar detection result.
如图4所示,本实施公开的方法包括:As shown in Figure 4, the method disclosed in this embodiment includes:
步骤401,发射毫米波雷达信号,并接收目标反射的回波信号。Step 401: Transmit a millimeter wave radar signal, and receive an echo signal reflected by the target.
示例性地,通过毫米波雷达传感器发射毫米波信号,并接收目标反射的回波信号,毫米波雷达传感器的检测范围如图3所示。Exemplarily, the millimeter wave signal is transmitted by the millimeter wave radar sensor and the echo signal reflected by the target is received. The detection range of the millimeter wave radar sensor is shown in FIG. 3.
步骤402,对所述回波信号进行处理得到对目标的检测结果,所述检测结果包括多个反射点。Step 402: Process the echo signal to obtain a detection result of the target, and the detection result includes a plurality of reflection points.
示例性地,可以采用本领域常用的处理方法来对所述回波信号进行处理得到对目标的检测结果,图5所示,护栏在毫米波雷达传感器的检测结果中呈现为数量很多的反射点。这些反射点有的是护栏反射点,有的不是。Exemplarily, a processing method commonly used in the art can be used to process the echo signal to obtain the detection result of the target. As shown in FIG. 5, the guardrail appears as a large number of reflection points in the detection result of the millimeter wave radar sensor. . Some of these reflection points are guardrail reflection points, and some are not.
步骤403,根据护栏特性从所述检测结果中筛选出护栏反射点。Step 403: Filter reflection points of the guardrail from the detection result according to the characteristics of the guardrail.
当在步骤402中得到反射点后,需要根据护栏特性从所述检测结果中筛选出护栏反射点。After the reflection points are obtained in step 402, the reflection points of the guardrail need to be filtered from the detection result according to the characteristics of the guardrail.
示例性地,根据护栏特性从所述检测结果中筛选出护栏反射点的方法为:首先,根据所述反射点对应的回波信号的信息确定所述反射点是否相 对地面静止。由于护栏相对地面静止,因此护栏反射点也相对地面静止。根据所述反射点对应的回波信号的信息可以确定该反射点的速度,进而根据该速度以及车辆速度可以确定该反射点相对地面的速度,如果该反射点相对地面速度为0,则表示该反射点可能为护栏反射点;反之则表示该反射点不是护栏反射点。Exemplarily, the method for screening the reflection points of the guardrail from the detection results according to the characteristics of the guardrail is as follows: First, determine whether the reflection point is stationary relative to the ground according to the information of the echo signal corresponding to the reflection point. Since the guardrail is stationary relative to the ground, the reflection point of the guardrail is also stationary relative to the ground. The speed of the reflection point can be determined according to the information of the echo signal corresponding to the reflection point, and then the speed of the reflection point relative to the ground can be determined according to the speed and the vehicle speed. If the relative ground speed of the reflection point is 0, it means that the reflection point is 0. The reflection point may be a guardrail reflection point; otherwise, it means that the reflection point is not a guardrail reflection point.
其次,所述反射点与相邻反射点之间的距离是否小于设定阈值。由于护栏所有反射点之间的相对距离都较近,因此通过判断所述反射点与相邻反射点之间的距离是否小于设定阈值可以判断该反射点是否为护栏反射点。示例性地,根据所述反射点对应的回波信号的信息可以确定该反射点的距离信息,例如与车辆的距离信息,然后根据各反射点的距离信息得到反射点与相邻反射点之间的距离,如果该反射点与相邻反射点之间的距离大于设定阈值,则表示该反射点与相邻反射点距离较远,可能不是护栏反射点,反之则是护栏反射点的可能性较大。Secondly, whether the distance between the reflection point and the adjacent reflection point is less than a set threshold. Since the relative distances between all reflection points of the guardrail are relatively close, it can be judged whether the reflection point is a guardrail reflection point by judging whether the distance between the reflection point and the adjacent reflection point is less than a set threshold. Exemplarily, the distance information of the reflection point can be determined according to the information of the echo signal corresponding to the reflection point, such as the distance information from the vehicle, and then the distance between the reflection point and the adjacent reflection point can be obtained according to the distance information of each reflection point. If the distance between the reflection point and the adjacent reflection point is greater than the set threshold, it means that the reflection point is far away from the adjacent reflection point, which may not be the reflection point of the guardrail, otherwise it is the possibility of the reflection point of the guardrail Larger.
最后,综上上述分析来确定反射点是否为护栏反射点。例如如果所述反射点相对地面静止,且与相邻反射点之间的距离小于设定阈值,则判定所述反射点为护栏反射点。Finally, the above analysis is combined to determine whether the reflection point is a guardrail reflection point. For example, if the reflection point is stationary relative to the ground and the distance between the reflection point and the adjacent reflection point is less than a set threshold, it is determined that the reflection point is a guardrail reflection point.
步骤404,根据所述护栏反射点确定护栏模型,进而确定并输出当前护栏的表征参数来表示当前护栏。Step 404: Determine a guardrail model according to the guardrail reflection point, and then determine and output the characteristic parameters of the current guardrail to represent the current guardrail.
当在步骤403中,从反射点确定护栏反射点后,根据护栏反射点的参数,例如坐标等数据进行拟合,从而得到确定护栏模型以及该模型的参数,然后输出护栏的表征参数来表示当前护栏。When in step 403, after determining the reflection point of the guardrail from the reflection point, fit according to the parameters of the reflection point of the guardrail, such as coordinates, etc., to obtain the determined guardrail model and the parameters of the model, and then output the characteristic parameters of the guardrail to indicate the current Guardrail.
示例性地,所述表征参数包括所述护栏模型的参数以所述护栏反射点中起始点和结束点的坐标。所述护栏模型的参数例如包括模型中的各系数的大小,示例性地,护栏模型为直线型y=ax+b,所述护栏参数包括a和b的大小,以及护栏反射点中起始点和结束点的坐标。通过护栏参数以及护栏反射点中起始点和结束点的坐标即可确定当前护栏的形状和位置。因为无需输出全部反射点来表示检测到的护栏,大大降低了数据输出压力,以避免影响雷达传感器对其他感兴趣目标的检测能力。Exemplarily, the characterizing parameter includes the parameters of the guardrail model and the coordinates of the starting point and the ending point in the reflection point of the guardrail. The parameters of the guardrail model include, for example, the size of each coefficient in the model. Illustratively, the guardrail model is linear y=ax+b, and the guardrail parameters include the sizes of a and b, and the starting point and The coordinates of the end point. The shape and position of the current guardrail can be determined by the guardrail parameters and the coordinates of the starting point and the end point in the guardrail reflection point. Because there is no need to output all reflection points to indicate the detected guardrail, the data output pressure is greatly reduced to avoid affecting the radar sensor's ability to detect other targets of interest.
进一步地,在本实施例中,为了避免单一护栏模型适用性差的问题,在本实施例中,预设多种护栏模型,并分别拟合,然后从中选出最优的护 栏模型。Further, in this embodiment, in order to avoid the problem of poor applicability of a single guardrail model, in this embodiment, multiple guardrail models are preset and fitted separately, and then the optimal guardrail model is selected.
示例性地,根据所述护栏反射点确定护栏模型的方法为:Exemplarily, the method for determining the guardrail model according to the guardrail reflection point is:
首先,对筛选出护栏反射点根据预设的护栏模型分别进行拟合,以得到每个护栏模型的参数以及拟合残差。即,根据护栏反射点的参数,例如坐标等数据对预设的护栏模型分别进行拟合,从而得到每个护栏模型的参数,然后计算每个护栏模型的拟合残差。示例性地,所述预设的护栏模型包括直线模型、二次多项式模型、圆曲线模型或回旋曲线模型。First, the screened guardrail reflection points are respectively fitted according to the preset guardrail models to obtain the parameters and fitting residuals of each guardrail model. That is, according to the parameters of the guardrail reflection point, such as coordinates, the preset guardrail models are respectively fitted to obtain the parameters of each guardrail model, and then the fitting residual of each guardrail model is calculated. Exemplarily, the preset guardrail model includes a straight line model, a quadratic polynomial model, a circular curve model, or a clothoid curve model.
其次,从所有护栏模型中选出拟合残差最小的护栏模型作为当前检测到的护栏的模型。当获得每个护栏模型的拟合残差之后,选择拟合残差最小的护栏模型作为前检测到的护栏的模型。Secondly, the guardrail model with the smallest fitting residual is selected from all guardrail models as the currently detected guardrail model. After the fitting residuals of each guardrail model are obtained, the guardrail model with the smallest fitting residual is selected as the previously detected guardrail model.
进一步地,在本实施例中,当确定护栏模型之后,还可以基于拟合残差最小的护栏模型的参数以及护栏的反射点中的开始点和结束点的坐标生成护栏的示意图,从而便于用户直管的知道护栏的形状和位置。Further, in this embodiment, after the guardrail model is determined, a schematic diagram of the guardrail can be generated based on the parameters of the guardrail model with the smallest fitting residual and the coordinates of the starting point and the end point in the reflection point of the guardrail, thereby facilitating the user The straight pipe knows the shape and position of the guardrail.
根据本实施例的基于毫米波雷达的护栏检测方法实现了护栏拟合的参数化和自动化,以护栏模型参数以及护栏反射点中起始点和终点的坐标来代替所有护栏反射点表示护栏,从而能够有效的降低护栏反射点数据输出压力,并且通过预设多种护栏模型分别拟合并从中选择最优模型,能够自动地选择最优护栏拟合模型以适应多种场景,提高护栏拟合的准确性和鲁棒性。The guardrail detection method based on millimeter wave radar according to this embodiment realizes the parametrization and automation of guardrail fitting, and replaces all guardrail reflection points with guardrail model parameters and the coordinates of the starting point and end point of the guardrail reflection point to represent the guardrail. Effectively reduce the data output pressure of the guardrail reflection point, and preset multiple guardrail models to fit separately and select the optimal model from them. The optimal guardrail fitting model can be automatically selected to adapt to a variety of scenarios and improve the accuracy of guardrail fitting And robustness.
进一步地,在上述的实施例中,护栏拟合主要是通过对静止反射点做聚类,然后拟合出护栏曲线。然而静止反射点的聚类效果严重受雷达测角精度和多径效应的影响。当雷达测角精度不高或者有多径效应时(测角结果会偏差很大),静止反射点难以被聚类,而这将导致护栏难以被识别和拟合。并且存在计算复杂度高的问题,因为该方法首先要对静止反射点做CFAR、MUSIC测角、聚类等算法,这些算法的计算复杂度较高,会增加对处理器的性能要求进而导致成本高。Further, in the above-mentioned embodiment, the guardrail fitting is mainly by clustering the static reflection points, and then fitting the guardrail curve. However, the clustering effect of static reflection points is seriously affected by the accuracy of radar angle measurement and multipath effects. When the accuracy of the radar angle measurement is not high or there is a multipath effect (the angle measurement results will have a large deviation), the static reflection points are difficult to be clustered, and this will make the guardrail difficult to be identified and fitted. And there is the problem of high computational complexity, because this method first needs to perform CFAR, MUSIC angle measurement, clustering and other algorithms for static reflection points. The computational complexity of these algorithms is high, which will increase the performance requirements of the processor and cause costs. high.
鉴于此,本申请还提供了一种基于毫米波雷达的护栏检测方法,其利用距离多普勒信息和护栏空间位置与自车速的隐藏关系来进行护栏的检测和拟合。利用该检测方法可以在不增加雷达硬件成本以及天线性能的情况下,大幅提高雷达对护栏的检测和拟合能力。同时,该检测方法的计算复 杂度也远远小于传统方法。下面结合图6至图10对该护栏检测方法进行描述。In view of this, the present application also provides a guardrail detection method based on millimeter wave radar, which uses distance Doppler information and the hidden relationship between the guardrail space position and the vehicle speed to detect and fit the guardrail. Using this detection method can greatly improve the radar's ability to detect and fit guardrails without increasing the cost of radar hardware and antenna performance. At the same time, the computational complexity of the detection method is far less than that of the traditional method. The guardrail detection method will be described below with reference to FIGS. 6 to 10.
图6示出根据本发明又一实施例的基于毫米波雷达的护栏检测方法的示意性流程图;图7示出图6所示拟合方法中坐标系定义示意图;图8示出图6所示拟合方法中护栏反射点距离和速度的计算示意图;图9示出对距离多普勒图像的护栏识别区域进行滤波的示意图;图10示出对图9中经过滤波的像素进行坐标变换的示意图。6 shows a schematic flowchart of a guardrail detection method based on millimeter wave radar according to another embodiment of the present invention; FIG. 7 shows a schematic diagram of the coordinate system definition in the fitting method shown in FIG. 6; Fig. 9 shows a schematic diagram of filtering the guardrail recognition area of the distance Doppler image; Fig. 10 shows the coordinate transformation of the filtered pixels in Fig. 9 Schematic.
首先结合图7描述本实施例中坐标系的定义。如图7所示,在本实施例中,由于车载雷达安装在车辆的正前方,因此以车载雷达的中心为原点,以雷达发射波束的法线方向为y轴正方向,然后按右手系建立笛卡尔坐标系。First, the definition of the coordinate system in this embodiment will be described with reference to FIG. 7. As shown in Figure 7, in this embodiment, since the vehicle-mounted radar is installed directly in front of the vehicle, the center of the vehicle-mounted radar is taken as the origin, and the normal direction of the radar beam is the positive direction of the y-axis, and then the right-hand system is established. Cartesian coordinate system.
接着,如图8所示,在本实施例中,护栏反射点横向距离计算方法为:Next, as shown in Figure 8, in this embodiment, the method for calculating the lateral distance of the guardrail reflection point is:
由于护栏反射点是对地静止,故其与雷达之间的真实相对速度V real大小就是本车车速V vehicle大小、方向与本车车速方向相反。即满足如下关系式: Since the reflection point of the guardrail is stationary to the ground, the true relative speed V real between it and the radar is the speed of the vehicle. The size and direction of the vehicle are opposite to the direction of the speed of the vehicle. That is, the following relationship is satisfied:
V real=-V vehicle V real =-V vehicle
雷达实际测量到的护栏反射点速度V doppier是V real在雷达中心与反射点之间的分量,该速度称为径向速度。 The radar reflection point velocity V doppier actually measured by the radar is the component of V real between the radar center and the reflection point. This velocity is called the radial velocity.
雷达实际测量到的护栏反射点距离R radial是护栏反射点到雷达中心之间的距离,该距离称为径向距离。 The distance R radial of the guardrail reflection point actually measured by the radar is the distance between the guardrail reflection point and the center of the radar. This distance is called the radial distance.
护栏反射点的横向距离R x、径向距离R radial、径向速度V doppier与自车速V vehicle满足如下关系式(正余弦公式) The lateral distance R x of the reflection point of the guardrail, the radial distance R radial , the radial speed V doppier and the self-vehicle speed V vehicle satisfy the following relationship (sine and cosine formula)
(Rx/R_radial)^2+(V_doppler/V_vehicle)^2=1  (式1)(Rx/R_radial)^2+(V_doppler/V_vehicle)^2=1 (Equation 1)
所以横向距离R x可由下式计算: Therefore, the lateral distance R x can be calculated by the following formula:
Figure PCTCN2019120981-appb-000001
Figure PCTCN2019120981-appb-000001
基于上述定义,接下来结合图6以及图9和图10对本实施例的护栏检测方法进行描述。Based on the above definition, the guardrail detection method of this embodiment will be described in conjunction with FIG. 6 and FIG. 9 and FIG. 10.
如图6所示,本实施例公开的方法,包括:As shown in FIG. 6, the method disclosed in this embodiment includes:
步骤401,对所述回波信号进行处理得到距离多普勒图像。Step 401: Process the echo signal to obtain a range Doppler image.
具体地,距离多普勒图像是通过对按快速锯齿波波形调制的雷达接收端中频时域信号进行二维FFT处理后得到的图像,如图9中左图所示,其横轴代表距离,纵轴代表速度。每个像素点的x坐标表示该反射点与雷达之间的径向距离,y坐标代表该反射点与雷达之间的径向相对速度(多普勒效应),数值大小代表反射点的反射强度。示例性地,在距离多普勒图像中颜色表示反射强度,例如以红色和蓝色表示为例,越红表示反射强度越强,越蓝表示反射强度越弱。Specifically, the range Doppler image is an image obtained by performing two-dimensional FFT processing on the radar receiving end intermediate frequency time domain signal modulated according to the fast sawtooth waveform, as shown in the left image in Figure 9, the horizontal axis represents the distance, The vertical axis represents speed. The x coordinate of each pixel represents the radial distance between the reflection point and the radar, the y coordinate represents the radial relative velocity between the reflection point and the radar (Doppler effect), and the value represents the reflection intensity of the reflection point . Exemplarily, the color in the range Doppler image represents the reflection intensity. For example, red and blue are used as an example. The redder means the stronger the reflection intensity, and the bluer means the weaker the reflection intensity.
步骤402,基于车辆速度在所述距离多普勒图像上确定护栏识别区域。Step 402: Determine a guardrail recognition area on the distance Doppler image based on the vehicle speed.
如图9左图所示,方框内的曲线便是由护栏产生,其曲线方程可由式1推导出。As shown in the left figure of Figure 9, the curve in the box is generated by the guardrail, and the curve equation can be derived from Equation 1.
Figure PCTCN2019120981-appb-000002
Figure PCTCN2019120981-appb-000002
由式3即可得出V doppier与R radial的曲线关系。由式3也可知距离多普勒图像上的护栏曲线是由R x和V vehicle两个参数来决定的。 From Equation 3, the curve relationship between V doppier and R radial can be obtained. It can also be seen from Equation 3 that the guardrail curve on the range Doppler image is determined by two parameters, R x and V vehicle.
示例性地,在本实施例中,基于车辆速度在所述距离多普勒图像上确定护栏识别区域的方法为:首先,基于车辆速度定义护栏识别区域中像素点的最大速度;接着,基于车辆速度定义护栏识别区域中像素点的最小速度;接着,设定护栏识别区域中像素点的最大距离;接着,设定护栏识别区域中像素点的最小距离;最后根据所述最大速度、最小速度、最大距离和最小距离确定护栏识别区域。Exemplarily, in this embodiment, the method for determining the guardrail recognition area on the distance Doppler image based on the vehicle speed is: firstly, define the maximum speed of the pixels in the guardrail recognition area based on the vehicle speed; then, based on the vehicle speed Speed defines the minimum speed of pixels in the guardrail recognition area; next, set the maximum distance of pixels in the guardrail recognition area; next, set the minimum distance of pixels in the guardrail recognition area; finally, according to the maximum speed, minimum speed, The maximum distance and the minimum distance determine the guardrail recognition area.
示例性地,例如护栏识别区域中像素点的最大速度V max为车辆速度V vehicle减去预设值V offset,最小速度为车辆速度V vehicle乘以预设值A,设定的最大距离和最小距离分别是R max和R min,所述护栏识别区域表示为: Exemplarily, for example, the maximum speed V max of the pixel in the guardrail recognition area is the vehicle speed V vehicle minus the preset value V offset , the minimum speed is the vehicle speed V vehicle multiplied by the preset value A, the set maximum distance and minimum The distances are R max and R min respectively , and the guardrail recognition area is expressed as:
V max=V vehicle-V offsetV max = V vehicle -V offset ,
V min=V vehicle*A, V min = V vehicle *A,
R min=B R min =B
R max=C R max =C
其中,V offset、A、B、C为预设值,该预设值可以根据经验或实验确定,示例性地,例如V offset取2m/s、3m/s、4m/s等,A取0.4、0.5、0.6等,B取3、4、5、6,C取50、60、70、80等,在此对V offset、A、B、C的具体数值不做限定。 Among them, V offset , A, B, and C are preset values, which can be determined based on experience or experiment. For example, for example, V offset is set to 2m/s, 3m/s, 4m/s, etc., and A is set to 0.4 , 0.5, 0.6, etc., B is 3, 4, 5, 6, and C is 50, 60, 70, 80, etc. The specific values of V offset , A, B, and C are not limited here.
通过上述关系式即可在距离多普勒图像上确定护栏识别区域,例如图9中左图的方框区域即为护栏识别区域。在该区域内的像素点有的是护栏反射点,有的不是。The guardrail recognition area can be determined on the distance Doppler image through the above-mentioned relational expression. For example, the box area in the left figure in FIG. 9 is the guardrail recognition area. Some of the pixels in this area are reflection points of the guardrail, and some are not.
步骤403,对所述距离多普勒图像上的所述护栏识别区域中的像素点依据反射强度进行滤波处理,以保留反射强度超过阈值的像素点作为护栏反射点。Step 403: Perform filtering processing on the pixels in the guardrail recognition area on the range Doppler image according to the reflection intensity, so as to retain the pixels whose reflection intensity exceeds a threshold value as the guardrail reflection points.
当在步骤402中确定所述距离多普勒图像上的护栏识别区域后,便对所述述护栏识别区域中的像素点依据反射强度进行滤波处理,以保留反射强度超过阈值的像素点作为护栏反射点。After the guardrail recognition area on the distance Doppler image is determined in step 402, the pixels in the guardrail recognition area are filtered according to the reflection intensity, so as to retain the pixels whose reflection intensity exceeds the threshold as the guardrail Reflection point.
示例性地,如图9所示,对距离多普勒图像上的护栏识别区域内的像素点,按护栏的距离-反射强度特性曲线来做反射强度滤波,只留下反射强度超过阈值的像素点。Exemplarily, as shown in FIG. 9, for the pixels in the guardrail recognition area on the distance Doppler image, the reflection intensity filtering is performed according to the distance-reflection intensity characteristic curve of the guardrail, and only the pixels whose reflection intensity exceeds the threshold are left. point.
通过对对所述距离多普勒图像上的所述护栏识别区域中的像素点依据反射强度进行滤波处理即可得到护栏反射点。The guardrail reflection point can be obtained by filtering the pixel points in the guardrail recognition area on the distance Doppler image according to the reflection intensity.
步骤404,对反射强度超过阈值的像素点进行映射,以将所述反射强度超过阈值的像素点从距离多普勒坐标系映射到以雷达为原点的笛卡尔坐标系中。Step 404: Map the pixel points whose reflection intensity exceeds the threshold value to map the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin.
当从距离多普勒图像中得到护栏反射点,即对护栏反射点按式二做映射,将表示护栏反射点的像素点从距离多普勒坐标系映射到图7所示的以车载雷达建立的笛卡尔坐标系中,以便最后对映射后的像素点做曲线拟合来进行护栏拟合。When the guardrail reflection point is obtained from the distance Doppler image, the reflection point of the guardrail is mapped according to formula 2, and the pixel point representing the reflection point of the guardrail is mapped from the distance Doppler coordinate system to the vehicle-mounted radar as shown in Figure 7. In the Cartesian coordinate system, in order to finally do curve fitting to the mapped pixels for guardrail fitting.
具体地,根据雷达测量到的护栏反射点的速度、车辆的行驶速度以及雷达测量到的护栏反射点与雷达中心之间的距离确定护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离R x和纵向距离R ySpecifically, the lateral distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin is determined according to the speed of the guardrail reflection point measured by the radar, the driving speed of the vehicle, and the distance between the guardrail reflection point measured by the radar and the radar center. R x and the longitudinal distance R y .
示例性地,根据下述公式确定每个护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离R x Exemplarily, the lateral distance R x of each guardrail reflection point in the Cartesian coordinate system with the radar as the origin is determined according to the following formula,
Figure PCTCN2019120981-appb-000003
Figure PCTCN2019120981-appb-000003
根据公式
Figure PCTCN2019120981-appb-000004
确定每个护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离R y
According to the formula
Figure PCTCN2019120981-appb-000004
Determine the lateral distance R y of each guardrail reflection point in the Cartesian coordinate system with the radar as the origin,
其中,R radial为以雷达为原点的笛卡尔坐标系中护栏反射点的径向距 离(即雷达测量到的护栏反射点导雷达中心的距离),V doppier为雷达测量到的护栏反射点的速度,V vehicle为车辆的行驶速度。 Among them, R radial is the radial distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin (that is, the distance from the guardrail reflection point to the radar center measured by the radar), and V doppier is the speed of the guardrail reflection point measured by the radar , V vehicle is the driving speed of the vehicle.
步骤405,根据护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离和纵向距离进行护栏拟合,以确定护栏模型。Step 405: Fit the guardrail according to the lateral distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin to determine the guardrail model.
示例性地,例如利用最小二乘法做曲线拟合,曲线模型可以选择直线、圆或回旋曲线。Exemplarily, for example, using the least squares method for curve fitting, the curve model can be a straight line, a circle, or a clothoid curve.
根据本实施例的护栏检测方法可以在不增加雷达硬件成本和天线设计复杂度的情况下,实现雷达对护栏的检测和识别。相比传统方法,本方案具有计算复杂度低、鲁棒性强、不依赖测角精度等优点,能大幅提高雷达对护栏的检测能力。根据本实施例的护栏拟合方法相较于传统方法,护栏的检测精度大幅上升,计算复杂度大幅降低。The guardrail detection method according to this embodiment can realize the detection and recognition of the guardrail by the radar without increasing the cost of radar hardware and the complexity of antenna design. Compared with traditional methods, this scheme has the advantages of low computational complexity, strong robustness, and does not rely on angle measurement accuracy, and can greatly improve the radar's ability to detect guardrails. Compared with the traditional method, the guardrail fitting method according to this embodiment greatly increases the detection accuracy of the guardrail and greatly reduces the computational complexity.
进一步地,在车载毫米波雷达的实际应用中,准确判断目标是否处于自车道是毫米波雷达的心竞争力,然而在弯道情况下,出入弯迟滞效应和本车传感器精度等原因,毫米波雷达无法准确地判断目标车是否处于自车道上。而这将导致ADAS系统和AD系统在弯道情况下的误报和漏检率大幅上升,带来安全隐患。鉴于此,本申请提出了一种新的车载毫米波雷达对目标是否处于自车道的判定方法,在不新增雷达硬件和处理器的基础上,且不依赖其他传感器(例如摄像头等视觉传感器)的情况下,利用毫米波雷达对护栏或路沿的检测和识别信息来大幅提高车载毫米波雷达在弯道中对目标是否处于本车道上的判定精度。下面结合图11对根据本发明实施例的基于护栏识别的目标自车道评价方法进行描述。Furthermore, in the practical application of vehicle-mounted millimeter-wave radar, it is the core competitiveness of millimeter-wave radar to accurately determine whether the target is in its own lane. However, in the case of a curve, the delay effect of entering and exiting the curve and the accuracy of the vehicle's sensor are caused by the millimeter wave. The radar cannot accurately determine whether the target vehicle is in its own lane. This will lead to a significant increase in the false alarm and missed detection rates of the ADAS system and the AD system in the case of a curve, which will bring safety hazards. In view of this, this application proposes a new vehicle-mounted millimeter-wave radar to determine whether the target is in its own lane, without adding radar hardware and processors, and without relying on other sensors (such as visual sensors such as cameras) In the case of using millimeter-wave radar to detect and identify guardrails or roadsides, the vehicle-mounted millimeter-wave radar can greatly improve the accuracy of determining whether the target is in the lane in a curve. In the following, a method for evaluating a target own lane based on guardrail recognition according to an embodiment of the present invention will be described with reference to FIG. 11.
图11示出根据本发明又一实施例的基于护栏识别的目标自车道评价方法的示意性流程图。FIG. 11 shows a schematic flowchart of a method for evaluating a target own lane based on guardrail recognition according to another embodiment of the present invention.
如图11所示,本实施例公开的方法包括:As shown in FIG. 11, the method disclosed in this embodiment includes:
步骤501,根据护栏反射点按回旋曲线模型进行拟合得到曲线参数。In step 501, the curve parameter is obtained by fitting a cyclotron curve model according to the reflection point of the guardrail.
护栏反射点可以根据前述实施例公开的方法或其他方法基于雷达回波信号得到,得到护栏反射点后,按按回旋曲线模型进行拟合得到曲线参数。示例性地,例如通过最小二乘法等进行曲线拟合来得到曲线参数。The guardrail reflection point can be obtained based on the radar echo signal according to the method disclosed in the foregoing embodiment or other methods. After the guardrail reflection point is obtained, the curve parameters are obtained by fitting according to the cyclotron curve model. Exemplarily, the curve parameters are obtained by performing curve fitting, for example, by the least square method or the like.
示例性地,所述回旋曲线模型表示为y=a*x 3+b*x 2+c; Exemplarily, the clothoid curve model is expressed as y=a*x 3 +b*x 2 +c;
根据每个护栏反射点在车身笛卡尔坐标系(以车头正中间为原点、车 前进方向为y轴正方向、车右侧为x轴正方向来建立坐标系)下的纵坐标和横坐标以及护栏反射点的个数按回旋曲线模型进行拟合得到曲线参数a、b和c。According to the vertical and horizontal coordinates of each guardrail reflection point in the Cartesian coordinate system of the car body (the center of the front is the origin, the forward direction of the car is the positive direction of the y-axis, and the right side of the car is the positive direction of the x-axis to establish the coordinate system) and The number of reflection points of the guardrail is fitted according to the cyclotron curve model to obtain the curve parameters a, b and c.
步骤502,计算车辆与护栏拟合曲线的距离。Step 502: Calculate the distance between the vehicle and the guardrail fitting curve.
具体地,根据曲线参数确定车辆与护栏拟合曲线的距离。示例性地,以y=a*x 3+b*x 2+c为例,例如车辆与护栏拟合曲线的距离等于曲线等于c。 Specifically, the distance between the vehicle and the guardrail fitting curve is determined according to the curve parameter. Illustratively, taking y=a*x 3 +b*x 2 +c as an example, for example, the distance between the vehicle and the guardrail fitting curve is equal to the curve equal to c.
步骤503,计算目标与护栏拟合曲线的距离。Step 503: Calculate the distance between the target and the fitting curve of the guardrail.
具体地,根据回旋曲线模型和曲线参数以及目标的纵坐标和横坐标确定目标与护栏拟合曲线的距离。Specifically, the distance between the target and the fitting curve of the guardrail is determined according to the clothoid curve model and curve parameters, as well as the ordinate and abscissa of the target.
步骤504,根据车辆与护栏拟合曲线的距离以及目标与护栏拟合曲线的距离计算目标的当前周期自车道评价值。Step 504: Calculate the current cycle lane evaluation value of the target according to the distance between the vehicle and the guardrail fitting curve and the distance between the target and the guardrail fitting curve.
具体地,根据车辆与护栏拟合曲线的距离、目标与护栏拟合曲线的距离以及车道距离判定门限确定目标当前更新周期的自车道评价值。,其中自车道距离判定门限可以根据经验确定,例如为1.5米、1.64米1.75米、1.82米等。Specifically, the vehicle lane evaluation value of the current update cycle of the target is determined according to the distance between the vehicle and the guardrail fitting curve, the distance between the target and the guardrail fitting curve, and the lane distance determination threshold. , Where the threshold for determining the distance of the self-lane can be determined based on experience, such as 1.5 meters, 1.64 meters, 1.75 meters, 1.82 meters, and so on.
步骤505,对目标的当前周期自车道评价值做平滑,得到目标当前周期平滑值。Step 505: Smooth the evaluation value of the target's current cycle self-lane to obtain the target current cycle smooth value.
根据当前更新周期的自车道评价值、前周期的平滑值以及平滑系数确定目标当前周期平滑值。其中,平滑系数可以根据经验确定,例如为0.3、0.4、0.5、0.6、0.7、0.8或0.9。Determine the target current period smoothing value according to the evaluation value of the own lane in the current update period, the smooth value of the previous period and the smoothing coefficient. Wherein, the smoothing coefficient can be determined empirically, for example, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8 or 0.9.
步骤506,根据目标当前周期平滑值判断目标是否在车辆所处车道上,Step 506: Determine whether the target is in the lane where the vehicle is located according to the current cycle smooth value of the target.
其中,如果目标当前周期平滑值大于设定阈值,则判定目标在车辆所处车道上,反之则认为目标不在车辆所处车道上。设定阈值可以根据经验或实验确定,例如可以为50、60、70或80。Among them, if the target current cycle smoothing value is greater than the set threshold, it is determined that the target is in the lane where the vehicle is located, otherwise it is considered that the target is not in the lane where the vehicle is located. The set threshold can be determined based on experience or experiment, for example, it can be 50, 60, 70, or 80.
根据本发明实施例的基于护栏识别的目标自车道评价方法在弯道场景下对目标是否处于本车道的判断能力有了巨大提升,误报和漏检率有了大幅降低。即,大幅调高了车载毫米波雷达在转弯时对目标是否处于自车道的判断能力,从而提高整个ADAS和AD系统的鲁棒性、提升用户体验。According to the method for evaluating a target's own lane based on guardrail recognition according to an embodiment of the present invention, the ability to judge whether the target is in the own lane in a curve scene has been greatly improved, and the rate of false alarms and missed detections has been greatly reduced. That is, the vehicle-mounted millimeter-wave radar has greatly increased its ability to judge whether the target is in its own lane when turning, thereby improving the robustness of the entire ADAS and AD system and improving the user experience.
图12示出根据本发明一实施例的基于毫米波雷达的护栏检测设备的示意性框图。Fig. 12 shows a schematic block diagram of a guardrail detection device based on millimeter wave radar according to an embodiment of the present invention.
如图12所示,本实施例的基于毫米波雷达的护栏检测设600包括毫米波雷达传感器610、存储器620和处理器630。As shown in FIG. 12, the guardrail detection device 600 based on millimeter wave radar of this embodiment includes a millimeter wave radar sensor 610, a memory 620 and a processor 630.
毫米波雷达传感器610用于向目标区域发射毫米波,并接收目标区域内的物体反射回的毫米波回波信号。毫米波雷达传感器610还可以对回波信号进行处理,以得到检测结果或护栏反射点。毫米波雷达传感器610例如包括线、收发模块和信号处理模块,收发模块例如包括线性VCO、放大器、平衡混频器等,当然毫米波雷达传感器还可以包括其它结构。The millimeter wave radar sensor 610 is used to transmit millimeter waves to the target area and receive the millimeter wave echo signals reflected by objects in the target area. The millimeter wave radar sensor 610 can also process the echo signal to obtain the detection result or the reflection point of the guardrail. The millimeter wave radar sensor 610 includes, for example, a line, a transceiver module, and a signal processing module. The transceiver module includes, for example, a linear VCO, an amplifier, a balanced mixer, and the like. Of course, the millimeter wave radar sensor may also include other structures.
一个或更多存储器620用于存储一种或更多种计算机程序。一个或更多存储器530可以包括一个或多个计算机程序产品,所述计算机程序产品可以包括各种形式的计算机可读存储介质,例如易失性存储器和/或非易失性存储器。所述易失性存储器例如可以包括随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。所述非易失性存储器例如可以包括只读存储器(ROM)、硬盘、闪存等永久性存储器。在所述计算机可读存储介质上可以存储一个或多个计算机程序指令,处理器可以运行所述程序指令,以实现上文所述的本发明实施例中(由处理器实现)的控制方法以及/或者其它期望的功能。在所述计算机可读存储介质中还可以存储各种应用程序和各种数据,例如所述应用程序使用和/或产生的各种数据等。One or more memories 620 are used to store one or more computer programs. The one or more memories 530 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include random access memory (RAM) and/or cache memory (cache), for example. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory and other permanent memories. One or more computer program instructions can be stored on the computer-readable storage medium, and the processor can run the program instructions to implement the control method in the above-mentioned embodiment of the present invention (implemented by the processor) and / Or other desired functions. Various application programs and various data, such as various data used and/or generated by the application program, can also be stored in the computer-readable storage medium.
一个或更多处理器630可以是中央处理单元(CPU)或者具有数据处理能力和/或指令执行能力的其它形式的处理单元,例如微微控制器(MCU),并且可以控制护栏拟合系统600中的其它组件以执行期望的功能。The one or more processors 630 may be a central processing unit (CPU) or other forms of processing units with data processing capability and/or instruction execution capability, such as a microcontroller (MCU), and may control the guardrail fitting system 600 Other components to perform the desired functions.
应当理解,在一些实施例中,处理器630可以为毫米波雷达传感器610本身的处理器;而在一些实施例中,处理器630也可以为毫米波雷达传感器610外部的处理器,其与毫米波雷达传感器610连接,并对毫米波雷达传感器610产生的数据进行处理,例如处理器630为车辆自身的处理器,而不是毫米波雷达传感器610内部的处理器。It should be understood that in some embodiments, the processor 630 may be the processor of the millimeter-wave radar sensor 610 itself; and in some embodiments, the processor 630 may also be a processor external to the millimeter-wave radar sensor 610, which is different from the millimeter wave radar sensor 610. The wave radar sensor 610 is connected and processes the data generated by the millimeter wave radar sensor 610. For example, the processor 630 is the processor of the vehicle itself, rather than the processor inside the millimeter wave radar sensor 610.
当所述一种或更多种计算机程序被所述一个或更多处理器630时使得所述一个或更多处理器630执行下述步骤:When the one or more computer programs are executed by the one or more processors 630, the one or more processors 630 execute the following steps:
对所述回波信号进行处理,以得到护栏反射点;Processing the echo signal to obtain the reflection point of the guardrail;
根据所述护栏反射点确定护栏模型,进而确定并输出当前护栏的表征参数来表示当前护栏。The guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
示例性地,根据所述护栏反射点确定护栏模型包括:Exemplarily, determining the guardrail model according to the guardrail reflection point includes:
对筛选出护栏反射点根据预设的护栏模型分别进行拟合,以得到每个护栏模型的参数以及拟合残差;Fit the screened guardrail reflection points separately according to the preset guardrail model to obtain the parameters and fitting residuals of each guardrail model;
从所有护栏模型中选出拟合残差最小的护栏模型作为当前检测到的护栏的模型。The guardrail model with the smallest fitting residual is selected from all guardrail models as the currently detected guardrail model.
示例性地,所述表征参数包括所述护栏模型的参数以所述护栏反射点中起始点和结束点的坐标。Exemplarily, the characterizing parameter includes the parameters of the guardrail model and the coordinates of the starting point and the ending point in the reflection point of the guardrail.
示例性地,对所述回波信号进行处理,以得到护栏反射点,包括:Exemplarily, processing the echo signal to obtain the reflection point of the guardrail includes:
对所述回波信号进行处理得到对目标的检测结果,所述检测结果包括多个反射点;Processing the echo signal to obtain a detection result of the target, and the detection result includes a plurality of reflection points;
根据护栏特性从所述检测结果中筛选出护栏反射点。The reflection points of the guardrail are screened out from the detection results according to the characteristics of the guardrail.
示例性地,根据护栏特性从所述检测结果中筛选出护栏反射点,包括:Exemplarily, screening out the reflection points of the guardrail from the detection result according to the characteristics of the guardrail includes:
根据所述反射点对应的回波信号的信息确定所述反射点是否相对地面静止;以及Determining whether the reflection point is stationary relative to the ground according to the information of the echo signal corresponding to the reflection point; and
所述反射点与相邻反射点之间的距离是否小于设定阈值,Whether the distance between the reflection point and the adjacent reflection point is less than a set threshold,
如果所述反射点相对地面静止,且与相邻反射点之间的距离小于设定阈值,则判定所述反射点为护栏反射点。If the reflection point is stationary with respect to the ground and the distance between the reflection point and the adjacent reflection point is less than the set threshold, it is determined that the reflection point is a guardrail reflection point.
示例性地,对所述回波信号进行处理,以得到护栏反射点,包括:Exemplarily, processing the echo signal to obtain the reflection point of the guardrail includes:
对所述回波信号进行处理得到距离多普勒图像;Processing the echo signal to obtain a range Doppler image;
基于车辆速度在所述距离多普勒图像上确定护栏识别区域;Determining a guardrail recognition area on the distance Doppler image based on the vehicle speed;
对所述距离多普勒图像上的所述护栏识别区域中的像素点依据反射强度进行滤波处理,以保留反射强度超过阈值的像素点作为护栏反射点。Filtering processing is performed on the pixel points in the guardrail recognition area on the distance Doppler image according to the reflection intensity, so as to retain the pixel points whose reflection intensity exceeds a threshold value as the guardrail reflection point.
示例性地,基于车辆速度在所述距离多普勒图像上确定护栏识别区域,包括:Exemplarily, determining the guardrail recognition area on the distance Doppler image based on the vehicle speed includes:
基于车辆速度定义护栏识别区域中像素点的最大速度;Define the maximum speed of pixels in the guardrail recognition area based on the vehicle speed;
基于车辆速度定义护栏识别区域中像素点的最小速度;Define the minimum speed of pixels in the guardrail recognition area based on the vehicle speed;
设定护栏识别区域中像素点的最大距离;Set the maximum distance of pixels in the guardrail recognition area;
设定护栏识别区域中像素点的最小距离;以及Set the minimum distance of pixels in the guardrail recognition area; and
根据所述最大速度、最小速度、最大距离和最小距离确定护栏识别区域。The guardrail recognition area is determined according to the maximum speed, minimum speed, maximum distance and minimum distance.
示例性地,还包括:Exemplarily, it also includes:
对反射强度超过阈值的像素点进行映射,以将所述反射强度超过阈值的像素点从距离多普勒坐标系映射到以雷达为原点的笛卡尔坐标系中。The pixel points whose reflection intensity exceeds the threshold value are mapped to map the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin.
示例性地,将所述反射强度超过阈值的像素点从距离多普勒坐标系映射到以雷达为原点的笛卡尔坐标系中,包括:Exemplarily, mapping the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin includes:
根据雷达测量到的护栏反射点的速度、车辆的行驶速度以及雷达测量到的护栏反射点与雷达中心之间的距离确定护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离和纵向距离。示例性地,还包括:根据护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离和纵向距离进行护栏拟合,以确定护栏模型。According to the speed of the guardrail reflection point measured by the radar, the driving speed of the vehicle, and the distance between the guardrail reflection point measured by the radar and the radar center, the horizontal distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin are determined . Exemplarily, the method further includes: fitting the guardrail according to the lateral distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin to determine the guardrail model.
示例性地,所述处理器还配置为:Exemplarily, the processor is further configured to:
根据护栏反射点按回旋曲线模型进行拟合得到曲线参数;According to the reflection point of the guardrail, the curve parameters are obtained by fitting the cyclotron curve model;
计算车辆与护栏拟合曲线的距离;Calculate the distance between the vehicle and the guardrail fitting curve;
计算目标与护栏拟合曲线的距离;Calculate the distance between the target and the fitting curve of the guardrail;
根据车辆与护栏拟合曲线的距离以及目标与护栏拟合曲线的距离计算目标的当前周期自车道评价值;According to the distance between the vehicle and the guardrail fitting curve and the distance between the target and the guardrail fitting curve, calculate the target's current cycle lane evaluation value;
对目标的当前周期自车道评价值做平滑,得到目标当前周期平滑值Pn;Smoothing the evaluation value of the target's current cycle self-lane to obtain the target current cycle smoothing value Pn;
根据目标当前周期平滑值判断目标是否在车辆所处车道上,Determine whether the target is in the lane of the vehicle according to the current cycle smooth value of the target,
其中,如果目标当前周期平滑值大于设定阈值,则判定目标在车辆所处车道上,反之则认为目标不在车辆所处车道上。Among them, if the target current cycle smoothing value is greater than the set threshold, it is determined that the target is in the lane where the vehicle is located, otherwise it is considered that the target is not in the lane where the vehicle is located.
示例性地,根据每个护栏反射点在车身笛卡尔坐标系下的纵坐标和横坐标以及护栏反射点的个数按回旋曲线模型进行拟合得到曲线参数,Exemplarily, according to the ordinate and abscissa of each guardrail reflection point in the Cartesian coordinate system of the vehicle body and the number of guardrail reflection points, the curve parameters are obtained by fitting according to the cyclotron curve model,
根据曲线参数确定车辆与护栏拟合曲线的距离。Determine the distance between the vehicle and the guardrail fitting curve according to the curve parameters.
示例性地,根据回旋曲线模型和曲线参数以及目标的纵坐标和横坐标确定目标与护栏拟合曲线的距离。Exemplarily, the distance between the target and the fitting curve of the guardrail is determined according to the clothoid curve model and curve parameters, as well as the ordinate and abscissa of the target.
示例性地,根据车辆与护栏拟合曲线的距离、目标与护栏拟合曲线的距离以及自车道距离判定门限确定目标当前更新周期的自车道评价值。Exemplarily, the self-lane evaluation value of the current update cycle of the target is determined according to the distance between the vehicle and the guardrail fitting curve, the distance between the target and the guardrail fitting curve, and the self-lane distance determination threshold.
示例性地,根据当前更新周期的自车道评价值、前周期的平滑值以及平滑系数确定目标当前周期平滑值。Exemplarily, the target current period smoothing value is determined according to the evaluation value of the own lane in the current update period, the smooth value of the previous period, and the smoothing coefficient.
示例性地,所述预设的护栏模型包括直线模型、二次多项式模型、圆 曲线模型或回旋曲线模型。Exemplarily, the preset guardrail model includes a straight line model, a quadratic polynomial model, a circular curve model or a clothoid curve model.
示例性地,所述处理器还用于:Exemplarily, the processor is further configured to:
基于拟合残差最小的护栏模型的参数以及护栏的反射点中的开始点和结束点的坐标生成护栏的示意图。A schematic diagram of the guardrail is generated based on the parameters of the guardrail model with the smallest fitting residual and the coordinates of the start point and the end point in the reflection point of the guardrail.
根据本实施例的护栏拟合系统以当前护栏的表征参数来表示当前护栏,从而能够有效降低护栏反射点的数据输出压力。According to the guardrail fitting system of this embodiment, the current guardrail is represented by the characteristic parameters of the current guardrail, so that the data output pressure of the reflection point of the guardrail can be effectively reduced.
进一步地,根据本实施例的护栏检测设备可以实现雷达对护栏的有效检测,检测精度答复提升,计算复杂度答复降低。Further, the guardrail detection device according to this embodiment can realize effective radar detection of the guardrail, the detection accuracy response is improved, and the calculation complexity response is reduced.
进一步地,根据本实施例的检测设备在弯道场景下对目标是否处于本车道的判断能力有了巨大提升,误报和漏检率有了大幅降低。Furthermore, the detection device according to this embodiment has a great improvement in its ability to judge whether the target is in its own lane in a curve scene, and the rate of false alarms and missed detections has been greatly reduced.
此外,根据本发明实施例,还提供了一种基于毫米波雷达的护栏检测装置,所述基于毫米波雷达的护栏检测装置包括存储装置和处理器,所述存储装置上存储有由所述处理器运行的计算机程序,所述计算机程序在被所述处理器运行时执行上述本发明实施例提供的方法。In addition, according to an embodiment of the present invention, there is also provided a guardrail detection device based on millimeter wave radar. The guardrail detection device based on millimeter wave radar includes a storage device and a processor. A computer program run by the processor, and the computer program executes the method provided in the foregoing embodiment of the present invention when the computer program is run by the processor.
此外,根据本发明实施例,还提供了一种存储介质,在所述存储介质上存储了程序指令,在所述程序指令被计算机或处理器运行时用于执行本发明实施例的控制方法的相应步骤,并且用于实现根据本发明实施例的控制系统各装置中的相应模块。所述存储介质例如可以包括智能电话的存储卡、平板电脑的存储部件、个人计算机的硬盘、只读存储器(ROM)、可擦除可编程只读存储器(EPROM)、便携式紧致盘只读存储器(CD-ROM)、USB存储器、或者上述存储介质的任意组合。所述计算机可读存储介质可以是一个或多个计算机可读存储介质的任意组合。In addition, according to an embodiment of the present invention, there is also provided a storage medium on which program instructions are stored, which are used to execute the control method of the embodiment of the present invention when the program instructions are run by a computer or a processor. The corresponding steps are used to implement the corresponding modules in the devices of the control system according to the embodiment of the present invention. The storage medium may include, for example, a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), USB memory, or any combination of the above storage media. The computer-readable storage medium may be any combination of one or more computer-readable storage media.
在一个实施例中,所述计算机程序指令在被计算机运行时执行以下步骤:发射毫米波雷达信号,并接收目标反射的回波信号;对所述回波信号进行处理,以得到护栏反射点;根据所述护栏反射点确定护栏模型,进而确定并输出当前护栏的表征参数来表示当前护栏。In one embodiment, the computer program instructions execute the following steps when run by the computer: transmit millimeter wave radar signals and receive echo signals reflected by the target; process the echo signals to obtain the guardrail reflection point; The guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
在一个实施例中,所述计算机程序指令在被计算机运行时执行以下步骤:对所述回波信号进行处理得到距离多普勒图像;基于车辆速度在所述距离多普勒图像上确定护栏识别区域;对所述距离多普勒图像上的所述护栏识别区域中的像素点依据反射强度进行滤波处理,以保留反射强度超过 阈值的像素点作为护栏反射点。In one embodiment, the computer program instructions execute the following steps when being run by a computer: process the echo signal to obtain a range Doppler image; determine guardrail recognition on the range Doppler image based on the vehicle speed Area; filtering the pixels in the guardrail recognition area on the distance Doppler image according to the reflection intensity, so as to retain the pixel points whose reflection intensity exceeds a threshold value as the guardrail reflection point.
在一个实施例中,所述计算机程序指令在被计算机运行时执行以下步骤:根据护栏反射点按回旋曲线模型进行拟合得到曲线参数;计算车辆与护栏拟合曲线的距离;计算目标与护栏拟合曲线的距离;根据车辆与护栏拟合曲线的距离以及目标与护栏拟合曲线的距离计算目标的当前周期自车道评价值;对目标的当前周期自车道评价值P做平滑,得到目标当前周期平滑值;根据目标当前周期平滑值判断目标是否在车辆所处车道上,其中,如果目标当前周期平滑值大于设定阈值,则判定目标在车辆所处车道上,反之则认为目标不在车辆所处车道上。In one embodiment, the computer program instructions execute the following steps when being run by a computer: according to the reflection point of the guardrail, fitting the curve model to obtain the curve parameters; calculating the distance between the vehicle and the guardrail fitting curve; calculating the target and the guardrail simulation Calculate the current cycle self-lane evaluation value of the target according to the distance between the vehicle and the guardrail fitting curve and the distance between the target and the guardrail fitting curve; smooth the current cycle self-lane evaluation value P of the target to obtain the current cycle of the target Smoothing value; judge whether the target is in the lane where the vehicle is located according to the current period smooth value of the target. If the current period smoothing value of the target is greater than the set threshold, it is determined that the target is in the lane where the vehicle is located, otherwise the target is considered not where the vehicle is located On the driveway.
根据本发明实施例的控制系统中的各模块可以通过根据本发明实施例的电子设备的处理器运行在存储器中存储的计算机程序指令来实现,或者可以在根据本发明实施例的计算机程序产品的计算机可读存储介质中存储的计算机指令被计算机运行时实现。The modules in the control system according to the embodiment of the present invention can be implemented by the processor of the electronic device according to the embodiment of the present invention running computer program instructions stored in the memory, or can be implemented in the computer program product according to the embodiment of the present invention. The computer instructions stored in the computer-readable storage medium are implemented when the computer runs.
此外,根据本发明实施例,还提供了一种可移动平台,其包括根据本发明实施例的护栏拟合系统或护栏拟合装置。所述可移动平台包括汽车。In addition, according to an embodiment of the present invention, a movable platform is also provided, which includes the guardrail fitting system or guardrail fitting device according to the embodiment of the present invention. The movable platform includes a car.
根据本发明实施例的基于毫米波雷达的护栏检测方法及设备、存储介质和可移动平台,以当前护栏的表征参数来表示当前护栏,从而能够有效降低护栏反射点的数据输出压力。According to the millimeter-wave radar-based guardrail detection method and device, storage medium, and movable platform according to the embodiment of the present invention, the current guardrail is represented by the current guardrail characteristic parameters, thereby effectively reducing the data output pressure of the guardrail reflection point.
尽管这里已经参考附图描述了示例实施例,应理解上述示例实施例仅仅是示例性的,并且不意图将本发明的范围限制于此。本领域普通技术人员可以在其中进行各种改变和修改,而不偏离本发明的范围和精神。所有这些改变和修改意在被包括在所附权利要求所要求的本发明的范围之内。Although the exemplary embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above-described exemplary embodiments are merely exemplary, and are not intended to limit the scope of the present invention thereto. Those of ordinary skill in the art can make various changes and modifications therein without departing from the scope and spirit of the present invention. All these changes and modifications are intended to be included within the scope of the present invention as claimed in the appended claims.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered as going beyond the scope of the present invention.
在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。例如,以上所描述的设备实施例仅仅是示意性 的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个设备,或一些特征可以忽略,或不执行。In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another device, or some features can be ignored or not implemented.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the instructions provided here, a lot of specific details are explained. However, it can be understood that the embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures, and technologies are not shown in detail, so as not to obscure the understanding of this specification.
类似地,应当理解,为了精简本发明并帮助理解各个发明方面中的一个或多个,在对本发明的示例性实施例的描述中,本发明的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该本发明的方法解释成反映如下意图:即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如相应的权利要求书所反映的那样,其发明点在于可以用少于某个公开的单个实施例的所有特征的特征来解决相应的技术问题。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本发明的单独实施例。Similarly, it should be understood that in order to simplify the present invention and help understand one or more of the various aspects of the invention, in the description of the exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment. , Or in its description. However, the method of the present invention should not be interpreted as reflecting the intention that the claimed present invention requires more features than those explicitly stated in each claim. More precisely, as reflected in the corresponding claims, the point of the invention is that the corresponding technical problems can be solved with features that are less than all the features of a single disclosed embodiment. Therefore, the claims following the specific embodiment are thus explicitly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present invention.
本领域的技术人员可以理解,除了特征之间相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的替代特征来代替。Those skilled in the art can understand that, in addition to mutual exclusion between the features, any combination of all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and any method or device disclosed in this way can be used in any combination. Processes or units are combined. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstract and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.
此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如,在权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。In addition, those skilled in the art can understand that although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments means that they are within the scope of the present invention. Within and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.
本发明的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(Digital Signal Processor,DSP)来实现根据本发明实施例的一些模块的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的 装置程序(例如,计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。The various component embodiments of the present invention may be implemented by hardware, or by software modules running on one or more processors, or by a combination of them. Those skilled in the art should understand that a microprocessor or a digital signal processor (Digital Signal Processor, DSP) may be used in practice to implement some or all of the functions of some modules according to the embodiments of the present invention. The present invention can also be implemented as a device program (for example, a computer program and a computer program product) for executing part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-mentioned embodiments illustrate rather than limit the present invention, and those skilled in the art can design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be constructed as a limitation to the claims. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims listing several devices, several of these devices may be embodied in the same hardware item. The use of the words first, second, and third, etc. do not indicate any order. These words can be interpreted as names.
以上所述,仅为本发明的具体实施方式或对具体实施方式的说明,本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。本发明的保护范围应以权利要求的保护范围为准。The above are only specific embodiments of the present invention or descriptions of specific embodiments. The protection scope of the present invention is not limited thereto. Any person skilled in the art can easily fall within the technical scope disclosed by the present invention. Any change or replacement should be included in the protection scope of the present invention. The protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (37)

  1. 一种基于毫米波雷达的护栏检测方法,其特征在于,包括:A guardrail detection method based on millimeter wave radar, which is characterized in that it includes:
    发射毫米波雷达信号,并接收目标反射的回波信号;Transmit millimeter-wave radar signals and receive echo signals reflected by the target;
    对所述回波信号进行处理,以得到护栏反射点;Processing the echo signal to obtain the reflection point of the guardrail;
    根据所述护栏反射点确定护栏模型,进而确定并输出当前护栏的表征参数来表示当前护栏。The guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
  2. 根据权利要求1所述的方法,其特征在于,根据所述护栏反射点确定护栏模型包括:The method according to claim 1, wherein determining the guardrail model according to the guardrail reflection point comprises:
    对筛选出护栏反射点根据预设的护栏模型分别进行拟合,以得到每个护栏模型的参数以及拟合残差;Fit the screened guardrail reflection points separately according to the preset guardrail model to obtain the parameters and fitting residuals of each guardrail model;
    从所有护栏模型中选出拟合残差最小的护栏模型作为当前检测到的护栏的模型。The guardrail model with the smallest fitting residual is selected from all guardrail models as the currently detected guardrail model.
  3. 根据权利要求1所述的方法,其特征在于,所述表征参数包括所述护栏模型的参数以所述护栏反射点中起始点和结束点的坐标。The method according to claim 1, wherein the characterizing parameters include the parameters of the guardrail model and the coordinates of the starting point and the ending point in the reflection point of the guardrail.
  4. 根据权利要求1所述的方法,其特征在于,对所述回波信号进行处理,以得到护栏反射点,包括:The method according to claim 1, wherein processing the echo signal to obtain a reflection point of a guardrail comprises:
    对所述回波信号进行处理得到对目标的检测结果,所述检测结果包括多个反射点;Processing the echo signal to obtain a detection result of the target, and the detection result includes a plurality of reflection points;
    根据护栏特性从所述检测结果中筛选出护栏反射点。The reflection points of the guardrail are screened out from the detection results according to the characteristics of the guardrail.
  5. 根据权利要求4所述的方法,其特征在于,根据护栏特性从所述检测结果中筛选出护栏反射点,包括:The method according to claim 4, wherein the screening of the reflection points of the guardrail from the detection result according to the characteristics of the guardrail comprises:
    根据所述反射点对应的回波信号的信息确定所述反射点是否相对地面静止;以及Determining whether the reflection point is stationary relative to the ground according to the information of the echo signal corresponding to the reflection point; and
    所述反射点与相邻反射点之间的距离是否小于设定阈值,Whether the distance between the reflection point and the adjacent reflection point is less than a set threshold,
    如果所述反射点相对地面静止,且与相邻反射点之间的距离小于设定阈值,则判定所述反射点为护栏反射点。If the reflection point is stationary with respect to the ground and the distance between the reflection point and the adjacent reflection point is less than the set threshold, it is determined that the reflection point is a guardrail reflection point.
  6. 根据权利要求1所述的方法,其特征在于,对所述回波信号进行处理,以得到护栏反射点,包括:The method according to claim 1, wherein processing the echo signal to obtain a reflection point of a guardrail comprises:
    对所述回波信号进行处理得到距离多普勒图像;Processing the echo signal to obtain a range Doppler image;
    基于车辆速度在所述距离多普勒图像上确定护栏识别区域;Determining a guardrail recognition area on the distance Doppler image based on the vehicle speed;
    对所述距离多普勒图像上的所述护栏识别区域中的像素点依据反射强度进行滤波处理,以保留反射强度超过阈值的像素点作为护栏反射点。Filtering processing is performed on the pixel points in the guardrail recognition area on the distance Doppler image according to the reflection intensity, so as to retain the pixel points whose reflection intensity exceeds a threshold value as the guardrail reflection point.
  7. 根据权利要求6所述的方法,其特征在于,基于车辆速度在所述距离多普勒图像上确定护栏识别区域,包括:The method according to claim 6, characterized in that determining the guardrail recognition area on the distance Doppler image based on the vehicle speed comprises:
    基于车辆速度定义护栏识别区域中像素点的最大速度;Define the maximum speed of pixels in the guardrail recognition area based on the vehicle speed;
    基于车辆速度定义护栏识别区域中像素点的最小速度;Define the minimum speed of pixels in the guardrail recognition area based on the vehicle speed;
    设定护栏识别区域中像素点的最大距离;Set the maximum distance of pixels in the guardrail recognition area;
    设定护栏识别区域中像素点的最小距离;以及Set the minimum distance of pixels in the guardrail recognition area; and
    根据所述最大速度、最小速度、最大距离和最小距离确定护栏识别区域。The guardrail recognition area is determined according to the maximum speed, minimum speed, maximum distance and minimum distance.
  8. 根据权利要求6所述的方法,其特征在于,还包括:The method according to claim 6, further comprising:
    对反射强度超过阈值的像素点进行映射,以将所述反射强度超过阈值的像素点从距离多普勒坐标系映射到以雷达为原点的笛卡尔坐标系中。The pixel points whose reflection intensity exceeds the threshold value are mapped to map the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin.
  9. 根据权利要求8所述的方法,其特征在于,将所述反射强度超过阈值的像素点从距离多普勒坐标系映射到以雷达为原点的笛卡尔坐标系中,包括:8. The method according to claim 8, wherein the mapping of the pixel points whose reflection intensity exceeds a threshold value from a range Doppler coordinate system to a Cartesian coordinate system with a radar as the origin comprises:
    根据雷达测量到的护栏反射点的速度、车辆的行驶速度以及雷达测量到的护栏反射点与雷达中心之间的距离确定护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离和纵向距离。According to the speed of the guardrail reflection point measured by the radar, the driving speed of the vehicle, and the distance between the guardrail reflection point measured by the radar and the radar center, the horizontal distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin are determined .
  10. 根据权利要求9所述的方法,其特征在于,还包括:The method according to claim 9, further comprising:
    根据护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离和纵向距离进行护栏拟合,以确定护栏模型。Fit the guardrail according to the horizontal distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin to determine the guardrail model.
  11. 根据权利要求1所述的方法,其特征在于,还包括:The method according to claim 1, further comprising:
    根据护栏反射点按回旋曲线模型进行拟合得到曲线参数;According to the reflection point of the guardrail, the curve parameters are obtained by fitting the cyclotron curve model;
    计算车辆与护栏拟合曲线的距离;Calculate the distance between the vehicle and the guardrail fitting curve;
    计算目标与护栏拟合曲线的距离;Calculate the distance between the target and the fitting curve of the guardrail;
    根据车辆与护栏拟合曲线的距离以及目标与护栏拟合曲线的距离计算目标的当前周期自车道评价值;Calculate the current cycle lane evaluation value of the target according to the distance between the vehicle and the guardrail fitting curve and the distance between the target and the guardrail fitting curve;
    对目标的当前周期自车道评价值做平滑,得到目标当前周期平滑值;Smooth the evaluation value of the target's current cycle of the self-lane to obtain the target's current cycle smooth value;
    根据目标当前周期平滑值判断目标是否在车辆所处车道上,Determine whether the target is in the lane of the vehicle according to the current cycle smooth value of the target,
    其中,如果目标当前周期平滑值大于设定阈值,则判定目标在车辆所处车道上,反之则认为目标不在车辆所处车道上。Among them, if the target current cycle smoothing value is greater than the set threshold, it is determined that the target is in the lane where the vehicle is located, otherwise it is considered that the target is not in the lane where the vehicle is located.
  12. 根据权利要求11所述的方法,其特征在于,The method of claim 11, wherein:
    根据每个护栏反射点在车身笛卡尔坐标系下的纵坐标和横坐标以及护栏反射点的个数按回旋曲线模型进行拟合得到曲线参数,According to the ordinate and abscissa of each guardrail reflection point in the cartesian coordinate system of the car body and the number of guardrail reflection points, the curve parameters are obtained by fitting according to the cyclotron curve model.
    根据曲线参数确定车辆与护栏拟合曲线的距离。Determine the distance between the vehicle and the guardrail fitting curve according to the curve parameters.
  13. 根据权利要求12所述的方法,其特征在于,The method of claim 12, wherein:
    根据回旋曲线模型和曲线参数以及目标的纵坐标和横坐标确定目标与护栏拟合曲线的距离。Determine the distance between the target and the fitting curve of the guardrail according to the clothoid curve model and curve parameters, as well as the ordinate and abscissa of the target.
  14. 根据权利要求13所述的方法,其特征在于,The method of claim 13, wherein:
    根据车辆与护栏拟合曲线的距离、目标与护栏拟合曲线的距离以及自车道距离判定门限确定目标当前更新周期的自车道评价值。According to the distance between the vehicle and the guardrail fitting curve, the distance between the target and the guardrail fitting curve, and the self-lane distance judgment threshold, the self-lane evaluation value of the current update cycle of the target is determined.
  15. 根据权利要求14所述的方法,其特征在于,The method of claim 14, wherein:
    根据当前更新周期的自车道评价值、前周期的平滑值以及平滑系数确定目标当前周期平滑值。Determine the target current period smoothing value according to the evaluation value of the own lane in the current update period, the smooth value of the previous period and the smoothing coefficient.
  16. 根据权利要求1所述的方法,其特征在于,所述预设的护栏模型包括直线模型、二次多项式模型、圆曲线模型或回旋曲线模型。The method according to claim 1, wherein the preset guardrail model includes a straight line model, a quadratic polynomial model, a circular curve model, or a clothoid curve model.
  17. 根据权利要求1所述的方法,其特征在于,还包括:The method according to claim 1, further comprising:
    基于拟合残差最小的护栏模型的参数以及护栏的反射点中的开始点和结束点的坐标生成护栏的示意图。A schematic diagram of the guardrail is generated based on the parameters of the guardrail model with the smallest fitting residual and the coordinates of the start point and the end point in the reflection point of the guardrail.
  18. 一种基于毫米波雷达的护栏检测设备,其特征在于,包括:A guardrail detection device based on millimeter wave radar, which is characterized in that it comprises:
    毫米波雷达传感器,所述毫米波雷达传感器用于向目标区域发射毫米波,并接收目标区域内的物体反射回的毫米波回波信号;Millimeter wave radar sensor, the millimeter wave radar sensor is used to transmit millimeter waves to the target area, and receive the millimeter wave echo signals reflected back by objects in the target area;
    处理器,所述处理器配置为对所述回波信号进行处理,以得到护栏反射点;A processor, the processor is configured to process the echo signal to obtain a guardrail reflection point;
    根据所述护栏反射点确定护栏模型,进而确定并输出当前护栏的表征参数来表示当前护栏。The guardrail model is determined according to the guardrail reflection point, and then the characteristic parameters of the current guardrail are determined and output to represent the current guardrail.
  19. 根据权利要求18所述的系统,其特征在于,根据所述护栏反射点确定护栏模型包括:The system according to claim 18, wherein determining the guardrail model according to the guardrail reflection point comprises:
    对筛选出护栏反射点根据预设的护栏模型分别进行拟合,以得到每个 护栏模型的参数以及拟合残差;Fit the screened guardrail reflection points separately according to the preset guardrail model to obtain the parameters and fitting residuals of each guardrail model;
    从所有护栏模型中选出拟合残差最小的护栏模型作为当前检测到的护栏的模型。The guardrail model with the smallest fitting residual is selected from all guardrail models as the currently detected guardrail model.
  20. 根据权利要求18所述的系统,其特征在于,所述表征参数包括所述护栏模型的参数以所述护栏反射点中起始点和结束点的坐标。The system according to claim 18, wherein the characterizing parameters include the parameters of the guardrail model and the coordinates of the starting point and the ending point in the reflection point of the guardrail.
  21. 根据权利要求18所述的系统,其特征在于,对所述回波信号进行处理,以得到护栏反射点,包括:The system according to claim 18, wherein processing the echo signal to obtain a reflection point of a guardrail comprises:
    对所述回波信号进行处理得到对目标的检测结果,所述检测结果包括多个反射点;Processing the echo signal to obtain a detection result of the target, and the detection result includes a plurality of reflection points;
    根据护栏特性从所述检测结果中筛选出护栏反射点。The reflection points of the guardrail are screened out from the detection results according to the characteristics of the guardrail.
  22. 根据权利要求21所述的系统,其特征在于,根据护栏特性从所述检测结果中筛选出护栏反射点,包括:The system according to claim 21, wherein the screening of the reflection points of the guardrail from the detection result according to the characteristics of the guardrail comprises:
    根据所述反射点对应的回波信号的信息确定所述反射点是否相对地面静止;以及Determining whether the reflection point is stationary relative to the ground according to the information of the echo signal corresponding to the reflection point; and
    所述反射点与相邻反射点之间的距离是否小于设定阈值,Whether the distance between the reflection point and the adjacent reflection point is less than a set threshold,
    如果所述反射点相对地面静止,且与相邻反射点之间的距离小于设定阈值,则判定所述反射点为护栏反射点。If the reflection point is stationary with respect to the ground and the distance between the reflection point and the adjacent reflection point is less than the set threshold, it is determined that the reflection point is a guardrail reflection point.
  23. 根据权利要求18所述的系统,其特征在于,对所述回波信号进行处理,以得到护栏反射点,包括:The system according to claim 18, wherein processing the echo signal to obtain a reflection point of a guardrail comprises:
    对所述回波信号进行处理得到距离多普勒图像;Processing the echo signal to obtain a range Doppler image;
    基于车辆速度在所述距离多普勒图像上确定护栏识别区域;Determining a guardrail recognition area on the distance Doppler image based on the vehicle speed;
    对所述距离多普勒图像上的所述护栏识别区域中的像素点依据反射强度进行滤波处理,以保留反射强度超过阈值的像素点作为护栏反射点。Filtering processing is performed on the pixel points in the guardrail recognition area on the distance Doppler image according to the reflection intensity, so as to retain the pixels whose reflection intensity exceeds a threshold value as the guardrail reflection point.
  24. 根据权利要求23所述的系统,其特征在于,基于车辆速度在所述距离多普勒图像上确定护栏识别区域,包括:The system according to claim 23, wherein determining the guardrail recognition area on the distance Doppler image based on the vehicle speed comprises:
    基于车辆速度定义护栏识别区域中像素点的最大速度;Define the maximum speed of pixels in the guardrail recognition area based on the vehicle speed;
    基于车辆速度定义护栏识别区域中像素点的最小速度;Define the minimum speed of pixels in the guardrail recognition area based on the vehicle speed;
    设定护栏识别区域中像素点的最大距离;Set the maximum distance of pixels in the guardrail recognition area;
    设定护栏识别区域中像素点的最小距离;以及Set the minimum distance of pixels in the guardrail recognition area; and
    根据所述最大速度、最小速度、最大距离和最小距离确定护栏识别区 域。The guardrail recognition area is determined according to the maximum speed, minimum speed, maximum distance and minimum distance.
  25. 根据权利要求23所述的系统,其特征在于,还包括:The system according to claim 23, further comprising:
    对反射强度超过阈值的像素点进行映射,以将所述反射强度超过阈值的像素点从距离多普勒坐标系映射到以雷达为原点的笛卡尔坐标系中。The pixel points whose reflection intensity exceeds the threshold value are mapped to map the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin.
  26. 根据权利要求25所述的系统,其特征在于,将所述反射强度超过阈值的像素点从距离多普勒坐标系映射到以雷达为原点的笛卡尔坐标系中,包括:The system according to claim 25, wherein the mapping of the pixel points whose reflection intensity exceeds the threshold value from the range Doppler coordinate system to the Cartesian coordinate system with the radar as the origin comprises:
    根据雷达测量到的护栏反射点的速度、车辆的行驶速度以及雷达测量到的护栏反射点与雷达中心之间的距离确定护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离和纵向距离。According to the speed of the guardrail reflection point measured by the radar, the driving speed of the vehicle, and the distance between the guardrail reflection point measured by the radar and the radar center, the horizontal distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin are determined .
  27. 根据权利要求26所述的系统,其特征在于,还包括:The system according to claim 26, further comprising:
    根据护栏反射点在以雷达为原点的笛卡尔坐标系中横向距离和纵向距离进行护栏拟合,以确定护栏模型。Fit the guardrail according to the horizontal distance and the longitudinal distance of the guardrail reflection point in the Cartesian coordinate system with the radar as the origin to determine the guardrail model.
  28. 根据权利要求18所述的系统,其特征在于,所述处理器还配置为:The system according to claim 18, wherein the processor is further configured to:
    根据护栏反射点按回旋曲线模型进行拟合得到曲线参数;According to the reflection point of the guardrail, the curve parameters are obtained by fitting the cyclotron curve model;
    计算车辆与护栏拟合曲线的距离;Calculate the distance between the vehicle and the guardrail fitting curve;
    计算目标与护栏拟合曲线的距离;Calculate the distance between the target and the fitting curve of the guardrail;
    根据车辆与护栏拟合曲线的距离以及目标与护栏拟合曲线的距计算目标的当前周期自车道评价值;Calculate the current cycle lane evaluation value of the target according to the distance between the vehicle and the guardrail fitting curve and the distance between the target and the guardrail fitting curve;
    对目标的当前周期自车道评价值做平滑,得到目标当前周期平滑值;Smooth the evaluation value of the target's current cycle of the self-lane to obtain the target's current cycle smooth value;
    根据目标当前周期平滑值判断目标是否在车辆所处车道上,Determine whether the target is in the lane of the vehicle according to the current cycle smooth value of the target,
    其中,如果目标当前周期平滑值大于设定阈值,则判定目标在车辆所处车道上,反之则认为目标不在车辆所处车道上。Among them, if the target current cycle smoothing value is greater than the set threshold, it is determined that the target is in the lane where the vehicle is located, otherwise it is considered that the target is not in the lane where the vehicle is located.
  29. 根据权利要求28所述的系统,其特征在于,The system of claim 28, wherein:
    根据每个护栏反射点在车身笛卡尔坐标系下的纵坐标和横坐标以及护栏反射点的个数按回旋曲线模型进行拟合得到曲线参数,According to the ordinate and abscissa of each guardrail reflection point in the cartesian coordinate system of the car body and the number of guardrail reflection points, the curve parameters are obtained by fitting according to the cyclotron curve model.
    根据曲线参数确定车辆与护栏拟合曲线的距离。Determine the distance between the vehicle and the guardrail fitting curve according to the curve parameters.
  30. 根据权利要求29所述的系统,其特征在于,The system of claim 29, wherein:
    根据回旋曲线模型和曲线参数以及目标的纵坐标和横坐标确定目标与护栏拟合曲线的距离。Determine the distance between the target and the fitting curve of the guardrail according to the clothoid curve model and curve parameters, as well as the ordinate and abscissa of the target.
  31. 根据权利要求30所述的系统,其特征在于,The system of claim 30, wherein:
    根据车辆与护栏拟合曲线的距离、目标与护栏拟合曲线的距离以及自车道距离判定门限确定目标当前更新周期的自车道评价值。According to the distance between the vehicle and the guardrail fitting curve, the distance between the target and the guardrail fitting curve, and the self-lane distance judgment threshold, the self-lane evaluation value of the current update cycle of the target is determined.
  32. 根据权利要求31所述的系统,其特征在于,The system of claim 31, wherein:
    根据当前更新周期的自车道评价值、前周期的平滑值以及平滑系数确定目标当前周期平滑值。Determine the target current period smoothing value according to the evaluation value of the own lane in the current update period, the smooth value of the previous period and the smoothing coefficient.
  33. 根据权利要求18所述的系统,其特征在于,所述预设的护栏模型包括直线模型、二次多项式模型、圆曲线模型或回旋曲线模型。The system according to claim 18, wherein the preset guardrail model includes a straight line model, a quadratic polynomial model, a circular curve model, or a clothoid curve model.
  34. 根据权利要求18所述的系统,其特征在于,所述处理器还配置为:The system according to claim 18, wherein the processor is further configured to:
    基于拟合残差最小的护栏模型的参数以及护栏的反射点中的开始点和结束点的坐标生成护栏的示意图。A schematic diagram of the guardrail is generated based on the parameters of the guardrail model with the smallest fitting residual and the coordinates of the start point and the end point in the reflection point of the guardrail.
  35. 一种存储介质,其特征在于,所述存储介质上存储有计算机程序,所述计算机程序在运行时执行如权利要求1-17中的任一项所述的方法。A storage medium, characterized in that a computer program is stored on the storage medium, and the computer program executes the method according to any one of claims 1-17 when running.
  36. 一种可移动平台,其特征在于,包括:权利要求17-34中的任一项所述的护栏拟合设备。A movable platform, characterized by comprising: the guardrail fitting device according to any one of claims 17-34.
  37. 根据权利要求36所述的可移动平台,其特征在于,所述可移动平台包括汽车。The movable platform of claim 36, wherein the movable platform comprises a car.
PCT/CN2019/120981 2019-11-26 2019-11-26 Guardrail detection method and device, storage medium, and movable platform WO2021102689A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/120981 WO2021102689A1 (en) 2019-11-26 2019-11-26 Guardrail detection method and device, storage medium, and movable platform
CN201980039524.2A CN112313539B (en) 2019-11-26 2019-11-26 Guardrail detection method and equipment, storage medium and movable platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/120981 WO2021102689A1 (en) 2019-11-26 2019-11-26 Guardrail detection method and device, storage medium, and movable platform

Publications (1)

Publication Number Publication Date
WO2021102689A1 true WO2021102689A1 (en) 2021-06-03

Family

ID=74336557

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/120981 WO2021102689A1 (en) 2019-11-26 2019-11-26 Guardrail detection method and device, storage medium, and movable platform

Country Status (2)

Country Link
CN (1) CN112313539B (en)
WO (1) WO2021102689A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022183369A1 (en) * 2021-03-02 2022-09-09 华为技术有限公司 Target detection method and apparatus
CN113033434A (en) * 2021-03-30 2021-06-25 重庆长安汽车股份有限公司 Method and device for extracting guardrails in road point cloud, controller and automobile
CN113514825A (en) * 2021-04-23 2021-10-19 芜湖森思泰克智能科技有限公司 Road edge obtaining method and device and terminal equipment
JP2022176641A (en) * 2021-05-17 2022-11-30 日立Astemo株式会社 Radar device
WO2023236112A1 (en) * 2022-06-08 2023-12-14 华为技术有限公司 Target false alarm type determination method, apparatus, and terminal

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000105276A (en) * 1998-09-29 2000-04-11 Mitsubishi Electric Corp Millimeter wave rader device
CN104937436A (en) * 2013-02-01 2015-09-23 三菱电机株式会社 Radar device
CN105000019A (en) * 2014-04-15 2015-10-28 通用汽车环球科技运作有限责任公司 Method and system for detecting, tracking and estimating stationary roadside objects
CN109035759A (en) * 2018-06-13 2018-12-18 重庆邮电大学 A kind of guardrail check and evaluation method
CN109254289A (en) * 2018-11-01 2019-01-22 百度在线网络技术(北京)有限公司 The detection method and detection device of road guard

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6970936B2 (en) * 2016-12-20 2021-11-24 パナソニックIpマネジメント株式会社 Object detector, object detection program, and recording medium
CN108909721B (en) * 2018-04-28 2021-04-23 南通职业大学 Vehicle yaw angle calculation method based on millimeter wave radar
CN110058239B (en) * 2019-04-29 2023-08-01 上海保隆汽车科技股份有限公司 Vehicle-mounted millimeter wave radar device and target detection method
CN110146899A (en) * 2019-05-28 2019-08-20 许灵男 A kind of terminal radar barrier sensory perceptual system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000105276A (en) * 1998-09-29 2000-04-11 Mitsubishi Electric Corp Millimeter wave rader device
CN104937436A (en) * 2013-02-01 2015-09-23 三菱电机株式会社 Radar device
CN105000019A (en) * 2014-04-15 2015-10-28 通用汽车环球科技运作有限责任公司 Method and system for detecting, tracking and estimating stationary roadside objects
CN109035759A (en) * 2018-06-13 2018-12-18 重庆邮电大学 A kind of guardrail check and evaluation method
CN109254289A (en) * 2018-11-01 2019-01-22 百度在线网络技术(北京)有限公司 The detection method and detection device of road guard

Also Published As

Publication number Publication date
CN112313539B (en) 2024-03-15
CN112313539A (en) 2021-02-02

Similar Documents

Publication Publication Date Title
WO2021102689A1 (en) Guardrail detection method and device, storage medium, and movable platform
WO2020007235A1 (en) Parking space detection method and apparatus, and medium and device
US9563808B2 (en) Target grouping techniques for object fusion
Kellner et al. Instantaneous lateral velocity estimation of a vehicle using Doppler radar
WO2021097618A1 (en) Point cloud segmentation method and system, and computer storage medium
US9298992B2 (en) Geographic feature-based localization with feature weighting
WO2018177026A1 (en) Device and method for determining road edge
CN112562314B (en) Road end sensing method and device based on deep fusion, road end equipment and system
US10132919B2 (en) Object detecting device, radar device, and object detection method
CN108859952B (en) Vehicle lane change early warning method and device and radar
JP6659367B2 (en) Object detection device and object detection method
Han et al. Road boundary detection and tracking for structured and unstructured roads using a 2D lidar sensor
US20190369212A1 (en) Determining specular reflectivity characteristics using lidar
WO2020199010A1 (en) Millimeter wave radar-based tracking detection method, millimeter wave radar and vehicle
WO2020186420A1 (en) Target detection method and device, millimeter wave radar and movable platform
CA3050586A1 (en) Object detection based on lidar intensity
CN110632617A (en) Laser radar point cloud data processing method and device
CN113391305B (en) False target suppression method and device for multi-radar fusion and terminal equipment
WO2022198637A1 (en) Point cloud noise filtering method and system, and movable platform
CN103473763A (en) Road edge detection method based on heuristic probability Hough transformation
CN108693517B (en) Vehicle positioning method and device and radar
JP6919764B2 (en) Radar image processing device, radar image processing method, and program
CN111413701B (en) Method and device for determining distance between obstacles, vehicle-mounted equipment and storage medium
CN114550142A (en) Parking space detection method based on fusion of 4D millimeter wave radar and image recognition
JP6411933B2 (en) Vehicle state determination device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19953751

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19953751

Country of ref document: EP

Kind code of ref document: A1