WO2021115395A1 - Map-based fault diagnosis - Google Patents

Map-based fault diagnosis Download PDF

Info

Publication number
WO2021115395A1
WO2021115395A1 PCT/CN2020/135398 CN2020135398W WO2021115395A1 WO 2021115395 A1 WO2021115395 A1 WO 2021115395A1 CN 2020135398 W CN2020135398 W CN 2020135398W WO 2021115395 A1 WO2021115395 A1 WO 2021115395A1
Authority
WO
WIPO (PCT)
Prior art keywords
map
area
information
automatic driving
hot spot
Prior art date
Application number
PCT/CN2020/135398
Other languages
French (fr)
Chinese (zh)
Inventor
廖方波
Original Assignee
北京三快在线科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京三快在线科技有限公司 filed Critical 北京三快在线科技有限公司
Publication of WO2021115395A1 publication Critical patent/WO2021115395A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/904Browsing; Visualisation therefor

Definitions

  • This application relates to the field of automatic driving, and specifically to map-based fault diagnosis methods, devices, electronic equipment, and storage media.
  • Autonomous driving can be applied to areas such as logistics, food delivery, and so on. Maps are an important part of autonomous driving.
  • the autonomous driving equipment matches the map with various measurement data collected by itself to determine its own location.
  • a map-based fault diagnosis method including: receiving map usage information reported by each automatic driving device; generating state information of each area in the map according to the map usage information; The state information of the area determines a hot spot area in the map; and the fault object is determined according to the state information of the hot spot area.
  • the map usage information includes a map matching degree score and pose information of the autonomous driving device
  • generating state information of each area in the map according to the map usage information includes: using Information, according to the pose information of the automatic driving device that reports the piece of map usage information, determine the area that matches the piece of map usage information, and obtain the correspondence between the piece of map usage information and the matched area; For each of the regions, the average value of the map matching scores corresponding to the region is calculated according to the corresponding relationship, and the average value is used as the state score of the region.
  • determining the hotspot area in the map according to the status information of each of the areas includes: selecting several areas as the hotspot area according to the status score from low to high; and/or The area where the state score is lower than the preset value is regarded as the hot spot area.
  • the map usage information further includes the identification of the automatic driving device, and determining the fault object according to the status information of the hotspot area includes: for each of the hotspot areas, according to the identification of the automatic driving device, based on the identification of the hotspot area The map matching degree score in the map usage information is calculated, and the state score of each of the autonomous driving devices related to the hot spot area is calculated; if the state score of the target automatic driving device is not consistent with the state scores of other automatic driving devices If it is not, the target autopilot device is regarded as the fault target.
  • the map usage information further includes time information
  • determining the fault object according to the status information of the hotspot area further includes: for each hotspot area, if the status score of each of the automatic driving devices related to the hotspot area is scored If there is consistency, the map matching degree scores corresponding to the hot spot area are sorted in chronological order to obtain a map matching degree score curve; if the map matching degree score curve meets the fault characteristics, the hot spot area is regarded as a fault object.
  • the area is a map grid obtained by rasterizing a map
  • the method further includes: providing a visualization interface based on the map grid, and displaying the information of each map grid in the visualization interface. status information.
  • the method further includes: generating a confidence map corresponding to the map according to the status information of each of the regions; and sending the confidence map to the automatic driving Device, so that when the automatic driving device uses the map, it adjusts the use weight of the map according to the confidence map.
  • a map-based fault diagnosis device including: a receiving unit for receiving map usage information reported by each automatic driving device; a diagnosis unit for generating a map based on the map usage information The status information of each area in each of the areas; determine the hot spot area in the map according to the status information of each area; determine the fault object according to the status information of the hot spot area.
  • the map usage information includes a map matching degree score and pose information of the automatic driving device, and the diagnosis unit is used for each piece of the map usage information, according to the report of the piece of map usage information.
  • the pose information of the automatic driving device determines the area that matches the piece of map usage information, and obtains the correspondence between the piece of map usage information and the matched area; for each of the areas, according to the correspondence Count the average value of the map matching scores corresponding to the area, and use the average value as the state score of the area.
  • the diagnosis unit is configured to select several areas as the hot spot area according to the state score from low to high; and/or use the area with the state score lower than a preset value as the Hot spot area.
  • the map usage information further includes an automatic driving device identification
  • the diagnosis unit is configured to, for each of the hotspot areas, according to the automatic driving device identification, based on the map usage information corresponding to the hotspot area Calculate the state score of each of the autonomous driving devices related to the hot spot area; if the state score of the target autonomous driving device is not consistent with the state scores of other autonomous driving devices, then the The target autopilot equipment is the target of the failure.
  • the map usage information further includes time information
  • the diagnosis unit is configured to, for each hotspot area, if the state scores of the autonomous driving devices related to the hotspot area are consistent, then The map matching degree scores corresponding to the hot spot areas are sorted in chronological order to obtain a map matching degree score curve; if the map matching degree score curve meets the fault characteristics, the hot spot area is taken as the fault object.
  • the area is a map grid obtained by rasterizing a map
  • the diagnosis unit is further configured to provide a visualization interface based on the map grid, and display each of the map grids in the visualization interface.
  • the status information of the grid is a map grid obtained by rasterizing a map
  • the device further includes: a confidence unit, configured to generate a confidence map corresponding to the map according to the state information of each of the regions; and send the confidence map to an automatic driving device to enable the automatic driving When the driving device uses the map, it adjusts the usage weight of the map according to the confidence map.
  • a confidence unit configured to generate a confidence map corresponding to the map according to the state information of each of the regions.
  • an electronic device including: a processor; and a memory storing computer-executable instructions, which when executed, cause the processor to execute any of the foregoing Methods.
  • a computer-readable storage medium wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the Any of the methods described above.
  • the embodiment of the present application receives map usage information reported by each automatic driving device; generates status information of each area in the map according to the map usage information; determines the hotspot area in the map according to the status information; The status information of the hot spot area determines the fault object.
  • the beneficial effect is that it can quickly diagnose the possible defects of the map based on the information of the map, determine the faulty object, improve the efficiency of the fault diagnosis, and provide a reliable guarantee for the normal operation of the map-based autonomous driving, thereby providing logistics and food delivery. Provide technical support in other business areas.
  • Fig. 1 shows a schematic flowchart of a map-based fault diagnosis method according to an embodiment of the present application
  • Figure 2 shows a schematic structural diagram of a map-based fault diagnosis device according to an embodiment of the present application
  • Fig. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present application
  • Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present application.
  • the automatic driving equipment uses the laser point cloud collected by the laser radar to match the laser map.
  • the laser map can also be called a laser location map.
  • higher requirements are imposed on the accuracy and real-time accuracy of the map.
  • the matching degree may be low, which may be caused by reasons such as untimely map update or failure of automatic driving equipment.
  • the map update is often concerned, and there is no diagnosis plan for the cause of the failure.
  • Fig. 1 shows a schematic flowchart of a map-based fault diagnosis method according to an embodiment of the present application. As shown in Fig. 1, the method includes step S110 to step S140.
  • Step S110 Receive map usage information reported by each automatic driving device.
  • the map can be established in the following ways: firstly, data collection is performed.
  • the map collection vehicle records sensor measurement data while driving on the road in the target area, such as laser data measured by lidar sensors, GNSS (Global Navigation Satellite System, Global Navigation Satellite System) Location data measured by the sensor.
  • GNSS Global Navigation Satellite System, Global Navigation Satellite System
  • the map contains the location information corresponding to the laser data, and the map can also be called a location map.
  • the above scenario takes the use of lidar to collect data as an example. In practical applications, it can also be extended to the scene of using a camera to collect data. For example, when building a map, the feature points are extracted from the image collected by the camera, and then projected onto the map.
  • the map contains scene contour features (such as lidar measurement points, feature points extracted by camera photography) and corresponding location information.
  • the automatic driving equipment obtains map usage information by matching the real-time measurement data of the sensor with the corresponding data contained in the map.
  • step S120 the status information of each area in the map is generated according to the map usage information.
  • the map can be divided into different areas, and the status information of each area in the map can be generated according to the map usage information.
  • multiple automatic driving devices can be used to comprehensively obtain the reported usage information to generate status information of each area, so as to avoid diagnosis errors caused by a single automatic driving device false alarm. In this way, the status information of each area in the map can be obtained, thereby providing technical support for business areas such as logistics and food delivery.
  • Step S130 Determine a hotspot area in the map according to the status information of each area.
  • hotspot areas in the map can be determined based on the status information, which is convenient for quickly determining areas that may have defects.
  • Step S140 Determine the fault object according to the status information of the hotspot area.
  • the status information of the hotspot area can be analyzed to obtain whether the analyzed hotspot area has a fault. In this way, the fault object is determined based on the status information of the hot spot area.
  • the method shown in Figure 1 can quickly diagnose possible defects in the map based on the information of the map, and determine the faulty object. Improve the efficiency of fault diagnosis, and provide reliable guarantee for the normal operation of map-based automatic driving.
  • the map usage information may include the map matching degree score and the pose information of the automatic driving device.
  • generating the state information of each area in the map includes: Map usage information, according to the posture information of the automatic driving device that reported the map usage information, determine the area matching the map usage information, and obtain the correspondence between the map usage information and the matched area; for each For the region, the average value of the map matching score corresponding to the region is calculated according to the corresponding relationship, and the average value is used as the state score of the region.
  • the automatic driving equipment uses lidar sensors and GNSS sensors to measure data respectively. Find the corresponding laser data in the positioning map according to the current GNSS sensor measurement data, and then calculate the matching degree between the current laser radar sensor measurement data and the found laser data to obtain a map matching score.
  • the map usage information may include the map matching degree score and the pose information of the automatic driving device, where the map matching degree score is the score of the positioning result.
  • the scoring basis may include the matching degree between the laser radar measurement result of the autopilot device and the corresponding laser data in the map. The better the match between the two, the higher the map matching score score.
  • the pose information of the autopilot device is the position information of the autopilot device in space and the posture information of the autopilot device, which can be represented by coordinates (x, y, theta). Where x represents the abscissa value of the space, y represents the ordinate value of the space, and theta represents the angle value between the posture of the autonomous driving device in the space and the coordinate system.
  • the status information of each area in the map can be generated according to the content characteristics of the map usage information. For example, based on each piece of map usage information, such as the location information of the autonomous driving device that reports the piece of map usage information in space and the posture information of the autonomous driving device, an area that matches the piece of map usage information can be determined, and Confirm the correspondence between the piece of map usage information and the matched area. In this way, you can get the area that matches the usage information of each map. For each region, the average value of the map matching degree score corresponding to the region can also be calculated according to the corresponding relationship, and the statistically obtained average value is used as the state score of the region, which reflects the state matching degree of the region.
  • determining the hotspot area in the map according to the state information of each area includes: selecting several areas as hotspot areas according to the state score from low to high; and/or The area where the status score is lower than the preset value is regarded as a hot spot area.
  • a hot spot area is an area where there may be anomalies or map defects.
  • the state scores of each area can be calculated separately, and then the state scores are performed in descending order Sort. In this way, several state scores can be selected according to the state scores from low to high, and the area corresponding to the selected state score can be used as a hot spot area. It is also possible to preset a certain threshold, and then compare the state score with the preset value. If the state score is lower than the preset value, the area corresponding to the state score is regarded as a hot spot area. In this way, hot spots can be determined automatically and quickly.
  • the map usage information may also include the identification of the automatic driving device, and determining the fault object according to the status information of the hotspot area includes: for each hotspot area, according to the identification of the automatic driving device, based on the identification of the automatic driving device The map matching score in the map usage information corresponding to the hot spot area is calculated, and the state score of each automatic driving device related to the hot spot area is calculated; if the state score of the target automatic driving device is not the same as the state score of other automatic driving devices If there is consistency, the target autopilot device is regarded as the target of the failure.
  • the autonomous driving device is associated with a specific unique identifier.
  • the unique ID information of the autonomous driving device for each vehicle can be represented by vehicles_id.
  • the map usage information may also include the identification of the automatic driving device, and the fault object may be determined based on the unique identification and combined with the status information of the hotspot area.
  • the map matching score corresponding to each hot spot area can be calculated, and then the state score of each automatic driving device related to the hot spot area can be calculated according to the automatic driving device identification.
  • the status score of the target autopilot device can be compared and analyzed with the status scores of other autopilot devices.
  • the target autonomous driving device can be determined as the fault object, and the possible errors in the fault diagnosis can be reduced.
  • the map usage information may also include time information
  • determining the fault object according to the status information of the hotspot area also includes: for each hotspot area, if the automatic driving related to the hotspot area If the status scores of the devices are consistent, the map matching scores corresponding to the hotspots are sorted in chronological order to obtain the map matching score curve; if the map matching scores curve meets the fault characteristics, the hotspot area is regarded as a fault Object.
  • the map usage information can also include time information, and the time information can be represented by a timestamp.
  • the state scores of each automatic driving device related to the hotspot area can be counted first. If the state scores of each automatic driving device have obvious similar characteristics, it can be considered as consistent. Then, the map matching degree scores corresponding to the hotspot area can be sorted in chronological order, so as to obtain the map matching degree score curve.
  • the curve reflected by the fault object often has obvious characteristics, such as obvious violent fluctuations and sudden cliff-like changes in the curve.
  • the curve characteristics of these fault objects can be summarized and stored in advance, and compared with the map matching degree scoring curve corresponding to the hot area. If the map matching degree scoring curve meets the fault characteristics, the hot area is regarded as the fault object. In this way, the faulty object can be determined automatically and quickly according to the map matching degree scoring curve.
  • the region is a map grid obtained by rasterizing the map
  • the above method further includes: providing a visualization interface based on the map grid, and displaying the information of each map grid in the visualization interface status information.
  • the map raster is a raster dataset that is consistent with the map in terms of content, geometric accuracy, and color after geometric correction and color correction are performed on the map.
  • the map grid can be obtained by rasterizing the map, that is, a rasterized map grid can be obtained.
  • a visualization interface based on map grids can be provided. In this way, the user can view the status information of each map grid in the visualization interface of the map grid, for example, can view information such as the passage of automatic driving equipment in a unit time and the statistics of the number of faulty objects.
  • the method further includes: generating a confidence map corresponding to the map according to the state information of each area; sending the confidence map to the automatic driving device to make When the autopilot device uses the map, it adjusts the weight of the map according to the confidence map.
  • a confidence map corresponding to the map can be generated according to the status information of each area.
  • the confidence map contains the weight ratio information used on the map.
  • the confidence map can be sent to the automatic driving device, so that when the automatic driving device uses the map, the weight of the map is adjusted according to the confidence map. For example, when driving on the road corresponding to the unupdated data of the map, the weight of the positioning map can be reduced accordingly, and the automatic driving equipment's own sensing device and satellite navigation positioning data can continue to maintain normal driving. In this way, the normal operation of the automatic driving equipment is maintained without updating the map.
  • determining the faulty object can be achieved through statistical analysis of multiple positioning points.
  • each autopilot device When each autopilot device is running, it can get the following data structure: (x, y, theta, score, vehicles_id, timestamp).
  • x represents the value of the abscissa in the coordinate system
  • y represents the value of the ordinate in the coordinate system
  • theta represents the angle between the posture of the autonomous driving device in the space and the coordinate system
  • score represents the map matching score
  • vehicle_id represents autonomous driving
  • timestamp represents the time information represented by the timestamp.
  • visual statistics can be performed by establishing a coordinate system in space and normalizing x and y to the nearest 0.5 meter precision integral point. For example, rasterize the map to obtain the map grid, and use the grid in the map as a unit to analyze to determine the hotspot area.
  • the following data set can be obtained: (x, y, score1, vehicles_id1, timestamp_1); (x, y, score2, vehicles_id1 ,timestamp_3); (x,y,score3,vechile_id2,timestamp_7); (x,y,score4,vechile_id3,timestamp_4); (x,y,score5,vechile_id1,timestamp_2).
  • the analysis can be performed by sorting the map matching scores in chronological order, drawing a time-map matching score curve, and analyzing the curve law shown by the time-map matching score curve, so as to determine the faulty object.
  • the corresponding curve characteristics can be obtained.
  • the horizontal axis of the curve is [timestamp_1,timestamp_2,timestamp_3,timestamp_4,timestamp_5]
  • the vertical axis of the curve is [score1,score5,score2,score4,score5].
  • Fig. 2 shows a schematic structural diagram of a map-based fault diagnosis device according to an embodiment of the present application.
  • the map-based fault diagnosis device 200 includes:
  • the receiving unit 210 is configured to receive map usage information reported by each automatic driving device.
  • the map can be established in the following ways: firstly, data collection is performed.
  • the map collection vehicle records sensor measurement data while driving on the road in the target area, such as laser data measured by lidar sensors, GNSS (Global Navigation Satellite System, Global Navigation Satellite System) Location data measured by the sensor.
  • GNSS Global Navigation Satellite System, Global Navigation Satellite System
  • the map contains the location information corresponding to the laser data, and the map can also be called a location map.
  • the above scenario takes the use of lidar to collect data as an example. In practical applications, it can also be extended to the scene of using a camera to collect data. For example, when building a map, the feature points are extracted from the image collected by the camera, and then projected onto the map.
  • the map contains scene contour features (such as lidar measurement points, feature points extracted by camera photography) and corresponding location information.
  • the automatic driving equipment obtains map usage information by matching the real-time measurement data of the sensor with the corresponding data contained in the map.
  • the embodiments of this application are mainly implemented based on maps, so map usage information of unmanned equipment is needed.
  • the map usage information may include map matching scores, pose information of the automatic driving device, and the like. In this way, it is possible to comprehensively analyze the cause of the failure by analyzing the map usage information reported by the automatic driving device, so as to determine the target of the failure.
  • the map can be divided into different areas, and the status information of each area in the map can be generated according to the map usage information.
  • multiple automatic driving devices can be used to comprehensively obtain the reported usage information to generate status information of each area, so as to avoid diagnosis errors caused by a single automatic driving device false alarm. In this way, the status information of each area in the map can be obtained.
  • the diagnosis unit 220 is configured to generate status information of each area in the map according to the map usage information; determine a hot spot area in the map according to the status information of each area; determine a fault object according to the status information of the hot spot area.
  • hotspot areas in the map can be determined based on the status information, which is convenient for quickly determining areas that may have defects.
  • the status information of the hotspot area can be analyzed to obtain whether the analyzed hotspot area has a fault. In this way, the fault object is determined based on the status information of the hot spot area.
  • the device shown in FIG. 2 can quickly diagnose possible defects in the map based on the information of the map, and determine the faulty object. Improve the efficiency of fault diagnosis, provide reliable guarantee for the normal operation of map-based autonomous driving, and provide technical support for logistics, food delivery and other business areas.
  • the map use information may include the map matching degree score and the pose information of the automatic driving device.
  • the diagnosis unit 220 is used for each piece of map use information, according to the report.
  • the pose information of the automatic driving device of the map usage information determines the area that matches the piece of map usage information, and obtains the correspondence between the piece of map usage information and the matched area; for each area, according to the correspondence, Count the average value of the map matching scores corresponding to the area, and use the average value as the state score of the area.
  • the diagnosis unit 220 is configured to select a number of areas as hot spots according to the state score from low to high; and/or, the state score is lower than a preset value The area serves as a hot spot.
  • the map usage information may also include the identification of the automatic driving equipment, and the diagnosis unit 220 is used for each hotspot area, according to the identification of the automatic driving equipment, based on all the corresponding hotspot areas. According to the map matching score in the map usage information, calculate the state score of each automatic driving device related to the hot area; if the state score of the target automatic driving device is not consistent with the state scores of other automatic driving devices, then Take the target autopilot device as the target of the failure.
  • the map usage information may also include time information, and the diagnosis unit 220 is used for each hotspot area, if the state scores of each automatic driving device related to the hotspot area are consistent If the map matching degree score corresponding to the hot spot area is sorted in chronological order, the map matching degree score curve is obtained; if the map matching degree score curve meets the fault characteristics, the hot spot area is regarded as the fault object.
  • the area is a map grid obtained by rasterizing the map
  • the diagnosis unit 220 is also used to provide a visualization interface based on the map grid, in which each map grid is displayed. The status information of the grid.
  • the device further includes: a confidence unit, configured to generate a confidence map corresponding to the map according to the state information of each region; and send the confidence map to the automatic driving equipment , So that when the automatic driving device uses the map, the weight of the map is adjusted according to the confidence map.
  • a confidence unit configured to generate a confidence map corresponding to the map according to the state information of each region
  • the embodiment of the present application receives map usage information reported by each automatic driving device; generates state information of each area in the map based on the map use information; determines the location based on the state information of each area.
  • the hot spot area in the map; the fault object is determined according to the status information of the hot spot area.
  • modules or units or components in the embodiments can be combined into one module or unit or component, and in addition, they can be divided into multiple sub-modules or sub-units or sub-components. Except that at least some of such features and/or processes or units are mutually exclusive, any combination can be used to compare all features disclosed in this specification (including the accompanying claims, abstract and drawings) and any method or methods disclosed in this manner or All the processes or units of the equipment are combined. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstract and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.
  • the various component embodiments of the present application may be implemented by hardware, or by software modules running on one or more processors, or by a combination of them.
  • a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the map-based fault diagnosis apparatus according to the embodiments of the present application.
  • This application can also be implemented as a device or device program (for example, a computer program and a computer program product) for executing part or all of the methods described herein.
  • Such a program for implementing the present application may be stored on a computer-readable medium, or may have the form of one or more signals.
  • Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
  • FIG. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • the electronic device 300 includes a processor 310 and a memory 320 storing computer-executable instructions (computer-readable program codes).
  • the memory 320 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM.
  • the memory 320 has a storage space 330 for storing computer-readable program codes 331 for executing any method steps in the above-mentioned methods.
  • the storage space 330 for storing computer-readable program codes may include various computer-readable program codes 331 respectively used to implement various steps in the above method.
  • the computer-readable program code 331 may be read from or written into one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards, or floppy disks. Such a computer program product is usually, for example, a computer-readable storage medium as described in FIG. 4.
  • Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present application.
  • the computer-readable storage medium 400 stores the computer-readable program code 331 for executing the method steps according to the present application, which can be read by the processor 310 of the electronic device 300, when the computer-readable program code 331 is run by the electronic device 300 , Causing the electronic device 300 to execute each step in the method described above.
  • the computer readable program code 331 stored in the computer readable storage medium can execute the method shown in any of the above embodiments.
  • the computer readable program code 331 may be compressed in an appropriate form.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Remote Sensing (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

A map-based fault diagnosis method and apparatus, an electronic device, and a storage medium. The method comprises: receiving map use information reported by each autonomous driving device (S110); generating the state information of each region in a map according to the map use information (S120); determining a hotspot region in the map according to the state information of each region (S130); and determining a fault object according to the state information of the hotspot region (S140).

Description

基于地图的故障诊断Map-based fault diagnosis 技术领域Technical field
本申请涉及自动驾驶领域,具体涉及基于地图的故障诊断方法、装置、电子设备和存储介质。This application relates to the field of automatic driving, and specifically to map-based fault diagnosis methods, devices, electronic equipment, and storage media.
背景技术Background technique
自动驾驶可以应用于物流、外卖配送等领域,地图是自动驾驶中所依赖的重要部分。自动驾驶设备通过自身采集的各类测量数据与地图进行匹配,以确定自身的位置。Autonomous driving can be applied to areas such as logistics, food delivery, and so on. Maps are an important part of autonomous driving. The autonomous driving equipment matches the map with various measurement data collected by itself to determine its own location.
发明内容Summary of the invention
依据本申请的一个方面,提供了一种基于地图的故障诊断方法,包括:接收各个自动驾驶设备上报的地图使用信息;根据所述地图使用信息生成地图中各区域的状态信息;根据各所述区域的所述状态信息确定所述地图中的热点区域;根据所述热点区域的状态信息确定故障对象。According to one aspect of this application, a map-based fault diagnosis method is provided, including: receiving map usage information reported by each automatic driving device; generating state information of each area in the map according to the map usage information; The state information of the area determines a hot spot area in the map; and the fault object is determined according to the state information of the hot spot area.
可选地,所述地图使用信息包括地图匹配度得分和所述自动驾驶设备的位姿信息,根据所述地图使用信息生成所述地图中各区域的状态信息包括:对每条所述地图使用信息,根据上报该条地图使用信息的所述自动驾驶设备的位姿信息确定与该条地图使用信息相匹配的区域,得到该条地图使用信息与所述匹配的区域之间的对应关系;对每个所述区域,根据所述对应关系,统计该区域对应的地图匹配度得分的平均值,将所述平均值作为该区域的状态得分。Optionally, the map usage information includes a map matching degree score and pose information of the autonomous driving device, and generating state information of each area in the map according to the map usage information includes: using Information, according to the pose information of the automatic driving device that reports the piece of map usage information, determine the area that matches the piece of map usage information, and obtain the correspondence between the piece of map usage information and the matched area; For each of the regions, the average value of the map matching scores corresponding to the region is calculated according to the corresponding relationship, and the average value is used as the state score of the region.
可选地,根据各所述区域的所述状态信息确定所述地图中的热点区域包括:按所述状态得分由低到高选出若干个区域作为所述热点区域;和/或,将所述状态得分低于预设值的区域作为所述热点区域。Optionally, determining the hotspot area in the map according to the status information of each of the areas includes: selecting several areas as the hotspot area according to the status score from low to high; and/or The area where the state score is lower than the preset value is regarded as the hot spot area.
可选地,所述地图使用信息还包括自动驾驶设备标识,根据所述热点区域的状态信息确定故障对象包括:对每个所述热点区域,按自动驾驶设备标识,基于与该热点区域对应的所述地图使用信息中的所述地图匹配度得分,计算与该热点区域相关的各所述自动驾驶设备的状态得分;若目标自动驾驶设备的状态得分与其他自动驾驶设备的状态得分不具备一致性,则将所述目标自动驾驶设备作为故障对象。Optionally, the map usage information further includes the identification of the automatic driving device, and determining the fault object according to the status information of the hotspot area includes: for each of the hotspot areas, according to the identification of the automatic driving device, based on the identification of the hotspot area The map matching degree score in the map usage information is calculated, and the state score of each of the autonomous driving devices related to the hot spot area is calculated; if the state score of the target automatic driving device is not consistent with the state scores of other automatic driving devices If it is not, the target autopilot device is regarded as the fault target.
可选地,所述地图使用信息还包括时间信息,根据所述热点区域的状态信息确定故障对象还包括:对于每个热点区域,若与该热点区域相关的各所述自动驾驶设备的状态得分具备一致性,则将该热点区域对应的地图匹配度得分按时间先后顺序进行排序,得到地图匹配度得分曲线;若所述地图匹配度得分曲线符合故障特征,则将该热点区域作为故障对象。Optionally, the map usage information further includes time information, and determining the fault object according to the status information of the hotspot area further includes: for each hotspot area, if the status score of each of the automatic driving devices related to the hotspot area is scored If there is consistency, the map matching degree scores corresponding to the hot spot area are sorted in chronological order to obtain a map matching degree score curve; if the map matching degree score curve meets the fault characteristics, the hot spot area is regarded as a fault object.
可选地,所述区域为对地图栅格化得到的地图栅格,所述方法还包括:提供基于所述地图栅格的可视化界面,在所述可视化界面中展示各所述地图栅格的状态信息。Optionally, the area is a map grid obtained by rasterizing a map, and the method further includes: providing a visualization interface based on the map grid, and displaying the information of each map grid in the visualization interface. status information.
可选地,如上述任一项所述的方法,其中,所述方法还包括:根据各所述区域的状态信息,生成与所述地图对应的置信图;将所述置信图发送给自动驾驶设备,以使所述自动驾驶设备在使用所述地图时,根据所述置信图调整所述地图的使用权重。Optionally, the method according to any one of the above, wherein the method further includes: generating a confidence map corresponding to the map according to the status information of each of the regions; and sending the confidence map to the automatic driving Device, so that when the automatic driving device uses the map, it adjusts the use weight of the map according to the confidence map.
依据本申请的另一方面,提供了一种基于地图的故障诊断装置,包括:接收单元,用于接收各个自动驾驶设备上报的地图使用信息;诊断单元,用于根据所述地图使用信息生成地图中各区域的状态信息;根据各所述区域的所述状态信息确定所述地图中的热点区域;根据所述热点区域的状态信息确定故障对象。According to another aspect of the present application, there is provided a map-based fault diagnosis device, including: a receiving unit for receiving map usage information reported by each automatic driving device; a diagnosis unit for generating a map based on the map usage information The status information of each area in each of the areas; determine the hot spot area in the map according to the status information of each area; determine the fault object according to the status information of the hot spot area.
可选地,所述地图使用信息包括地图匹配度得分和所述自动驾驶设备的位姿信息,所述诊断单元,用于对每条所述地图使用信息,根据上报该条地图使用信息的所述自动驾驶设备的位姿信息确定与该条地图使用信息相匹配的区域,得到该条地图使用信息与所述匹配的区域之间的对应关系;对每个所述区域,根据所述对应关系,统计该区域对应的地图匹配度得分的平均值,将所述平均值作为该区域的状态得分。Optionally, the map usage information includes a map matching degree score and pose information of the automatic driving device, and the diagnosis unit is used for each piece of the map usage information, according to the report of the piece of map usage information. The pose information of the automatic driving device determines the area that matches the piece of map usage information, and obtains the correspondence between the piece of map usage information and the matched area; for each of the areas, according to the correspondence Count the average value of the map matching scores corresponding to the area, and use the average value as the state score of the area.
可选地,所述诊断单元,用于按所述状态得分由低到高选出若干个区域作为所述热点区域;和/或,将所述状态得分低于预设值的区域作为所述热点区域。Optionally, the diagnosis unit is configured to select several areas as the hot spot area according to the state score from low to high; and/or use the area with the state score lower than a preset value as the Hot spot area.
可选地,所述地图使用信息还包括自动驾驶设备标识,所述诊断单元,用于对每个所述热点区域,按自动驾驶设备标识,基于与该热点区域对应的所述地图使用信息中的所述地图匹配度得分,计算与该热点区域相关的各所述自动驾驶设备的状态得分;若目标自动驾驶设备的状态得分与其他自动驾驶设备的状态得分不具备一致性,则将所述目标自动驾驶设备作为故障对象。Optionally, the map usage information further includes an automatic driving device identification, and the diagnosis unit is configured to, for each of the hotspot areas, according to the automatic driving device identification, based on the map usage information corresponding to the hotspot area Calculate the state score of each of the autonomous driving devices related to the hot spot area; if the state score of the target autonomous driving device is not consistent with the state scores of other autonomous driving devices, then the The target autopilot equipment is the target of the failure.
可选地,所述地图使用信息还包括时间信息,所述诊断单元,用于对于每个热点区域,若与该热点区域相关的各所述自动驾驶设备的状态得分具备一致性,则将该热点区域对应的地图匹配度得分按时间先后顺序进行排序,得到地图匹配度得分曲线;若所述 地图匹配度得分曲线符合故障特征,则将该热点区域作为故障对象。Optionally, the map usage information further includes time information, and the diagnosis unit is configured to, for each hotspot area, if the state scores of the autonomous driving devices related to the hotspot area are consistent, then The map matching degree scores corresponding to the hot spot areas are sorted in chronological order to obtain a map matching degree score curve; if the map matching degree score curve meets the fault characteristics, the hot spot area is taken as the fault object.
可选地,所述区域为对地图栅格化得到的地图栅格,所述诊断单元,还用于提供基于所述地图栅格的可视化界面,在所述可视化界面中展示各所述地图栅格的状态信息。Optionally, the area is a map grid obtained by rasterizing a map, and the diagnosis unit is further configured to provide a visualization interface based on the map grid, and display each of the map grids in the visualization interface. The status information of the grid.
可选地,所述装置还包括:置信单元,用于根据各所述区域的状态信息,生成与所述地图对应的置信图;将所述置信图发送给自动驾驶设备,以使所述自动驾驶设备在使用所述地图时,根据所述置信图调整所述地图的使用权重。Optionally, the device further includes: a confidence unit, configured to generate a confidence map corresponding to the map according to the state information of each of the regions; and send the confidence map to an automatic driving device to enable the automatic driving When the driving device uses the map, it adjusts the usage weight of the map according to the confidence map.
依据本申请的又一方面,提供了一种电子设备,包括:处理器;以及存储计算机可执行指令的存储器,所述可执行指令在被执行时使所述处理器执行如上述任一所述的方法。According to another aspect of the present application, there is provided an electronic device, including: a processor; and a memory storing computer-executable instructions, which when executed, cause the processor to execute any of the foregoing Methods.
依据本申请的再一方面,提供了一种计算机可读存储介质,其中,所述计算机可读存储介质存储一个或多个程序,所述一个或多个程序当被处理器执行时,实现如上述任一所述的方法。According to another aspect of the present application, there is provided a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the Any of the methods described above.
由上述可知,本申请的实施例,通过接收各个自动驾驶设备上报的地图使用信息;根据所述地图使用信息生成地图中各区域的状态信息;根据所述状态信息确定地图中的热点区域;根据所述热点区域的状态信息确定故障对象。有益效果在于,可以基于地图的信息,快速对地图可能存在的缺陷进行诊断,确定出故障对象,提高了故障诊断的效率,为基于地图的自动驾驶的正常运行提供可靠保障,从而为物流、外卖等业务领域提供了技术支撑。It can be seen from the above that the embodiment of the present application receives map usage information reported by each automatic driving device; generates status information of each area in the map according to the map usage information; determines the hotspot area in the map according to the status information; The status information of the hot spot area determines the fault object. The beneficial effect is that it can quickly diagnose the possible defects of the map based on the information of the map, determine the faulty object, improve the efficiency of the fault diagnosis, and provide a reliable guarantee for the normal operation of the map-based autonomous driving, thereby providing logistics and food delivery. Provide technical support in other business areas.
上述说明仅是本申请实施例的概述,为了能够更清楚了解本申请的技术手段,而可依照说明书的内容予以实施,并且为了让本申请的上述和其它目的、特征和优点能够更明显易懂,以下特举本申请的具体实施方式。The above description is only an overview of the embodiments of the application. In order to understand the technical means of the application more clearly, it can be implemented in accordance with the content of the specification, and to make the above and other purposes, features and advantages of the application more obvious and understandable. , The specific implementations of this application are cited below.
附图说明Description of the drawings
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本申请的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:By reading the detailed description of the preferred embodiments below, various other advantages and benefits will become clear to those of ordinary skill in the art. The drawings are only used for the purpose of illustrating the preferred embodiments, and are not considered as a limitation to the application. Also, throughout the drawings, the same reference symbols are used to denote the same components. In the attached picture:
图1示出了根据本申请一个实施例的基于地图的故障诊断方法的流程示意图;Fig. 1 shows a schematic flowchart of a map-based fault diagnosis method according to an embodiment of the present application;
图2示出了根据本申请一个实施例的基于地图的故障诊断装置的结构示意图;Figure 2 shows a schematic structural diagram of a map-based fault diagnosis device according to an embodiment of the present application;
图3示出了根据本申请一个实施例的电子设备的结构示意图;Fig. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present application;
图4示出了根据本申请一个实施例的计算机可读存储介质的结构示意图。Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present application.
具体实施方式Detailed ways
下面将参照附图更详细地描述本申请的示例性实施例。虽然附图中显示了本申请的示例性实施例,然而应当理解,可以以各种形式实现本申请而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本申请,并且能够将本申请的范围完整的传达给本领域的技术人员。Hereinafter, exemplary embodiments of the present application will be described in more detail with reference to the accompanying drawings. Although the exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the application and to fully convey the scope of the application to those skilled in the art.
自动驾驶设备利用激光雷达采集的激光点云与激光地图进行匹配,此时激光地图也可以称为激光定位地图。为了确保自动驾驶的安全性,对地图的精度和实时准确性要求较高。然而实际应用中可能存在匹配度偏低的情况,这可能由于地图更新不及时或是自动驾驶设备故障等原因造成,但目前往往仅关注地图的更新,缺少对故障原因的诊断方案。The automatic driving equipment uses the laser point cloud collected by the laser radar to match the laser map. At this time, the laser map can also be called a laser location map. In order to ensure the safety of autonomous driving, higher requirements are imposed on the accuracy and real-time accuracy of the map. However, in actual applications, the matching degree may be low, which may be caused by reasons such as untimely map update or failure of automatic driving equipment. However, at present, only the map update is often concerned, and there is no diagnosis plan for the cause of the failure.
图1示出了根据本申请一个实施例的基于地图的故障诊断方法的流程示意图。如图1所示,该方法包括步骤S110至步骤S140。Fig. 1 shows a schematic flowchart of a map-based fault diagnosis method according to an embodiment of the present application. As shown in Fig. 1, the method includes step S110 to step S140.
步骤S110,接收各个自动驾驶设备上报的地图使用信息。Step S110: Receive map usage information reported by each automatic driving device.
地图可以通过如下方式建立:首先进行数据采集,地图采集车在目标区域道路行驶的过程中记录传感器的测量数据,例如激光雷达传感器测量的激光数据,GNSS(Global Navigation Satellite System,全球导航卫星系统)传感器测量的位置数据。其次依据采集的数据进行建图,对传感器采集的测量数据进行时间戳对齐,再以GNSS传感器的测量姿态和地图采集车的内部传感器标定为依据,将激光雷达传感器测量的激光数据投影到地图上。这样地图就包含了与激光数据对应的位置信息,该地图也可称为定位地图。上面的场景以使用激光雷达采集数据为例,在实际应用中也可以拓展到使用摄像头采集数据的场景。例如,在建图时,将摄像头采集的图片提取特征点,再投影至地图中。The map can be established in the following ways: firstly, data collection is performed. The map collection vehicle records sensor measurement data while driving on the road in the target area, such as laser data measured by lidar sensors, GNSS (Global Navigation Satellite System, Global Navigation Satellite System) Location data measured by the sensor. Secondly, build a map based on the collected data, align the measurement data collected by the sensor with time stamps, and then project the laser data measured by the lidar sensor onto the map based on the measurement attitude of the GNSS sensor and the internal sensor calibration of the map collection vehicle . In this way, the map contains the location information corresponding to the laser data, and the map can also be called a location map. The above scenario takes the use of lidar to collect data as an example. In practical applications, it can also be extended to the scene of using a camera to collect data. For example, when building a map, the feature points are extracted from the image collected by the camera, and then projected onto the map.
也就是说,地图(定位地图)中包含了场景轮廓特征(例如激光雷达测量点、通过摄像头拍照提取的特征点)以及对应的位置信息。自动驾驶设备在行驶过程中,通过将传感器的实时测量数据与地图中包含的相应数据进行匹配,得到地图使用信息。That is to say, the map (location map) contains scene contour features (such as lidar measurement points, feature points extracted by camera photography) and corresponding location information. During the driving process, the automatic driving equipment obtains map usage information by matching the real-time measurement data of the sensor with the corresponding data contained in the map.
步骤S120,根据地图使用信息生成地图中各区域的状态信息。In step S120, the status information of each area in the map is generated according to the map usage information.
可以将地图划分为不同区域,并根据地图使用信息生成地图中各区域的状态信息。 本申请可以利用多个自动驾驶设备综合获取上报的使用信息,以生成各区域的状态信息,避免因单个自动驾驶设备误报带来的诊断错误。这样,就可以获取地图中各区域的状态信息,从而为物流、外卖等业务领域提供了技术支撑。The map can be divided into different areas, and the status information of each area in the map can be generated according to the map usage information. In this application, multiple automatic driving devices can be used to comprehensively obtain the reported usage information to generate status information of each area, so as to avoid diagnosis errors caused by a single automatic driving device false alarm. In this way, the status information of each area in the map can be obtained, thereby providing technical support for business areas such as logistics and food delivery.
步骤S130,根据各区域的状态信息确定地图中的热点区域。Step S130: Determine a hotspot area in the map according to the status information of each area.
在没有故障的情况下,各区域的状态信息近乎一致。因此,通过查找与其他区域的状态信息不一致的区域,可以将具有明显异常特征的区域确定为热点区域。这样,就可以根据状态信息确定地图中的热点区域,便于快速确定可能存在缺陷的区域。In the absence of faults, the status information of each area is almost the same. Therefore, by searching for areas that are inconsistent with the status information of other areas, areas with obvious abnormal features can be determined as hot spots. In this way, hotspot areas in the map can be determined based on the status information, which is convenient for quickly determining areas that may have defects.
步骤S140,根据热点区域的状态信息确定故障对象。Step S140: Determine the fault object according to the status information of the hotspot area.
可以对热点区域的状态信息进行分析,以得到所分析的热点区域是否存在故障。这样,就实现了根据热点区域的状态信息确定故障对象。The status information of the hotspot area can be analyzed to obtain whether the analyzed hotspot area has a fault. In this way, the fault object is determined based on the status information of the hot spot area.
可见,如图1所示的方法,可以基于地图的信息,快速对地图可能存在的缺陷进行诊断,确定出故障对象。提高了故障诊断的效率,为基于地图的自动驾驶的正常运行提供可靠保障。It can be seen that the method shown in Figure 1 can quickly diagnose possible defects in the map based on the information of the map, and determine the faulty object. Improve the efficiency of fault diagnosis, and provide reliable guarantee for the normal operation of map-based automatic driving.
在本申请的一个实施例中,上述方法中,地图使用信息可以包括地图匹配度得分和所述自动驾驶设备的位姿信息,根据地图使用信息生成地图中各区域的状态信息包括:对每条地图使用信息,根据上报该条地图使用信息的自动驾驶设备的位姿信息确定与该条地图使用信息相匹配的区域,得到该条地图使用信息与匹配的区域之间的对应关系;对每个区域,根据所述对应关系,统计该区域对应的地图匹配度得分的平均值,将该平均值作为该区域的状态得分。In an embodiment of the present application, in the above method, the map usage information may include the map matching degree score and the pose information of the automatic driving device. According to the map usage information, generating the state information of each area in the map includes: Map usage information, according to the posture information of the automatic driving device that reported the map usage information, determine the area matching the map usage information, and obtain the correspondence between the map usage information and the matched area; for each For the region, the average value of the map matching score corresponding to the region is calculated according to the corresponding relationship, and the average value is used as the state score of the region.
例如,自动驾驶设备在行驶过程中,通过激光雷达传感器和GNSS传感器分别进行数据的测量。依据当前GNSS传感器的测量数据在定位地图中查找出对应的激光数据,再将当前激光雷达传感器的测量数据与查找出的激光数据进行匹配度计算,得到地图匹配度得分。For example, in the course of driving, the automatic driving equipment uses lidar sensors and GNSS sensors to measure data respectively. Find the corresponding laser data in the positioning map according to the current GNSS sensor measurement data, and then calculate the matching degree between the current laser radar sensor measurement data and the found laser data to obtain a map matching score.
因此,地图使用信息可以包括地图匹配度得分和自动驾驶设备的位姿信息,其中,地图匹配度得分是定位结果的打分。打分的依据可以包括自动驾驶设备激光雷达的测量结果与地图中对应的激光数据的匹配度,两者之间的匹配越好,则地图匹配度得分score就越高。自动驾驶设备的位姿信息是自动驾驶设备在空间中的位置信息和自动驾驶设备的姿态信息,可以用坐标(x,y,theta)来表示。其中x表示空间的横坐标值,y表示空间的纵坐标值,theta表示空间中自动驾驶设备的姿态与坐标系的夹角值。可以根据地图使 用信息的内容特征生成地图中各区域的状态信息。例如,可以根据每条地图使用信息,诸如上报该条地图使用信息的自动驾驶设备在空间中的位置信息和该自动驾驶设备的姿态信息,确定出与该条地图使用信息相匹配的区域,并确认该条地图使用信息与所述匹配的区域之间的对应关系。这样,就可以得到每条地图使用信息相匹配的区域。对每个区域,还可以根据所述对应关系计算该区域对应的地图匹配度得分的平均值,将统计得到的平均值作为该区域的状态得分,这从而反映出该区域的状态匹配度。Therefore, the map usage information may include the map matching degree score and the pose information of the automatic driving device, where the map matching degree score is the score of the positioning result. The scoring basis may include the matching degree between the laser radar measurement result of the autopilot device and the corresponding laser data in the map. The better the match between the two, the higher the map matching score score. The pose information of the autopilot device is the position information of the autopilot device in space and the posture information of the autopilot device, which can be represented by coordinates (x, y, theta). Where x represents the abscissa value of the space, y represents the ordinate value of the space, and theta represents the angle value between the posture of the autonomous driving device in the space and the coordinate system. The status information of each area in the map can be generated according to the content characteristics of the map usage information. For example, based on each piece of map usage information, such as the location information of the autonomous driving device that reports the piece of map usage information in space and the posture information of the autonomous driving device, an area that matches the piece of map usage information can be determined, and Confirm the correspondence between the piece of map usage information and the matched area. In this way, you can get the area that matches the usage information of each map. For each region, the average value of the map matching degree score corresponding to the region can also be calculated according to the corresponding relationship, and the statistically obtained average value is used as the state score of the region, which reflects the state matching degree of the region.
在本申请的一个实施例中,上述方法中,根据各区域的状态信息确定地图中的热点区域包括:按所述状态得分由低到高选出若干个区域作为热点区域;和/或,将状态得分低于预设值的区域作为热点区域。In an embodiment of the present application, in the above method, determining the hotspot area in the map according to the state information of each area includes: selecting several areas as hotspot areas according to the state score from low to high; and/or The area where the status score is lower than the preset value is regarded as a hot spot area.
热点区域是可能存在异常或者地图缺陷的区域,为了更为准确和高效地确定出热点区域,可以先分别计算出各个区域的状态得分,然后再将所述状态得分按由低到高的顺序进行排序。这样就可以按所述状态得分由低到高选取出若干个状态得分,并将选出的状态得分对应的区域作为热点区域。也可以通过预设一定的阈值,然后将状态得分与预设值进行比较,若状态得分低于预设值,则将该状态得分对应的区域作为热点区域。这样,就可以自动、快速地确定出热点区域。A hot spot area is an area where there may be anomalies or map defects. In order to determine the hot spot area more accurately and efficiently, the state scores of each area can be calculated separately, and then the state scores are performed in descending order Sort. In this way, several state scores can be selected according to the state scores from low to high, and the area corresponding to the selected state score can be used as a hot spot area. It is also possible to preset a certain threshold, and then compare the state score with the preset value. If the state score is lower than the preset value, the area corresponding to the state score is regarded as a hot spot area. In this way, hot spots can be determined automatically and quickly.
在本申请的一个实施例中,上述方法中,地图使用信息还可以包括自动驾驶设备标识,根据热点区域的状态信息确定故障对象包括:对每个热点区域,按自动驾驶设备标识,基于与该热点区域对应的所述地图使用信息中的所述地图匹配度得分,计算与该热点区域相关的各自动驾驶设备的状态得分;若目标自动驾驶设备的状态得分与其他自动驾驶设备的状态得分不具备一致性,则将目标自动驾驶设备作为故障对象。In an embodiment of the present application, in the above method, the map usage information may also include the identification of the automatic driving device, and determining the fault object according to the status information of the hotspot area includes: for each hotspot area, according to the identification of the automatic driving device, based on the identification of the automatic driving device The map matching score in the map usage information corresponding to the hot spot area is calculated, and the state score of each automatic driving device related to the hot spot area is calculated; if the state score of the target automatic driving device is not the same as the state score of other automatic driving devices If there is consistency, the target autopilot device is regarded as the target of the failure.
自动驾驶设备关联有特定的唯一性标识,例如每辆车唯一的自动驾驶设备ID信息,可以用vechile_id来表示。地图使用信息还可以包括自动驾驶设备标识,可以根据该唯一性标识,并结合热点区域的状态信息确定故障对象。具体而言,可以计算出每个热点区域对应的地图匹配度得分,然后按自动驾驶设备标识,计算出与该热点区域相关的各自动驾驶设备的状态得分。可以将目标自动驾驶设备的状态得分与其他自动驾驶设备的状态得分进行比较分析,若目标自动驾驶设备的状态得分与其他自动驾驶设备的状态得分不具备一致性,例如,目标自动驾驶设备的状态得分明显低于其他自动驾驶设备的状态得分,则将目标自动驾驶设备作为故障对象。这样,可以通过多车统计分析的手段,并结合自动驾驶设备标识将目标自动驾驶设备确定为故障对象,减少故障诊断中可能存在的误差。The autonomous driving device is associated with a specific unique identifier. For example, the unique ID information of the autonomous driving device for each vehicle can be represented by vechile_id. The map usage information may also include the identification of the automatic driving device, and the fault object may be determined based on the unique identification and combined with the status information of the hotspot area. Specifically, the map matching score corresponding to each hot spot area can be calculated, and then the state score of each automatic driving device related to the hot spot area can be calculated according to the automatic driving device identification. The status score of the target autopilot device can be compared and analyzed with the status scores of other autopilot devices. If the status score of the target autopilot device is not consistent with the status scores of other autopilot devices, for example, the status of the target autopilot device If the score is significantly lower than the state scores of other autonomous driving devices, the target autonomous driving device will be regarded as the failure object. In this way, by means of multi-vehicle statistical analysis, combined with the identification of the automatic driving device, the target automatic driving device can be determined as the fault object, and the possible errors in the fault diagnosis can be reduced.
在本申请的一个实施例中,上述方法中,地图使用信息还可以包括时间信息,根据热点区域的状态信息确定故障对象还包括:对于每个热点区域,若与该热点区域相关的各自动驾驶设备的状态得分具备一致性,则将该热点区域对应的地图匹配度得分按时间先后顺序进行排序,得到地图匹配度得分曲线;若地图匹配度得分曲线符合故障特征,则将该热点区域作为故障对象。In an embodiment of the present application, in the above method, the map usage information may also include time information, and determining the fault object according to the status information of the hotspot area also includes: for each hotspot area, if the automatic driving related to the hotspot area If the status scores of the devices are consistent, the map matching scores corresponding to the hotspots are sorted in chronological order to obtain the map matching score curve; if the map matching scores curve meets the fault characteristics, the hotspot area is regarded as a fault Object.
由于不同的自动驾驶设备具有不同的车速与出现时间,因此将热点区域作为故障对象的分析过程会受到车速与时间的影响。为了更为准确快速地确定出故障对象,地图使用信息还可以包括时间信息,时间信息可以利用时间戳timestamp来表示。具体地,对于每个热点区域,可以先统计与该热点区域相关的各自动驾驶设备的状态得分,若各自动驾驶设备的状态得分具有明显的同类特征,可认为具备一致性。则可以将该热点区域对应的地图匹配度得分按时间先后顺序进行排序,从而得到地图匹配度得分曲线。故障对象反映的曲线往往具有明显特征,如曲线出现明显的剧烈波动、突然断崖式变化等特征。可以预先将这些故障对象的曲线特征进行归纳存储,并与热点区域对应的地图匹配度得分曲线进行比较,若地图匹配度得分曲线符合故障特征,则将该热点区域作为故障对象。这样,就实现了根据地图匹配度得分曲线自动、快速地确定出故障对象。Since different automatic driving devices have different vehicle speeds and time of occurrence, the analysis process of using hot spots as fault objects will be affected by vehicle speed and time. In order to determine the faulty object more accurately and quickly, the map usage information can also include time information, and the time information can be represented by a timestamp. Specifically, for each hotspot area, the state scores of each automatic driving device related to the hotspot area can be counted first. If the state scores of each automatic driving device have obvious similar characteristics, it can be considered as consistent. Then, the map matching degree scores corresponding to the hotspot area can be sorted in chronological order, so as to obtain the map matching degree score curve. The curve reflected by the fault object often has obvious characteristics, such as obvious violent fluctuations and sudden cliff-like changes in the curve. The curve characteristics of these fault objects can be summarized and stored in advance, and compared with the map matching degree scoring curve corresponding to the hot area. If the map matching degree scoring curve meets the fault characteristics, the hot area is regarded as the fault object. In this way, the faulty object can be determined automatically and quickly according to the map matching degree scoring curve.
在本申请的一个实施例中,上述方法中,区域为对地图栅格化得到的地图栅格,上述方法还包括:提供基于地图栅格的可视化界面,在可视化界面中展示各地图栅格的状态信息。In an embodiment of the present application, in the above method, the region is a map grid obtained by rasterizing the map, and the above method further includes: providing a visualization interface based on the map grid, and displaying the information of each map grid in the visualization interface status information.
地图栅格是对地图进行几何纠正及色彩校正后,形成在内容、几何精度和色彩上与地图保持一致的栅格数据集。可以通过对地图栅格化得到地图栅格,即,得到栅格化的地图栅格。为了便于管理维护和统计,可以提供基于地图栅格的可视化界面。这样,用户可以在地图栅格的可视化界面中查看各地图栅格的状态信息,如可以查看单位时间内的自动驾驶设备的通过情况,故障对象数量统计等信息。The map raster is a raster dataset that is consistent with the map in terms of content, geometric accuracy, and color after geometric correction and color correction are performed on the map. The map grid can be obtained by rasterizing the map, that is, a rasterized map grid can be obtained. In order to facilitate management, maintenance and statistics, a visualization interface based on map grids can be provided. In this way, the user can view the status information of each map grid in the visualization interface of the map grid, for example, can view information such as the passage of automatic driving equipment in a unit time and the statistics of the number of faulty objects.
在本申请的一个实施例中,如上述任一项的方法中,其中,方法还包括:根据各区域的状态信息,生成与地图对应的置信图;将置信图发送给自动驾驶设备,以使自动驾驶设备在使用地图时,根据置信图调整地图的使用权重。In an embodiment of the present application, in the method of any one of the above, the method further includes: generating a confidence map corresponding to the map according to the state information of each area; sending the confidence map to the automatic driving device to make When the autopilot device uses the map, it adjusts the weight of the map according to the confidence map.
在地图未及时更新的情况下,为了使自动驾驶设备能保持正常行驶,可以根据各区域的状态信息,生成与地图对应的置信图。置信图中含有对地图使用的权重比例信息。在地图未及时更新的情况下,可以将置信图发送给自动驾驶设备,以使自动驾驶设备在使用地图时,根据置信图调整地图的使用权重。例如在地图未更新数据对应的路面行驶 时,可以相应降低定位地图的使用权重,而结合自动驾驶设备自身传感装置和卫星导航定位数据继续保持正常行驶。这样,实现了在不更新地图的情况下,保持自动驾驶设备的正常运行。When the map is not updated in time, in order to enable the automatic driving device to maintain normal driving, a confidence map corresponding to the map can be generated according to the status information of each area. The confidence map contains the weight ratio information used on the map. When the map is not updated in time, the confidence map can be sent to the automatic driving device, so that when the automatic driving device uses the map, the weight of the map is adjusted according to the confidence map. For example, when driving on the road corresponding to the unupdated data of the map, the weight of the positioning map can be reduced accordingly, and the automatic driving equipment's own sensing device and satellite navigation positioning data can continue to maintain normal driving. In this way, the normal operation of the automatic driving equipment is maintained without updating the map.
在本申请的一个实施例中,确定故障对象可通过对多个定位点的统计分析实现。每个自动驾驶设备在运行的时候,可以得到以下数据结构:(x,y,theta,score,vechile_id,timestamp)。其中,x表示坐标系中横坐标的值,y表示坐标系中纵坐标的值,theta表示空间中自动驾驶设备的姿态与坐标系的夹角值,score表示地图匹配度得分,vechile_id表示自动驾驶设备的ID信息,timestamp表示时间戳代表的时间信息。由于每个定位点之间不完全重合,可以通过在空间建立坐标系,将x,y规整到附近的0.5米精度整点的方法进行可视化统计。例如,对地图进行栅格化得到地图栅格,以地图中的栅格为单元进行分析来确定热点区域。具体地,以地图中某个栅格a为例,多台自动驾驶设备经过栅格a时可以得到如下数据集合:(x,y,score1,vechile_id1,timestamp_1);(x,y,score2,vechile_id1,timestamp_3);(x,y,score3,vechile_id2,timestamp_7);(x,y,score4,vechile_id3,timestamp_4);(x,y,score5,vechile_id1,timestamp_2)。在栅格化的地图栅格中,假设针对某个栅格,得到的数据集合中地图匹配度得分score的数量为sum_count=n,则该栅格的地图匹配度得分的平均分分值average_score=(score1+score2+…+score n)/sum_count。因此,栅格a的average_score=(score1+score2+score3+score4+score5)/5,再对地图中的其他栅格进行相同计算,即可得到地图中每个栅格的地图匹配度得分的平均分分值,最终将平均分较低的栅格确定为热点栅格,即热点区域。然后,针对热点区域进行分析。具体地,可以分别对不同自动驾驶设备进行打分,排除车辆自身存在的问题。例如,average_score_id1=(score1+score2+score5)/3;average_score_id2=(score3)/1;average_score_id2=(score4)/1。如果以上分数具备一致性,则可以排除特定自动驾驶设备自身出现故障的影响干扰;否则,需要针对特定自动驾驶设备进行检查诊断。可以通过将地图匹配度得分按时间先后顺序进行排序来进行分析,通过绘制时间-地图匹配度得分曲线,并且对时间-地图匹配度得分曲线表现出来的曲线规律进行分析,从而确定出故障对象。具体地,绘制以timestamp为横轴、score为纵轴的曲线,可以得到相应的曲线特性。其中,曲线横轴为[timestamp_1,timestamp_2,timestamp_3,timestamp_4,timestamp_5],曲线纵轴为[score1,score5,score2,score4,score5]。假设在某个时间点之后的时间里,该热点区域的匹配度得分score都开始变差,则说明该热点区域对应的环境发生了较大变化。这样,就 可以通过对热点区域的分析确定出故障对象。In an embodiment of the present application, determining the faulty object can be achieved through statistical analysis of multiple positioning points. When each autopilot device is running, it can get the following data structure: (x, y, theta, score, vechile_id, timestamp). Among them, x represents the value of the abscissa in the coordinate system, y represents the value of the ordinate in the coordinate system, theta represents the angle between the posture of the autonomous driving device in the space and the coordinate system, score represents the map matching score, and vechile_id represents autonomous driving The ID information of the device, timestamp represents the time information represented by the timestamp. Since each positioning point is not completely coincident, visual statistics can be performed by establishing a coordinate system in space and normalizing x and y to the nearest 0.5 meter precision integral point. For example, rasterize the map to obtain the map grid, and use the grid in the map as a unit to analyze to determine the hotspot area. Specifically, taking a certain grid a in the map as an example, when multiple autopilot devices pass through grid a, the following data set can be obtained: (x, y, score1, vechile_id1, timestamp_1); (x, y, score2, vechile_id1 ,timestamp_3); (x,y,score3,vechile_id2,timestamp_7); (x,y,score4,vechile_id3,timestamp_4); (x,y,score5,vechile_id1,timestamp_2). In a rasterized map grid, assuming that for a certain grid, the number of map matching scores in the data set obtained is sum_count=n, then the average score of the map matching score of the grid average_score= (score1+score2+…+score n)/sum_count. Therefore, average_score of grid a=(score1+score2+score3+score4+score5)/5, and then perform the same calculation on other grids in the map to get the average of the map matching score of each grid in the map Score, and finally determine the grid with a lower average score as a hotspot grid, that is, a hotspot area. Then, analyze the hot spots. Specifically, different automatic driving devices can be scored separately to eliminate problems in the vehicle itself. For example, average_score_id1=(score1+score2+score5)/3; average_score_id2=(score3)/1; average_score_id2=(score4)/1. If the above scores are consistent, the influence and interference caused by the failure of the specific automatic driving equipment itself can be excluded; otherwise, the inspection and diagnosis of the specific automatic driving equipment needs to be carried out. The analysis can be performed by sorting the map matching scores in chronological order, drawing a time-map matching score curve, and analyzing the curve law shown by the time-map matching score curve, so as to determine the faulty object. Specifically, by drawing a curve with timestamp as the horizontal axis and score as the vertical axis, the corresponding curve characteristics can be obtained. Among them, the horizontal axis of the curve is [timestamp_1,timestamp_2,timestamp_3,timestamp_4,timestamp_5], and the vertical axis of the curve is [score1,score5,score2,score4,score5]. Assuming that in the time after a certain point in time, the matching score of the hotspot area starts to deteriorate, it means that the environment corresponding to the hotspot area has changed greatly. In this way, the fault object can be determined through the analysis of the hot spot area.
图2示出了根据本申请一个实施例的基于地图的故障诊断装置的结构示意图。如图2所示,该基于地图的故障诊断装置200包括:Fig. 2 shows a schematic structural diagram of a map-based fault diagnosis device according to an embodiment of the present application. As shown in FIG. 2, the map-based fault diagnosis device 200 includes:
接收单元210,用于接收各个自动驾驶设备上报的地图使用信息。The receiving unit 210 is configured to receive map usage information reported by each automatic driving device.
地图可以通过如下方式建立:首先进行数据采集,地图采集车在目标区域道路行驶的过程中记录传感器的测量数据,例如激光雷达传感器测量的激光数据,GNSS(Global Navigation Satellite System,全球导航卫星系统)传感器测量的位置数据。其次依据采集的数据进行建图,对传感器采集的测量数据进行时间戳对齐,再以GNSS传感器的测量姿态和地图采集车的内部传感器标定为依据,将激光雷达传感器测量的激光数据投影到地图上。这样地图就包含了与激光数据对应的位置信息,该地图也可称为定位地图。上面的场景以使用激光雷达采集数据为例,在实际应用中也可以拓展到使用摄像头采集数据的场景。例如,在建图时,将摄像头采集的图片提取特征点,再投影至地图中。The map can be established in the following ways: firstly, data collection is performed. The map collection vehicle records sensor measurement data while driving on the road in the target area, such as laser data measured by lidar sensors, GNSS (Global Navigation Satellite System, Global Navigation Satellite System) Location data measured by the sensor. Secondly, build a map based on the collected data, align the measurement data collected by the sensor with time stamps, and then project the laser data measured by the lidar sensor onto the map based on the measurement attitude of the GNSS sensor and the internal sensor calibration of the map collection vehicle . In this way, the map contains the location information corresponding to the laser data, and the map can also be called a location map. The above scenario takes the use of lidar to collect data as an example. In practical applications, it can also be extended to the scene of using a camera to collect data. For example, when building a map, the feature points are extracted from the image collected by the camera, and then projected onto the map.
也就是说,地图(定位地图)中包含了场景轮廓特征(例如激光雷达测量点、通过摄像头拍照提取的特征点)以及对应的位置信息。自动驾驶设备在行驶过程中,通过将传感器的实时测量数据与地图中包含的相应数据进行匹配,得到地图使用信息。That is to say, the map (location map) contains scene contour features (such as lidar measurement points, feature points extracted by camera photography) and corresponding location information. During the driving process, the automatic driving equipment obtains map usage information by matching the real-time measurement data of the sensor with the corresponding data contained in the map.
本申请实施例主要是基于地图实现的,因此需要无人设备的地图使用信息。具体来说,所述地图使用信息可以包含地图匹配度得分和自动驾驶设备的位姿信息等。这样,可以通过分析自动驾驶设备上报的地图使用信息来综合分析故障原因,从而确定故障对象。The embodiments of this application are mainly implemented based on maps, so map usage information of unmanned equipment is needed. Specifically, the map usage information may include map matching scores, pose information of the automatic driving device, and the like. In this way, it is possible to comprehensively analyze the cause of the failure by analyzing the map usage information reported by the automatic driving device, so as to determine the target of the failure.
可以将地图划分为不同区域,并根据地图使用信息生成地图中各区域的状态信息。本申请可以利用多个自动驾驶设备综合获取上报的使用信息,以生成各区域的状态信息,避免因单个自动驾驶设备误报带来的诊断错误。这样,就可以获取地图中各区域的状态信息。The map can be divided into different areas, and the status information of each area in the map can be generated according to the map usage information. In this application, multiple automatic driving devices can be used to comprehensively obtain the reported usage information to generate status information of each area, so as to avoid diagnosis errors caused by a single automatic driving device false alarm. In this way, the status information of each area in the map can be obtained.
诊断单元220,用于根据地图使用信息生成地图中各区域的状态信息;根据各区域的状态信息确定地图中的热点区域;根据热点区域的状态信息确定故障对象。The diagnosis unit 220 is configured to generate status information of each area in the map according to the map usage information; determine a hot spot area in the map according to the status information of each area; determine a fault object according to the status information of the hot spot area.
在没有故障的情况下,各区域的状态信息近乎一致。因此,通过查找与其他区域的状态信息不一致的区域,可以将具有明显异常特征的区域确定为热点区域。这样,就可以根据状态信息确定地图中的热点区域,便于快速确定可能存在缺陷的区域。In the absence of faults, the status information of each area is almost the same. Therefore, by searching for areas that are inconsistent with the status information of other areas, areas with obvious abnormal features can be determined as hot spots. In this way, hotspot areas in the map can be determined based on the status information, which is convenient for quickly determining areas that may have defects.
可以对热点区域的状态信息进行分析,以得到所分析的热点区域是否存在故障。这 样,就实现了根据热点区域的状态信息确定故障对象。The status information of the hotspot area can be analyzed to obtain whether the analyzed hotspot area has a fault. In this way, the fault object is determined based on the status information of the hot spot area.
可见,如图2所示的装置,可以基于地图的信息,快速对地图可能存在的缺陷进行诊断,确定出故障对象。提高了故障诊断的效率,为基于地图的自动驾驶的正常运行提供可靠保障,从而为物流、外卖等业务领域提供了技术支撑。It can be seen that the device shown in FIG. 2 can quickly diagnose possible defects in the map based on the information of the map, and determine the faulty object. Improve the efficiency of fault diagnosis, provide reliable guarantee for the normal operation of map-based autonomous driving, and provide technical support for logistics, food delivery and other business areas.
在本申请的一个实施例中,上述装置中,地图使用信息可以包括地图匹配度得分和所述自动驾驶设备的位姿信息,诊断单元220,用于对每条地图使用信息,根据上报该条地图使用信息的自动驾驶设备的位姿信息确定与该条地图使用信息相匹配的区域,得到该条地图使用信息与匹配的区域之间的对应关系;对每个区域,根据所述对应关系,统计该区域对应的地图匹配度得分的平均值,将该平均值作为该区域的状态得分。In an embodiment of the present application, in the above-mentioned device, the map use information may include the map matching degree score and the pose information of the automatic driving device. The diagnosis unit 220 is used for each piece of map use information, according to the report. The pose information of the automatic driving device of the map usage information determines the area that matches the piece of map usage information, and obtains the correspondence between the piece of map usage information and the matched area; for each area, according to the correspondence, Count the average value of the map matching scores corresponding to the area, and use the average value as the state score of the area.
在本申请的一个实施例中,上述装置中,诊断单元220,用于按所述状态得分由低到高选出若干个区域作为热点区域;和/或,将状态得分低于预设值的区域作为热点区域。In an embodiment of the present application, in the above-mentioned device, the diagnosis unit 220 is configured to select a number of areas as hot spots according to the state score from low to high; and/or, the state score is lower than a preset value The area serves as a hot spot.
在本申请的一个实施例中,上述装置中,地图使用信息还可以包括自动驾驶设备标识,诊断单元220,用于对每个热点区域,按自动驾驶设备标识,基于与该热点区域对应的所述地图使用信息中的所述地图匹配度得分,计算与该热点区域相关的各自动驾驶设备的状态得分;若目标自动驾驶设备的状态得分与其他自动驾驶设备的状态得分不具备一致性,则将目标自动驾驶设备作为故障对象。In an embodiment of the present application, in the above-mentioned device, the map usage information may also include the identification of the automatic driving equipment, and the diagnosis unit 220 is used for each hotspot area, according to the identification of the automatic driving equipment, based on all the corresponding hotspot areas. According to the map matching score in the map usage information, calculate the state score of each automatic driving device related to the hot area; if the state score of the target automatic driving device is not consistent with the state scores of other automatic driving devices, then Take the target autopilot device as the target of the failure.
在本申请的一个实施例中,上述装置中,地图使用信息还可以包括时间信息,诊断单元220,用于对于每个热点区域,若与该热点区域相关的各自动驾驶设备的状态得分具备一致性,则将该热点区域对应的地图匹配度得分按时间先后顺序进行排序,得到地图匹配度得分曲线;若地图匹配度得分曲线符合故障特征,则将该热点区域作为故障对象。In an embodiment of the present application, in the above-mentioned device, the map usage information may also include time information, and the diagnosis unit 220 is used for each hotspot area, if the state scores of each automatic driving device related to the hotspot area are consistent If the map matching degree score corresponding to the hot spot area is sorted in chronological order, the map matching degree score curve is obtained; if the map matching degree score curve meets the fault characteristics, the hot spot area is regarded as the fault object.
在本申请的一个实施例中,上述装置中,区域为对地图栅格化得到的地图栅格,诊断单元220,还用于提供基于地图栅格的可视化界面,在可视化界面中展示各地图栅格的状态信息。In an embodiment of the present application, in the above-mentioned device, the area is a map grid obtained by rasterizing the map, and the diagnosis unit 220 is also used to provide a visualization interface based on the map grid, in which each map grid is displayed. The status information of the grid.
在本申请的一个实施例中,上述任一项装置中,其中,装置还包括:置信单元,用于根据各区域的状态信息,生成与地图对应的置信图;将置信图发送给自动驾驶设备,以使自动驾驶设备在使用地图时,根据置信图调整地图的使用权重。In an embodiment of the present application, in any of the above-mentioned devices, the device further includes: a confidence unit, configured to generate a confidence map corresponding to the map according to the state information of each region; and send the confidence map to the automatic driving equipment , So that when the automatic driving device uses the map, the weight of the map is adjusted according to the confidence map.
需要说明的是,上述各装置实施例的具体实施方式可以参照前述对应方法实施例的具体实施方式进行,在此不再赘述。It should be noted that the specific implementation manners of the foregoing device embodiments can be performed with reference to the specific implementation manners of the foregoing corresponding method embodiments, and details are not described herein again.
综上所述,本申请的实施例,通过接收各个自动驾驶设备上报的地图使用信息;根据所述地图使用信息生成地图中各区域的状态信息;根据各所述区域的所述状态信息确定所述地图中的热点区域;根据所述热点区域的状态信息确定故障对象。有益效果在于,可以基于地图的信息,快速对地图可能存在的缺陷进行诊断,确定出故障对象。提高了故障诊断的效率,为基于地图的自动驾驶的正常运行提供可靠保障,从而为物流、外卖等业务领域提供了技术支撑。In summary, the embodiment of the present application receives map usage information reported by each automatic driving device; generates state information of each area in the map based on the map use information; determines the location based on the state information of each area. The hot spot area in the map; the fault object is determined according to the status information of the hot spot area. The beneficial effect is that, based on the information of the map, the possible defects of the map can be quickly diagnosed, and the faulty object can be determined. Improve the efficiency of fault diagnosis, provide reliable guarantee for the normal operation of map-based autonomous driving, and provide technical support for logistics, food delivery and other business areas.
需要说明的是:在此提供的算法和显示不与任何特定计算机、虚拟装置或者其它设备固有相关。各种通用装置也可以与基于在此的示教一起使用。根据上面的描述,构造这类装置所要求的结构是显而易见的。此外,本申请也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本申请的内容,并且上面对特定语言所做的描述是为了披露本申请的最佳实施方式。It should be noted that the algorithms and displays provided here are not inherently related to any specific computer, virtual device or other equipment. Various general-purpose devices can also be used with the teaching based on this. From the above description, the structure required to construct this type of device is obvious. In addition, this application is not aimed at any specific programming language. It should be understood that various programming languages can be used to implement the content of the application described herein, and the above description of a specific language is for the purpose of disclosing the best embodiment of the application.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本申请的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the instructions provided here, a lot of specific details are explained. However, it can be understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures, and technologies are not shown in detail, so as not to obscure the understanding of this specification.
类似地,应当理解,为了精简本申请并帮助理解各个发明方面中的一个或多个,在上面对本申请的示例性实施例的描述中,本申请的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本申请要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本申请的单独实施例。Similarly, it should be understood that, in order to simplify this application and help understand one or more of the various inventive aspects, in the above description of the exemplary embodiments of this application, the various features of this application are sometimes grouped together into a single embodiment, Figure, or its description. However, the disclosed method should not be interpreted as reflecting the intention that the claimed application requires more features than the features explicitly recorded in each claim. More precisely, as reflected in the following claims, the inventive aspect lies in less than all the features of a single embodiment disclosed previously. Therefore, the claims following the specific embodiment are thus explicitly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the application.
本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art can understand that it is possible to adaptively change the modules in the device in the embodiment and set them in one or more devices different from the embodiment. The modules or units or components in the embodiments can be combined into one module or unit or component, and in addition, they can be divided into multiple sub-modules or sub-units or sub-components. Except that at least some of such features and/or processes or units are mutually exclusive, any combination can be used to compare all features disclosed in this specification (including the accompanying claims, abstract and drawings) and any method or methods disclosed in this manner or All the processes or units of the equipment are combined. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstract and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.
此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中 所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本申请的范围之内并且形成不同的实施例。例如,在下面的权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。In addition, those skilled in the art can understand that although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments means that they are within the scope of the present application. Within and form different embodiments. For example, in the following claims, any one of the claimed embodiments can be used in any combination.
本申请的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本申请实施例的基于地图的故障诊断装置中的一些或者全部部件的一些或者全部功能。本申请还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本申请的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。The various component embodiments of the present application may be implemented by hardware, or by software modules running on one or more processors, or by a combination of them. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the map-based fault diagnosis apparatus according to the embodiments of the present application. This application can also be implemented as a device or device program (for example, a computer program and a computer program product) for executing part or all of the methods described herein. Such a program for implementing the present application may be stored on a computer-readable medium, or may have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
例如,图3示出了根据本申请一个实施例的电子设备的结构示意图。该电子设备300包括处理器310和存储计算机可执行指令(计算机可读程序代码)的存储器320。存储器320可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储器320具有存储用于执行上述方法中的任何方法步骤的计算机可读程序代码331的存储空间330。例如,用于存储计算机可读程序代码的存储空间330可以包括分别用于实现上面的方法中的各种步骤的各个计算机可读程序代码331。计算机可读程序代码331可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘,紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为例如图4所述的计算机可读存储介质。图4示出了根据本申请一个实施例的一种计算机可读存储介质的结构示意图。该计算机可读存储介质400存储有用于执行根据本申请的方法步骤的计算机可读程序代码331,可以被电子设备300的处理器310读取,当计算机可读程序代码331由电子设备300运行时,导致该电子设备300执行上面所描述的方法中的各个步骤,具体来说,该计算机可读存储介质存储的计算机可读程序代码331可以执行上述任一实施例中示出的方法。计算机可读程序代码331可以以适当形式进行压缩。For example, FIG. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 300 includes a processor 310 and a memory 320 storing computer-executable instructions (computer-readable program codes). The memory 320 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. The memory 320 has a storage space 330 for storing computer-readable program codes 331 for executing any method steps in the above-mentioned methods. For example, the storage space 330 for storing computer-readable program codes may include various computer-readable program codes 331 respectively used to implement various steps in the above method. The computer-readable program code 331 may be read from or written into one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards, or floppy disks. Such a computer program product is usually, for example, a computer-readable storage medium as described in FIG. 4. Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present application. The computer-readable storage medium 400 stores the computer-readable program code 331 for executing the method steps according to the present application, which can be read by the processor 310 of the electronic device 300, when the computer-readable program code 331 is run by the electronic device 300 , Causing the electronic device 300 to execute each step in the method described above. Specifically, the computer readable program code 331 stored in the computer readable storage medium can execute the method shown in any of the above embodiments. The computer readable program code 331 may be compressed in an appropriate form.
应该注意的是上述实施例对本申请进行说明而不是对本申请进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这 样的元件。本申请可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-mentioned embodiments illustrate rather than limit the application, and those skilled in the art can design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be constructed as a limitation to the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application can be realized by means of hardware including several different elements and by means of a suitably programmed computer. In the unit claims listing several devices, several of these devices may be embodied in the same hardware item. The use of the words first, second, and third, etc. do not indicate any order. These words can be interpreted as names.

Claims (10)

  1. 一种基于地图的故障诊断方法,包括:A map-based fault diagnosis method, including:
    接收各个自动驾驶设备上报的地图使用信息;Receive map usage information reported by each autopilot device;
    根据所述地图使用信息生成地图中各区域的状态信息;Generating state information of each area in the map according to the map usage information;
    根据各所述区域的所述状态信息确定所述地图中的热点区域;Determining a hot spot area in the map according to the state information of each of the areas;
    根据所述热点区域的状态信息确定故障对象。The fault object is determined according to the status information of the hot spot area.
  2. 如权利要求1所述的方法,其中,所述地图使用信息包括地图匹配度得分和所述自动驾驶设备的位姿信息,根据所述地图使用信息生成所述地图中各区域的状态信息包括:The method of claim 1, wherein the map usage information includes a map matching degree score and pose information of the automatic driving device, and generating state information of each area in the map according to the map usage information includes:
    对每条所述地图使用信息,For each piece of map usage information,
    根据上报该条地图使用信息的所述自动驾驶设备的位姿信息确定与该条地图使用信息相匹配的区域,Determine an area matching the piece of map usage information according to the pose information of the autonomous driving device that reports the piece of map usage information,
    得到该条地图使用信息与所述匹配的区域之间的对应关系;Obtain the correspondence between the piece of map usage information and the matched area;
    对每个所述区域,For each said area,
    根据所述对应关系,统计该区域对应的地图匹配度得分的平均值,According to the corresponding relationship, the average value of the map matching score corresponding to the area is counted,
    将所述平均值作为该区域的状态得分。The average value is used as the state score of the area.
  3. 如权利要求2所述的方法,其中,根据各所述区域的所述状态信息确定所述地图中的热点区域包括:3. The method of claim 2, wherein determining the hot spot area in the map according to the state information of each of the areas comprises:
    按所述状态得分由低到高选出若干个区域作为所述热点区域;和/或,Select a number of areas as the hot spot area according to the state score from low to high; and/or,
    将所述状态得分低于预设值的区域作为所述热点区域。The area where the state score is lower than the preset value is taken as the hot spot area.
  4. 如权利要求2所述的方法,其中,所述地图使用信息还包括自动驾驶设备标识,根据所述热点区域的状态信息确定故障对象包括:The method according to claim 2, wherein the map usage information further includes an automatic driving device identification, and determining the fault object according to the status information of the hotspot area includes:
    对每个所述热点区域,For each of the hot spots,
    按自动驾驶设备标识,基于与该热点区域对应的所述地图使用信息中的所述地图匹配度得分,计算与该热点区域相关的各所述自动驾驶设备的状态得分;According to the automatic driving device identifier, calculate the state score of each automatic driving device related to the hot spot area based on the map matching score in the map usage information corresponding to the hot spot area;
    若目标自动驾驶设备的状态得分与其他自动驾驶设备的状态得分不具备一致性,则将所述目标自动驾驶设备作为故障对象。If the state score of the target automatic driving device is not consistent with the state scores of other automatic driving devices, then the target automatic driving device is taken as the failure target.
  5. 如权利要求4所述的方法,其中,所述地图使用信息还包括时间信息,根据所述热点区域的状态信息确定故障对象还包括:The method of claim 4, wherein the map usage information further includes time information, and determining the fault object according to the status information of the hotspot area further includes:
    对于每个热点区域,For each hot spot,
    若与该热点区域相关的各所述自动驾驶设备的状态得分具备一致性,则将该热 点区域对应的地图匹配度得分按时间先后顺序进行排序,得到地图匹配度得分曲线;If the state scores of the autonomous driving devices related to the hot spot area are consistent, then the map matching degree scores corresponding to the hot spot area are sorted in chronological order to obtain a map matching degree score curve;
    若所述地图匹配度得分曲线符合故障特征,则将该热点区域作为故障对象。If the map matching degree scoring curve conforms to the fault feature, then the hot spot area is taken as the fault object.
  6. 如权利要求1所述的方法,其中,所述区域为对地图栅格化得到的地图栅格,所述方法还包括:The method according to claim 1, wherein the area is a map grid obtained by rasterizing a map, and the method further comprises:
    提供基于所述地图栅格的可视化界面,Provide a visual interface based on the map grid,
    在所述可视化界面中展示各所述地图栅格的状态信息。The state information of each of the map grids is displayed in the visualization interface.
  7. 如权利要求1-6中任一项所述的方法,其中,所述方法还包括:The method according to any one of claims 1-6, wherein the method further comprises:
    根据各所述区域的状态信息,生成与所述地图对应的置信图;Generating a confidence map corresponding to the map according to the state information of each of the regions;
    将所述置信图发送给自动驾驶设备,以使所述自动驾驶设备在使用所述地图时,根据所述置信图调整所述地图的使用权重。The confidence map is sent to an automatic driving device, so that when the automatic driving device uses the map, the use weight of the map is adjusted according to the confidence map.
  8. 一种基于地图的故障诊断装置,包括:A map-based fault diagnosis device includes:
    接收单元,用于接收各个自动驾驶设备上报的地图使用信息;The receiving unit is used to receive map usage information reported by each automatic driving device;
    诊断单元,用于根据所述地图使用信息生成地图中各区域的状态信息;根据各所述区域的所述状态信息确定所述地图中的热点区域;根据所述热点区域的状态信息确定故障对象。The diagnosis unit is configured to generate status information of each area in the map according to the map usage information; determine a hot spot area in the map according to the status information of each area; determine a fault object according to the status information of the hot spot area .
  9. 一种电子设备,包括:An electronic device including:
    处理器;以及Processor; and
    存储计算机可执行指令的存储器,所述可执行指令在被执行时使所述处理器执行如权利要求1-7中任一项所述的方法。A memory storing computer-executable instructions, which when executed, cause the processor to perform the method according to any one of claims 1-7.
  10. 一种计算机可读存储介质,其中,所述计算机可读存储介质存储一个或多个程序,所述一个或多个程序当被处理器执行时,实现如权利要求1-7中任一项所述的方法。A computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and the one or more programs, when executed by a processor, realize the The method described.
PCT/CN2020/135398 2019-12-13 2020-12-10 Map-based fault diagnosis WO2021115395A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911284612.7A CN111160420B (en) 2019-12-13 2019-12-13 Map-based fault diagnosis method, map-based fault diagnosis device, electronic equipment and storage medium
CN201911284612.7 2019-12-13

Publications (1)

Publication Number Publication Date
WO2021115395A1 true WO2021115395A1 (en) 2021-06-17

Family

ID=70557091

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/135398 WO2021115395A1 (en) 2019-12-13 2020-12-10 Map-based fault diagnosis

Country Status (2)

Country Link
CN (1) CN111160420B (en)
WO (1) WO2021115395A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111160420B (en) * 2019-12-13 2023-10-10 北京三快在线科技有限公司 Map-based fault diagnosis method, map-based fault diagnosis device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108958266A (en) * 2018-08-09 2018-12-07 北京智行者科技有限公司 A kind of map datum acquisition methods
US20190137286A1 (en) * 2016-06-14 2019-05-09 Robert Bosch Gmbh Method and apparatus for creating an optimized localization map and method for creating a localization map for a vehicle
CN109931939A (en) * 2019-02-27 2019-06-25 杭州飞步科技有限公司 Localization method, device, equipment and the computer readable storage medium of vehicle
CN110542908A (en) * 2019-09-09 2019-12-06 阿尔法巴人工智能(深圳)有限公司 laser radar dynamic object perception method applied to intelligent driving vehicle
CN111160420A (en) * 2019-12-13 2020-05-15 北京三快在线科技有限公司 Map-based fault diagnosis method and device, electronic equipment and storage medium

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9984331B2 (en) * 2015-06-08 2018-05-29 International Business Machines Corporation Automated vehicular accident detection
US10268740B2 (en) * 2015-10-14 2019-04-23 Tharmalingam Satkunarajah 3D analytics actionable solution support system and apparatus
CN108204819B (en) * 2016-12-19 2020-10-30 北京四维图新科技股份有限公司 Map data automatic detection method and device and hybrid navigation system
US10429194B2 (en) * 2016-12-30 2019-10-01 DeepMap Inc. High definition map updates with vehicle data load balancing
CN108279428B (en) * 2017-01-05 2020-10-16 武汉四维图新科技有限公司 Map data evaluating device and system, data acquisition system, acquisition vehicle and acquisition base station
CN107323354A (en) * 2017-02-10 2017-11-07 问众智能信息科技(北京)有限公司 It is a kind of that the method and system navigated with car is realized by intelligent back vision mirror
CN106969779B (en) * 2017-03-17 2020-05-12 重庆邮电大学 DSRC-based intelligent vehicle map fusion system and method
CN108931246B (en) * 2017-05-26 2020-12-11 杭州海康机器人技术有限公司 Method and device for detecting existence probability of obstacle at unknown position
CN109101011A (en) * 2017-06-20 2018-12-28 百度在线网络技术(北京)有限公司 Sensor monitoring method, device, equipment and the storage medium of automatic driving vehicle
US20190056231A1 (en) * 2017-08-15 2019-02-21 GM Global Technology Operations LLC Method and apparatus for participative map anomaly detection and correction
US11216004B2 (en) * 2017-11-07 2022-01-04 Uatc, Llc Map automation—lane classification
CN108508872B (en) * 2018-04-18 2020-05-05 鄂尔多斯市普渡科技有限公司 Fault detection method of unmanned automobile information acquisition system
CN110398912B (en) * 2018-04-25 2021-02-19 北京四维图新科技股份有限公司 Fault monitoring system of electronic map field data acquisition equipment
JP6943221B2 (en) * 2018-05-14 2021-09-29 トヨタ自動車株式会社 Anomaly detection device
CN108830261B (en) * 2018-07-20 2021-11-30 北京汉能华科技股份有限公司 Equipment fault diagnosis method and device based on image recognition
CN108958264B (en) * 2018-08-03 2021-07-23 北京智行者科技有限公司 Road traffic inspection method based on automatic driving technology and vehicle
CN109783588A (en) * 2018-12-10 2019-05-21 北京百度网讯科技有限公司 Error message detection method, device, equipment, vehicle and the storage medium of map
CN109740462B (en) * 2018-12-21 2020-10-27 北京智行者科技有限公司 Target identification following method
CN110386148B (en) * 2019-06-26 2021-04-02 北京汽车集团有限公司 Control method and device for automatic driving vehicle and vehicle
CN110493333B (en) * 2019-08-15 2021-08-17 腾讯科技(深圳)有限公司 Method, device and equipment for determining target position point and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190137286A1 (en) * 2016-06-14 2019-05-09 Robert Bosch Gmbh Method and apparatus for creating an optimized localization map and method for creating a localization map for a vehicle
CN108958266A (en) * 2018-08-09 2018-12-07 北京智行者科技有限公司 A kind of map datum acquisition methods
CN109931939A (en) * 2019-02-27 2019-06-25 杭州飞步科技有限公司 Localization method, device, equipment and the computer readable storage medium of vehicle
CN110542908A (en) * 2019-09-09 2019-12-06 阿尔法巴人工智能(深圳)有限公司 laser radar dynamic object perception method applied to intelligent driving vehicle
CN111160420A (en) * 2019-12-13 2020-05-15 北京三快在线科技有限公司 Map-based fault diagnosis method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN111160420B (en) 2023-10-10
CN111160420A (en) 2020-05-15

Similar Documents

Publication Publication Date Title
US11430180B2 (en) Systems and methods for controlling a fleet of drones for data collection
US9047668B2 (en) Location determination for an object using visual data
JP6205030B2 (en) How to locate train events on the rail network
WO2019198076A1 (en) Real-time raw data- and sensor fusion
US20210216906A1 (en) Integrating simulated and real-world data to improve machine learning models
US8744752B2 (en) Apparatus and method for detecting locations of vehicle and obstacle
US10109191B2 (en) Method of quickly detecting road distress
WO2021115395A1 (en) Map-based fault diagnosis
US11416004B2 (en) System and method for validating readings of orientation sensor mounted on autonomous ground vehicle
JP6828448B2 (en) Information processing equipment, information processing systems, information processing methods, and information processing programs
US20220234588A1 (en) Data Recording for Advanced Driving Assistance System Testing and Validation
US20240071080A1 (en) Drone based automated yard check
CN115880673B (en) Obstacle avoidance method and system based on computer vision
WO2017126280A1 (en) Mobile object measurement system and method of determining number of people in measurement area
WO2022247299A1 (en) Indicator lamp state recognition
CN116386373A (en) Vehicle positioning method and device, storage medium and electronic equipment
CN110796901A (en) Air traffic situation risk hotspot identification method
CN113220805B (en) Map generation device, recording medium, and map generation method
CN111857113B (en) Positioning method and positioning device for movable equipment
CN113048988B (en) Method and device for detecting change elements of scene corresponding to navigation map
US20220335645A1 (en) Usage of machine learning for automatic determination of turbine locations from images
CN111143488A (en) POI position determining method and device
CN114881543B (en) Road grade determination method and device, electronic equipment and medium
CN116013018B (en) Forest fire prevention early warning analysis method and system based on unmanned aerial vehicle detection
CN117930167A (en) Determination method and device of abnormal data, storage medium and vehicle

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20898596

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20898596

Country of ref document: EP

Kind code of ref document: A1