WO2024132935A1 - Appareil et procédé de détermination d'une représentation d'un environnement - Google Patents

Appareil et procédé de détermination d'une représentation d'un environnement Download PDF

Info

Publication number
WO2024132935A1
WO2024132935A1 PCT/EP2023/086072 EP2023086072W WO2024132935A1 WO 2024132935 A1 WO2024132935 A1 WO 2024132935A1 EP 2023086072 W EP2023086072 W EP 2023086072W WO 2024132935 A1 WO2024132935 A1 WO 2024132935A1
Authority
WO
WIPO (PCT)
Prior art keywords
sensor
cells
control system
occupancy grid
cell
Prior art date
Application number
PCT/EP2023/086072
Other languages
English (en)
Inventor
Jonathan Lloyd
Margaret Toohey
Stefan ARNAUTU
Jhonata QUEIROZ
Original Assignee
Jaguar Land Rover Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jaguar Land Rover Limited filed Critical Jaguar Land Rover Limited
Publication of WO2024132935A1 publication Critical patent/WO2024132935A1/fr

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/66—Radar-tracking systems; Analogous systems
    • G01S13/72—Radar-tracking systems; Analogous systems for two-dimensional tracking, e.g. combination of angle and range tracking, track-while-scan radar
    • G01S13/723—Radar-tracking systems; Analogous systems for two-dimensional tracking, e.g. combination of angle and range tracking, track-while-scan radar by using numerical data
    • G01S13/726—Multiple target tracking
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/89—Radar or analogous systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/91—Radar or analogous systems specially adapted for specific applications for traffic control
    • G01S13/913—Radar or analogous systems specially adapted for specific applications for traffic control for landing purposes
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88—Sonar systems specially adapted for specific applications
    • G01S15/93—Sonar systems specially adapted for specific applications for anti-collision purposes
    • G01S15/931—Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/66—Tracking systems using electromagnetic waves other than radio waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G01S13/865—Combination of radar systems with lidar systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G01S13/867—Combination of radar systems with cameras
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/881—Radar or analogous systems specially adapted for specific applications for robotics
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9318—Controlling the steering
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9323—Alternative operation using light waves

Definitions

  • the present disclosure relates to determining an occupancy grid representing an environment. Aspects of the invention relate to a control system, to a system, to a vehicle, to a method and to computer software.
  • a robot determines information about its environment, such as information about objects in the environment
  • the information about objects is used for navigation to avoid the objects
  • an occupancy grid to be used to store information about the environment, such as a location of objects in the environment
  • the occupancy grid represents the environment of the robot and has a plurality of cells, each representing a portion of the environment and storing an indication of a probability of the occupancy of the respective portion.
  • Sensors associated with the robot, such as the vehicle provide measurement data indicative of the location of objects and the measurement data is used to update the occupancy grid In this way, the occupancy grid can be used to track dynamic objects in the environment.
  • the sensors associated with the robot are high definition which provide dense measurement data relating to the environment, such as dense point cloud data indicative of objects.
  • An example of such a high-definition sensor is a 64 laser LIDAR sensor. Because of this high density, an absence of objects e.g. empty space can also be reliably inferred.
  • high-definition or high-density sensors have an associated cost and complexity. It is desired to utilise lower definition or density sensors to update an occupancy grid.
  • a control system for a vehicle comprising at least one controller, the control system being configured to receive, from at least one sensor, sensor data indicative of a location of one or more objects detected in an environment of the vehicle, modify an occupancy grid stored in a memory accessible to the control system in dependence on the sensor data, wherein the modifying comprises the control system being configured to determine one or more cells of the occupancy grid within a field of view of the sensor for which the sensor data did not indicate the location of an object
  • the control system may modify a value associated with the determined one or more cells of the occupancy grid for which the sensor data did not indicate the location of an object.
  • a control system for a vehicle comprising at least one controller, the control system being configured to receive, from at least one sensor, sensor data indicative of a location of one or more objects detected in an environment of the vehicle, modify an occupancy grid stored in a memory accessible to the control system in dependence on the sensor data, wherein the modifying comprises the control system being configured to determine one or more cells of the occupancy grid within a field of view of the sensor for which the sensor data did not indicate the location of an object, and modify a value associated with the determined one or more cells of the occupancy grid to be indicative of an increased uncertainty associated with the determined one or more cells being occupied.
  • the occupancy grid is indicative of cells, corresponding to locations in the environment, for which the uncertainty of occupancy is increased due to the portions of the environment being obscured.
  • a control system for a robot comprising at least one controller, the control system being configured to receive, from at least one sensor, sensor data indicative of a location of one or more objects detected in an environment of the vehicle, and to determine one or more cells of the occupancy grid where the field of view of the sensor is obstructed by at least one of the one or more objects; and modify at least one value associated with the determined one or more cells of the occupancy grid to be indicative of an increased uncertainty of the cell being occupied by an object.
  • the occupancy grid is indicative of cells, corresponding to locations in the environment, for which the uncertainty of occupancy is increased due to the portions of the environment being obscured.
  • a control system for a vehicle comprising at least one controller, the control system being configured to receive, from at least one sensor, sensor data indicative of a location of one or more objects detected in an environment of the vehicle, modify an occupancy grid stored in a memory accessible to the control system in dependence on the sensor data, the occupancy grid representing an environment of the vehicle and having a plurality of cells, wherein each cell is associated with at least one value indicative of a likelihood of a corresponding portion of the environment being occupied by one of the one or more objects, wherein the modifying comprises the control system being configured to determine one or more cells of the occupancy grid within a field of view of the sensor for which the sensor data did not indicate the location of an object; and modify the at least one value associated with the determined one or more cells of the occupancy grid to be indicative of an increased likelihood of the cell being unoccupied by an object.
  • the occupancy grid is indicative of cells, corresponding to locations in the environment, for which the likelihood of the cell being unoccupied is increased due to the portions
  • a control system for a vehicle comprising at least one controller, the control system being configured to receive, from at least one sensor, sensor data indicative of a location of one or more objects detected in an environment of the vehicle, modify an occupancy grid stored in a memory accessible to the control system in dependence on the sensor data, the occupancy grid representing an environment of the vehicle and having a plurality of cells, wherein each cell is associated with at least one value indicative of a likelihood of a corresponding portion of the environment being occupied by one of the one or more objects, wherein the modifying comprises the control system being configured to determine one or more cells of the occupancy grid within a field of view of the sensor for which the sensor data did not indicate the location of an object, and modify the at least one value associated with the determined one or more cells of the occupancy grid to be indicative of an increased likelihood of the cell being unoccupied by an object.
  • the occupancy grid is indicative of cells, corresponding to locations in the environment, for which the likelihood of the cell being unoccupied is increased due to the portions
  • the one or more cells of the occupancy grid within a field of view of the sensor for which the sensor data did not indicate the location of an object may be assumed as empty cells.
  • the cells are assumed as empty due to the sensor data not indicating the location of the object corresponding to the cell.
  • the modifying optionally comprises the control system being configured to determine one or more cells of the occupancy grid where the field of view of the sensor is obstructed by at least one of the one or more objects, and modify the at least one value associated with the determined one or more cells of the occupancy grid to be indicative of an increased uncertainty of the cell being occupied by an object.
  • modification of the at least one value is made due to the portions of the environment being obscured from the sensor.
  • the at least one of the one or more objects may have a location corresponding to at least one other cell of the occupancy grid.
  • the location of the object is associated with the at least one other cell of the occupancy grid.
  • the one or more cells of the occupancy grid where the field of view of the sensor is obstructed may be obstructed cells.
  • the obstructed cells are recognised to be cells within the field of view, but which the sensor cannot determine the location of an object.
  • the one or more cells of the occupancy grid where the field of view of the sensor is obstructed by at least one of the one or more objects are cells determined as being in a shadow of the one of the one or more objects detected in the environment of the vehicle.
  • shadowed cells may not be observed by the sensor.
  • the modifying optionally comprises the control system combining a predetermined free mass value with a prior free mass for the one or more cells of the occupancy grid within the field of view of the sensor for which the sensor data did not indicate the location of an object.
  • the combining introduces the updated value to the prior free mass.
  • the predetermined free mass value may be equal to or greater than 0.7.
  • the free mass value may be equal to or greater than 0.9
  • the free mass value may be a value which promotes the cell as being indicative of not being occupied i.e. having a relatively higher free mass.
  • the modifying may comprise the control system combining a predetermined unknown mass value with a prior unknown mass for the one or more cells of the occupancy grid within the field of view of the sensor for which the sensor data did not indicate the location of an object.
  • the unknown mass value may be indicative of the occupancy of the cell being unknown.
  • the predetermined unknown mass value may be equal to or greater than 0.4.
  • the unknown mass value may be around 0.5
  • the unknown mass value may be indicative of the occupancy of the cell being unknown.
  • setting the unknown mass comprises setting a free mass value and an occupied mass value associated with each cell to corresponding values such that the free mass is equal to or greater than the predetermined value.
  • the unknown mass value may correspond to a difference between a free mass value and an occupied mass value associated with each cell.
  • the free mass and the occupied mass values may be controlled.
  • the combining is optionally according to a Dempster Shafer rule of combination.
  • the Dempster Shafer rule of combination allows combination of the predetermined value and the prior value.
  • the modifying may comprise the control system being configured to determine the field of view of the sensor in dependence on one or more characteristics associated with the sensor, and select cells of the occupancy grid corresponding to the field of view of the sensor.
  • the field of view is determined in dependence on the characteristics to resemble the actual field of view of the sensor.
  • the modifying optionally comprises the control system being configured to determine a first field of view of the sensor, determine one or more cells of the occupancy grid within the first field of view of the sensor for which the sensor data did not indicate the location of an object, determine a first cell of the occupancy grid corresponding to a location of one of the one or more objects detected in the environment of the vehicle within the first field of view of the sensor, and determine a second field of view of the sensor in dependence on one or more characteristics associated with the sensor and the location of the one of the one or more objects
  • the field of view of each respective sensor is determined.
  • the control system is optionally configured to determine the one or more cells of the occupancy grid where the field of view of the sensor is obstructed by at least one of the one or more objects as cells in a shadow of the one of the one or more objects detected in the environment of the vehicle.
  • the field of view does not extend to areas in the shadow and therefore the sensor cannot accurately determined the occupancy of such cells
  • the control system may be configured to sequentially select cells of the occupancy grid outward from a location of the sensor to determine whether the sensor data indicates the location of an object.
  • the outward processing of cells allows efficient modification of cell values.
  • a system for a vehicle comprising the control system of any preceding claim, and at least one sensor arranged to output sensor data indicative of a location of one or more objects detected in an environment of the vehicle.
  • the at least one sensor may comprises one or more of a radar sensor, a lidar sensor, and/or an optical sensor.
  • a vehicle comprising a control system as described above or a system as described above.
  • a computer-implemented method comprising receiving, from at least one sensor, sensor data indicative of a location of one or more objects detected in an environment of a vehicle, modifying an occupancy grid stored in a memory in dependence on the sensor data, the occupancy grid representing an environment of the vehicle and having a plurality of cells, wherein each cell is associated with at least one value indicative of a likelihood of a corresponding portion of the environment being occupied by one of the one or more objects, wherein the modifying comprises determining one or more cells of the occupancy grid within a field of view of the sensor for which the sensor data did not indicate the location of an object, and modifying the at least one value associated with the determined one or more cells of the occupancy grid to be indicative of an increased likelihood of the cell being unoccupied by an object.
  • the modifying optionally comprises determining one or more cells of the occupancy grid where the field of view of the sensor is obstructed by at least one of the one or more objects, and modifying the at least one value associated with the determined one or more cells of the occupancy grid to be indicative of an increased uncertainty of the cell being occupied by an object
  • the modifying optionally comprises combining a predetermined free mass value with a prior free mass for the one or more cells of the occupancy grid within the field of view of the sensor for which the sensor data did not indicate the location of an object.
  • the predetermined free mass value may be equal to or greater than 0 7.
  • the combining may be according to a Dempster Shafer rule of combination
  • the modifying optionally comprises determining the field of view of the sensor in dependence on one or more characteristics associated with the sensor, and selecting cells of the occupancy grid corresponding to the field of view of the sensor.
  • the modifying optionally comprises determining a first field of view of the sensor, determining one or more cells of the occupancy grid within the first field of view of the sensor for which the sensor data did not indicate the location of an object, determining a first cell of the occupancy grid corresponding to a location of one of the one or more objects detected in the environment of the vehicle within the first field of view of the sensor, and determining a second field of view of the sensor in dependence on one or more characteristics associated with the sensor and the location of the one of the one or more objects.
  • a Computer software which, when executed by a computer, is arranged to perform a method as described above.
  • a computer readable data storage medium may have tangibly stored thereon the computer software.
  • Figure 1 shows a system according to an embodiment of the present invention
  • Figure 2 shows a vehicle according to an embodiment of the present invention
  • Figure 3 shows an illustration of an occupancy grid according to an embodiment of the present invention
  • Figure 4 shows a method according to an embodiment of the present invention
  • Figure 5 shows a method according to another embodiment of the present invention.
  • Figure 6 shows an illustration of an occupancy grid according to another embodiment of the present invention.
  • Figure 7 illustrates probabilities according to an embodiment of the invention.
  • FIG. 1 there is illustrated a system 100 according to an embodiment of the invention.
  • the system 100 is for use with a robot such as a vehicle 200 according to an embodiment of the invention as shown in Figure 2.
  • the vehicle 200 is an example of a robot with an autonomous movement or navigation capability to navigate around an environment in which the vehicle 200 is located.
  • the vehicle 200 may have Level 4 or 5 autonomy capability as defined by SAE International.
  • the vehicle 200 may comprise the system 100 as part of providing such capability. Whilst embodiments of the invention are described with respect to such a vehicle 200 it will be appreciated that embodiments of the invention are not limited in this respect.
  • the system 100 is arranged to determine an occupancy grid 300 relating to an environment of the vehicle 200.
  • the occupancy grid 300 represents the environment of the vehicle 200 and has a plurality of cells, each representing a portion of the environment and being associated with a probability indicative of the occupancy of the respective portion corresponding to the cell.
  • the occupancy grid is useful for navigating the vehicle 200 within the environment, such as for tracking movement of one or more objects in the environment as will be appreciated.
  • a representation of example occupancy grid or occupancy grid map 300 is illustrated in Figure 3
  • the occupancy grid map 300 and the cells forming part thereof are defined by parameters which define their sizes such that the size and resolution of the occupancy grid map 300 may be chosen for each particular use case.
  • the occupancy grid map 300 is 8x8 in size and is thus formed by 64 cells.
  • the occupancy grid map 300 is selected to have a cell size of 1m x 1 m and thus the example square occupancy grid map 300 has sides of length 8m and represents a 64m 2 area of the environment.
  • the illustrated occupancy grid map 300 is relatively small for practical application and larger occupancy grid maps are typically used, such as for example, a 120m x 120m occupancy grid map although embodiments of the invention are not limited in this respect.
  • the occupancy grid map 300 is formed by rows and columns of cells which may each have a corresponding number.
  • cells each have a linear cell index as illustrated which may begin at 0 for a cell in one corner, such as the top-left corner of the occupancy grip map 300 as illustrated.
  • the vehicle 200 is assumed to be located at a centre of the occupancy grid 300 as indicated by arrows shown.
  • a relative coordinate space system may be used wherein cells forward of the vehicle are assigned a positive x coordinate value and cells to a left lateral side of the vehicle being associated a positive y coordinate value.
  • Such a coordinate space may be referred to as an EGO relative coordinate space.
  • the system illustrated in Figure 1 is arranged to output data indicative of the occupancy grip map 300 for use in navigating the vehicle 200
  • the occupancy grip map 300 is determined in dependence on sensor measurement data indicative of the environment of the vehicle 200 which is provided by one or more sensors associated with the vehicle 200 as will be explained At least some of the one or more sensors may provide sensor measurement data indicative of a detection of an object whose location corresponds to one or more cells (an object can be determined to correspond to more than one cell) in the occupancy grip map 300.
  • a field of view (FOV) of at least one of the sensors is determined and, for any cells within the FOV of the sensor for which the sensor measurement data did not indicate the location of an object, data associated with the cell is updated or modified to be indicative of an increased likelihood of the cell being unoccupied by an object.
  • FOV field of view
  • the system 100 shown in Figure 1 comprises one or more controller 110.
  • the system 100 comprises one controller 110 although it will be appreciated that embodiments of the invention are not limited in this respect.
  • the controller 110 is arranged to, in use, output data 155 indicative of the occupancy grip map 300.
  • Each controller 110 may comprise a respective processing means 120, such as an electronic processing device 120 or computer processor, hereinafter processor 120.
  • the processor 120 is arranged to operably execute computer-readable instructions which may be stored in a memory means 130 formed by one or more memory devices 130 forming a memory 130 which is communicatively coupled to the processing device 120.
  • the controller 120 comprises an input means 140 and an output means 150.
  • the input means 140 may comprise an electrical input 140 of the controller 110.
  • the output means 150 may comprise an electrical output 150 of the controller 110.
  • the input means 140 and output means 150 may be unified such as in the form of a network interface which inputs and outputs data, for example to a communication bus of the vehicle 200.
  • the controller 110 may therefore receive data from the communication bus and output data onto the communication bus.
  • the input means 140 is arranged to receive sensor measurement data 145 from one or more sensors 160, 170 associated with the vehicle 200.
  • the system 100 comprises first 160 and second 170 sensors although it will be appreciated that this merely an example.
  • At least some of the sensors 160, 170 may emit radiation, such as from a laser, and receive radiation reflected from an object, such as via a photodiode or similar. The reflected radiation is used to determine a point corresponding to the object wherein a collection of points each corresponding to reflections of radiation form a point cloud. Data indicative of detections of objects is provided to the controller 110 as the sensor measurement data 145.
  • the processor 120 is arranged to store in the memory 130 data indicative of the occupancy grip map 300.
  • the processor 120 is arranged to update or modify the occupancy grip map 300 based on the incoming sensor measurement data 145. Fusing of incoming sensor measurement data with the occupancy grid may be performed by a dynamic occupancy grid map (DOGMa) process.
  • DOGMa process 300 may be performed at a periodic time interval based on received sensor measurement data 145.
  • a time interval variable may be used to represent the time between iterations or cycles of a DOGMa process as explained below in connection with block 410 of a method 400 illustrated in Figure 4.
  • the DOGMa process provides a method of fusing sensor data in the dynamic occupancy grid map
  • the DOGMa process is explained more in a PhD Thesis by D. Nuss, “A Random Finite Set Approach for Dynamic Occupancy Grid Maps”, 2018 also published in The International Journal of Robotics Research, which are herein incorporated by reference.
  • Embodiments of the present invention are described in connection with the DOGMa process However, it will be understood that other processes, such as using a direct association of cells to track level fusion or Bayesian Occupancy filters, may be used for updating or modifying an occupancy grid and the usefulness of embodiments of the present invention are not limited to the DOGMa process.
  • Embodiments of the present invention operate to influence values associated with at least some cells of the occupancy grid in dependence on a field of view of a sensor providing sensor data. In particular, embodiments of the present invention influence a probability associated with at least some cells of being free, as will be explained.
  • values associated with at least some cells of the occupancy grid are influenced to be indicative of an uncertainty associated with a state of the cell when those cells are obstructed from the field of view of the sensor.
  • values associated with cells whose location corresponds to detected objects updated but also values associated with cells assumed to be free or empty and the obstructed cells
  • this improves the updating or modifying of the occupancy grid and may allow, for example, use of sensors with lower resolution thereby enabling a reduction in cost, for example
  • a particle filter is used to model a state of the occupancy grid map 300.
  • the particle filter maintains a list of particle states, one or more weights and cell indices and indices of cells of the occupancy grid map 300 to which the particles belong
  • a label may be assigned to each particle as an identifier for an object (if any) to which the particle belongs.
  • a next state of the particles is predicted and they are updated by detections of objects in the sensor measurement data 145 as will be explained.
  • a method 400 according to an embodiment of the present invention is explained with reference to Figure 4.
  • the method 400 may be performed by the processor 120 and instructions representing the method may be stored in the memory 130 as computer readable instructions.
  • a prediction operation is performed.
  • the prediction operation predicts a new location for particles and updates the cells of the occupancy grip map 300 with which the particles are associated accordingly.
  • a T ransition Matrix is created using a time_step variable indicative of the periodic time interval between cycles of the method 400 updating or modifying the occupancy grid map 300.
  • a noise generation function may be used to create a process_noise matrix that is used to model uncertainty in the particle predictions. This may be performed by using a randomly generated matrix with a configurable i.e. selected standard deviation.
  • the state of the particles used in the DOGMa process are predicted
  • the state may be represented with position and velocity, such as: x,y, vx, vy.
  • position and velocity such as: x,y, vx, vy.
  • the state prediction may be performed by matrix multiplication between the current state and the transition matrix.
  • the processjioise matrix is added to the result of the multiplication to introduce uncertainty.
  • the weight of each particle may be degraded whenever a prediction is carried out in block 410.
  • the degrading may be performed by a multiplication of a weights matrix and a persistence -probability variable.
  • the weights matrix is a matrix which may be used in some embodiments to store a weight associated with each particle.
  • the weights matrix may be a 1 x N matrix or vector, where N is the number of particles.
  • the persistence -probability is a parameter that controls the longevity of particles in the DOGMa process.
  • the persistence -probability may have a value of between 0.0-1.0, wherein 0.0 means the particle will not persist and 1.0 meaning the particle weight will never degrade.
  • each particle has an updated location and velocity.
  • the cell index to which they are each assigned is updated.
  • the updating of cell indexes may be performed by mapping the x,y state indicative of the location of each particle to the location of the cell of the occupancy grid map 300 to which it belongs.
  • BBA Basic Belief Assignment
  • a variable predicted_occupancy_mass may be maintained, that represents the likelihood that a cell of the occupancy grid map 300 is occupied
  • predicted_free_mass that represents the likelihood that a cell of the occupancy grid map 300 is unoccupied or free.
  • these masses may be determined in block 410 for each cell of the occupancy grip map 300 using the weights of particles, such as stored in the weights matrix, assigned to each respective cell.
  • This BBA is then stored as a prior mass or prior BBA, which is used subsequently to determine a posterior calculated mass or posterior BBA, as will be explained
  • the prior BBA is prior to receiving measurements and the posterior BBA is as updated during an iteration of the method 400.
  • any objects in the environment of the vehicle 200 are detected by the one or more sensors 160, 170 associated with the vehicle 200.
  • Each sensor 160, 170 outputs sensor measurement data 145 indicative of any detected objects, where the sensor measurement data 145 is received by the controller 110.
  • the sensor measurement data 145 is formed into a measurement grid map as discussed below
  • the measurement grid map is another grid map which may match the dimensions of the DOGMa occupancy grid map 300 i e. in the example the measurement grid map 300 may be 8x8 cells as in Figure 3, although it will be appreciated that other sizes of measurement grip map may be used.
  • the detections of any objects indicated in the sensor measurement data 145 received in block 420 are mapped onto the measurement grid map in bock 420 and assigned to cells of the measurement grid map.
  • the detections of objects in the sensor measurement data 145 are provided as a point cloud.
  • the point cloud comprises point data indicative of locations at which an object is detected by the sensors 160, 170.
  • the points in the point cloud have associated x,y,z positions
  • the occupancy grip map 300 may be, especially for a land-going robot or vehicle, 2D i.e lacking in dimension z.
  • the points in the point cloud may be flattened As part of the flattening, points with z axis values that are outside of a region-of-interest associated with the vehicle may be removed e.g. a point detected 20 meters above the EGO vehicle does not form part of the measurement grid map 300.
  • the flattened points are then mapped or assigned to cells of the measurement grip map in block 430.
  • cell occupancy probability is determined for the cells of the measurement grid map.
  • Each cell of the measurement grid map is associated with one or both of an occupied mass and a free mass.
  • each cell of the measurement grid map, and also the occupancy grid map is associated with a value indicative of an occupied mass and a value indicative of a free mass of the respective cell.
  • the occupied mass is a probability or belief of the cell being occupied by an object and the free mass is a probability of the cell being free or unoccupied. Based on these mass values, a value indicative of an unknown mass or probability may be determined as a difference between the two mass values.
  • a detection of an object in a cell raises the occupied mass of one or more adjacent cells.
  • a 2D Gaussian Kernel is created which allows the detection in one cell of the measurement grid map to raise the occupied mass of adjacent cells.
  • the Gaussian Kernel generates a matrix where the values inside the cells of the matrix correspond to a Gaussian distribution with mean 0 and standard deviation given by a sigma parameter
  • the occupied mass of each cell of the measurement grid map may be initialised to all be zero, then a list of cells that contain detections from block 420 is used to generate beliefs for each cell to be occupied.
  • the beliefs may be generated by using matrix convolution of the Gaussian Kernel applied to the measurement grid map.
  • a vector of occupied mass is produced which is used to generate the cell occupancy BBA as described above with respect to the occupancy grid map
  • the Dempster-Schafer Rule of Combination may be used where cell mass is updated or modified multiple times, for example when a cell is adjacent to two detections, or when multiple detections are in one cell.
  • each cell of the measurement grid is associated with a variable occupancy_mass which represents the likelihood that the respective cell of the measurement grid map 300 is occupied, and free_mass which represents the likelihood of the respective cell being empty or free.
  • each cell may be associated with a data structure such as occupancy_bba which contains values corresponding to the occupancy_mass and the freejnass
  • a field-of-view BBA is determined which is combined with the BBA of the measurement grid map determined in block 440.
  • the FOV of the sensor is used to influence the mass of cells.
  • cells within the FOV of the sensor 160, 170 in which an object has not been detected i.e. are absent a detected object the mass of the cell is determined to be indicative of being free
  • cells which are within the FOV but are obscured from the sensor 160, 170 by an object are determined to have a mass indicative of unknown occupancy, since the occupancy of the cell cannot be determined since it is not visible to the sensor 160, 170, as will be explained
  • a method 500 according to an embodiment of the invention of applying the FOV of a sensor 160, 170 to the measurement grid map is illustrated in Figure 5.
  • the method 500 may be performed in block 450.
  • the method 500 will be explained with reference to Figure 6 which illustrates a portion of an example measurement grid map 600.
  • the measurement grid map 600 is illustrated in relation to a sensor 160, 170 associated with a vehicle being located at the origin 0, 0 (bottom left-hand corner). Therefore the portion of the map illustrated in Figure 6 is located upper-right of the vehicle 200.
  • the measurement grid map 600 illustrates cells corresponding to detections of objects with diagonal shading such as cell 640.
  • the method 500 is described in connection with the DOGMa process of Nuss with it being understood that its usefulness is not limited to the DOGMa process.
  • the method 500 comprises a block of 510 of determining cells of the measurement grid within the FOV of the sensor.
  • the FOV of the sensor is described as being a cone
  • the FOV of the sensor 160, 170 may have another shape, such as being circular, oval or rectangular as examples.
  • Figure 6 illustrates the FOV of the sensor 160, 170 as a cone 605 extending between first and second boundary lines 610, 620 at each peripheral sides of the cone 605 extending from the origin (0,0) at which the sensor 160, 170 is located.
  • the FOV 605 of the sensor 160, 170 may be referred to as a first FOV 605.
  • the FOV, in this embodiment the cone, 605 is generated for each sensor 160, 170 using its extrinsics or characteristics, such as one or more of its location about the vehicle, angular resolution and range
  • the cone 605 represents an area in which there is an increased confidence of it being empty, except where detections of objects exist and the occluded space behind detections as will be explained
  • the FoV method 500 determines a FOV, such as the cone 605 in the example, originating from the sensor’s 160, 170 position relative to EGO vehicle centre point which may be the rear axle in some embodiments.
  • the environment around the EGO vehicle is divided into a plurality of areas or sectors In one embodiment, the environment is divided into octants, although it will be realised that other numbers of sectors may be used.
  • the method 500 may then be performed separately for each sector, which advantageously reduces computation complexity. In some embodiments, the method may be performed at least partly in parallel for two or more sectors which reduces a computation time.
  • the FOVs of each sensor 160, 170 such as cones 605 cast by the sensors, can cross into multiple octants i.e. the FOV of a sensor is not necessarily confined to one sector In Figure 6, the cone 605 is cast in block 510 on the measurement grid map 600 which is already divided into cells of a uniform size.
  • one or more cells of the measurement grid map 600 are selected which are at least partially within the FOV 605 of the sensor i.e. within the cone 605 in the illustrated embodiment.
  • a cell may be selected if it is only partially within the FOV 605 of the sensor.
  • the method 500 iterates over columns of the measurement grid map 600 moving away from the origin (0,0) of the cone 605 until it reaches the bounds of the cone, based on the respective sensor’s angular resolution and the range of the sensor 160, 170.
  • the sensor’s 160, 170 range is considered to extend to the periphery of the measurement grid map 600 but it will be appreciated that the range may fall within the measurement grid map 600 i e.it may not reach the edge of the map 600.
  • a first column 630 is selected in block 520 and one or more cells within that column are selected which are at least partially between the boundaries 610, 620.
  • the first column is that with a lowest column index in an embodiment.
  • block 530 it is determined if the selected cell(s) contain a detection of an object and, if not, the method 500 moves to block 540.
  • the sensor data did not indicate the location of an object in said cell 615 with the cell being within the FOV 605
  • the sensor data did not indicate the location of an object in said cell 615 with the cell being within the FOV 605
  • other cells within the FOV 605 have corresponding sensor data indicating the detection of an object and thereby demonstrating that the sensor 160, 170 is operational, it can be better assumed that the cell 615 is actually empty as no object is detected within the cell 615.
  • the method 500 is recursive in that it returns to block 510 where a new FOV is cast for the sensor 160, 170
  • the method 500 creates a new FOV between the detected one or more objects and/or a boundary of the previous FOV.
  • a cell 640 comprising an object detection is determined in block 530 causing the method to return to block 510.
  • a second FOV 650 is cast comprising boundaries 660, 670 between cells comprising detections of objects, i.e.
  • the method 500 then repeats for the newly cast FOV 650 of the sensor.
  • the newly cast FOV 650 represents a region into which the sensor 160, 170 has visibility between detected object(s).
  • block 550 after marking cell(s) as visible and empty in block 540, it is considered whether all cells within the current FOV 605, 650 of the sensor 160, 170 which are visible to the sensor have been considered If not, the method returns to block 520 to select one or more further cell(s), such as within a next column of the measurement grid map 600. If, however, all visible cells have been considered the method moves to block 560
  • cells in the measurement grid map 600 which are not occupied by detected objects are marked or identified as being visible and empty, such as cells 690, or obscured, such as cells 680. It can be considered that rays of illumination are cast outward from the sensor 160, 170 to illuminate regions within the FOV 605, 650 of the sensor 160, 170. Illuminated cells of the measurement grid map 600 which are not occupied are considered as being empty 690, whereas cells 680 within a shadow of an object 640 caused by the illumination are considered as being indeterminate in occupancy.
  • a free mass for those cells is set to a predetermined value.
  • the predetermined value is indicative of a probability of being free, such as at least 0.5
  • the predetermined free mass value may be, for example, 0.95 i.e. a probability of being free of 95%, although it will be appreciated that other values may be chosen.
  • a value associated with said cells can be controlled to be indicative of the increased confidence, such as a predetermined free mass value of equal to or greater than 0 7, or equal to or greater than 0.8, 0.9 or 0.95.
  • a predetermined free mass value of equal to or greater than 0 7, or equal to or greater than 0.8, 0.9 or 0.95.
  • the unknown mass or probability may be set to a predetermined value, such as 0.5 although other values may be chosen.
  • the unknown mass value may be between 0.4 and 0.6.
  • the unknown mass of 0 5 equates to a 50:50 likelihood of being occupied and unoccupied.
  • the occupied_mass value and the free_mass values may be set to predetermined values, such as indicative of the 50:50 likelihood.
  • the occupiedjnass value may be set to 0.5 and the freejnass value set to 0.5
  • both values may be set to 0 to be indicative of an unknown mass of 1. It will be appreciated that other values may be chosen to have a similar or equivalent effect.
  • the free mass value and the occupied mass value may each be updated to be less than 0.3.
  • the Dempster-Schafer rule of combination is used to combine the unknown mass or BBA, as discussed below, with the prior mass, the occupied mass gradually, i.e over a number of iterations or updates, moves from what was previously measured to be a value indicative of unknown occupancy. Therefore, if a detection was previously seen in a now occluded or obscured cell, such as one of cells 680 in Figure 6, the occupancy mass of that cell will not immediately change to be indicative of unknown occupancy. It takes several cycles of the cell being occluded to degrade the occupied mass such that it is indicative of being of unknown occupancy.
  • a parameter fov_threshold which controls what is considered an opaque cell by the algorithm, i.e what occupancy mass of a cell we consider as occupied by a detection. For example, if fovjhreshold is set to 0.4, then any cells having an occupiedjnass equal to or above the fov_threshold value of 0.4 are considered to be occupied.
  • the mass values determined as a result of the FOV of the sensor are combined with those of the measurement grid map.
  • Combining the FoV with the measurement grid map may be performed with the Dempster-Schafer (DS) rule of combination.
  • Figure 7 illustrates occupied and free masses of two cells 710, 720 which are to be combined using the DS rule of combination as below.
  • K is equal to the sum of the product of all the combinations of disjoint sets. In this example, for simplicity of explanation, this means Occupied vs Free. These two possibilities are incompatible, so they can be considered “disjoint sets”. This translates to:
  • particle association is performed with the detections in block 460. This allows the DOGMa process to create and maintain particles associated with detections Advantageously computational effort is not wasted on associated particles that model nothing in the real-world.
  • a data structure particle_association_info is associated with the measurement grid map.
  • This data structure stores a probability for each cell for particles in that cell being associated with a measurement of an object.
  • the probability y is determined with a probability density function according to a Normal Gaussian distribution, although it will be appreciated that other distributions may be used. The function may be:
  • mean (m) may be 0, sigma (s) may be 1 and x is the distance in meters from the cell to the detection of the object.
  • one or more components of particles are determined.
  • the particles for which the one or more components are determined in block 470 may be newly born particles and persistent particles in the posterior belief i.e. posterior BBA.
  • the one or more components which may be represented as occupied jnassjcomponents are determined using the occupiedjnass from the determined measurement grid map, the prior_occupied_mass from DOGMa Grid as determined in the prediction of block 410 and a birth probability parameter.
  • the occupied jnass components represents the components of newly born particles, which are used in resampled block 480 below, and the components of persistent particles which are used in update block 475 below.
  • the birthjactor parameter controls a balance of newly created particles versus persistent particles.
  • the birthjactor parameter may assume a value in a predetermined range such as 0-1.
  • a value of 0 means no new particles are created, whereas a value of 1 means that particles will be created directly relative to the occupied mass.
  • a greater number of new particles being created results in a greater number of existing particles being pruned in the resample block 480.
  • the birth probability may be around 0.02, although other values may be chosen.
  • persjnass occupiedjnass - bomjnass
  • the persistent mass persjnass is a remainder of the bom mass being deducted from the occupied mass. Please note that the operations above are element wise vector operations.
  • Block 475 is an update block.
  • cells and particles in the dynamic occupancy grid map are updated or modified with the detections incorporated into the measurement grip map, which also includes the effect of the FOV determination according to an embodiment of the invention discussed above with reference to Figure 5 in particular
  • a function likelihood may be defined that calculates the Doppler measurement likelihood according to the method from DOGMa Thesis (Nuss, 2017) (equation 5.70 and 5.71 pp. 77)
  • the update operation in block 475 is a determination of the likelihood of a particle existing relative to an incoming measurement, i.e. if a particle is close to the measurement, and has a similar velocity, then the particle will be given a greater weight
  • Block 475 may comprise cell occupancy and particle updating processes.
  • the cell occupancy is updated in block 475 by updating the posterior BBA with the BBA from the measurement grid map and the prior BBA. As described above, the updating may be performed using the Dempster-Schafer Rule of Combination for the occupied and free masses.
  • particle weights are updated
  • a function to update particle weights is used in some embodiments which carries out a vector multiplication between existing, un-normalised, weights of the particles and the Doppler measurement likelihood that is referred to above. Updating particles in this way degrades the particle weights depending on how much their states differ from the incoming detection.
  • a normalisation factor may be used in some embodiments for each cell to normalise the weights of particles that are within each cell Such normalisation is done separately for associated (associated with a detection) and un-associated cells.
  • the persistence mass for a cell may be divided by the sum of the particle weight in that cell Persistence mass is relative to the incoming detections in the measurement grid map, where the persistence mass is calculated in block 470 above. This is carried out for every cell in the measurement grid map. In effect, this process increases particle weights for particles that are at, or close to, incoming detections from the one or more sensors 160, 170
  • Un-associated cells may be updated by dividing the persistence mass by the prior occupied mass. The un-associated and associated weight normalisation factors are updated in this way. These are vectors with entries for each cell.
  • normalisation may be carried out on the weights vector.
  • the normalisation may use the unnormalised_weights for each particle, associated _particles_normalisation_factors for each cell, unassociated _particles_normalisation_factors for each cell and the association _prob from the measurement grid map.
  • This step of block 475 determines a probability for each cell for particles in the cell to be associated with a measurement. Each particle has a probability of being associated and of being un-associated, which in added together may form the weight of the particle in some embodiments.
  • association part may be calculated by the association probability of the cell multiplied by the associated particles normalisation factor and the un-normalised weight of the particle.
  • associated_part association _prob * associated _particles_normalisation_factors(ce ⁇ ) * unnormalised /veights(paMe ⁇ ,'
  • the above process may be carried out for every particle.
  • a resampling operation is performed During the resampling operation, new particles are initialised, which may be according to the born mass discussed above, and other existing particles are pruned. As mentioned above, pruning may performed to maintain the total number of particles in the dynamic grid map at a defined num _particies parameter which provides a desired number of particles for the grid map After new particles are born, the total number of particles is num _particles + number_of_birth _particies where number_of_birth _particies defines the number of born particles. Pruning is used to reduce the number of particles to num _particles. In some embodiments, the pruning may comprise generating a number of uniformly distributed random numbers. The distribution of random numbers will be of size num _particles to index particles in the total number of particles. These are the particles that will persist, with the rest being pruned, thereby maintaining the number of particles at nu _particles.
  • a sampler function is used.
  • the sampler function is a function to assist in performing weighted random sampling.
  • Use of the function is modular in that a different sampler functions can be used in block 480
  • a discrete distribution is used which returns random numbers where the probability of integer / is defined as:
  • w is the weight of the /-th integer divided by the sum S of all n weights where n is the number of weights It may be considered that the random sampler has a greater likelihood of retaining particles having a higher weight.
  • New particles may be created during the resampling operation in block 480.
  • the creating of particles may be controlled by parameters new _particles _per_celt the number of new particles that should be created in each cell, proportional to the born_mass. bornjnass'. for each cell, the component of the posterior occupied mass for new particles. probability_for_cell'. This contains the probability for each cell for particles in that cell to be associated with a measurement. max_velocity. Maximum velocity to be used for newly initialised particles in meters per second.
  • a particle creation function in some embodiments is used which returns a pair where the 'first' member is a Nx4 matrix, where N is the total number of new particles, of particles states as [ y vx vy], and a 'second' member is a A/x1 vector of particle weights.
  • New particles may be instantiated in a cell where the higher the bornjnass the larger number of particles will be created Since bornjnass is relative to incoming detections, this results in more particles created around incoming detections.
  • These particles are created with a position and velocity strategy.
  • the strategy may comprise instantiating particles with a distribution, such as a standard random distribution, inside a cell.
  • Advantageously particles are not all created at the centre of a grid cell, but distributed randomly around the cell with random velocities.
  • all new particles are un-associated, so they are instantiated with a label ID that represents un-associated, such as -1 although other labels may be used.
  • the creation of new particles may provide a vector of new particles. New particles may be appended to existing particles. In some embodiments, the created joint vector of particles is resampled, such as using the sampler function noted above. In this way, new particles are created for the particle filter and, at the same time, low-weight particles are pruned so that the total number of particles is maintained at the defined limit.
  • labels associated with particles are updated to represent objects
  • the particles may be clustered using a DBSCAN algorithm (Ester, et al., 1996), although other methods of clustering particles may be used.
  • the clustering creates clusters of particles with the same label which will be extracted to an untracked object with a centre point, velocity and bounding box.
  • This algorithm will associated groups of particles as an object.
  • a configurable min_points determines the minimum number of particles that need to be in a cluster for it to be considered an object and an epsilon variable to configure the distance allowable between particles to be considered part of the cluster.
  • This object extraction allows the dynamic occupancy grip to produce untracked objects which are then output to an Object Level Tracker (OLT) as another sensor input to be fused with data from other sensors, such as camera and radar sensors. Since these objects are fairly simple, e.g. they lack any classification detail, they can be fused with data from sensors that allows high quality classification to be provided, such as camera/Lidar, and to improve the position and velocity estimates of those sensors.
  • OLT Object Level Tracker
  • a conversion is performed from the BBA to a value representing a probability of occupancy.
  • this conversion assists in using the occupancy grid map.
  • the value representing the probability may be an integer such as in the range 0-1 , rather than the BBA of two different possibilities (occupied and free). Therefore, in some embodiments, the BBA is converted into a probability value for each cell to be occupied.
  • the occupancy grid map is output.
  • the occupancy grid map contains a probability of occupancy for each cell in the occupancy grid map, and an associated list of detected objects which are extracted from the occupancy grip map, as described above.
  • the controller 110 outputs occupancy grid map data 155 indicative of the occupancy grip map 300 and the objects.
  • the occupancy grid map data 155 may be provided to another controller of the vehicle 200, for controlling movement of the vehicle 200.
  • the occupancy grid map data 155 may be used to determine a path of the vehicle 200.
  • the occupancy grid map data 155 may be used reduce a likelihood of the vehicle 200 coming into contact with any objects in the environment of the vehicle 200.
  • the objects may be used as input to an Object Level Tracker (OLT) that performs association, tracking and state estimation on tracks from multiple sensors
  • OLT may perform association using a Munkres algorithm (Konstantinova, et al., 2003).
  • the tracker maintains a list of tracks that are updated with the output of the association.
  • state estimation may handled with the reuse of the particle filter described above or use of an Unscented Kalman Filter (UKF)
  • UEF Unscented Kalman Filter
  • a paired down version with a much smaller amount of particles is used to model the state of each track. This is done by removing the grid, instead the world that is modelled by the particle filter is the bounding box of the track, updated by any incoming detection that the Association step has determined is related to this track

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Acoustics & Sound (AREA)
  • Traffic Control Systems (AREA)
  • Combined Controls Of Internal Combustion Engines (AREA)

Abstract

Des aspects de la présente invention concernent un système de commande pour un véhicule (200), le système de commande comprenant au moins un dispositif de commande (110), le système de commande étant configuré pour recevoir, en provenance d'au moins un capteur (160, 170), des données de capteur (145) indiquant un emplacement d'un ou plusieurs objets détectés dans un environnement du véhicule (200), modifier une grille d'occupation (300, 600) stockée dans une mémoire accessible au système de commande en fonction des données de capteur, la grille d'occupation représentant un environnement du véhicule et ayant une pluralité de cellules (605), chaque cellule étant associée à au moins une valeur indicative d'une probabilité qu'une partie correspondante de l'environnement soit occupée par l'un du ou des objets, la modification comprenant le système de commande étant configuré pour déterminer (530, 540) une ou plusieurs cellules (690) de la grille d'occupation dans un champ de vision du capteur pour lequel les données de capteur n'indiquent pas l'emplacement d'un objet, et modifier la ou les valeurs associées à la ou aux cellules déterminées de la grille d'occupation pour indiquer une probabilité accrue de l'inoccupation de la cellule par un objet.
PCT/EP2023/086072 2022-12-22 2023-12-15 Appareil et procédé de détermination d'une représentation d'un environnement WO2024132935A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB2219502.8 2022-12-22
GB2219502.8A GB2625733A (en) 2022-12-22 2022-12-22 Apparatus and method for determining a representation of an environment

Publications (1)

Publication Number Publication Date
WO2024132935A1 true WO2024132935A1 (fr) 2024-06-27

Family

ID=85130055

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2023/086072 WO2024132935A1 (fr) 2022-12-22 2023-12-15 Appareil et procédé de détermination d'une représentation d'un environnement

Country Status (2)

Country Link
GB (1) GB2625733A (fr)
WO (1) WO2024132935A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200103523A1 (en) * 2018-09-28 2020-04-02 Zoox, Inc. Radar Spatial Estimation
US20200278681A1 (en) * 2019-02-28 2020-09-03 Zoox, Inc. Determining occupancy of occluded regions
EP4012347A1 (fr) * 2020-12-14 2022-06-15 Aptiv Technologies Limited Système et procédé de mappage de l'environnement d'un véhicule
US20220185267A1 (en) * 2020-12-16 2022-06-16 Zoox, Inc. Object determination in an occluded region

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10195992B2 (en) * 2017-04-03 2019-02-05 Ford Global Technologies, Llc Obstacle detection systems and methods
GB2605587A (en) * 2021-04-01 2022-10-12 Aptiv Tech Ltd Mapping a vehicle environment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200103523A1 (en) * 2018-09-28 2020-04-02 Zoox, Inc. Radar Spatial Estimation
US20200278681A1 (en) * 2019-02-28 2020-09-03 Zoox, Inc. Determining occupancy of occluded regions
EP4012347A1 (fr) * 2020-12-14 2022-06-15 Aptiv Technologies Limited Système et procédé de mappage de l'environnement d'un véhicule
US20220185267A1 (en) * 2020-12-16 2022-06-16 Zoox, Inc. Object determination in an occluded region

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
D. NUSS: "The International Journal of Robotics Research", 2018, article "A Random Finite Set Approach for Dynamic Occupancy Grid Maps"

Also Published As

Publication number Publication date
GB2625733A (en) 2024-07-03
GB202219502D0 (en) 2023-02-08

Similar Documents

Publication Publication Date Title
US11682129B2 (en) Electronic device, system and method for determining a semantic grid of an environment of a vehicle
US20210333108A1 (en) Path Planning Method And Device And Mobile Device
EP3767332B1 (fr) Procédés et systèmes de détection radar d'objets
CN113570629B (zh) 去除动态物体的语义分割方法及系统
CN112166458B (zh) 目标检测与跟踪方法、系统、设备及存储介质
CN111582105A (zh) 基于局部全局双向推理的无监督点云特征学习方法及装置
CN114384491A (zh) 用于激光雷达的点云处理方法及装置、存储介质
Rachman 3D-Lidar multi object tracking for autonomous driving
CN115187944A (zh) 一种车道线检测方法及装置
CN114859938A (zh) 机器人、动态障碍物状态估计方法、装置和计算机设备
US12111386B2 (en) Methods and systems for predicting a trajectory of an object
CN117974990A (zh) 一种基于注意力机制和特征增强结构的点云目标检测方法
CN117739954A (zh) 地图局部更新方法、装置及电子设备
WO2024132935A1 (fr) Appareil et procédé de détermination d'une représentation d'un environnement
CN116523970B (zh) 基于二次隐式匹配的动态三维目标跟踪方法及装置
WO2024132926A1 (fr) Appareil et procédé de détermination d'une représentation d'un environnement
CN110531340B (zh) 一种激光雷达点云数据的基于深度学习的识别处理方法
CN117516560A (zh) 一种基于语义信息的非结构化环境地图构建方法及系统
CN116481513A (zh) 地图生成方法、装置、电子设备
GB2625732A (en) Apparatus and method for tracking objects
CN111338336B (zh) 一种自动驾驶方法及装置
Richter et al. Advanced occupancy grid techniques for lidar based object detection and tracking
CN114202567A (zh) 一种基于视觉的点云处理避障方法
CN115527034B (zh) 一种车端点云动静分割方法、装置及介质
CN118466525B (zh) 一种电力巡检机器人高空避障方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23837180

Country of ref document: EP

Kind code of ref document: A1