US12674685B2 - System and method of actor-based map attribute generation - Google Patents
System and method of actor-based map attribute generationInfo
- Publication number
- US12674685B2 US12674685B2 US18/651,824 US202418651824A US12674685B2 US 12674685 B2 US12674685 B2 US 12674685B2 US 202418651824 A US202418651824 A US 202418651824A US 12674685 B2 US12674685 B2 US 12674685B2
- Authority
- US
- United States
- Prior art keywords
- map
- attributes
- data
- actor
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
- G01C21/3863—Structures of map data
- G01C21/387—Organisation of map data, e.g. version management or database structures
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/28—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
- G01C21/30—Map- or contour-matching
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3602—Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
- G01C21/3804—Creation or updating of map data
- G01C21/3807—Creation or updating of map data characterised by the type of data
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
- G01C21/3804—Creation or updating of map data
- G01C21/3807—Creation or updating of map data characterised by the type of data
- G01C21/3815—Road data
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
- G01C21/3804—Creation or updating of map data
- G01C21/3833—Creation or updating of map data characterised by the source of data
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
- G01C21/3804—Creation or updating of map data
- G01C21/3833—Creation or updating of map data characterised by the source of data
- G01C21/3841—Data obtained from two or more sources, e.g. probe vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
- G01C21/3885—Transmission of map data to client devices; Reception of map data by client devices
- G01C21/3896—Transmission of map data from central databases
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09626—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages where the origin of the information is within the own vehicle, e.g. a local storage device, digital map
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0968—Systems involving transmission of navigation instructions to the vehicle
- G08G1/096805—Systems involving transmission of navigation instructions to the vehicle where the transmitted instructions are used to compute a route
- G08G1/096811—Systems involving transmission of navigation instructions to the vehicle where the transmitted instructions are used to compute a route where the route is computed offboard
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0968—Systems involving transmission of navigation instructions to the vehicle
- G08G1/096805—Systems involving transmission of navigation instructions to the vehicle where the transmitted instructions are used to compute a route
- G08G1/096827—Systems involving transmission of navigation instructions to the vehicle where the transmitted instructions are used to compute a route where the route is computed onboard
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0968—Systems involving transmission of navigation instructions to the vehicle
- G08G1/096833—Systems involving transmission of navigation instructions to the vehicle where different aspects are considered when computing the route
- G08G1/096844—Systems involving transmission of navigation instructions to the vehicle where different aspects are considered when computing the route where the complete route is dynamically recomputed based on new data
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
- G08G1/163—Decentralised systems, e.g. inter-vehicle communication involving continuous checking
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/164—Centralised systems, e.g. external to vehicles
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/35—Data fusion
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/40—High definition maps
Definitions
- the present disclosure relates generally to onboard and off-board maps of vehicles, and more particularly, extracting road features to maintain onboard and off-board maps for autonomous driving vehicles.
- map data In general, autonomous vehicles rely on map data to generate a future path of travel.
- the map data can include inaccuracies and/or limitations due to a number of factors. For example, adverse weather can cause blurriness, sensors may be blocked, or changes to a road network since the map data was gathered. Gathering one or more attributes of the road and updating the map data with the same may be desirable to enhance the data relied on by autonomous vehicles.
- the present disclosure addresses one or more shortcomings of existing systems and methods of gathering and updating map data for partially and/or fully autonomous vehicles.
- a computer-implemented method that, when executed by data processing hardware, causes the data processing hardware to perform operations.
- the operations include gathering sensor data via a sensor system of a host vehicle, processing perception data via a perception system of the host vehicle, maintaining onboard map data of the host vehicle, determining a position of the host vehicle, evaluating the sensor data, the perception data, and the onboard map data via an online mapping module, and fusing one or more detected map attributes with existing map attributes.
- Implementations of the disclosure may include one or more of the following optional features.
- the method may further include updating the onboard map data with the one or more detected map attributes.
- the method may further include determining quality of existing map attributes based on the one or more detected map attributes.
- the method may further include communicating the one or more detected map attributes to a cloud database for use by other vehicles.
- the online mapping module may further include an actor-based reasoner module and an online map generator module.
- the one or more detected map attributes can be semantic road attributes.
- the semantic road attributes can determined based on perceived data of one or more road actors.
- the one or more detected map attributes may be geometrical road attributes.
- the geometrical road attributes may be inferred based on perceived data of one or more road actors.
- fusing the one or more detected map attributes with the existing map attributes can further include providing high definition map data that is configured for a planning module of the host vehicle.
- a system in another configuration, includes data processing hardware and memory hardware in communication with the data processing hardware, the memory hardware storing instructions that, when executed on the data processing hardware, cause the data processing hardware to perform operations.
- the operations include gathering sensor data via a sensor system of a host vehicle, processing perception data via a perception system of the host vehicle, maintaining onboard map data of the host vehicle, determining a position of the host vehicle, evaluating the sensor data, the perception data, and the onboard map data via an online mapping module, and fusing one or more detected map attributes with existing map attributes.
- Implementations of the disclosure may include one or more of the following optional features.
- the method can further include updating the onboard map data with the one or more detected map attributes.
- the method can further include determining quality of existing map attributes based on the one or more detected map attributes.
- the method can further include communicating the one or more detected map attributes to a cloud database for use by other vehicles.
- the one or more detected map attributes can be either semantic road attributes or geometrical road attributes.
- a vehicle management system in yet another configuration, includes a sensor system, a perception system, an onboard map module, an online mapping module comprising an actor-based reasoner module and an online map generator module, data processing hardware, and memory hardware in communication with the data processing hardware.
- the memory hardware storing instructions that, when executed on the data processing hardware, cause the data processing hardware to perform operations.
- the operations include gathering sensor data via a sensor system of a host vehicle, processing perception data via a perception system of the host vehicle, maintaining onboard map data of the host vehicle, determining a position of the host vehicle, evaluating the sensor data, the perception data, and the onboard map data via an online mapping module, and fusing one or more detected map attributes with existing map attributes.
- Implementations of the disclosure may include one or more of the following optional features.
- the method can further include updating the onboard map data with the one or more detected map attributes.
- the method can further include determining quality of existing map attributes based on the one or more detected map attributes.
- the method can further include communicating the one or more detected map attributes to a cloud database for use by other vehicles.
- the one or more detected map attributes can be either semantic road attributes or geometrical road attributes.
- FIG. 1 is a schematic diagram of a vehicle environment including a vehicle and a vehicle management system of the vehicle according to principles of the present disclosure
- FIG. 2 is an enlarged schematic diagram showing an example vehicle management system comprising an online mapping module according to the principles of the present disclosure
- FIG. 3 A is an enlarged schematic diagram showing a configuration of the online mapping module of FIG. 2 ;
- FIG. 3 B is a flow diagram showing operations of the online mapping module of FIG. 3 A ;
- FIG. 3 C is a plot showing position of the vehicle versus time according to the principles of the present disclosure
- FIG. 3 D is a detailed flow diagram of one step of the flow diagram of FIG. 3 B ;
- FIG. 3 E is a flow diagram showing operations of the online mapping module of FIG. 3 A ;
- FIG. 4 is an enlarged schematic diagram showing another configuration of the online mapping module of FIG. 2 ;
- FIG. 5 A is an enlarged schematic diagram showing another configuration of the online mapping module of FIG. 2 ;
- FIG. 5 B is a flow diagram showing operations of the online mapping module of FIG. 5 A ;
- FIG. 5 C is a flow diagram showing operations of the online mapping module of FIG. 5 A ;
- FIG. 5 D is a plot showing position of a road actor with respect to a perceived lane edge point
- FIG. 5 E is a schematic showing initial lane inference could be miss-aligned due to actors miss-alignment on a road according to principles of the present disclosure
- FIG. 5 F is a schematic showing actor-to-perception alignment according to principles of the present disclosure.
- FIG. 5 G is a schematic showing actor-to-actor alignment according to principles of the present disclosure.
- FIG. 5 H is a plot showing position of a road actor with respect to another road actor
- FIG. 5 I is a schematic showing initial lane inference could be miss-aligned due to actors miss-alignment on a road according to principles of the present disclosure
- FIG. 5 J is a schematic showing actor-to-perception alignment according to principles of the present disclosure.
- FIG. 5 K is a schematic showing actor-to-actor alignment according to principles of the present disclosure.
- FIG. 5 L is a flow diagram showing operations of the online mapping module of FIG. 5 A ;
- FIG. 6 A is a schematic diagram showing an attribute detector according to principles of the present disclosure.
- FIG. 6 B is a flow diagram showing operations of the attribute detector of FIG. 6 A according to one configuration
- FIG. 6 C is schematic showing a driving scenario of two road actors on a road
- FIG. 6 D is a schematic showing another driving scenario of the two road actors on the road.
- FIG. 6 E is a flow diagram showing operations of the attribute detector of FIG. 6 A according to another configuration.
- FIG. 7 is a flow diagram showing operations of the vehicle management system of FIG. 2 .
- Example configurations will now be described more fully with reference to the accompanying drawings.
- Example configurations are provided so that this disclosure will be thorough, and will fully convey the scope of the disclosure to those of ordinary skill in the art. Specific details are set forth such as examples of specific components, devices, and methods, to provide a thorough understanding of configurations of the present disclosure. It will be apparent to those of ordinary skill in the art that specific details need not be employed, that example configurations may be embodied in many different forms, and that the specific details and the example configurations should not be construed to limit the scope of the disclosure.
- first,” “second,” “third,” etc. may be used herein to describe various elements, components, regions, layers and/or sections. These elements, components, regions, layers and/or sections should not be limited by these terms. These terms may be only used to distinguish one element, component, region, layer or section from another region, layer or section. Terms such as “first,” “second,” and other numerical terms do not imply a sequence or order unless clearly indicated by the context. Thus, a first element, component, region, layer or section discussed below could be termed a second element, component, region, layer or section without departing from the teachings of the example configurations.
- module may be replaced with the term “circuit.”
- the term “module” may refer to, be part of, or include an Application Specific Integrated Circuit (ASIC); a digital, analog, or mixed analog/digital discrete circuit; a digital, analog, or mixed analog/digital integrated circuit; a combinational logic circuit; a field programmable gate array (FPGA); a processor (shared, dedicated, or group) that executes code; memory (shared, dedicated, or group) that stores code executed by a processor; other suitable hardware components that provide the described functionality; or a combination of some or all of the above, such as in a system-on-chip.
- ASIC Application Specific Integrated Circuit
- FPGA field programmable gate array
- code may include software, firmware, and/or microcode, and may refer to programs, routines, functions, classes, and/or objects.
- shared processor encompasses a single processor that executes some or all code from multiple modules.
- group processor encompasses a processor that, in combination with additional processors, executes some or all code from one or more modules.
- shared memory encompasses a single memory that stores some or all code from multiple modules.
- group memory encompasses a memory that, in combination with additional memories, stores some or all code from one or more modules.
- memory may be a subset of the term “computer-readable medium.”
- computer-readable medium does not encompass transitory electrical and electromagnetic signals propagating through a medium, and may therefore be considered tangible and non-transitory memory.
- Non-limiting examples of a non-transitory memory include a tangible computer readable medium including a nonvolatile memory, magnetic storage, and optical storage.
- the apparatuses and methods described in this application may be partially or fully implemented by one or more computer programs executed by one or more processors.
- the computer programs include processor-executable instructions that are stored on at least one non-transitory tangible computer readable medium.
- the computer programs may also include and/or rely on stored data.
- a software application may refer to computer software that causes a computing device to perform a task.
- a software application may be referred to as an “application,” an “app,” or a “program.”
- Example applications include, but are not limited to, system diagnostic applications, system management applications, system maintenance applications, word processing applications, spreadsheet applications, messaging applications, media streaming applications, social networking applications, and gaming applications.
- the non-transitory memory may be physical devices used to store programs (e.g., sequences of instructions) or data (e.g., program state information) on a temporary or permanent basis for use by a computing device.
- the non-transitory memory may be volatile and/or non-volatile addressable semiconductor memory. Examples of non-volatile memory include, but are not limited to, flash memory and read-only memory (ROM)/programmable read-only memory (PROM)/erasable programmable read-only memory (EPROM)/electronically erasable programmable read-only memory (EEPROM) (e.g., typically used for firmware, such as boot programs).
- Examples of volatile memory include, but are not limited to, random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), phase change memory (PCM) as well as disks or tapes.
- implementations of the systems and techniques described herein can be realized in digital electronic and/or optical circuitry, integrated circuitry, specially designed ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof.
- ASICs application specific integrated circuits
- These various implementations can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
- the processes and logic flows described in this specification can be performed by one or more programmable processors, also referred to as data processing hardware, executing one or more computer programs to perform functions by operating on input data and generating output.
- the processes and logic flows can also be performed by special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).
- processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer.
- a processor will receive instructions and data from a read only memory or a random access memory or both.
- the essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data.
- a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks.
- mass storage devices for storing data
- a computer need not have such devices.
- Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto optical disks; and CD ROM and DVD-ROM disks.
- the processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
- one or more aspects of the disclosure can be implemented on a computer having a display device, e.g., a CRT (cathode ray tube), LCD (liquid crystal display) monitor, or touch screen for displaying information to the user and optionally a keyboard and a pointing device, e.g., a mouse or a trackball, by which the user can provide input to the computer.
- a display device e.g., a CRT (cathode ray tube), LCD (liquid crystal display) monitor, or touch screen for displaying information to the user and optionally a keyboard and a pointing device, e.g., a mouse or a trackball, by which the user can provide input to the computer.
- Other kinds of devices can be used to provide interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, or tactile input
- the vehicle operating environment 10 includes a vehicle 100 which may also be referred to as a host vehicle or an ego vehicle throughout the description of the present disclosure.
- the vehicle 100 may be an autonomous vehicle and may be any type of vehicle such as, a sedan, truck, sport utility vehicle, van, or motor home.
- the vehicle 100 may be fully autonomous including an automated driving system (ADS) for performing all driving tasks or a semi-autonomous vehicle including an advanced driver assistance system (ADAS) for assisting a driver with steering, braking, and/or accelerating.
- ADS automated driving system
- ADAS advanced driver assistance system
- the vehicle environment 10 can include one or more non-host vehicles or actors 102 .
- the one or more actors 102 may be fully autonomous, partially autonomous, or non-autonomous vehicles and may be equipped with the same or different hardware as the host vehicle 100 .
- the vehicle environment 10 includes one or more scene, road, or geometrical attributes 104 (i.e., lane lines, lane markings, curbs, etc.) and/or one or more semantic attributes 106 on a road 108 .
- the one or more geometrical attributes 104 or the one or more semantic attributes 106 may be missing or are outdated at scenes with occlusion, short field of view (FOV), work zones, etc.
- the vehicle environment 10 also includes a vehicle service center 20 .
- the vehicle operating environment 10 is shown as including a single vehicle service center 20 .
- the vehicle operating environment 10 may include a plurality of vehicle service centers 20 in communication over a network 40 (e.g., the Internet, cellular networks).
- a network 40 e.g., the Internet, cellular networks.
- the vehicle 100 includes a vehicle management system 110 including a sensor system 120 , a computer system 130 , a perception system 140 , an onboard map module 150 , a planner module 160 , and an online mapping module 200 . While the vehicle 100 maneuvers about the environment 10 , the sensor system 120 includes various sensor subsystems 122 , 122 a - 122 c configured to gather sensor data 123 , 123 a - 123 c relating to characteristics of the environment 10 and/or a status of the vehicle 100 .
- the sensor subsystems 122 include a vehicle exterior sensor subsystem 122 a configured to measure or obtain external environmental data 123 a , such as lane markings or surrounding objects (e.g., vehicles, pedestrians), an interior sensor subsystem 122 b configured to measure interior environmental data 123 b , such as vehicle occupancy, and/or a vehicle status sensor subsystem 122 c configured to measure or obtain vehicle operating data 123 c , such as vehicle location and operating parameters such as wheel speed and/or lateral acceleration.
- the exterior sensor subsystem 122 a and the interior sensor subsystem 122 b can include one or more of an RGB camera, an infrared camera, a thermal camera, a radar, and/or an external microphone.
- the vehicle status sensor subsystem 122 c can include an inertial measurement unit (IMU), a global positioning system (GPS), one or more wheel speed sensors, as well as other sensors for obtaining vehicle operating data such as wheel speed, steering wheel position, yaw rate, and lateral acceleration.
- the vehicle status sensor subsystem 122 c can continuously monitor a position 124 of the host vehicle 100 which may be defined as an x-position, y-position, and a heading.
- the position 124 of the host vehicle 100 can also be represented as motion or position vectors 125 .
- the computing system 130 is configured to store, process, and/or communicate the sensor data 123 within the vehicle operating environment 10 .
- the computing system 130 of the vehicle 100 includes data processing hardware 132 and memory hardware 134 .
- the data processing hardware 132 is configured to execute instructions stored in the memory hardware 134 to perform computing tasks related to operation and management of the vehicle 100 .
- the computing system 130 can refer to one or more locations of data processing hardware 132 and/or memory hardware 134 .
- the computing system 130 is a local system located on the vehicle 100 .
- the computing system 130 may be centralized (i.e., in a single location/area on the vehicle 100 , for example, a vehicle control unit), decentralized (i.e., located at various locations about the vehicle 100 ), or a hybrid combination of both (e.g., with a majority of centralized hardware and a minority of decentralized hardware).
- a decentralized computing system 130 may allow processing to occur at an activity location while a centralized computing system 130 may allow for a central processing hub that communicates to systems located at various positions on the vehicle 100 .
- the computing system 130 includes computing resources that are located remotely from the vehicle 100 .
- the computing system 130 may communicate via the network 40 with a remote vehicle computing system 30 (e.g., a remote computer/server or a cloud-based environment).
- the remote vehicle computing system 30 includes remote computing resources such as remote data processing hardware 32 and remote memory hardware 34 .
- sensor data 123 or other processed data may be stored in the remote vehicle computing system 30 and may be accessible to the computing system 130 .
- the computing system 130 is configured to utilize the remote resources 32 , 34 as extensions of the computing resources 132 , 134 such that resources of the computing system 130 may reside on resources of the remote vehicle computing system 30 .
- the perception system 140 can be configured to store and/or process the sensor data 123 and communicate perception data 143 within the vehicle operating environment 10 .
- the perception system 140 is integrated in the computing system 130 or the remote computing system 30 .
- the perception system 140 is a separate system from both the computing system 130 and the remote computing system 30 .
- the semantic attributes 106 such as maneuvers from other road actors 102 may be gathered and/or perceived for generating, monitoring, and/or maintaining an onboard and/or off-board map for the host vehicle 102 .
- the other road actors 102 may be used to infer geometrical attributes 104 such as, lanes and lane connectivity for the host vehicle 100 . This may be particularly useful when the perception system 140 cannot detect geometrical attributes 104 due to occlusion or a short field of view, for example. In some instances, it is easier to detect the other road actors 102 on the road 108 rather than the actual geometrical attributes 104 (i.e., lanes and road markings) or the semantic attributes 106 (i.e., maneuvers) of the road 108 .
- the vehicle 10 can be equipped with the onboard map module 150 comprising an onboard map or onboard map data 153 which provides prior mapping information with high and/or low resolution road segments 155 of the road 108 to the online mapping module 200 of the host vehicle 100 . Additionally or alternatively, the onboard map module 150 can include prior map semantic attributes 157 that can be provided to the online mapping module 200 of the host vehicle 100 . The onboard map module 150 may be configured to be continuously updated in real time while the host vehicle 100 is traveling or is at rest.
- the online mapping module 200 can include an actor-based reasoner module 202 and an online map generator module 204 .
- the vehicle status sensor data 123 c , the perception data 143 , and the onboard map data 153 can be provided to the online mapping module 200 so that the semantic attributes 106 and/or the geometrical attributes 104 may be generated and utilized by the host vehicle 100 . This will be discussed in more detail with respect to the following configurations and according to the principles of the present disclosure.
- the semantic attributes 106 can be monitored using road actor reasoning.
- traffic control devices and/or signs and road elements are designed to create particular road actor 102 behavior and patterns and, thus, unusual behavior of the road actors 102 can indicate anomalies of the onboard map 153 .
- the vehicle status sensor data 123 c , the perception data 143 , and the onboard map data 153 is provided to the online mapping module 200 .
- a segmentizer module 210 of the online map generator module 204 evaluates mapping data 153 and the position 124 of the host vehicle 100 and provides a connectivity graph 212 to a connectivity inference module 220 of the actor-based reasoner module 202 .
- the connectivity inference module 220 evaluates the connectivity graph 212 and provides a connectivity sequence 222 to an association and backpropagation module 230 of the actor-based reasoner module 202 .
- An actor-based semantic reasoner module 250 provides detected semantic attributes 252 to the association and backpropagation module 230 which can be configured to synchronize the detected semantic attributes 252 with the connectivity sequence 212 .
- a classifier module 270 of the online map generator module 204 can also receive and evaluate the connectivity graph 212 from the segmentizer module 210 .
- a map monitoring module 280 of the actor-based reasoner module 202 compares the semantic attributes 106 of the road 108 with the detected semantic attributes 252 of the actor-based semantic reasoner 250 to determine anomalies of the onboard map 153 . The anomalies can be reported to a cloud system for onboard map data or can be used to assess quality of the prior onboard map data 153 , for example.
- the online map generator module 204 ′ can include a scene builder and publisher module 290 .
- the scene builder and publisher module 290 may be configured to fuse the detected semantic attributes 252 with prior onboard map data 153 and generate a high definition (HD) type map 292 .
- the HD type map 292 may be desirable as it provides the planner module 160 with additional or updated semantic road attributes 106 such that the planner module 160 can control the vehicle 100 with improved data in real time.
- a method 300 of evaluating the one or more road actors 102 and extracting the detected semantic attributes 252 is provided.
- the detected semantic attributes 252 can be estimated based on trajectories of one or more of the road actors 102 .
- the trajectories may be represented as motion or position vectors V1, V2, for example.
- the position vectors V 1 , V 2 of the road actor 102 are determined over a consecutive time window such as, a first time window T 1 and a second time window T 2 .
- the road actor 102 heading change ( ⁇ h) compared to the prior time window is calculated.
- the heading change ( ⁇ h) can be calculated using equation (I):
- heading change ( ⁇ h) can be further evaluated so that road curvature, if any, is compensated for.
- compensating for road curvature at 332 includes calculating a rate of heading changed over a distance D the road actor 102 traveled during T2 which may be represented with equation (II):
- ⁇ ⁇ H ⁇ ( K + 1 ) ⁇ ⁇ H ⁇ ( K ) + ⁇ ⁇ h ⁇ dt h ( V )
- an accumulative heading change 342 , ⁇ H of the road actor 102 is calculated.
- the accumulative heading change 342 , ⁇ H may be represented by equation (VI):
- ⁇ ⁇ H ⁇ 0 T ⁇ ⁇ h compensated ⁇ ⁇ ⁇ t h ( VI )
- one or more of the semantic attributes 252 (i.e., maneuvers and direction) of the road actors 102 relative to the host vehicle 102 are calculated.
- the semantic attributes 252 of the road actors 102 may be calculated based on the accumulative heading change 342 , the second position vector V 2 of the road actor 102 , and a second position vector 125 of the host vehicle 100 .
- a method 400 of maneuver backpropagation for detecting and assessing maneuvers of the road actors 102 during or after the maneuver is completed is provided.
- Maneuver backpropagation can be desirable because it can identify lane segments that a maneuver could be initiated from.
- a lane segment 412 is identified for which a maneuver is detected for the first time.
- Boundaries 414 and a first location (x, y) 416 can be gathered to help identify the maneuver with respect to the lane segment 412 .
- a node sequence 422 is selected from the connectivity graph 212 that includes the lane segment 412 identified at 410 .
- a number of nodes 432 are selected that cover a required distance 434 before a maneuver could be initiated.
- a final node sequence 442 is selected from the nodes 432 and the node sequence 422 that belongs to a particular maneuver.
- FIG. 5 A illustrates another illustrative configuration of an online mapping module 500 .
- This configuration is similar in many respects to the configurations of FIGS. 3 A- 3 E and FIG. 4 . Accordingly, the descriptions of the configurations are hereby incorporated into one another, and description of subject matter common to the configurations generally may not be repeated.
- road actor information i.e., the vehicle status sensor data 123 c and the perception data 143
- onboard map data 153 is gathered and provided to an actor-based reasoner module 502 .
- the actor-based reasoner module 502 may be configured to infer geometric road attributes based on the road actor information. Any detected geometrical attributes can be provided to an online map generator module 504 .
- a lane inference module 530 evaluates the vehicle status sensor data 123 c , the perception data 143 , and the onboard map data 153 and provides detected lane segments 532 to a de-duplication module 540 of the online map generator module 504 .
- An ARG smoother module 550 of the online map generator module 504 provides the de-duplication module 540 with perceived lane information 552 that can be compared and/or fused to actor-based lane edges.
- the de-duplication module 540 provides final lane segments 542 to a segmentizer module 510 .
- a road level graph generation module 560 can provide the segmentizer module 510 with a graph of road connections based on prior known road topology.
- the segmentizer module 510 of the online map generator module 504 evaluates final lane segments 542 and provides a connectivity graph 512 to a connectivity interface module 520 and to a classifier module 570 .
- the segmentizer 510 can be configured to detect connectivity of segments by determining shared segments.
- the connectivity interface module 520 evaluates the connectivity graph 512 and provides connectivity sequences 522 to a scene builder and publisher module 590 of the online map generator module 504 .
- the scene builder and publisher module 590 can provide a high resolution module 592 to the planner module 160 ( FIG. 1 ) of the vehicle 100 , for example.
- the lane inference module 530 can generate lane segments over a selected time window according to a method 600 .
- the method 600 is initiated. In practical terms, the method 600 is initiated when an operator starts the ignition of the host vehicle 100 .
- a moving time window T is selected.
- a trajectory 632 of one or more of the road actors 102 is collected.
- an inferred lane segment can be formed by projecting the motion vector M to the right and to the left based on the perpendicular vectors.
- the inferred lane segments are connected to previous inferred segments to form the connectivity graph 512 .
- the lane inference module 530 can cancel lane offset according to method 700 .
- a closest perception point 712 to an inferred edge point 714 can be determined.
- the distance between the closest perception point 712 and the inferred edge point 714 is evaluated to determine whether the distance is less than or equal to a value R1.
- Actor-Perception alignment can be represented by the following equations (VIII-XIII):
- positions of road actors 731 , 732 are projected on perceived lane markings 733 .
- Inferred lane edges 734 of a first road actor 731 can be aligned with perceived lane edges 733 , as shown in FIG. 5 F .
- Inferred lane edges 735 of a second road actor 734 can then be aligned with the inferred lane edges 734 of the first road actor 731 and the perceived lane edges 733 , as shown in FIG. 5 G .
- inferred edges 714 are evaluated to find a closest aligned inferred point 742 to the inferred edge point 714 .
- the distance between the closest aligned point 742 and the inferred edge point 714 is evaluated to determine whether the distance is less than or equal to a value R2.
- Actor-Actor alignment is performed to cancel lane offset.
- Actor-Actor alignment can be represented by the following equations (XIV, XV, XVI):
- the connectivity inference module 520 can connect map elements so that they may be used to design a future path for the vehicle 100 according to method 800 .
- Trajectories of the road actors 102 can be used for connecting inferred map elements and existing map elements.
- visited segments of the connectivity graph 512 based on the trajectory 632 of the road actor 102 are identified for each of the roach actors 102 .
- the connectivity sequences 522 can include observed connectivity sequences 812 and inferred connectivity sequences 822 .
- the observed connectivity sequences 812 may be used to provide the inferred connectivity sequences 822 , for example.
- the connectivity sequences 522 may be desirable for providing a possible sequence that can be followed by the host vehicle 100 .
- An attribute detector 902 can be configured to receive one or more inputs, such as inferred lanes 903 and one or more road actor matrices 904 .
- the attribute detector 901 can be configured to utilize various techniques such as deep and/or shallow classifiers, a Bayesian inference engine or rule, etc. to detect attributes such as a lane split point, a lane merge point, or a road exit, for example.
- a method 900 is provided for utilizing a Bayes classifier to detect lane merge.
- two or more longitudinal locations can be selected.
- two or more conditional probabilities can be calculated for the two or more longitudinal locations. For example, a probability (H 1 ) of an existence of a single lane and a probability of an existence of two or more lanes (H 2 ) given the actor feature vector 904 can be calculated using the following equation (XVII):
- conditional probabilities can be evaluated to determine whether following relationship in (XVIII) is true:
- conditional probabilities can be evaluated to determine whether the following relationship in (XIX) is true:
- conditional probabilities can be evaluated to determine whether the following relationship in (XX) is true:
- a method 900 ′ is provided for utilizing detected lanes to identify lane splits and merges.
- a parallel lane scenario is provided in FIG. 6 C and a merging lane scenario is provide in FIG. 6 D .
- trajectories of a first road actor and a second road actor can be determined.
- one or more lane segments can be inferred over a time horizon T h .
- a first angle ⁇ 1 and a second angle ⁇ 2 can be measured from a tangent to a midpoint of a lane.
- the first angle ⁇ 1 and the second angle ⁇ 2 can be calculated to compensate for road curvature, if any.
- a road skeleton can be used to represent actors in a local Frenet frame, for example.
- the method 900 ′ proceeds to 912 ′ and parallel lanes exist ( FIG. 6 C ). If not, then the method 900 ′ proceeds to 914 ′.
- the method 900 ′ proceeds to 916 ′ and a lane split exists. If not, then the method 900 ′ proceeds to 918 ′ and lane merging exists ( FIG. 6 D ).
- the method 900 ′ can proceed to 920 where the geometric road attribute can be projected on a map.
- lane inference using road actor information may be avoided during certain road actor maneuvers. For instance, if an actor is performing a lane change, lane inference can be bypassed for that actor. However, information from other road actors that are not performing a lane change can still be used. According to one aspect, a high-risk threshold can be implemented which bypasses actor-based inference if another road actor surpasses the high-risk threshold, for example.
- a method 1000 is provided for detecting road attributes that defined the shape of the road and/or map attributes that define expected behavior of road users.
- the method 1000 is initiated. In practical terms, the method 1000 is initiated when an operator starts the ignition of the host vehicle 100 .
- sensor data 123 may be gather through the sensor system 120 of the host vehicle 100 .
- perception data is processed using the perception system of the host vehicle 100 .
- onboard map data 153 is maintained via the onboard map module 150 .
- the position 124 of the vehicle 100 is continuously monitored.
- the sensor data 123 , the perception data 143 , and the onboard map data 153 is evaluated using the online map module 200 , 200 ′, 500 .
- detected road and/or map attributes can be fused with existing road and/or map attributes.
- the detected road/or map attributes may be used to update the onboard map, determine quality of existing map data, and/or update a cloud database.
- the method 1000 ends.
Landscapes
- Engineering & Computer Science (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
If the rate of heading changed over the distance D is less than the threshold value (thr), then the change in heading is due to road curvature at 336. The change in heading being due to road curvature may be represented by the following equation (IV):
If the rate of heading changed over the distance D is greater than the threshold value (thr), then the change in heading is due to a turn maneuver at 338. The change in heading being due to the turn maneuver may be represented by the following equation (V):
If the road actor has not exceeded the threshold Dthr, then the method 600 returns to 630 and t0=t0+T
With reference to
The calculated “New” values refer to coordinates of inferred points after alignment. With reference to
If the relationship in (XVIII) is true then the method 900 proceeds to 932 and no split or merge exists. However, if the relationship in (XII) is false then the method proceeds to 940.
If the relationship in (XIX) is true then the method 900 proceeds to 942 and a split exists (i.e., the first location has one lane and the second location has two lanes). However, if the relationship in (XIX) is false then the method proceeds to 950.
If the relationship in (XX) is true then the method 900 proceeds to 952 and a merge exists (i.e., the first location has two lanes and the second location has one lane.
Claims (17)
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/651,824 US12674685B2 (en) | 2024-05-01 | 2024-05-01 | System and method of actor-based map attribute generation |
| DE102024117992.9A DE102024117992B3 (en) | 2024-05-01 | 2024-06-26 | System and method for actor-based card attribute generation |
| CN202410869355.8A CN120892505A (en) | 2024-05-01 | 2024-07-01 | Systems and methods for generating map attributes based on participants |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/651,824 US12674685B2 (en) | 2024-05-01 | 2024-05-01 | System and method of actor-based map attribute generation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20250341405A1 US20250341405A1 (en) | 2025-11-06 |
| US12674685B2 true US12674685B2 (en) | 2026-07-07 |
Family
ID=96346772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/651,824 Active 2044-06-28 US12674685B2 (en) | 2024-05-01 | 2024-05-01 | System and method of actor-based map attribute generation |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US12674685B2 (en) |
| CN (1) | CN120892505A (en) |
| DE (1) | DE102024117992B3 (en) |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110202271A1 (en) * | 2008-10-21 | 2011-08-18 | Jacobus Martinus Kruithof | Reporting Of Changes In Navigation Map Data For Navigation System |
| US20180188037A1 (en) * | 2016-12-30 | 2018-07-05 | DeepMap Inc. | Occupancy Map Updates Based on Sensor Data Collected by Autonomous Vehicles |
| DE102017211607A1 (en) | 2017-07-07 | 2019-01-10 | Robert Bosch Gmbh | Method for verifying a digital map of a higher automated vehicle (HAF), in particular a highly automated vehicle |
| DE102017215708A1 (en) * | 2017-09-06 | 2019-03-07 | Audi Ag | Method and system for determining a quality mark for road markings |
| US20200025935A1 (en) * | 2018-03-14 | 2020-01-23 | Uber Technologies, Inc. | Three-Dimensional Object Detection |
| US20200278217A1 (en) * | 2019-03-01 | 2020-09-03 | GM Global Technology Operations LLC | Method and apparatus for a context-aware crowd-sourced sparse high definition map |
| US20210354708A1 (en) * | 2020-05-15 | 2021-11-18 | Zenuity Ab | Online perception performance evaluation for autonomous and semi-autonomous vehicles |
| US20210373566A1 (en) * | 2020-05-29 | 2021-12-02 | Zoox, Inc. | Trajectory generation using lateral offset biasing |
| WO2022098511A2 (en) | 2020-11-09 | 2022-05-12 | Argo AI, LLC | Architecture for map change detection in autonomous vehicles |
| US20220250646A1 (en) * | 2021-02-11 | 2022-08-11 | Zoox, Inc. | Route-relative trajectory numerical integrator and controller using the same |
| US20220348224A1 (en) * | 2021-04-29 | 2022-11-03 | Tusimple, Inc. | Direct autonomous vehicle to autonomous vehicle communications |
| US20240142265A1 (en) * | 2022-10-28 | 2024-05-02 | Continental Autonomous Mobility Germany GmbH | Method for creating and providing an enhanced environment map |
| US20240419902A1 (en) * | 2023-06-16 | 2024-12-19 | Nvidia Corporation | Using large language models to update data in mapping systems and applications |
| US20250003764A1 (en) * | 2023-06-27 | 2025-01-02 | Torc Robotics, Inc. | World model generation and correction for autonomous vehicles |
| US12195038B1 (en) * | 2023-12-26 | 2025-01-14 | Aurora Operations, Inc. | Dual mode map for autonomous vehicle |
| US20250171020A1 (en) * | 2023-11-27 | 2025-05-29 | Nvidia Corporation | Speed limit fusion for automotive systems and applications |
-
2024
- 2024-05-01 US US18/651,824 patent/US12674685B2/en active Active
- 2024-06-26 DE DE102024117992.9A patent/DE102024117992B3/en active Active
- 2024-07-01 CN CN202410869355.8A patent/CN120892505A/en active Pending
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110202271A1 (en) * | 2008-10-21 | 2011-08-18 | Jacobus Martinus Kruithof | Reporting Of Changes In Navigation Map Data For Navigation System |
| US20180188037A1 (en) * | 2016-12-30 | 2018-07-05 | DeepMap Inc. | Occupancy Map Updates Based on Sensor Data Collected by Autonomous Vehicles |
| DE102017211607A1 (en) | 2017-07-07 | 2019-01-10 | Robert Bosch Gmbh | Method for verifying a digital map of a higher automated vehicle (HAF), in particular a highly automated vehicle |
| DE102017215708A1 (en) * | 2017-09-06 | 2019-03-07 | Audi Ag | Method and system for determining a quality mark for road markings |
| US20200025935A1 (en) * | 2018-03-14 | 2020-01-23 | Uber Technologies, Inc. | Three-Dimensional Object Detection |
| US20200278217A1 (en) * | 2019-03-01 | 2020-09-03 | GM Global Technology Operations LLC | Method and apparatus for a context-aware crowd-sourced sparse high definition map |
| DE102020102725A1 (en) | 2019-03-01 | 2020-09-03 | GM Global Technology Operations LLC | METHOD AND DEVICE FOR A CONTEXT-DEPENDENT HIGH-RESOLUTION MAP FROM THE CROWD SOURCE |
| US20210354708A1 (en) * | 2020-05-15 | 2021-11-18 | Zenuity Ab | Online perception performance evaluation for autonomous and semi-autonomous vehicles |
| US20210373566A1 (en) * | 2020-05-29 | 2021-12-02 | Zoox, Inc. | Trajectory generation using lateral offset biasing |
| WO2022098511A2 (en) | 2020-11-09 | 2022-05-12 | Argo AI, LLC | Architecture for map change detection in autonomous vehicles |
| US20220250646A1 (en) * | 2021-02-11 | 2022-08-11 | Zoox, Inc. | Route-relative trajectory numerical integrator and controller using the same |
| US20220348224A1 (en) * | 2021-04-29 | 2022-11-03 | Tusimple, Inc. | Direct autonomous vehicle to autonomous vehicle communications |
| US20240142265A1 (en) * | 2022-10-28 | 2024-05-02 | Continental Autonomous Mobility Germany GmbH | Method for creating and providing an enhanced environment map |
| US20240419902A1 (en) * | 2023-06-16 | 2024-12-19 | Nvidia Corporation | Using large language models to update data in mapping systems and applications |
| US20250003764A1 (en) * | 2023-06-27 | 2025-01-02 | Torc Robotics, Inc. | World model generation and correction for autonomous vehicles |
| US20250171020A1 (en) * | 2023-11-27 | 2025-05-29 | Nvidia Corporation | Speed limit fusion for automotive systems and applications |
| US12195038B1 (en) * | 2023-12-26 | 2025-01-14 | Aurora Operations, Inc. | Dual mode map for autonomous vehicle |
Non-Patent Citations (4)
| Title |
|---|
| Machine translation of DE-102017215708-A1 (Year: 2019). * |
| Zou, G.J., "Scene Creation System for an Autonomous Vehicle," U.S. Appl. No. 18/157,880, filed Jan. 23, 2023. |
| Machine translation of DE-102017215708-A1 (Year: 2019). * |
| Zou, G.J., "Scene Creation System for an Autonomous Vehicle," U.S. Appl. No. 18/157,880, filed Jan. 23, 2023. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN120892505A (en) | 2025-11-04 |
| US20250341405A1 (en) | 2025-11-06 |
| DE102024117992B3 (en) | 2025-07-31 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: ALLOWED -- NOTICE OF ALLOWANCE NOT YET MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |