US11292487B2 - Methods and systems for controlling automated driving features of a vehicle - Google Patents
Methods and systems for controlling automated driving features of a vehicle Download PDFInfo
- Publication number
- US11292487B2 US11292487B2 US16/381,161 US201916381161A US11292487B2 US 11292487 B2 US11292487 B2 US 11292487B2 US 201916381161 A US201916381161 A US 201916381161A US 11292487 B2 US11292487 B2 US 11292487B2
- Authority
- US
- United States
- Prior art keywords
- sensor
- road
- vehicle
- features
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/005—Handover processes
- B60W60/0059—Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/18—Propelling the vehicle
- B60W30/18009—Propelling the vehicle related to particular drive situations
- B60W30/18154—Approaching an intersection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
- B60W40/06—Road conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
- B60W40/105—Speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W2050/0062—Adapting control system settings
- B60W2050/007—Switching between manual and automatic parameter input, and vice versa
- B60W2050/0072—Controller asks driver to take over
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2552/00—Input parameters relating to infrastructure
- B60W2552/15—Road slope, i.e. the inclination of a road segment in the longitudinal direction
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/20—Static objects
Definitions
- the present disclosure generally relates to vehicles, and more particularly relates to methods and systems for managing automated driving features of a vehicle.
- An autonomous vehicle is a vehicle that is capable of sensing its environment and navigating with little or no user input.
- An autonomous vehicle senses its environment using sensing devices such as radar, lidar, image sensors, and the like.
- the autonomous vehicle system further uses information from global positioning systems (GPS) technology, navigation systems, vehicle-to-vehicle communication, vehicle-to-infrastructure technology, and/or drive-by-wire systems to navigate the vehicle.
- GPS global positioning systems
- sensors have limitations when implemented on a vehicle. Some limitations stem from the sensor's ability to view all areas of the environment. For example, certain areas of the environment may be blocked from a sensor's field of view by an element in the environment (e.g., a building, a tree, a vehicle, etc.). Implementing multiple sensors at various viewing angles, in an attempt to minimize the undetectable areas, can be costly.
- a method includes: determining, by a processor, road features of an upcoming road based on at least one of sensor data and map data; computing, by the processor, a required viewing angle of a sensor based on the road features; computing, by the processor, an operational envelope based on the required viewing angle and a sensor profile, wherein the operational envelope includes points along a map where the sensor can sense; and generating a control signal to disable autonomous control of the vehicle based on the operational envelope.
- the road feature includes road edges. In various embodiments, the road feature further includes a static object adjacent to the road edges. In various embodiments, the road feature further includes a dynamic object.
- the road feature includes a road grade.
- the determining the operational envelope is based on comparison of the required viewing angle to a sensor profile.
- the sensor profile defines right and left horizontal viewing boundaries of the sensor.
- the sensor profile defines top and bottom vertical viewing boundaries of the sensor.
- the sensor profile defines range viewing boundaries of the sensor.
- the sensor profile is based on vehicle speed.
- a system in another embodiments, includes: at least one sensor that generates sensor data associated with an environment of the vehicle; and a controller configured to, by a processor, receive the sensor data, determine road features of an upcoming road based on at least one of the sensor data and map data, compute a required viewing angle of a sensor based on the road features, compute an operational envelope based on the required viewing angle and a sensor profile, wherein the operational envelope includes points along a map where the sensor can sense, and generate a control signal to disable autonomous control of the vehicle based on the operational envelope.
- the road feature includes road edges. In various embodiments, the road feature further includes a static object adjacent to the road edges. In various embodiments, the road feature further includes a dynamic object.
- the road feature includes a road grade.
- the determining the operational envelope is based on comparison of the required viewing angle to a sensor profile.
- the sensor profile defines right and left horizontal viewing boundaries of the sensor.
- the sensor profile defines top and bottom vertical viewing boundaries of the sensor. In various embodiments, the sensor profile defines range viewing boundaries of the sensor. In various embodiments, the sensor profile is based on vehicle speed.
- FIG. 1 is a functional block diagram illustrating an autonomous vehicle having an autonomous feature management system, in accordance with various embodiments
- FIG. 2 is a dataflow diagrams illustrating an autonomous driving system that includes the autonomous feature management system, in accordance with various embodiments;
- FIG. 3 is a dataflow diagram illustrating an autonomous feature management system, in accordance with various embodiments.
- FIGS. 4, 5, 6, and 7 are illustrations of road features that can be detected by the autonomous feature management system, in accordance with various embodiments.
- FIG. 8 is a flowchart illustrating an autonomous feature management method that may be performed by the feature management system, in accordance with various embodiments.
- module refers to any hardware, software, firmware, electronic control component, processing logic, and/or processor device, individually or in any combination, including without limitation: application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
- ASIC application specific integrated circuit
- Embodiments of the present disclosure may be described herein in terms of functional and/or logical block components and various processing steps. It should be appreciated that such block components may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions. For example, an embodiment of the present disclosure may employ various integrated circuit components, e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. In addition, those skilled in the art will appreciate that embodiments of the present disclosure may be practiced in conjunction with any number of systems, and that the systems described herein is merely exemplary embodiments of the present disclosure.
- an autonomous feature management system shown generally at 100 is associated with a vehicle 10 in accordance with various embodiments.
- the autonomous feature management system 100 processes data provided by one or more sensors disposed about the vehicle 10 and/or data stored in a map (as will be discussed in more detail below) to determine whether to enable or disable automated features of the vehicle 10 .
- the vehicle 10 generally includes a chassis 12 , a body 14 , front wheels 16 , and rear wheels 18 .
- the body 14 is arranged on the chassis 12 and substantially encloses components of the vehicle 10 .
- the body 14 and the chassis 12 may jointly form a frame.
- the wheels 16 - 18 are each rotationally coupled to the chassis 12 near a respective corner of the body 14 .
- the vehicle 10 is an autonomous vehicle and the localization system 100 is incorporated into the autonomous vehicle 10 (hereinafter referred to as the autonomous vehicle 10 ).
- the autonomous vehicle 10 is, for example, a vehicle that is automatically controlled to carry passengers from one location to another.
- the vehicle 10 is depicted in the illustrated embodiment as a passenger car, but it should be appreciated that any other vehicle including motorcycles, trucks, sport utility vehicles (SUVs), recreational vehicles (RVs), marine vessels, aircraft, or simply robots, etc., can also be used.
- the autonomous vehicle 10 is a so-called Level Four or Level Five automation system.
- a Level Four system indicates “high automation”, referring to the driving mode-specific performance by an automated driving system of all aspects of the dynamic driving task, even if a human driver does not respond appropriately to a request to intervene.
- a Level Five system indicates “full automation”, referring to the full-time performance by an automated driving system of all aspects of the dynamic driving task under all roadway and environmental conditions that can be managed by a human driver.
- the autonomous vehicle 10 can be any level of automation.
- the autonomous vehicle can be a Level Two or other level system that includes an automated driving active safety system (ADAS).
- ADAS automated driving active safety system
- the autonomous vehicle 10 generally includes a propulsion system 20 , a transmission system 22 , a steering system 24 , a brake system 26 , a sensor system 28 , an actuator system 30 , at least one data storage device 32 , at least one controller 34 , and a communication system 36 .
- the propulsion system 20 may, in various embodiments, include an internal combustion engine, an electric machine such as a traction motor, and/or a fuel cell propulsion system.
- the transmission system 22 is configured to transmit power from the propulsion system 20 to the vehicle wheels 16 - 18 according to selectable speed ratios.
- the transmission system 22 may include a step-ratio automatic transmission, a continuously-variable transmission, or other appropriate transmission.
- the brake system 26 is configured to provide braking torque to the vehicle wheels 16 - 18 .
- the brake system 26 may, in various embodiments, include friction brakes, brake by wire, a regenerative braking system such as an electric machine, and/or other appropriate braking systems.
- the steering system 24 influences a position of the of the vehicle wheels 16 - 18 . While depicted as including a steering wheel for illustrative purposes, in some embodiments contemplated within the scope of the present disclosure, the steering system 24 may not include a steering wheel.
- the sensor system 28 includes one or more sensing devices 40 a - 40 n that sense observable conditions of the exterior environment and/or the interior environment of the autonomous vehicle 10 .
- the sensing devices 40 a - 40 n can include, but are not limited to, sensor such as radars, lidars, global positioning systems, optical cameras, thermal cameras, ultrasonic sensors, inertial measurement units, and/or other sensors.
- the actuator system 30 includes one or more actuator devices 42 a - 42 n that control one or more vehicle features such as, but not limited to, the propulsion system 20 , the transmission system 22 , the steering system 24 , and the brake system 26 .
- the vehicle features can further include interior and/or exterior vehicle features such as, but are not limited to, doors, a trunk, and cabin features such as air, music, lighting, etc. (not numbered).
- the communication system 36 is configured to wirelessly communicate information to and from other entities 48 , such as but not limited to, other vehicles (“V2V” communication,) infrastructure (“V2I” communication), remote systems, and/or personal devices (described in more detail with regard to FIG. 2 ).
- the communication system 36 is a wireless communication system configured to communicate via a wireless local area network (WLAN) using IEEE 802.11 standards or by using cellular data communication.
- WLAN wireless local area network
- DSRC dedicated short-range communications
- DSRC channels refer to one-way or two-way short-range to medium-range wireless communication channels specifically designed for automotive use and a corresponding set of protocols and standards.
- the data storage device 32 stores data for use in automatically controlling the autonomous vehicle 10 .
- the data storage device 32 stores defined maps of the navigable environment.
- the maps are received from a remote system and/or other vehicles.
- the data storage device 32 may be part of the controller 34 , separate from the controller 34 , or part of the controller 34 and part of a separate system.
- the controller 34 includes at least one processor 44 and a computer readable storage device or media 46 .
- the processor 44 can be any custom made or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among several processors associated with the controller 34 , a semiconductor based microprocessor (in the form of a microchip or chip set), a macroprocessor, any combination thereof, or generally any device for executing instructions.
- the computer readable storage device or media 46 may include volatile and nonvolatile storage in read-only memory (ROM), random-access memory (RAM), and keep-alive memory (KAM), for example.
- KAM is a persistent or non-volatile memory that may be used to store various operating variables while the processor 44 is powered down.
- the computer-readable storage device or media 46 may be implemented using any of a number of known memory devices such as PROMs (programmable read-only memory), EPROMs (electrically PROM), EEPROMs (electrically erasable PROM), flash memory, or any other electric, magnetic, optical, or combination memory devices capable of storing data, some of which represent executable instructions, used by the controller 34 in controlling the autonomous vehicle 10 .
- PROMs programmable read-only memory
- EPROMs electrically PROM
- EEPROMs electrically erasable PROM
- flash memory or any other electric, magnetic, optical, or combination memory devices capable of storing data, some of which represent executable instructions, used by the controller 34 in controlling the autonomous vehicle 10 .
- the instructions may include one or more separate programs, each of which comprises an ordered listing of executable instructions for implementing logical functions.
- the instructions when executed by the processor 44 , receive and process signals from the sensor system 28 , perform logic, calculations, methods and/or algorithms for automatically controlling the components of the autonomous vehicle 10 , and generate control signals to the actuator system 30 to automatically control the components of the autonomous vehicle 10 based on the logic, calculations, methods, and/or algorithms.
- controller 34 Although only one controller 34 is shown in FIG. 1 , embodiments of the autonomous vehicle 10 can include any number of controllers 34 that communicate over any suitable communication medium or a combination of communication mediums and that cooperate to process the sensor signals, perform logic, calculations, methods, and/or algorithms, and generate control signals to automatically control features of the autonomous vehicle 10 .
- one or more instructions of the controller 34 are embodied in the autonomous feature management system 100 .
- an autonomous vehicle and autonomous vehicle based remote transportation system can be modified, enhanced, or otherwise supplemented to provide the additional features described in more detail below.
- the controller 34 implements an autonomous driving system (ADS) 50 as shown in FIG. 2 that, as discussed above, may implement any level of autonomous control. That is, suitable software and/or hardware components of the controller 34 (e.g., the processor 44 and the computer-readable storage device 46 ) are utilized to provide an autonomous driving system 50 that is used in conjunction with vehicle 10 .
- ADS autonomous driving system
- the instructions of the autonomous driving system 50 may be organized by function, module, or system.
- the autonomous driving system 50 can include a computer vision system 54 , a positioning system 56 , a guidance system 58 , and a vehicle control system 60 .
- the instructions may be organized into any number of systems (e.g., combined, further partitioned, etc.) as the disclosure is not limited to the present examples.
- the computer vision system 54 synthesizes and processes sensor data and predicts the presence, location, classification, and/or path of objects and features of the environment of the vehicle 10 .
- the computer vision system 54 can incorporate information from multiple sensors, including but not limited to cameras, lidars, radars, and/or any number of other types of sensors.
- the positioning system 56 processes sensor data along with other data to determine a position (e.g., a local position relative to a map, an exact position relative to lane of a road, vehicle heading, velocity, etc.) of the vehicle 10 relative to the environment.
- the guidance system 58 processes sensor data along with other data to determine a path for the vehicle 10 to follow.
- the vehicle control system 60 generates control signals for controlling the vehicle 10 according to the determined path.
- the controller 34 implements machine learning techniques to assist the functionality of the controller 34 , such as feature detection/classification, obstruction mitigation, route traversal, mapping, sensor integration, ground-truth determination, and the like.
- the autonomous feature management system 100 of FIG. 1 is included within the ADS 50 , for example, as part of the vehicle control system 60 or as a separate system (as shown).
- the autonomous feature management system 100 provides enablement/disablement criteria for allowing the vehicle control system 60 to control the vehicle 10 .
- the vehicle control system 60 passes control of the vehicle 10 to non-automated systems (not shown).
- FIG. 3 illustrates the autonomous feature management system 100 in accordance with various exemplary embodiments.
- the autonomous feature management system 100 may be implemented as one or more modules and/or sub-modules. As can be appreciated, the modules shown may be combined and/or further partitioned in various other embodiments.
- the autonomous feature management system 100 can include a road feature evaluation module 102 , a sensor limitation evaluation module 104 , a control handling module 106 , a map datastore 108 , and a sensor profile datastore 110 .
- the road feature evaluation module 102 receives as input sensor data 112 from sensing devices 42 a - 42 n including the cameras, lidars, radars etc., and receives localization data 114 indicating a current pose and heading of the vehicle 10 .
- the input sensor data may be in the form of raw, low-level and/or high-level semantic detection data.
- the road feature evaluation module 102 retrieves map data 116 from the map datastore 108 (which may or may not be a part of the data storage device 46 FIG. 1 ) based on the location of the vehicle 10 .
- the road feature evaluation module 102 processes the received data to determine sensor coverage and detection requirements for the current or upcoming environment. For example, the road feature evaluation module 102 determines the vehicle's position relative to a map based on the map data 116 and the localization data 114 and extracts upcoming road features from the map 116 . The road feature evaluation module 102 uses the location of the extracted road features to determine an actual location of the extracted road features and to compute a required viewing angle 118 for the sensor when the vehicle 10 is positioned at a given road location.
- the extracted road features may include road edges.
- the location of the road edges as indicated by the map data 116 are used to compute the required viewing angle 118 for the vehicle 10 when the vehicle 10 is located at certain road locations.
- the required viewing angle 118 can be determined based on geometric and/or trigonometric functions.
- the road features may include a road grade.
- the road grade at certain locations may be indicated by the map data 116 .
- the road grade is used to compute the required viewing angle 118 for the sensor when the vehicle 10 is located at certain road locations.
- the road features may include static objects such as buildings, signs, trees, etc. adjacent to the road edges. The location of the static objects and the road edges as indicated by the computed sensor data and/or map data 116 are used to compute the required sensor distance and angles 118 for the scene/environment when the vehicle 10 is at certain road locations.
- the road feature evaluation module 102 determines upcoming road features from the sensor data 112 in addition to or as an alternative to the map data 116 .
- the road feature evaluation module 102 performs one or more machine learning techniques to extract and classify objects in the environment.
- the road feature evaluation module 102 then defines a location of the classified objects relative to the retrieved map.
- the objects can include the road edges, the road grade, and/or the static objects and the required viewing angles 118 are computed as discussed above.
- the sensor data 112 may processed by performing regression techniques on the pose of the road features using a deep neural network to learn the ratio between different road features, like the curb size, in two different points, and provide the road edge angle, with regards to the observation angle. If the sensor provides semantic object data, than the semantic objects will contain position information with respect to the autonomous vehicle's origin. Once the position information is obtained, geometry and/or trigonometry functions can be used to derive the required angles and distances. The distance may be further based on the vehicles internal processing limitations (delays/latency) and the current speed of the vehicle 10 .
- a road profile/surface angle can be calculated using the sensor data 112 by means of semantically locating the road features using segmentation methods, which can be based on deep neural network or other segmentation approaches, and fitting a plane to the road features.
- the identified objects can include dynamic objects such as, but not limited to, vehicles, construction equipment, or other objects that may move and obstruct the view of the sensors.
- dynamic objects such as, but not limited to, vehicles, construction equipment, or other objects that may move and obstruct the view of the sensors.
- the location of the dynamic objects and the road edges as indicated by the sensor data 112 are used to compute the required viewing angle 118 for the sensor when the vehicle 10 is at certain road locations.
- the sensor limitation evaluation module 104 receives the required viewing angles 118 for upcoming locations of the vehicle 10 along the road.
- the sensor limitation evaluation module 104 retrieves a sensor profile 120 from the sensor profile datastore 110 .
- the sensor profile 120 indicates viewing boundaries of a sensor, or a system of sensors.
- the viewing boundaries can include left and right vertical boundaries, top and bottom horizontal boundaries, and/or range boundaries.
- multiple sensor profiles 120 can be implemented per vehicle 10 , depending on the number of sensors implemented, and the boundaries of the sensor profiles 120 may overlap. In such embodiments, multiple sensor profiles 120 may be retrieved and processed.
- a single sensor profile 120 can include a three dimensional coverage map based on all of the sensors mounted on the vehicle 10 , where each sensor has its own field-of-view, and detection limits or coverage capability.
- the boundaries of the sensor profiles 120 may be based on vehicle conditions, such as speed, or other conditions.
- a sensor profile 120 may be retrieved based on received vehicle data 124 .
- the sensor limitation evaluation module 104 compares the required viewing angles 118 to the sensor profile(s) 120 to determine whether a required viewing angle 118 is outside of the boundaries set in the sensor profile(s) 120 . Based on the comparisons, the sensor limitation evaluation module 104 generates an available operational envelope 122 of the vehicle 10 .
- the available operational envelope 122 indicates at which points along the map the sensors of the vehicle 10 can cover given the current sensor configuration and limitations.
- the control handling module 106 receives the operational envelop 122 .
- the control handling module 106 selectively controls autonomous operation of the vehicle 10 based on the values of the operational envelope 122 . For example, when the values indicate that the sensors are limited at an upcoming location, that is, the sensors are unable to view the required field identified at the upcoming location, the control handling module 106 generates signals 126 to pass control to the driver or other systems. When the values indicate that the sensors are not limited, the control handling module 106 generates control signals 126 to permit autonomous control of the vehicle 10 . In some conditions, based on the nature or severity of the operational envelope 122 , control signals can be sent to a driver to begin the transfer of vehicle control from the autonomous system, to the driver, thus disabling the autonomous system.
- a flowchart illustrates an autonomous feature management method 200 that can be performed by the autonomous feature management system 100 in accordance with various embodiments.
- the order of operation within method 200 is not limited to the sequential execution as illustrated in FIG. 8 but may be performed in one or more varying orders as applicable and in accordance with the present disclosure.
- the method 200 can be scheduled to run based on one or more predetermined events, and/or can run continuously during operation of the autonomous vehicle 10 .
- the method 200 may begin at 205 .
- the sensor data 112 and the localization data 114 are received at 210 .
- the map data 116 is retrieved based on the location of the vehicle 10 indicated by the localization data 114 at 220 .
- the road features are extracted from the sensor data 112 and/or the map data 114 , for example as discussed above, at 230 .
- the required viewing angles 118 are computed for a number of locations along the road based on the road features, for example as discussed above at 240 .
- the sensor profile 120 is retrieved from the vehicle 10 saved within sensor profile datastore 110 , at 250 .
- the operational envelope 122 is determined based on the current vehicle conditions indicated by the vehicle data 124 and a comparison of the required viewing angles 118 and the sensor profile 120 at 260 .
- the operational envelope 122 which contains the required viewing angles 118 at 260 , is evaluated to determine whether the sensors are limited in the upcoming environment at 270 . If the sensors are limited at an upcoming location in the environment at 270 , the control signals 126 are generated to disable autonomous control and initiate control by another at 280 . If the sensors are not limited at an upcoming location at 270 , the control signals 126 are generated to permit or enable autonomous control by the ADS 70 at 290 . Thereafter, the method may end at 300 .
- the sensor data 112 may not be received and the road features are determined solely from the map data 16 .
- the map data 116 may not be retrieved and the road features are determined solely from the sensor data 112 .
- other alternatives may be implemented in the method 200 in various embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
Claims (12)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/381,161 US11292487B2 (en) | 2019-04-11 | 2019-04-11 | Methods and systems for controlling automated driving features of a vehicle |
| DE102020106469.1A DE102020106469A1 (en) | 2019-04-11 | 2020-03-10 | PROCEDURES AND SYSTEMS FOR THE MANAGEMENT OF AUTOMATED DRIVING FUNCTIONS |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/381,161 US11292487B2 (en) | 2019-04-11 | 2019-04-11 | Methods and systems for controlling automated driving features of a vehicle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20200324786A1 US20200324786A1 (en) | 2020-10-15 |
| US11292487B2 true US11292487B2 (en) | 2022-04-05 |
Family
ID=72613146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US16/381,161 Active 2039-10-30 US11292487B2 (en) | 2019-04-11 | 2019-04-11 | Methods and systems for controlling automated driving features of a vehicle |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US11292487B2 (en) |
| DE (1) | DE102020106469A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4033460B1 (en) * | 2021-01-22 | 2025-10-08 | Aptiv Technologies AG | Data recording for adas testing and validation |
| US12271998B2 (en) | 2021-09-23 | 2025-04-08 | Motional Ad Llc | Spatially and temporally consistent ground modelling with information fusion |
| CN114419190A (en) * | 2022-01-11 | 2022-04-29 | 长沙慧联智能科技有限公司 | Grid map visual guiding line generation method and device |
| US12525126B2 (en) * | 2023-11-29 | 2026-01-13 | GM Global Technology Operations LLC | System and method for crowdsourced detection of dynamic road features |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170057520A1 (en) * | 2015-08-31 | 2017-03-02 | Uber Technologies, Inc. | Control system for autonomous-capable vehicles |
| US20180090039A1 (en) * | 2016-09-29 | 2018-03-29 | GM Global Technology Operations LLC | System and method to place subjective messages on a vehicle |
| US20200108785A1 (en) * | 2017-08-10 | 2020-04-09 | Uatc, Llc | Configuration of Vehicle Compartments |
| US20200142067A1 (en) * | 2018-11-01 | 2020-05-07 | Automotive Research & Testing Center | Lane stripe detecting method based on three-dimensional lidar and system thereof |
| US10877473B2 (en) * | 2018-08-09 | 2020-12-29 | Here Global B.V. | Method, apparatus and computer program product for differential policy enforcement for roadways |
-
2019
- 2019-04-11 US US16/381,161 patent/US11292487B2/en active Active
-
2020
- 2020-03-10 DE DE102020106469.1A patent/DE102020106469A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170057520A1 (en) * | 2015-08-31 | 2017-03-02 | Uber Technologies, Inc. | Control system for autonomous-capable vehicles |
| US20180090039A1 (en) * | 2016-09-29 | 2018-03-29 | GM Global Technology Operations LLC | System and method to place subjective messages on a vehicle |
| US20200108785A1 (en) * | 2017-08-10 | 2020-04-09 | Uatc, Llc | Configuration of Vehicle Compartments |
| US10877473B2 (en) * | 2018-08-09 | 2020-12-29 | Here Global B.V. | Method, apparatus and computer program product for differential policy enforcement for roadways |
| US20200142067A1 (en) * | 2018-11-01 | 2020-05-07 | Automotive Research & Testing Center | Lane stripe detecting method based on three-dimensional lidar and system thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| DE102020106469A1 (en) | 2020-10-15 |
| US20200324786A1 (en) | 2020-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11125567B2 (en) | Methods and systems for mapping and localization for a vehicle | |
| US10274961B2 (en) | Path planning for autonomous driving | |
| US10859673B2 (en) | Method for disambiguating ambiguous detections in sensor fusion systems | |
| JP7247042B2 (en) | Vehicle control system, vehicle control method, and program | |
| US10733420B2 (en) | Systems and methods for free space inference to break apart clustered objects in vehicle perception systems | |
| US9956958B2 (en) | Vehicle driving control device and control device | |
| US10935652B2 (en) | Systems and methods for using road understanding to constrain radar tracks | |
| US10759415B2 (en) | Effective rolling radius | |
| US11631325B2 (en) | Methods and systems for traffic light state monitoring and traffic light to lane assignment | |
| US11292487B2 (en) | Methods and systems for controlling automated driving features of a vehicle | |
| US20210074162A1 (en) | Methods and systems for performing lane changes by an autonomous vehicle | |
| US11892574B2 (en) | Dynamic lidar to camera alignment | |
| US20230009173A1 (en) | Lane change negotiation methods and systems | |
| US20200318976A1 (en) | Methods and systems for mapping and localization for a vehicle | |
| US20230278562A1 (en) | Method to arbitrate multiple automatic lane change requests in proximity to route splits | |
| US20190018409A1 (en) | Systems and methods for providing an intelligent override for a driving automation system | |
| CN111599166B (en) | Method and system for interpreting traffic signals and negotiating signalized intersections | |
| US12252121B2 (en) | Systems and methods for employing driver input for adapting path planning in lane centering applications | |
| US11347235B2 (en) | Methods and systems for generating radar maps | |
| US11698641B2 (en) | Dynamic lidar alignment | |
| US20200387161A1 (en) | Systems and methods for training an autonomous vehicle | |
| US12005933B2 (en) | Methods and systems for a unified driver override for path based automated driving assist under external threat | |
| US12260749B2 (en) | Methods and systems for sensor fusion for traffic intersection assist | |
| US11214261B2 (en) | Learn association for multi-object tracking with multi sensory data and missing modalities | |
| US20240409125A1 (en) | Vehicle systems and methods for autonomous operation using unclassified hazard detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: GM GLOBAL TECHNOLOGY OPERATIONS LLC, MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GRAY, JEREMY P.;HOSKERI, NIKHIL L.;BATIKOFF, AMIT;SIGNING DATES FROM 20190410 TO 20190411;REEL/FRAME:048856/0514 |
|
| FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |