USRE47058E1 - Controlling a vehicle having inadequate map data - Google Patents
Controlling a vehicle having inadequate map data Download PDFInfo
- Publication number
- USRE47058E1 USRE47058E1 US15/367,122 US201615367122A USRE47058E US RE47058 E1 USRE47058 E1 US RE47058E1 US 201615367122 A US201615367122 A US 201615367122A US RE47058 E USRE47058 E US RE47058E
- Authority
- US
- United States
- Prior art keywords
- vehicle
- sensor data
- autonomous mode
- map data
- controlling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000004044 response Effects 0.000 claims abstract description 24
- 238000000034 method Methods 0.000 claims description 61
- 238000004891 communication Methods 0.000 claims description 38
- 230000006870 function Effects 0.000 claims description 15
- 230000009471 action Effects 0.000 claims description 14
- 230000033001 locomotion Effects 0.000 claims description 8
- 238000005259 measurement Methods 0.000 claims description 2
- 238000004422 calculation algorithm Methods 0.000 description 10
- 238000013500 data storage Methods 0.000 description 9
- 230000002093 peripheral effect Effects 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000004927 fusion Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 3
- 230000003292 diminished effect Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 3
- 239000000446 fuel Substances 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 2
- ATUOYWHBWRKTHZ-UHFFFAOYSA-N Propane Chemical compound CCC ATUOYWHBWRKTHZ-UHFFFAOYSA-N 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000010267 cellular communication Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000003502 gasoline Substances 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 101100175317 Danio rerio gdf6a gene Proteins 0.000 description 1
- HBBGRARXTFLTSG-UHFFFAOYSA-N Lithium ion Chemical compound [Li+] HBBGRARXTFLTSG-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 239000002253 acid Substances 0.000 description 1
- -1 batteries Substances 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000002485 combustion reaction Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 239000002828 fuel tank Substances 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005305 interferometry Methods 0.000 description 1
- 229910001416 lithium ion Inorganic materials 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 239000010705 motor oil Substances 0.000 description 1
- 239000003208 petroleum Substances 0.000 description 1
- 239000001294 propane Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 238000002366 time-of-flight method Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/027—Parking aids, e.g. instruction means
- B62D15/0285—Parking performed automatically
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
- G05D1/0272—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means comprising means for registering the travel distance, e.g. revolutions of wheels
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
- G05D1/0274—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device
Definitions
- Some vehicles are configured to operate in an autonomous mode in which the vehicle navigates through an environment with little or no input from a driver.
- a vehicle typically includes sensors that are configured to sense information about the environment. The vehicle can use the sensed information to navigate through the environment. For example, if the sensors sense that the vehicle is approaching an obstacle, the vehicle can navigate around the obstacle.
- a method in a first aspect, includes controlling a vehicle in a first autonomous mode of operation. Controlling the vehicle in the first autonomous mode of operation includes navigating the vehicle based on map data. The method includes obtaining sensor data using one or more sensors of the vehicle. The sensor data is indicative of an environment of the vehicle. The method includes detecting an inadequacy in the map data. Detecting the inadequacy in the map data includes comparing the map data to the sensor data. The method includes, in response to detecting the inadequacy in the map data, controlling the vehicle in a second autonomous mode of operation and prompting a user to switch to a manual mode of operation. Controlling the vehicle in the second autonomous mode of operation includes obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data.
- a vehicle in a second aspect, includes at least one sensor and a computer system.
- the at least one sensor is configured to obtain first sensor data.
- the first sensor data is indicative of an environment of the vehicle when the vehicle is in a first autonomous mode of operation.
- the at least one sensor is configured to obtain second sensor data.
- the second sensor data is indicative of an environment of the vehicle when the vehicle is in a second autonomous mode of operation.
- the computer system is configured to control the vehicle in the first autonomous mode of operation by at least navigating the vehicle based on map data.
- the computer system is configured to detect an inadequacy in the map data by at least comparing the map data to the first sensor data.
- the computer system is configured to, in response to detecting the inadequacy in the map data, (i) control the vehicle in the second autonomous mode of operation by at least navigating the vehicle based on the second sensor data, and (ii) prompt a user to switch to a manual mode of operation.
- a non-transitory computer-readable medium includes stored instructions that are executable by a computer system to cause the computer system to perform functions.
- the functions include controlling a vehicle in a first autonomous mode of operation. Controlling the vehicle in the first autonomous mode of operation includes navigating the vehicle based on map data.
- the functions include receiving sensor data from one or more sensors of the vehicle. The sensor data is indicative of an environment of the vehicle.
- the functions include detecting an inadequacy in the map data. Detecting the inadequacy in the map data includes comparing the map data to the sensor data.
- the functions include, in response to detecting the inadequacy in the map data, controlling the vehicle in a second autonomous mode of operation and prompting a user to switch to a manual mode of operation.
- Controlling the vehicle in the second autonomous mode of operation includes obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data.
- FIG. 1 illustrates a functional block diagram of a vehicle, according to an example embodiment.
- FIG. 2 illustrates a vehicle, according to an example embodiment.
- FIGS. 3A-3C illustrate a scenario showing a navigation of a vehicle having inadequate map data, according to an example embodiment.
- FIG. 4 illustrates an example of a method for controlling a vehicle, according to an example embodiment.
- FIG. 5 illustrates a conceptual view of a computer program product, according to an example embodiment.
- Map data can be, for example, predetermined data that relates to the route of a vehicle or otherwise relates to the surroundings of the vehicle.
- map data can relate to traffic conditions, road conditions, route information, positioning information, or combinations of these.
- map data can be inadequate for use in autonomously navigating a vehicle. For example, map data can become outdated over time due to changing road conditions, or the map data may not include sufficient detail about the present or future environment of the vehicle. If the vehicle determines that the map data is inadequate, the vehicle can rely on other sources of information to operate autonomously, or the vehicle can switch (or indicate an option to switch) to a manual mode.
- a computer system can control a vehicle in a first autonomous mode of operation (or simply “first autonomous mode”).
- first autonomous mode the computer system can navigate the vehicle based on map data.
- the computer system can obtain sensor data using one or more sensors of the vehicle.
- the sensor data can be indicative of an environment of the vehicle.
- the sensor data can represent nearby objects, such as, for example, traffic signs, lane markers, other vehicles, or pedestrians.
- the sensor data can also, or instead, represent observations or calculations such as, for example, traffic patterns and geometries of one or more roads near the vehicle.
- the computer system can compare the map data to the sensor data in order to detect an inadequacy in the map data.
- the inadequacy in the map data can be an inconsistency between the sensor data and the map data.
- the computer system can control the vehicle in a second autonomous mode of operation (or simply “second autonomous mode”), and provide an indication of an option to switch to a manual mode of operation (or simply “manual mode”).
- the indication can serve to notify a person, such as an on-board passenger, of the inadequacy in the map data, and to suggest that the person take control of the vehicle, such as by causing the vehicle to switch to the manual mode.
- the computer system can obtain additional sensor data using the one or more sensors, and can navigate the vehicle based on the additional sensor data.
- the computer system can take precautions, such as, for example, reducing a speed of the vehicle, causing the vehicle to maintain a safer than usual distance from another vehicle, or the like. In this way, the computer system can take measures to enhance the safety of a person, such as an on-board passenger, while the computer system waits for the person to take control of the vehicle.
- the computer system can control the vehicle in a third autonomous mode of operation (or simply “third autonomous mode”). For example, if the computer system detects that a predetermined period has passed without the vehicle switching to the manual mode, then the computer system can control the vehicle in the third autonomous mode.
- the computer system can obtain further sensor data using the one or more sensors, and can navigate the vehicle based on the further sensor data.
- the computer system can navigate the vehicle with diminished or no use of the map data.
- the computer system can take further precautions, such as, for example, stopping the vehicle, navigating the vehicle to a shoulder of a road, following another vehicle at a safe distance, enabling the vehicle's hazard lights, or sending a message to alert appropriate authorities. In this way, when an on-board passenger does not take control of the vehicle in the second autonomous mode, the vehicle can be safely maneuvered and/or parked.
- a system can take the form of an automobile or another suitable vehicle.
- Suitable vehicles include a car, truck, motorcycle, bus, boat, airplane, helicopter, lawn mower, earthmover, snowmobile, recreational vehicle, amusement park vehicle, farm equipment, construction equipment, tram, golf cart, train, or trolley. Other vehicles are possible as well.
- FIG. 1 illustrates a functional block diagram of a vehicle 100 .
- the vehicle 100 can be configured to operate in one of several autonomous modes of operation or in a manual mode of operation.
- the autonomous modes can include one or more of a first autonomous mode, a second autonomous mode, and a third autonomous mode.
- the first, second, and third autonomous modes are discussed below in further detail.
- the vehicle 100 is in one of the autonomous modes, the vehicle 100 can be configured to operate without a need for human interaction.
- the vehicle 100 is in the manual mode, the vehicle 100 can be configured to operate under the control of a person, such as an on-board passenger.
- the vehicle can be configured to operate in a semi-autonomous mode, in which the vehicle can be configured to perform some operations without a need for human interaction and to perform some operations under the control of a person, such as an on-board passenger.
- the vehicle 100 can include various subsystems such as a propulsion system 102 , a sensor system 104 , a control system 106 , one or more peripherals 108 , as well as a power supply 110 , a computer system 112 , and a user interface 116 .
- the vehicle 100 can include more or fewer subsystems and each subsystem can include multiple elements. Further, each of the subsystems and elements of the vehicle 100 can be interconnected. Thus, one or more of the described functions of the vehicle 100 can be divided into additional functional or physical components, or combined into fewer functional or physical components. In some further examples, additional functional or physical components can be added to the illustration of FIG. 1 .
- the propulsion system 102 can include components operable to provide powered motion for the vehicle 100 .
- the propulsion system 102 can include an engine/motor 118 , an energy source 119 , a transmission 120 , and wheels/tires 121 .
- the engine/motor 118 can be any combination of an internal combustion engine, an electric motor, steam engine, Stirling engine, or another engines/motor.
- the engine/motor 118 can be configured to convert the energy source 119 into mechanical energy.
- the propulsion system 102 can include multiple types of engines and/or motors. For instance, a gas-electric hybrid car can include a gasoline engine and an electric motor. Other implementations are possible.
- the energy source 119 can represent a source of energy that can, in full or in part, power the engine/motor 118 . That is, the engine/motor 118 can be configured to convert the energy source 119 into mechanical energy. Examples of energy sources 119 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electrical power. The energy source 119 can also, or instead, include any combination of fuel tanks, batteries, capacitors, and flywheels. The energy source 119 can also provide energy for other systems of the vehicle 100 .
- the transmission 120 can include elements that are operable to transmit mechanical power from the engine/motor 118 to the wheels/tires 121 .
- the transmission 120 can include a gearbox, clutch, differential, and drive shafts.
- the transmission 120 can include other elements.
- the drive shafts can include one or more axles that can be coupled to the one or more wheels/tires 121 .
- the wheels/tires 121 of the vehicle 100 can be of various forms, such as, for example, those of a unicycle, motorcycle, tricycle, or car. Other wheel/tire forms are possible, such as those including six or more wheels. Any combination of the wheels/tires 121 of the vehicle 100 can be operable to rotate differentially with respect to other wheels/tires 121 .
- the wheels/tires 121 can represent at least one wheel that is attached to the transmission 120 and at least one tire coupled to a rim of the wheel that can make contact with the driving surface.
- the wheels/tires 121 can include any combination of metal and rubber, or another combination of materials.
- the sensor system 104 can include a number of sensors configured to sense information about an environment of the vehicle 100 .
- the sensor system 104 can include a Global Positioning System (GPS) 122 , an inertial measurement unit (IMU) 124 , a RADAR unit 126 , a laser rangefinder/LIDAR unit 128 , and a camera 130 , among other types of sensors.
- the sensor system 104 can include sensors that are configured to monitor internal systems of the vehicle 100 . Examples include an O 2 monitor, fuel gauge, and engine oil temperature.
- the sensor system 104 can include sensors that can sense conditions in a passenger cabin of the vehicle 100 , if the vehicle 100 is equipped with a passenger cabin. Examples include physiological sensors and cameras. Other sensors are possible as well.
- the GPS 122 can include any number and combination of sensors, and can be configured to estimate a geographic location of the vehicle 100 .
- the GPS 122 can include a transceiver that is operable to provide information regarding the position of the vehicle 100 with respect to the Earth.
- the IMU 124 can include any number and combination of sensors (for example, accelerometers and gyroscopes), and can be configured to sense position and orientation changes of the vehicle 100 based on inertial acceleration.
- sensors for example, accelerometers and gyroscopes
- the RADAR unit 126 can represent a system that utilizes radio signals to sense objects within the environment of the vehicle 100 .
- the RADAR unit 126 in addition to sensing the objects, can additionally be configured to sense the speed of the objects, the heading of the objects, or both.
- the laser rangefinder or LIDAR unit 128 can include any number and combination of sensors, and can be configured to sense objects in the environment of the vehicle 100 by using lasers.
- the laser rangefinder/LIDAR unit 128 can include one or more laser sources, laser scanners, and detectors, among other components.
- the laser rangefinder/LIDAR unit 128 can be configured to operate in a coherent detection mode (for example, by using heterodyne detection) or an incoherent detection mode.
- the camera 130 can include any number and combination of devices, and can be configured to capture images of the environment of the vehicle 100 .
- the camera 130 can be a still camera or a video camera.
- the control system 106 can be configured to control operation of the vehicle 100 and its components. To this end, the control system 106 can include various elements, including a steering unit 132 , a throttle 134 , a brake unit 136 , a sensor fusion algorithm 138 , a computer vision system 140 , a navigation/pathing system 142 , and an obstacle avoidance system 144 .
- the steering unit 132 can include any number and combination of devices, and can be configured to adjust the heading of the vehicle 100 .
- the throttle 134 can be configured to control, for instance, the operating speed of the engine/motor 118 and, in turn, control the speed of the vehicle 100 .
- the brake unit 136 can include any number and combination of devices, and can be configured to decelerate the vehicle 100 .
- the brake unit 136 can apply friction to slow the wheels/tires 121 .
- the brake unit 136 can convert the kinetic energy of the wheels/tires 121 to electric current. Other implementations are possible.
- the sensor fusion algorithm 138 can be an algorithm or a computer program product storing an algorithm, and can be configured to receive data from the sensor system 104 as an input.
- the data can include, for example, data representing information sensed at the sensors of the sensor system 104 .
- the sensor fusion algorithm 138 can include, for instance, a Kalman filter, Bayesian network, or other algorithm.
- the sensor fusion algorithm 138 can further provide various assessments based on the data from the sensor system 104 . Depending on the implementation, the assessments can include evaluations of individual objects or features in the environment of the vehicle 100 , evaluation of a particular situation, or evaluations of possible impacts based on the particular situation. Other assessments are possible.
- the computer vision system 140 can be any system that is operable to process and analyze images captured by the camera 130 in order to identify objects or features in the environment of the vehicle 100 .
- the objects or features can include, for example, traffic signals, traffic signs, roadway boundaries, and obstacles.
- the computer vision system 140 can use an object recognition algorithm, a Structure From Motion (SFM) algorithm, video tracking, and other computer vision techniques.
- SFM Structure From Motion
- the computer vision system 140 can be configured to map an environment, track objects, and estimate the speed of objects.
- the navigation and pathing system 142 can be configured to determine a driving path for the vehicle 100 .
- the navigation and pathing system 142 can be configured to update the driving path dynamically while the vehicle 100 is in operation.
- the navigation and pathing system 142 can be configured to use map data to determine the driving path for the vehicle 100 .
- the navigation and pathing system 142 can use data from the sensor fusion algorithm 138 or the GPS 122 , or from a different system or component of the vehicle 100 , to determine the driving path for the vehicle 100 .
- the obstacle avoidance system 144 can represent a control system that is configured to identify, evaluate, and avoid or otherwise negotiate potential obstacles in the environment of the vehicle 100 .
- the peripherals 108 can be configured to allow interaction between the vehicle 100 and external sensors, other vehicles, other computer systems, or a user.
- the peripherals 108 can include a wireless communication system 146 , a touchscreen 148 , a microphone 150 , and a speaker 152 .
- the peripherals 108 can enable a user of the vehicle 100 to interact with the user interface 116 .
- the touchscreen 148 can provide information to a user of vehicle 100 .
- the touchscreen 148 can provide an indication of an option to switch from an autonomous mode of operation to a manual mode of operation.
- the user interface 116 can be operable to accept input from the user via the touchscreen 148 .
- the touchscreen 148 can be configured to sense at least one of a position and a movement of a user's finger via capacitive sensing, resistance sensing, or a surface acoustic wave process, among other possibilities.
- the touchscreen 148 can be capable of sensing finger movement in a direction parallel or planar to the touchscreen surface, in a direction normal to the touchscreen surface, or both, and can also be capable of sensing a level of pressure applied to the touchscreen surface.
- the touchscreen 148 can be formed of one or more translucent or transparent insulating layers and one or more translucent or transparent conducting layers.
- the touchscreen 148 can take other forms as well.
- the peripherals 108 can enable the vehicle 100 to communicate with devices in its environment.
- the microphone 150 can be configured to receive audio (for example, a voice command or other audio input) from a user of the vehicle 100 .
- the speakers 152 can be configured to output audio to the user of the vehicle 100 .
- the speakers 152 can provide an indication of an option to switch from an autonomous mode of operation to a manual mode of operation.
- the wireless communication system 146 can be configured to wirelessly communicate with one or more devices directly or via a communication network.
- the wireless communication system 146 can use 3G cellular communication, such as CDMA, EVDO, GSM/GPRS, or 4 G cellular communication, such as WiMAX or LTE.
- the wireless communication system 146 can communicate with a wireless local area network (WLAN), for example, using WiFi.
- the wireless communication system 146 can communicate directly with a device, for example, using an infrared link, Bluetooth, or ZigBee. Other wireless protocols, such as various vehicular communication systems, are possible.
- the wireless communication system 146 can include one or more dedicated short-range communications (DSRC) devices that can include public or private data communications between vehicles and roadside stations.
- DSRC dedicated short-range communications
- the power supply 110 can provide power to various components of the vehicle 100 and can represent, for example, a rechargeable lithium-ion or lead-acid battery. In some implementations, one or more banks of such batteries can be configured to provide electrical power. Other power supply materials and configurations are possible. In some implementations, the power supply 110 and energy source 119 can be implemented together, as in some all-electric cars.
- the computer system 112 can include at least one processor 113 , which can include at least one microprocessor.
- the at least one processor 113 can execute instructions 115 stored in a non-transitory computer-readable medium, such as the data storage 114 .
- the computer system 112 can also represent multiple computing devices that can control individual components or subsystems of the vehicle 100 in a distributed fashion.
- the data storage 114 can contain instructions 115 (for example, program logic) that are executable by the processor 113 to execute various functions of vehicle 100 , including those described above in connection with FIG. 1 and those discussed below in connection with FIGS. 3A-3C and 4 .
- the data storage 114 can contain additional instructions as well, including instructions to transmit data to, receive data from, interact with, and/or control one or more of the propulsion system 102 , the sensor system 104 , the control system 106 , and the peripherals 108 .
- the data storage 114 can store map data, which can include roadway maps, path information, and road condition information, among other data.
- map data can be used by the vehicle 100 and computer system 112 during the operation of the vehicle 100 in the autonomous, semi-autonomous, or manual modes.
- the map data can be selectively used by the vehicle 100 during the operation of the vehicle 100 in some of the autonomous modes, and can be used to a lesser extent during operation of the vehicle 100 in other autonomous modes.
- the vehicle 100 can include a user interface 116 for providing information to or receiving input from a user of vehicle 100 .
- the user interface 116 can control or enable control of content and/or the layout of interactive images that can be displayed on the touchscreen 148 .
- the user interface 116 can include one or more input/output devices within the set of peripherals 108 , such as the wireless communication system 146 , the touchscreen 148 , the microphone 150 , and the speaker 152 .
- the computer system 112 can control functions of the vehicle 100 based on inputs received from various subsystems (for example, the propulsion system 102 , sensor system 104 , and control system 106 ), as well as from the user interface 116 .
- the computer system 112 can utilize input from the control system 106 in order to control the steering unit 132 to avoid an obstacle detected by the sensor system 104 and the obstacle avoidance system 144 .
- the computer system 112 can be operable to provide control over many aspects of the vehicle 100 and its subsystems.
- the components of the vehicle 100 can be configured to work in an interconnected fashion with other components within or outside their respective systems.
- the camera 130 can capture a plurality of images that can represent information about a state of an environment of the vehicle 100 operating in an autonomous mode.
- the environment can include another vehicle, the road on which the vehicle 100 travels (including markings on the road), signs near the vehicle, pedestrians, and the like.
- the computer vision system 140 can recognize aspects of the environment based on object recognition models stored in data storage 114 .
- the computer system 112 can control the vehicle 100 in one of several autonomous modes of operation, including first, second, and third autonomous modes.
- the computer system can navigate the vehicle based on map data, such as, for example, map data from the global positioning system 122 , map data that is stored to the data storage 114 , or map data that is received from the wireless communication system 146 .
- map data such as, for example, map data from the global positioning system 122 , map data that is stored to the data storage 114 , or map data that is received from the wireless communication system 146 .
- the computer system 112 can obtain sensor data using one or more sensors in the sensor system 104 .
- the sensor data can be indicative of an environment of the vehicle 100 .
- the sensor data can represent nearby objects, such as, for example, traffic signs, lane markers, other vehicles, or pedestrians.
- the sensor data can also, or instead, represent observations or calculations such as, for example, traffic patterns and road shapes near the vehicle 100 .
- the computer system 112 can compare the map data to the sensor data in order to detect an inadequacy in the map data.
- the inadequacy in the map data can be an inconsistency between the sensor data and the map data.
- the computer system 112 can control the vehicle 100 in the second autonomous mode, and can provide an indication of an option to switch to the manual mode.
- the indication can be provided by way of the touch screen 148 , the speaker 152 , and/or the user interface 116 .
- the indication can serve to notify a person, such as an on-board passenger, of the inadequacy in the map data, and to suggest that the person take control of the vehicle 100 , such as by causing the vehicle 100 to switch to the manual mode.
- the computer system 112 can obtain additional sensor data using the sensor system 104 , and can navigate the vehicle 100 based on the additional sensor data.
- the computer system can take precautions, such as, for example, reducing a speed of the vehicle 100 , causing the vehicle 100 to maintain a safer than usual distance from other vehicles, or the like.
- the computer system 112 can take measures to enhance the safety of persons, such as on-board passengers, while the computer system 112 waits for a person to take control of the vehicle 100 .
- the computer system 112 in the second autonomous mode, if the computer system 112 detects an inactivity in relation to the option to switch to the manual mode, then the computer system 112 can control the vehicle 100 in the third autonomous mode. For example, if the computer system 112 detects that a predetermined period has passed without the vehicle 100 switching to the manual mode, then the computer system 112 can control the vehicle 100 in the third autonomous mode.
- the computer system 112 can obtain further sensor data using the one or more sensors, and can navigate the vehicle 100 based on the further sensor data.
- the computer system 112 in the third autonomous mode, can navigate the vehicle 100 with diminished or no use of the map data.
- the computer system 112 can take further precautions, such as, for example, stopping the vehicle 100 immediately, navigating the vehicle 100 to a shoulder of a road and then stopping the vehicle 100 , causing the vehicle 100 to follow another vehicle at a safe distance, enabling hazard lights of the vehicle 100 , or sending a message (for example, by way of the wireless communication system 146 ) to alert appropriate authorities.
- the vehicle 100 can be safely maneuvered and/or parked.
- FIG. 1 shows various components of the vehicle 100 , such as, for example, the wireless communication system 146 , the computer system 112 , the data storage 114 , and the user interface 116 , as being integrated into the vehicle 100 , one or more of these components can be mounted or associated separately from the vehicle 100 .
- the data storage 114 can, in part or in full, exist separate from the vehicle 100 .
- the vehicle 100 can be provided in the form of device elements that can be located separately or together.
- the device elements that make up the vehicle 100 can be communicatively coupled together in a wired or wireless fashion.
- FIG. 2 illustrates a vehicle 200 .
- the vehicle 200 can be similar or identical to the vehicle 100 discussed in reference to FIG. 1 .
- the vehicle 200 is illustrated in FIG. 2 as a car, other implementations are possible.
- the vehicle 200 can represent a truck, a van, a semi-trailer truck, a motorcycle, a golf cart, an off-road vehicle, or a farm vehicle, among other types of vehicles.
- the vehicle 200 can include a sensor unit 202 , a wireless communication system 204 , a LIDAR unit 206 , a laser rangefinder unit 208 , and a camera 210 .
- the elements of the vehicle 200 can include some or all of the elements described in connection with FIG. 1 .
- the sensor unit 202 can include one or more different sensors configured to capture information about an environment of the vehicle 200 .
- the sensor unit 202 can include any combination of cameras, RADARs, LIDARs, range finders, and acoustic sensors. Other types of sensors are possible.
- the sensor unit 202 can include one or more movable mounts that can be operable to adjust the orientation of one or more sensors in the sensor unit 202 .
- the movable mount can include a rotating platform that can scan sensors so as to obtain information from each direction around the vehicle 200 .
- the movable mount of the sensor unit 202 can be moveable in a scanning fashion within a particular range of angles or azimuths.
- the sensor unit 202 can be mounted atop the roof of a car, for instance; however other mounting locations are possible. In addition, the sensors of sensor unit 202 can be distributed in different locations and need not be collocated in a single location. Some possible sensor types and mounting locations include the LIDAR unit 206 and the laser rangefinder unit 208 . In addition, each sensor of the sensor unit 202 can move or scan independently of other sensors of the sensor unit 202 .
- the wireless communication system 204 can be located on a roof of the vehicle 200 , as depicted in FIG. 2 . In some implementations, the wireless communication system 204 can be located elsewhere.
- the wireless communication system 204 can include wireless transmitters and receivers that can be configured to communicate with devices external or internal to the vehicle 200 .
- the wireless communication system 204 can include transceivers that can be configured to communicate with other vehicles and/or computing devices, for instance, in a vehicular communication system or a roadway station. Examples of such vehicular communication systems include dedicated short-range communications (DSRC), radio frequency identification (RFID), and other proposed communication standards directed towards intelligent transport systems.
- DSRC dedicated short-range communications
- RFID radio frequency identification
- the camera 210 can be any camera (for example, a still camera or a video camera) that is configured to capture a plurality of images of the environment of the vehicle 200 .
- the camera 210 can be configured to detect visible light, or can be configured to detect light from other portions of the spectrum, such as infrared or ultraviolet light. Other types of cameras are possible as well.
- the camera 210 can be a two-dimensional detector, or can have a three-dimensional spatial range.
- the camera 210 can be, for example, a range detector that is configured to generate a two-dimensional image indicating a distance from the camera 210 to a number of points in the environment.
- the camera 210 can use one or more range detecting techniques.
- the camera 210 can use a structured light technique in which the vehicle 200 illuminates an object in the environment with a predetermined light pattern, such as a grid or checkerboard pattern and uses the camera 210 to detect a reflection of the predetermined light pattern from the object. Based on distortions in the reflected light pattern, the vehicle 200 can determine the distance to the points on the object.
- the predetermined light pattern can include infrared light or light of another wavelength.
- the camera 210 can use a laser scanning technique in which the vehicle 200 emits a laser and scans across a number of points on an object in the environment. While scanning the object, the vehicle 200 can use the camera 210 to detect a reflection of the laser from the object for each point. Based on a duration that it takes for the laser to reflect from the object at each point, the vehicle 200 can determine the distance to the points on the object.
- the camera 210 can use a time-of-flight technique in which the vehicle 200 emits a light pulse and uses the camera 210 to detect a reflection of the light pulse from an object at a number of points on the object.
- the camera 210 can include a number of pixels, and each pixel can detect the reflection of the light pulse from a point on the object. Based on a duration it takes for the light pulse to reflect from the object at each point, the vehicle 200 can determine the distance to the points on the object.
- the light pulse can be a laser pulse.
- Other range detecting techniques are possible as well, including stereo triangulation, sheet-of-light triangulation, interferometry, and coded aperture techniques, among others.
- the camera 210 can take other forms as well.
- the camera 210 can be mounted inside a front windshield of the vehicle 200 . Specifically, as illustrated, the camera 210 can capture images from a forward-looking view with respect to the vehicle 200 . Other mounting locations and viewing angles of the camera 210 are possible, either inside or outside the vehicle 200 .
- the camera 210 can have associated optics that can be operable to provide an adjustable field of view. Further, the camera 210 can be mounted to the vehicle 200 with a movable mount that can be operable to vary a pointing angle of the camera 210 .
- FIGS. 3A-3C illustrate an example of a scenario 300 showing a navigation of a vehicle having inadequate map data.
- the scenario 300 involves a roadway with a left lane 302 , a right lane 304 , and a shoulder 306 .
- a vehicle 308 In the left lane 302 is a vehicle 308 .
- Traveling in front of the vehicle 308 is a truck 314
- traveling to the right of the vehicle 308 is a car 312 .
- the vehicle 308 is operating in a first autonomous mode.
- the vehicle 308 can be navigated based on map data.
- the map data can include, for example, roadway maps, path information, and road condition information, among other data.
- the map data can be received by the vehicle 308 while the vehicle is 308 is in motion or prior to the vehicle 308 being in motion.
- the vehicle 308 can receive map data of a route in real-time, or can receive map data of the route in iterations as the vehicle 308 travels along the route.
- the vehicle 308 can receive map data prior to commencing the route.
- the map data can be generated and/or received prior to controlling the vehicle 308 in the first autonomous mode.
- a computer system of the vehicle 308 can obtain sensor data using a sensor unit 310 of the vehicle 308 or any other sensor of the vehicle 308 .
- the sensor data can be indicative of the environment of the vehicle 308 and, accordingly, can represent such aspects of the environment as the roadway, the truck 314 or car 312 , and information on the road sign 316 . These examples are illustrative only; the sensor data can represent various other aspects of the environment of the vehicle 308 .
- the vehicle's computer system can compare the map data to the sensor data in order to detect an inadequacy in the map data.
- the computer system can determine, based on the comparison, whether the difference between the map data and the sensor data exceeds a predetermined threshold. If the difference exceeds the threshold, then the computer system can determine that that the map data is inadequate.
- the map data can be compared to the sensor data in real-time. In some implementations, the map data can be compared to the sensor data outside real-time.
- the computer system of the vehicle 308 can control the vehicle 308 in a second autonomous mode, and can provide an indication of an option to switch to a manual mode.
- the indication can be any suitable indication, such as, for example, a notification by way of a display in a passenger cabin of the vehicle 308 , a speaker of the vehicle 308 , or a light indicator of the vehicle 308 .
- An inadequacy can also be found when there is simply no relevant map data for a given area.
- the vehicle 308 may not receive map data for a given area, or may receive map data that does not include data for the given area.
- FIG. 3B shows the vehicle 308 operating in the second autonomous mode.
- the computer system of the vehicle 308 can obtain additional sensor data using the sensor unit 310 of the vehicle 308 or any other sensor of the vehicle 308 .
- the additional sensor data can be indicative of any aspect of the environment of the vehicle 308 and, accordingly, can represent such features of the environment as the truck 314 , the car 312 , the positions of the truck 314 and the car 314 relative to the vehicle 308 , the left lane 302 and the right lane 304 of the roadway, the boundary between the left and right lanes, and the information on the road sign 316 , for example.
- the vehicle can continue to drive safely while transitioning control by estimating the shape and location of the current lane and road and using this information to stay within its lane.
- the vehicle may incorporate several sources of information from sensors on the vehicle, such as features representing where the lane markers are, where other vehicles are traveling, and objects specific to road environments such as traffic signs, cones, and other markers.
- the vehicle can also take into account where other vehicles/objects are in its vicinity to maintain a safe distance from these vehicles/objects while transitioning control to the human driver.
- the additional sensor data can represent various other aspects of the environment of the vehicle 308 .
- the vehicle 308 can be navigated based on the additional sensor data. In some implementations, the vehicle 308 can be navigated based on a message that conveys a condition of the environment of the vehicle 308 . For example, assume that the road sign 316 includes the message “Construction ahead: reduce speed to 20 MPH.” The computer system of the vehicle 308 can accordingly reduce the speed of the vehicle 308 in accordance with the message on the road sign 316 . As another example, the computer system of the vehicle 308 can detect lane boundaries, such as, for example, the boundaries of the lane 302 , and can navigate the vehicle 308 to stay in the lane 302 . In some implementations, the computer system can navigate the vehicle 308 based on the additional sensor data and without using the map data.
- the computer system can navigate the vehicle 308 based on a combination of the additional sensor data and the map data.
- the computer system of the vehicle 308 can use portions of the map data that are sufficiently consistent with the sensor data, and can use the sensor data to the exclusion of the map data when the sensor data and map data are sufficiently different from each other.
- the computer system of the vehicle 308 can take precautions, such as, for example, reducing a speed of the vehicle 308 , causing the vehicle 308 to maintain a safer than usual distance from other vehicles, or the like. In this way, the computer system of the vehicle 308 can take measures to enhance the safety of persons, such as on-board passengers, while the computer system waits for a person to respond to the indication of the option to switch to the manual mode. For example, as illustrated by arrow 318 , the vehicle 308 has slowed down and backed off from the truck 314 .
- Other implementations for taking precautions in the second autonomous mode are possible.
- the computer system of the vehicle 308 can monitor for an inactivity in relation to the option to switch to the manual mode. If the computer system detects such an inactivity, then the computer system can control the vehicle 308 in a third autonomous mode. For example, if the computer system detects that a predetermined period has passed without the vehicle switching to the manual mode, then the computer system can control the vehicle in the third autonomous mode.
- the computer system can use sensors that are in or focused on the passenger cabin of the vehicle 308 to determine a condition of an on-board passenger. For instance, a camera in the passenger cabin can be used to determine whether an on-board passenger has moved (or has moved to a sufficient extent) after the indication was provided.
- the computer system of the vehicle 308 can detect the inactivity by detecting an inaction in the passenger cabin of the vehicle 308 .
- the computer system can use data from physiological sensors, such as, for example, heart rate monitors, to monitor for an inactivity.
- FIG. 3C shows the vehicle 308 operating in the third autonomous mode.
- the computer system of the vehicle 308 can obtain further sensor data using the sensor unit 310 or another sensor of the vehicle 308 , and can navigate the vehicle 308 based on the further sensor data.
- the computer system of the vehicle 308 in the third autonomous mode, can navigate the vehicle 308 with diminished or no use of the map data.
- the computer system of the vehicle 308 in the third autonomous mode, can take or can cause the vehicle to take one or more precautious actions in addition to those taken, if any, in the second autonomous mode.
- the computer system of the vehicle 308 can immediately stop the vehicle 308 , assuming that the computer system determines that it is feasible and safe to do so.
- the computer system in the third autonomous mode, can determine a level of safety of parking the vehicle 308 at a location, such as, for example, the shoulder 306 of the roadway.
- the computer system can cause the vehicle 308 to navigate to the location and park the vehicle 308 at the location, as illustrated by arrow 320 .
- the computer system of the vehicle 308 can cause the vehicle 308 to follow another vehicle, such as the truck 314 , at a safe distance. In this way, the vehicle 308 can take advantage of the behavior of the other vehicle. The vehicle 308 can follow the other vehicle, for example, until the computer system determines that some condition or combination of conditions has been met.
- the computer system of the vehicle 308 can cause the vehicle 308 to stop following the other vehicle upon a determination that it is no longer safe for the vehicle 308 to continue to follow the other vehicle, upon a determination that following the other vehicle has led or will lead the vehicle 308 sufficiently astray from a target path, or upon a determination of a safe location to park the vehicle 308 .
- the computer system of the vehicle 308 in the third autonomous mode, can enable hazard lights of the vehicle 308 and can reduce the speed of the vehicle 308 .
- the computer system of the vehicle 308 can locate an area to park, for example, by way of a navigation system of the vehicle 308 or a navigation system that is accessible through a communication system of the vehicle 308 .
- the computer system of the vehicle 308 can navigate the vehicle 308 to the area and park the vehicle at the area.
- the computer system of the vehicle 308 can cause the vehicle 308 to send a message to alert appropriate authorities.
- the computer system of the vehicle 308 can continue to navigate the vehicle 308 partially or entirely along a route.
- the route can be a predetermined route or a route that is generated upon (or after) the vehicle 308 entering the third autonomous mode. For instance, if the computer system is confident in its estimate of the current or future environment of the vehicle 308 based on the sensor data, then the computer system can continue to navigate the vehicle 308 along a route.
- the computer system can navigate the vehicle 308 partially along the predetermined route, for example, by navigating the vehicle 308 for a certain period of time or for a certain distance. In some implementations, the computer system can navigate the vehicle 308 until the vehicle 308 reaches the destination of the route.
- the vehicle 308 can be safely maneuvered and/or parked while the vehicle 308 is in the third autonomous mode.
- precautious actions can be implemented together in various combinations.
- the computer system of the vehicle 308 can turn on hazard lights of the vehicle 308 while the computer system searches for a suitable location to park the vehicle 308 .
- the computer system can turn off the hazard lights and navigate the vehicle 308 to the location.
- the vehicle 308 can take (or be caused to take) various other precautious actions in the third autonomous mode; this disclosure contemplates the various other precautious actions.
- FIG. 4 illustrates an example of a method 400 for controlling a vehicle.
- the method 400 can be performed using the vehicle 100 shown in FIG. 1 , the vehicle 200 shown in FIG. 2 , another suitable vehicle, or another suitable system or apparatus.
- the method 400 includes controlling a vehicle in a first autonomous mode of operation.
- controlling the vehicle in the first autonomous mode of operation includes navigating the vehicle based on map data.
- the method 400 can include receiving the map data prior to controlling the vehicle in the first autonomous mode of operation.
- the map data can be generated prior to controlling the vehicle in the first autonomous mode of operation.
- the method 400 includes obtaining sensor data using one or more sensors of the vehicle.
- the sensor data is indicative of an environment of the vehicle.
- the method 400 includes detecting an inadequacy in the map data.
- detecting the inadequacy in the map data includes comparing the map data to the sensor data.
- detecting the inadequacy in the map data includes detecting a difference between the map data and the sensor data.
- comparing the map data to the sensor data comprises comparing the map data to the sensor data in real-time.
- the method 400 includes controlling the vehicle in a second autonomous mode of operation and providing an indication of an option to switch to a manual mode of operation, in response to detecting the inadequacy in the map data.
- Providing the indication can serve to prompt a user to switch to the manual mode of operation.
- the indication can be provided in various ways.
- the indication can be provided, for example, by way of any device or system that is provided in connection with the vehicle, such as, for example, any combination of one or more displays (such as a touch-screen display), speakers, indicator lights, and navigation systems. These examples are merely illustrative; the indication can be provided in various other ways.
- the indication can be provided by way of a mobile device, such as a mobile phone, that is in wireless communication with the vehicle.
- controlling the vehicle in the second autonomous mode of operation includes obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data.
- navigating the vehicle based on the additional sensor data comprises navigating the vehicle without using the map data.
- the additional sensor data can be indicative of a lane boundary, and navigating the vehicle based on the additional sensor data can include navigating the vehicle based on the lane boundary.
- the additional sensor data can be indicative of a position of a second vehicle, and navigating the vehicle based on the additional sensor data can include navigating the vehicle based on the position of the second vehicle.
- the additional sensor data can be indicative of a traffic sign. The traffic sign can present a condition of an environment of the vehicle. Navigating the vehicle based on the additional sensor data can include navigating the vehicle based on the condition.
- the method 400 can include detecting an inactivity when the vehicle is in the second autonomous mode of operation.
- the inactivity can relate to the option to switch to the manual mode of operation.
- detecting the inactivity can include receiving information that is indicative of a condition in a passenger cabin of the vehicle, and detecting the inactivity based on the information.
- detecting the inactivity can include detecting an inaction in a passenger cabin of the vehicle.
- the method 400 can include controlling the vehicle in a third autonomous mode of operation, in response to detecting the inadequacy in the map data. Controlling the vehicle in the third autonomous mode of operation can include obtaining further sensor data using the one or more sensors of the vehicle, and navigating the vehicle based on the further sensor data.
- navigating the vehicle based on the further sensor data can include determining a level of safety of parking the vehicle at a location, determining that the level of safety exceeds a target threshold, and in response to determining that the level of safety exceeds the target threshold, parking the vehicle at the location. In some implementations, navigating the vehicle based on the further sensor data can include navigating the vehicle without using the map data.
- the method 400 of FIG. 4 can be carried out in whole or in part by a vehicle and its subsystems.
- the method 400 can be implemented in whole or in part by one or more computing devices.
- the method 400 can be implemented in whole or in part by a server system, which receives data from a device that is associated with a vehicle.
- Other examples of computing devices or combinations of computing devices that can implement the method 400 are possible.
- the method 400 can be implemented as computer program instructions encoded on a non-transitory computer-readable storage media in a machine-readable format, or on other non-transitory media or articles of manufacture.
- FIG. 5 illustrates a conceptual view of a computer program product 500 .
- the computer program product 500 can be used to implement methods, such as the method 400 , that are in the scope of this disclosure.
- the computer program product 500 is provided using a signal bearing medium 502 .
- the signal bearing medium 502 can include one or more programming instructions 504 that, when executed by one or more processors can provide functionality or portions of the functionality described above with respect to FIGS. 1-4 .
- the signal bearing medium 502 can encompass a computer-readable medium 506 , such as, but not limited to, a hard disk drive, a Compact Disc (CD), a Digital Video Disk (DVD), a digital tape, or memory.
- a computer-readable medium 506 such as, but not limited to, a hard disk drive, a Compact Disc (CD), a Digital Video Disk (DVD), a digital tape, or memory.
- the signal bearing medium 502 can encompass a computer recordable medium 508 , such as, but not limited to, memory, read/write (R/W) CDs, or R/W DVDs.
- the signal bearing medium 502 can encompass a communications medium 510 , such as, but not limited to, a digital and/or an analog communication medium (for example, a fiber optic cable, a waveguide, a wired communications link, or a wireless communication link).
- a wireless form of the communications medium 510 can be conveyed by a wireless form of the communications medium 510 .
- the one or more programming instructions 504 can be, for example, computer executable and/or logic implemented instructions.
- a computing device such as the computer system 112 of FIG. 1 can be configured to provide various operations, functions, or actions in response to the programming instructions 504 conveyed to the computer system 112 by one or more of the computer readable medium 506 , the computer recordable medium 508 , and/or the communications medium 510 .
- the non-transitory computer readable medium can also be distributed among multiple data storage elements, which can be remotely located from each other.
- the computing device that executes some or all of the stored instructions can be a vehicle, such as the vehicle 200 illustrated in FIG. 2 .
- the computing device that executes some or all of the stored instructions can be another computing device, such as a server.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Aviation & Aerospace Engineering (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
Abstract
A vehicle can be controlled in a first autonomous mode of operation by at least navigating the vehicle based on map data. Sensor data can be obtained using one or more sensors of the vehicle. The sensor data can be indicative of an environment of the vehicle. An inadequacy in the map data can be detected by at least comparing the map data to the sensor data. In response to detecting the inadequacy in the map data, the vehicle can be controlled in a second autonomous mode of operation and a user can be prompted to switch to a manual mode of operation. The vehicle can be controlled in the second autonomous mode of operation by at least obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data.
Description
This application is a continuation of U.S. patent application Ser. No. 13/943,867 filed on Jul. 17, 2013, and entitled “Controlling a Vehicle Having Inadequate Map Data,” which is a continuation of U.S. patent application Ser. No. 13/465,348 (now U.S. Pat. No. 8,521,352), filed on May 7, 2012, and entitled “Controlling a Vehicle Having Inadequate Map Data,” all of which are herein incorporated by reference as if fully set forth in this description.
Some vehicles are configured to operate in an autonomous mode in which the vehicle navigates through an environment with little or no input from a driver. Such a vehicle typically includes sensors that are configured to sense information about the environment. The vehicle can use the sensed information to navigate through the environment. For example, if the sensors sense that the vehicle is approaching an obstacle, the vehicle can navigate around the obstacle.
In a first aspect, a method is provided. The method includes controlling a vehicle in a first autonomous mode of operation. Controlling the vehicle in the first autonomous mode of operation includes navigating the vehicle based on map data. The method includes obtaining sensor data using one or more sensors of the vehicle. The sensor data is indicative of an environment of the vehicle. The method includes detecting an inadequacy in the map data. Detecting the inadequacy in the map data includes comparing the map data to the sensor data. The method includes, in response to detecting the inadequacy in the map data, controlling the vehicle in a second autonomous mode of operation and prompting a user to switch to a manual mode of operation. Controlling the vehicle in the second autonomous mode of operation includes obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data.
In a second aspect, a vehicle is provided. The vehicle includes at least one sensor and a computer system. The at least one sensor is configured to obtain first sensor data. The first sensor data is indicative of an environment of the vehicle when the vehicle is in a first autonomous mode of operation. The at least one sensor is configured to obtain second sensor data. The second sensor data is indicative of an environment of the vehicle when the vehicle is in a second autonomous mode of operation. The computer system is configured to control the vehicle in the first autonomous mode of operation by at least navigating the vehicle based on map data. The computer system is configured to detect an inadequacy in the map data by at least comparing the map data to the first sensor data. The computer system is configured to, in response to detecting the inadequacy in the map data, (i) control the vehicle in the second autonomous mode of operation by at least navigating the vehicle based on the second sensor data, and (ii) prompt a user to switch to a manual mode of operation.
In a third aspect, a non-transitory computer-readable medium is provided. The medium includes stored instructions that are executable by a computer system to cause the computer system to perform functions. The functions include controlling a vehicle in a first autonomous mode of operation. Controlling the vehicle in the first autonomous mode of operation includes navigating the vehicle based on map data. The functions include receiving sensor data from one or more sensors of the vehicle. The sensor data is indicative of an environment of the vehicle. The functions include detecting an inadequacy in the map data. Detecting the inadequacy in the map data includes comparing the map data to the sensor data. The functions include, in response to detecting the inadequacy in the map data, controlling the vehicle in a second autonomous mode of operation and prompting a user to switch to a manual mode of operation. Controlling the vehicle in the second autonomous mode of operation includes obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data.
Some vehicles can operate autonomously with the use of map data. For example, a person, such as an on-board passenger, can cause a vehicle to switch from manual operation to autonomous operation. In the autonomous mode, the vehicle can use map data to navigate the vehicle. Map data can be, for example, predetermined data that relates to the route of a vehicle or otherwise relates to the surroundings of the vehicle. For example, map data can relate to traffic conditions, road conditions, route information, positioning information, or combinations of these.
In some situations, map data can be inadequate for use in autonomously navigating a vehicle. For example, map data can become outdated over time due to changing road conditions, or the map data may not include sufficient detail about the present or future environment of the vehicle. If the vehicle determines that the map data is inadequate, the vehicle can rely on other sources of information to operate autonomously, or the vehicle can switch (or indicate an option to switch) to a manual mode.
This disclosure provides techniques for operating a vehicle when the map data has been determined to be inadequate. In some implementations, a computer system can control a vehicle in a first autonomous mode of operation (or simply “first autonomous mode”). In the first autonomous mode, the computer system can navigate the vehicle based on map data. While the vehicle is in the first autonomous mode, the computer system can obtain sensor data using one or more sensors of the vehicle. The sensor data can be indicative of an environment of the vehicle. The sensor data can represent nearby objects, such as, for example, traffic signs, lane markers, other vehicles, or pedestrians. The sensor data can also, or instead, represent observations or calculations such as, for example, traffic patterns and geometries of one or more roads near the vehicle.
The computer system can compare the map data to the sensor data in order to detect an inadequacy in the map data. For example, the inadequacy in the map data can be an inconsistency between the sensor data and the map data. In response to detecting the inadequacy in the map data, the computer system can control the vehicle in a second autonomous mode of operation (or simply “second autonomous mode”), and provide an indication of an option to switch to a manual mode of operation (or simply “manual mode”). The indication can serve to notify a person, such as an on-board passenger, of the inadequacy in the map data, and to suggest that the person take control of the vehicle, such as by causing the vehicle to switch to the manual mode. In the second autonomous mode, the computer system can obtain additional sensor data using the one or more sensors, and can navigate the vehicle based on the additional sensor data.
In addition, in the second autonomous mode, the computer system can take precautions, such as, for example, reducing a speed of the vehicle, causing the vehicle to maintain a safer than usual distance from another vehicle, or the like. In this way, the computer system can take measures to enhance the safety of a person, such as an on-board passenger, while the computer system waits for the person to take control of the vehicle.
In the second autonomous mode, if the computer system detects an inactivity in relation to the option to switch to the manual mode, then the computer system can control the vehicle in a third autonomous mode of operation (or simply “third autonomous mode”). For example, if the computer system detects that a predetermined period has passed without the vehicle switching to the manual mode, then the computer system can control the vehicle in the third autonomous mode. In the third autonomous mode, the computer system can obtain further sensor data using the one or more sensors, and can navigate the vehicle based on the further sensor data. In addition, in the third autonomous mode, the computer system can navigate the vehicle with diminished or no use of the map data. In the third autonomous mode, the computer system can take further precautions, such as, for example, stopping the vehicle, navigating the vehicle to a shoulder of a road, following another vehicle at a safe distance, enabling the vehicle's hazard lights, or sending a message to alert appropriate authorities. In this way, when an on-board passenger does not take control of the vehicle in the second autonomous mode, the vehicle can be safely maneuvered and/or parked.
Also discussed are examples of systems that can be used in connection with some disclosed implementations. In some implementations, a system can take the form of an automobile or another suitable vehicle. Suitable vehicles include a car, truck, motorcycle, bus, boat, airplane, helicopter, lawn mower, earthmover, snowmobile, recreational vehicle, amusement park vehicle, farm equipment, construction equipment, tram, golf cart, train, or trolley. Other vehicles are possible as well.
With reference to FIG. 1 , the vehicle 100 can include various subsystems such as a propulsion system 102, a sensor system 104, a control system 106, one or more peripherals 108, as well as a power supply 110, a computer system 112, and a user interface 116. The vehicle 100 can include more or fewer subsystems and each subsystem can include multiple elements. Further, each of the subsystems and elements of the vehicle 100 can be interconnected. Thus, one or more of the described functions of the vehicle 100 can be divided into additional functional or physical components, or combined into fewer functional or physical components. In some further examples, additional functional or physical components can be added to the illustration of FIG. 1 .
The propulsion system 102 can include components operable to provide powered motion for the vehicle 100. Depending on the implementation, the propulsion system 102 can include an engine/motor 118, an energy source 119, a transmission 120, and wheels/tires 121. The engine/motor 118 can be any combination of an internal combustion engine, an electric motor, steam engine, Stirling engine, or another engines/motor. In some implementations, the engine/motor 118 can be configured to convert the energy source 119 into mechanical energy. In some implementations, the propulsion system 102 can include multiple types of engines and/or motors. For instance, a gas-electric hybrid car can include a gasoline engine and an electric motor. Other implementations are possible.
The energy source 119 can represent a source of energy that can, in full or in part, power the engine/motor 118. That is, the engine/motor 118 can be configured to convert the energy source 119 into mechanical energy. Examples of energy sources 119 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electrical power. The energy source 119 can also, or instead, include any combination of fuel tanks, batteries, capacitors, and flywheels. The energy source 119 can also provide energy for other systems of the vehicle 100.
The transmission 120 can include elements that are operable to transmit mechanical power from the engine/motor 118 to the wheels/tires 121. To this end, the transmission 120 can include a gearbox, clutch, differential, and drive shafts. The transmission 120 can include other elements. The drive shafts can include one or more axles that can be coupled to the one or more wheels/tires 121.
The wheels/tires 121 of the vehicle 100 can be of various forms, such as, for example, those of a unicycle, motorcycle, tricycle, or car. Other wheel/tire forms are possible, such as those including six or more wheels. Any combination of the wheels/tires 121 of the vehicle 100 can be operable to rotate differentially with respect to other wheels/tires 121. The wheels/tires 121 can represent at least one wheel that is attached to the transmission 120 and at least one tire coupled to a rim of the wheel that can make contact with the driving surface. The wheels/tires 121 can include any combination of metal and rubber, or another combination of materials.
The sensor system 104 can include a number of sensors configured to sense information about an environment of the vehicle 100. For example, the sensor system 104 can include a Global Positioning System (GPS) 122, an inertial measurement unit (IMU) 124, a RADAR unit 126, a laser rangefinder/LIDAR unit 128, and a camera 130, among other types of sensors. In addition, the sensor system 104 can include sensors that are configured to monitor internal systems of the vehicle 100. Examples include an O2 monitor, fuel gauge, and engine oil temperature. In addition, the sensor system 104 can include sensors that can sense conditions in a passenger cabin of the vehicle 100, if the vehicle 100 is equipped with a passenger cabin. Examples include physiological sensors and cameras. Other sensors are possible as well.
The GPS 122 can include any number and combination of sensors, and can be configured to estimate a geographic location of the vehicle 100. To this end, the GPS 122 can include a transceiver that is operable to provide information regarding the position of the vehicle 100 with respect to the Earth.
The IMU 124 can include any number and combination of sensors (for example, accelerometers and gyroscopes), and can be configured to sense position and orientation changes of the vehicle 100 based on inertial acceleration.
The RADAR unit 126 can represent a system that utilizes radio signals to sense objects within the environment of the vehicle 100. In some implementations, in addition to sensing the objects, the RADAR unit 126 can additionally be configured to sense the speed of the objects, the heading of the objects, or both.
The laser rangefinder or LIDAR unit 128 can include any number and combination of sensors, and can be configured to sense objects in the environment of the vehicle 100 by using lasers. Depending on the implementation, the laser rangefinder/LIDAR unit 128 can include one or more laser sources, laser scanners, and detectors, among other components. The laser rangefinder/LIDAR unit 128 can be configured to operate in a coherent detection mode (for example, by using heterodyne detection) or an incoherent detection mode.
The camera 130 can include any number and combination of devices, and can be configured to capture images of the environment of the vehicle 100. The camera 130 can be a still camera or a video camera.
The control system 106 can be configured to control operation of the vehicle 100 and its components. To this end, the control system 106 can include various elements, including a steering unit 132, a throttle 134, a brake unit 136, a sensor fusion algorithm 138, a computer vision system 140, a navigation/pathing system 142, and an obstacle avoidance system 144.
The steering unit 132 can include any number and combination of devices, and can be configured to adjust the heading of the vehicle 100.
The throttle 134 can be configured to control, for instance, the operating speed of the engine/motor 118 and, in turn, control the speed of the vehicle 100.
The brake unit 136 can include any number and combination of devices, and can be configured to decelerate the vehicle 100. The brake unit 136 can apply friction to slow the wheels/tires 121. In some implementations, the brake unit 136 can convert the kinetic energy of the wheels/tires 121 to electric current. Other implementations are possible.
The sensor fusion algorithm 138 can be an algorithm or a computer program product storing an algorithm, and can be configured to receive data from the sensor system 104 as an input. The data can include, for example, data representing information sensed at the sensors of the sensor system 104. The sensor fusion algorithm 138 can include, for instance, a Kalman filter, Bayesian network, or other algorithm. The sensor fusion algorithm 138 can further provide various assessments based on the data from the sensor system 104. Depending on the implementation, the assessments can include evaluations of individual objects or features in the environment of the vehicle 100, evaluation of a particular situation, or evaluations of possible impacts based on the particular situation. Other assessments are possible.
The computer vision system 140 can be any system that is operable to process and analyze images captured by the camera 130 in order to identify objects or features in the environment of the vehicle 100. The objects or features can include, for example, traffic signals, traffic signs, roadway boundaries, and obstacles. The computer vision system 140 can use an object recognition algorithm, a Structure From Motion (SFM) algorithm, video tracking, and other computer vision techniques. In some implementations, the computer vision system 140 can be configured to map an environment, track objects, and estimate the speed of objects.
The navigation and pathing system 142 can be configured to determine a driving path for the vehicle 100. The navigation and pathing system 142 can be configured to update the driving path dynamically while the vehicle 100 is in operation. In some implementations, the navigation and pathing system 142 can be configured to use map data to determine the driving path for the vehicle 100. For example, the navigation and pathing system 142 can use data from the sensor fusion algorithm 138 or the GPS 122, or from a different system or component of the vehicle 100, to determine the driving path for the vehicle 100.
The obstacle avoidance system 144 can represent a control system that is configured to identify, evaluate, and avoid or otherwise negotiate potential obstacles in the environment of the vehicle 100.
The peripherals 108 can be configured to allow interaction between the vehicle 100 and external sensors, other vehicles, other computer systems, or a user. For example, the peripherals 108 can include a wireless communication system 146, a touchscreen 148, a microphone 150, and a speaker 152.
In some implementations, the peripherals 108 can enable a user of the vehicle 100 to interact with the user interface 116. To this end, the touchscreen 148 can provide information to a user of vehicle 100. For example, the touchscreen 148 can provide an indication of an option to switch from an autonomous mode of operation to a manual mode of operation. The user interface 116 can be operable to accept input from the user via the touchscreen 148. The touchscreen 148 can be configured to sense at least one of a position and a movement of a user's finger via capacitive sensing, resistance sensing, or a surface acoustic wave process, among other possibilities. The touchscreen 148 can be capable of sensing finger movement in a direction parallel or planar to the touchscreen surface, in a direction normal to the touchscreen surface, or both, and can also be capable of sensing a level of pressure applied to the touchscreen surface. The touchscreen 148 can be formed of one or more translucent or transparent insulating layers and one or more translucent or transparent conducting layers. The touchscreen 148 can take other forms as well.
In some implementations, the peripherals 108 can enable the vehicle 100 to communicate with devices in its environment. The microphone 150 can be configured to receive audio (for example, a voice command or other audio input) from a user of the vehicle 100. Similarly, the speakers 152 can be configured to output audio to the user of the vehicle 100. For example, the speakers 152 can provide an indication of an option to switch from an autonomous mode of operation to a manual mode of operation.
The wireless communication system 146 can be configured to wirelessly communicate with one or more devices directly or via a communication network. For example, the wireless communication system 146 can use 3G cellular communication, such as CDMA, EVDO, GSM/GPRS, or 4G cellular communication, such as WiMAX or LTE. In some implementations, the wireless communication system 146 can communicate with a wireless local area network (WLAN), for example, using WiFi. In some implementations, the wireless communication system 146 can communicate directly with a device, for example, using an infrared link, Bluetooth, or ZigBee. Other wireless protocols, such as various vehicular communication systems, are possible. For example, the wireless communication system 146 can include one or more dedicated short-range communications (DSRC) devices that can include public or private data communications between vehicles and roadside stations.
The power supply 110 can provide power to various components of the vehicle 100 and can represent, for example, a rechargeable lithium-ion or lead-acid battery. In some implementations, one or more banks of such batteries can be configured to provide electrical power. Other power supply materials and configurations are possible. In some implementations, the power supply 110 and energy source 119 can be implemented together, as in some all-electric cars.
Many or all of the functions of the vehicle 100 can be controlled by the computer system 112. The computer system 112 can include at least one processor 113, which can include at least one microprocessor. The at least one processor 113 can execute instructions 115 stored in a non-transitory computer-readable medium, such as the data storage 114. The computer system 112 can also represent multiple computing devices that can control individual components or subsystems of the vehicle 100 in a distributed fashion.
In some implementations, the data storage 114 can contain instructions 115 (for example, program logic) that are executable by the processor 113 to execute various functions of vehicle 100, including those described above in connection with FIG. 1 and those discussed below in connection with FIGS. 3A-3C and 4 . The data storage 114 can contain additional instructions as well, including instructions to transmit data to, receive data from, interact with, and/or control one or more of the propulsion system 102, the sensor system 104, the control system 106, and the peripherals 108.
In addition to the instructions 115, the data storage 114 can store map data, which can include roadway maps, path information, and road condition information, among other data. In some implementations, the map data can be used by the vehicle 100 and computer system 112 during the operation of the vehicle 100 in the autonomous, semi-autonomous, or manual modes. In some implementations, the map data can be selectively used by the vehicle 100 during the operation of the vehicle 100 in some of the autonomous modes, and can be used to a lesser extent during operation of the vehicle 100 in other autonomous modes.
The vehicle 100 can include a user interface 116 for providing information to or receiving input from a user of vehicle 100. The user interface 116 can control or enable control of content and/or the layout of interactive images that can be displayed on the touchscreen 148. Further, the user interface 116 can include one or more input/output devices within the set of peripherals 108, such as the wireless communication system 146, the touchscreen 148, the microphone 150, and the speaker 152.
The computer system 112 can control functions of the vehicle 100 based on inputs received from various subsystems (for example, the propulsion system 102, sensor system 104, and control system 106), as well as from the user interface 116. For example, the computer system 112 can utilize input from the control system 106 in order to control the steering unit 132 to avoid an obstacle detected by the sensor system 104 and the obstacle avoidance system 144. Depending upon the implementation, the computer system 112 can be operable to provide control over many aspects of the vehicle 100 and its subsystems.
The components of the vehicle 100 can be configured to work in an interconnected fashion with other components within or outside their respective systems. For instance, in some implementations, the camera 130 can capture a plurality of images that can represent information about a state of an environment of the vehicle 100 operating in an autonomous mode. The environment can include another vehicle, the road on which the vehicle 100 travels (including markings on the road), signs near the vehicle, pedestrians, and the like. The computer vision system 140 can recognize aspects of the environment based on object recognition models stored in data storage 114.
In some implementations, the computer system 112 can control the vehicle 100 in one of several autonomous modes of operation, including first, second, and third autonomous modes. In the first autonomous mode, the computer system can navigate the vehicle based on map data, such as, for example, map data from the global positioning system 122, map data that is stored to the data storage 114, or map data that is received from the wireless communication system 146. While the vehicle 100 is in the first autonomous mode, the computer system 112 can obtain sensor data using one or more sensors in the sensor system 104. The sensor data can be indicative of an environment of the vehicle 100. The sensor data can represent nearby objects, such as, for example, traffic signs, lane markers, other vehicles, or pedestrians. The sensor data can also, or instead, represent observations or calculations such as, for example, traffic patterns and road shapes near the vehicle 100.
The computer system 112 can compare the map data to the sensor data in order to detect an inadequacy in the map data. For example, the inadequacy in the map data can be an inconsistency between the sensor data and the map data. In response to detecting the inadequacy in the map data, the computer system 112 can control the vehicle 100 in the second autonomous mode, and can provide an indication of an option to switch to the manual mode. For example, the indication can be provided by way of the touch screen 148, the speaker 152, and/or the user interface 116. The indication can serve to notify a person, such as an on-board passenger, of the inadequacy in the map data, and to suggest that the person take control of the vehicle 100, such as by causing the vehicle 100 to switch to the manual mode. In the second autonomous mode, the computer system 112 can obtain additional sensor data using the sensor system 104, and can navigate the vehicle 100 based on the additional sensor data.
Also, in the second autonomous mode, the computer system can take precautions, such as, for example, reducing a speed of the vehicle 100, causing the vehicle 100 to maintain a safer than usual distance from other vehicles, or the like. In this way, the computer system 112 can take measures to enhance the safety of persons, such as on-board passengers, while the computer system 112 waits for a person to take control of the vehicle 100.
In some implementations, in the second autonomous mode, if the computer system 112 detects an inactivity in relation to the option to switch to the manual mode, then the computer system 112 can control the vehicle 100 in the third autonomous mode. For example, if the computer system 112 detects that a predetermined period has passed without the vehicle 100 switching to the manual mode, then the computer system 112 can control the vehicle 100 in the third autonomous mode. In the third autonomous mode, the computer system 112 can obtain further sensor data using the one or more sensors, and can navigate the vehicle 100 based on the further sensor data. In addition, in the third autonomous mode, the computer system 112 can navigate the vehicle 100 with diminished or no use of the map data. In the third autonomous mode, the computer system 112 can take further precautions, such as, for example, stopping the vehicle 100 immediately, navigating the vehicle 100 to a shoulder of a road and then stopping the vehicle 100, causing the vehicle 100 to follow another vehicle at a safe distance, enabling hazard lights of the vehicle 100, or sending a message (for example, by way of the wireless communication system 146) to alert appropriate authorities. In this way, when a person, such as an on-board passenger, does not take control of the vehicle 100, the vehicle 100 can be safely maneuvered and/or parked.
Although FIG. 1 shows various components of the vehicle 100, such as, for example, the wireless communication system 146, the computer system 112, the data storage 114, and the user interface 116, as being integrated into the vehicle 100, one or more of these components can be mounted or associated separately from the vehicle 100. For example, the data storage 114 can, in part or in full, exist separate from the vehicle 100. Thus, the vehicle 100 can be provided in the form of device elements that can be located separately or together. The device elements that make up the vehicle 100 can be communicatively coupled together in a wired or wireless fashion.
Depending on the implementation, the vehicle 200 can include a sensor unit 202, a wireless communication system 204, a LIDAR unit 206, a laser rangefinder unit 208, and a camera 210. The elements of the vehicle 200 can include some or all of the elements described in connection with FIG. 1 .
The sensor unit 202 can include one or more different sensors configured to capture information about an environment of the vehicle 200. For example, the sensor unit 202 can include any combination of cameras, RADARs, LIDARs, range finders, and acoustic sensors. Other types of sensors are possible. Depending on the implementation, the sensor unit 202 can include one or more movable mounts that can be operable to adjust the orientation of one or more sensors in the sensor unit 202. In some implementations, the movable mount can include a rotating platform that can scan sensors so as to obtain information from each direction around the vehicle 200. In another implementation, the movable mount of the sensor unit 202 can be moveable in a scanning fashion within a particular range of angles or azimuths. The sensor unit 202 can be mounted atop the roof of a car, for instance; however other mounting locations are possible. In addition, the sensors of sensor unit 202 can be distributed in different locations and need not be collocated in a single location. Some possible sensor types and mounting locations include the LIDAR unit 206 and the laser rangefinder unit 208. In addition, each sensor of the sensor unit 202 can move or scan independently of other sensors of the sensor unit 202.
The wireless communication system 204 can be located on a roof of the vehicle 200, as depicted in FIG. 2 . In some implementations, the wireless communication system 204 can be located elsewhere. The wireless communication system 204 can include wireless transmitters and receivers that can be configured to communicate with devices external or internal to the vehicle 200. In particular, the wireless communication system 204 can include transceivers that can be configured to communicate with other vehicles and/or computing devices, for instance, in a vehicular communication system or a roadway station. Examples of such vehicular communication systems include dedicated short-range communications (DSRC), radio frequency identification (RFID), and other proposed communication standards directed towards intelligent transport systems.
The camera 210 can be any camera (for example, a still camera or a video camera) that is configured to capture a plurality of images of the environment of the vehicle 200. To this end, the camera 210 can be configured to detect visible light, or can be configured to detect light from other portions of the spectrum, such as infrared or ultraviolet light. Other types of cameras are possible as well.
The camera 210 can be a two-dimensional detector, or can have a three-dimensional spatial range. In some implementations, the camera 210 can be, for example, a range detector that is configured to generate a two-dimensional image indicating a distance from the camera 210 to a number of points in the environment. To this end, the camera 210 can use one or more range detecting techniques. For example, the camera 210 can use a structured light technique in which the vehicle 200 illuminates an object in the environment with a predetermined light pattern, such as a grid or checkerboard pattern and uses the camera 210 to detect a reflection of the predetermined light pattern from the object. Based on distortions in the reflected light pattern, the vehicle 200 can determine the distance to the points on the object. The predetermined light pattern can include infrared light or light of another wavelength. As another example, the camera 210 can use a laser scanning technique in which the vehicle 200 emits a laser and scans across a number of points on an object in the environment. While scanning the object, the vehicle 200 can use the camera 210 to detect a reflection of the laser from the object for each point. Based on a duration that it takes for the laser to reflect from the object at each point, the vehicle 200 can determine the distance to the points on the object. As yet another example, the camera 210 can use a time-of-flight technique in which the vehicle 200 emits a light pulse and uses the camera 210 to detect a reflection of the light pulse from an object at a number of points on the object. In particular, the camera 210 can include a number of pixels, and each pixel can detect the reflection of the light pulse from a point on the object. Based on a duration it takes for the light pulse to reflect from the object at each point, the vehicle 200 can determine the distance to the points on the object. The light pulse can be a laser pulse. Other range detecting techniques are possible as well, including stereo triangulation, sheet-of-light triangulation, interferometry, and coded aperture techniques, among others. The camera 210 can take other forms as well.
The camera 210 can be mounted inside a front windshield of the vehicle 200. Specifically, as illustrated, the camera 210 can capture images from a forward-looking view with respect to the vehicle 200. Other mounting locations and viewing angles of the camera 210 are possible, either inside or outside the vehicle 200.
The camera 210 can have associated optics that can be operable to provide an adjustable field of view. Further, the camera 210 can be mounted to the vehicle 200 with a movable mount that can be operable to vary a pointing angle of the camera 210.
While the vehicle 308 is in the first autonomous mode, a computer system of the vehicle 308 can obtain sensor data using a sensor unit 310 of the vehicle 308 or any other sensor of the vehicle 308. The sensor data can be indicative of the environment of the vehicle 308 and, accordingly, can represent such aspects of the environment as the roadway, the truck 314 or car 312, and information on the road sign 316. These examples are illustrative only; the sensor data can represent various other aspects of the environment of the vehicle 308.
In addition, when the vehicle 308 is in the first autonomous mode, the vehicle's computer system can compare the map data to the sensor data in order to detect an inadequacy in the map data. In some implementations, the computer system can determine, based on the comparison, whether the difference between the map data and the sensor data exceeds a predetermined threshold. If the difference exceeds the threshold, then the computer system can determine that that the map data is inadequate. In some implementations, the map data can be compared to the sensor data in real-time. In some implementations, the map data can be compared to the sensor data outside real-time.
In response to detecting an inadequacy in the map data, the computer system of the vehicle 308 can control the vehicle 308 in a second autonomous mode, and can provide an indication of an option to switch to a manual mode. The indication can be any suitable indication, such as, for example, a notification by way of a display in a passenger cabin of the vehicle 308, a speaker of the vehicle 308, or a light indicator of the vehicle 308.
Some of the examples above discuss an inadequacy in terms of inadequate map data. An inadequacy can also be found when there is simply no relevant map data for a given area. For example, the vehicle 308 may not receive map data for a given area, or may receive map data that does not include data for the given area.
The vehicle 308 can be navigated based on the additional sensor data. In some implementations, the vehicle 308 can be navigated based on a message that conveys a condition of the environment of the vehicle 308. For example, assume that the road sign 316 includes the message “Construction ahead: reduce speed to 20 MPH.” The computer system of the vehicle 308 can accordingly reduce the speed of the vehicle 308 in accordance with the message on the road sign 316. As another example, the computer system of the vehicle 308 can detect lane boundaries, such as, for example, the boundaries of the lane 302, and can navigate the vehicle 308 to stay in the lane 302. In some implementations, the computer system can navigate the vehicle 308 based on the additional sensor data and without using the map data. In some implementations, the computer system can navigate the vehicle 308 based on a combination of the additional sensor data and the map data. For example, the computer system of the vehicle 308 can use portions of the map data that are sufficiently consistent with the sensor data, and can use the sensor data to the exclusion of the map data when the sensor data and map data are sufficiently different from each other.
In some implementations, when the vehicle 308 is operating in the second autonomous mode, the computer system of the vehicle 308 can take precautions, such as, for example, reducing a speed of the vehicle 308, causing the vehicle 308 to maintain a safer than usual distance from other vehicles, or the like. In this way, the computer system of the vehicle 308 can take measures to enhance the safety of persons, such as on-board passengers, while the computer system waits for a person to respond to the indication of the option to switch to the manual mode. For example, as illustrated by arrow 318, the vehicle 308 has slowed down and backed off from the truck 314. Other implementations for taking precautions in the second autonomous mode are possible.
In some implementations, after the vehicle 308 begins to operate in the second autonomous mode, the computer system of the vehicle 308 can monitor for an inactivity in relation to the option to switch to the manual mode. If the computer system detects such an inactivity, then the computer system can control the vehicle 308 in a third autonomous mode. For example, if the computer system detects that a predetermined period has passed without the vehicle switching to the manual mode, then the computer system can control the vehicle in the third autonomous mode. As another example, the computer system can use sensors that are in or focused on the passenger cabin of the vehicle 308 to determine a condition of an on-board passenger. For instance, a camera in the passenger cabin can be used to determine whether an on-board passenger has moved (or has moved to a sufficient extent) after the indication was provided. In this way, the computer system of the vehicle 308 can detect the inactivity by detecting an inaction in the passenger cabin of the vehicle 308. Other implementations are possible. For example, the computer system can use data from physiological sensors, such as, for example, heart rate monitors, to monitor for an inactivity.
In some implementations, in the third autonomous mode, the computer system of the vehicle 308 can take or can cause the vehicle to take one or more precautious actions in addition to those taken, if any, in the second autonomous mode. As an example of a precautious action, the computer system of the vehicle 308 can immediately stop the vehicle 308, assuming that the computer system determines that it is feasible and safe to do so. As another example of a precautious action, in the third autonomous mode, the computer system can determine a level of safety of parking the vehicle 308 at a location, such as, for example, the shoulder 306 of the roadway. If the computer system determines that the level of safety exceeds a target threshold, then the computer system can cause the vehicle 308 to navigate to the location and park the vehicle 308 at the location, as illustrated by arrow 320. As yet another example of a precautious action, in the third autonomous mode, the computer system of the vehicle 308 can cause the vehicle 308 to follow another vehicle, such as the truck 314, at a safe distance. In this way, the vehicle 308 can take advantage of the behavior of the other vehicle. The vehicle 308 can follow the other vehicle, for example, until the computer system determines that some condition or combination of conditions has been met. For example, the computer system of the vehicle 308 can cause the vehicle 308 to stop following the other vehicle upon a determination that it is no longer safe for the vehicle 308 to continue to follow the other vehicle, upon a determination that following the other vehicle has led or will lead the vehicle 308 sufficiently astray from a target path, or upon a determination of a safe location to park the vehicle 308. As yet another example of a precautious action, in the third autonomous mode, the computer system of the vehicle 308 can enable hazard lights of the vehicle 308 and can reduce the speed of the vehicle 308. As a further example of a precautious action, in the third autonomous mode, the computer system of the vehicle 308 can locate an area to park, for example, by way of a navigation system of the vehicle 308 or a navigation system that is accessible through a communication system of the vehicle 308. The computer system of the vehicle 308 can navigate the vehicle 308 to the area and park the vehicle at the area. As still another example of a precautious action, in the third autonomous mode, the computer system of the vehicle 308 can cause the vehicle 308 to send a message to alert appropriate authorities.
As a further example of a precautious action, in the third autonomous mode, the computer system of the vehicle 308 can continue to navigate the vehicle 308 partially or entirely along a route. The route can be a predetermined route or a route that is generated upon (or after) the vehicle 308 entering the third autonomous mode. For instance, if the computer system is confident in its estimate of the current or future environment of the vehicle 308 based on the sensor data, then the computer system can continue to navigate the vehicle 308 along a route. In some implementations, the computer system can navigate the vehicle 308 partially along the predetermined route, for example, by navigating the vehicle 308 for a certain period of time or for a certain distance. In some implementations, the computer system can navigate the vehicle 308 until the vehicle 308 reaches the destination of the route.
Accordingly, when a person, such as an on-board passenger, does not cause the vehicle 308 to switch from the second autonomous mode to the manual mode, the vehicle 308 can be safely maneuvered and/or parked while the vehicle 308 is in the third autonomous mode. These examples of precautious actions can be implemented together in various combinations. For example, the computer system of the vehicle 308 can turn on hazard lights of the vehicle 308 while the computer system searches for a suitable location to park the vehicle 308. Upon identifying a suitable location to park the vehicle 308, the computer system can turn off the hazard lights and navigate the vehicle 308 to the location. These examples are illustratively only. The vehicle 308 can take (or be caused to take) various other precautious actions in the third autonomous mode; this disclosure contemplates the various other precautious actions.
At block 402, the method 400 includes controlling a vehicle in a first autonomous mode of operation. In the method 400, controlling the vehicle in the first autonomous mode of operation includes navigating the vehicle based on map data. In some implementations, the method 400 can include receiving the map data prior to controlling the vehicle in the first autonomous mode of operation. In some implementations, the map data can be generated prior to controlling the vehicle in the first autonomous mode of operation.
At block 404, the method 400 includes obtaining sensor data using one or more sensors of the vehicle. In the method 400, the sensor data is indicative of an environment of the vehicle.
At block 406, the method 400 includes detecting an inadequacy in the map data. In the method 400, detecting the inadequacy in the map data includes comparing the map data to the sensor data. In some implementations, detecting the inadequacy in the map data includes detecting a difference between the map data and the sensor data. In some implementations, comparing the map data to the sensor data comprises comparing the map data to the sensor data in real-time.
At block 408, the method 400 includes controlling the vehicle in a second autonomous mode of operation and providing an indication of an option to switch to a manual mode of operation, in response to detecting the inadequacy in the map data. Providing the indication can serve to prompt a user to switch to the manual mode of operation. The indication can be provided in various ways. The indication can be provided, for example, by way of any device or system that is provided in connection with the vehicle, such as, for example, any combination of one or more displays (such as a touch-screen display), speakers, indicator lights, and navigation systems. These examples are merely illustrative; the indication can be provided in various other ways. For example, the indication can be provided by way of a mobile device, such as a mobile phone, that is in wireless communication with the vehicle.
In the method 400, controlling the vehicle in the second autonomous mode of operation includes obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data. In some implementations, navigating the vehicle based on the additional sensor data comprises navigating the vehicle without using the map data. In some implementations, the additional sensor data can be indicative of a lane boundary, and navigating the vehicle based on the additional sensor data can include navigating the vehicle based on the lane boundary. In some implementations, the additional sensor data can be indicative of a position of a second vehicle, and navigating the vehicle based on the additional sensor data can include navigating the vehicle based on the position of the second vehicle. In some implementations, the additional sensor data can be indicative of a traffic sign. The traffic sign can present a condition of an environment of the vehicle. Navigating the vehicle based on the additional sensor data can include navigating the vehicle based on the condition.
In some implementations, the method 400 can include detecting an inactivity when the vehicle is in the second autonomous mode of operation. The inactivity can relate to the option to switch to the manual mode of operation. In some implementations, detecting the inactivity can include receiving information that is indicative of a condition in a passenger cabin of the vehicle, and detecting the inactivity based on the information. In some implementations, detecting the inactivity can include detecting an inaction in a passenger cabin of the vehicle. The method 400 can include controlling the vehicle in a third autonomous mode of operation, in response to detecting the inadequacy in the map data. Controlling the vehicle in the third autonomous mode of operation can include obtaining further sensor data using the one or more sensors of the vehicle, and navigating the vehicle based on the further sensor data. In some implementations, navigating the vehicle based on the further sensor data can include determining a level of safety of parking the vehicle at a location, determining that the level of safety exceeds a target threshold, and in response to determining that the level of safety exceeds the target threshold, parking the vehicle at the location. In some implementations, navigating the vehicle based on the further sensor data can include navigating the vehicle without using the map data.
The method 400 of FIG. 4 , as well as other methods in the scope of this disclosure, can be carried out in whole or in part by a vehicle and its subsystems. In some implementations, the method 400 can be implemented in whole or in part by one or more computing devices. For example, the method 400 can be implemented in whole or in part by a server system, which receives data from a device that is associated with a vehicle. Other examples of computing devices or combinations of computing devices that can implement the method 400 are possible.
In some implementations, the method 400, as well as other methods in the scope of this disclosure, can be implemented as computer program instructions encoded on a non-transitory computer-readable storage media in a machine-readable format, or on other non-transitory media or articles of manufacture.
The one or more programming instructions 504 can be, for example, computer executable and/or logic implemented instructions. In some examples, a computing device such as the computer system 112 of FIG. 1 can be configured to provide various operations, functions, or actions in response to the programming instructions 504 conveyed to the computer system 112 by one or more of the computer readable medium 506, the computer recordable medium 508, and/or the communications medium 510.
The non-transitory computer readable medium can also be distributed among multiple data storage elements, which can be remotely located from each other. The computing device that executes some or all of the stored instructions can be a vehicle, such as the vehicle 200 illustrated in FIG. 2 . Alternatively, the computing device that executes some or all of the stored instructions can be another computing device, such as a server.
The above detailed description describes various features and functions of the disclosed systems, devices, and methods with reference to the accompanying figures. While various aspects and implementations have been disclosed herein, other aspects and implementations are possible. The various aspects and implementations disclosed herein are for purposes of illustration and are not intended to be limiting, with the true scope and spirit being indicated by the following claims.
Claims (40)
1. A method comprising:
controlling a vehicle in a first autonomous mode of operation, wherein controlling the vehicle in the first autonomous mode of operation comprises navigating the vehicle based on map data;
obtaining sensor data using one or more sensors of the vehicle, wherein the sensor data is indicative of an environment of the vehicle;
detecting an inadequacy in the map data, wherein detecting the inadequacy in the map data comprises comparing the map data to the sensor data; and
in response to detecting the inadequacy in the map data, controlling the vehicle in a second autonomous mode of operation, wherein controlling the vehicle in the second autonomous mode of operation comprises obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data.
2. The method of claim 1 , wherein the map data includes one or more of traffic conditions, road conditions, route information, and positioning information.
3. The method of claim 1 , wherein detecting the inadequacy in the map data comprises comparing the map data and the sensor data to determine whether a difference between the map data and the sensor data exceeds a predetermined threshold.
4. The method of claim 1 , wherein the additional sensor data is indicative of a lane boundary, and wherein navigating the vehicle based on the additional sensor data comprises navigating the vehicle based on the lane boundary.
5. The method of claim 1 , wherein the additional sensor data is indicative of a position of a second vehicle, and wherein navigating the vehicle based on the additional sensor data comprises navigating the vehicle based on the position of the second vehicle.
6. The method of claim 5 , wherein navigating the vehicle based on the further sensor data comprises increasing a distance between the vehicle and the second vehicle.
7. The method of claim 1 , wherein the additional sensor data is indicative of a traffic sign, wherein the traffic sign presents a textual message, and wherein navigating the vehicle based on the additional sensor data comprises navigating the vehicle based on the textual message.
8. The method of claim 1 , further comprising:
providing an indication of an option to switch to a manual mode of operation, wherein the indication of an option to switch to a manual mode of operation is provided by one or more of a display, a speaker, an indicator light and a mobile device in wireless communication with the vehicle;
detecting an inactivity when the vehicle is in the second autonomous mode of operation, wherein the inactivity relates to the option to switch to the manual mode of operation; and
in response to detecting the inactivity, controlling the vehicle in a third autonomous mode of operation.
9. The method of claim 8 , wherein detecting the inactivity comprises:
receiving information that is indicative of a movement of an on-board passenger in the vehicle; and
detecting the inactivity based on the information.
10. The method of claim 8 , wherein controlling the vehicle in the third autonomous mode of operation comprises:
obtaining further sensor data using the one or more sensors of the vehicle, and
navigating the vehicle based on the further sensor data.
11. The method of claim 10 , wherein navigating the vehicle based on the further sensor data comprises:
determining a level of safety of parking the vehicle at a location;
determining that the level of safety exceeds a target threshold; and
in response to determining that the level of safety exceeds the target threshold, parking the vehicle at the location.
12. The method of claim 10 , wherein navigating the vehicle based on the further sensor data comprises enabling hazard lights of the vehicle and reducing a speed of the vehicle.
13. A vehicle comprising:
one or more sensors; and
a controller configured to:
receive first sensor data from the one or more sensors, wherein the first sensor data is indicative of an environment of the vehicle when the vehicle is in a first autonomous mode of operation;
receive second sensor data from the one or more sensors, wherein the second sensor data is indicative of an environment of the vehicle when the vehicle is in a second autonomous mode of operation;
control the vehicle in the first autonomous mode of operation by at least navigating the vehicle based on map data;
detect an inadequacy in the map data by at least comparing the map data to the first sensor data; and
in response to detecting the inadequacy in the map data, control the vehicle in the second autonomous mode of operation by at least navigating the vehicle based on the second sensor data.
14. The vehicle of claim 13 , wherein the additional sensor data is indicative of a traffic sign, wherein the traffic sign presents a textual message, and wherein navigating the vehicle based on the additional sensor data comprises navigating the vehicle based on the textual message.
15. The vehicle of claim 13 , wherein the controller is further configured to:
provide an indication of an option to switch to a manual mode of operation, wherein the indication of an option to switch to a manual mode of operation is provided by one or more of a display, a speaker, an indicator light and a mobile device in wireless communication with the vehicle;
detect an inactivity when the vehicle is in the second autonomous mode of operation, wherein the inactivity relates to the option to switch to the manual mode of operation; and
in response to detecting the inactivity, control the vehicle in a third autonomous mode of operation by at least causing one or more precautious actions to be performed.
16. The vehicle of claim 15 , wherein the one or more precautious actions comprises one or more of parking the vehicle, causing the vehicle to follow another vehicle, reducing a speed of the vehicle, navigating the vehicle along at least a part of a route, sending an alert message, and enabling one or more hazard lights of the vehicle.
17. The vehicle of claim 13 , wherein the one or more sensors comprise one or more of a camera, a radar system, a LIDAR system, a global positioning system, and an inertial measurement unit.
18. A non-transitory computer-readable storage medium having stored thereon instructions, that when executed by a computing device, cause the computing device to carry out functions comprising:
controlling a vehicle in a first autonomous mode of operation, wherein controlling the vehicle in the first autonomous mode of operation comprises navigating the vehicle based on map data;
obtaining sensor data using one or more sensors of the vehicle, wherein the sensor data is indicative of an environment of the vehicle;
detecting an inadequacy in the map data, wherein detecting the inadequacy in the map data comprises comparing the map data to the sensor data; and
in response to detecting the inadequacy in the map data, controlling the vehicle in a second autonomous mode of operation, wherein controlling the vehicle in the second autonomous mode of operation comprises obtaining additional sensor data using the one or more sensors of the vehicle and navigating the vehicle based on the additional sensor data.
19. The non-transitory computer-readable storage medium of claim 18 , wherein the functions further comprise:
providing an indication of an option to switch to a manual mode of operation, wherein the indication of an option to switch to a manual mode of operation is provided by one or more of a display, a speaker, an indicator light and a mobile device in wireless communication with the vehicle;
detecting an inactivity when the vehicle is in the second autonomous mode of operation, wherein the inactivity relates to the option to switch to the manual mode of operation; and
in response to detecting the inactivity, controlling the vehicle in a third autonomous mode of operation.
20. The non-transitory computer-readable storage medium of claim 18 , wherein the additional sensor data is indicative of a traffic sign, wherein the traffic sign presents a textual message, and wherein navigating the vehicle based on the additional sensor data comprises navigating the vehicle based on the textual message.
21. A method, comprising:
controlling a vehicle in a first autonomous mode, wherein controlling the vehicle in the first autonomous mode comprises controlling the vehicle based on map data;
detecting an inadequacy in the map data, wherein detecting the inadequacy in the map data comprises determining there is no relevant map data for a given area; and
in response to detecting the inadequacy in the map data, controlling the vehicle in a second autonomous mode, wherein controlling the vehicle in the second autonomous mode comprises transitioning to a manual mode of operation.
22. The method of claim 21, further comprising obtaining sensor data indicative of an environment of the vehicle, wherein the sensor data comprises data provided by one or more of a camera, a radar system, and a LIDAR system, and wherein controlling the vehicle in the second autonomous mode comprises controlling the vehicle based at least in part on the sensor data.
23. The method of claim 21, wherein transitioning to the manual mode of operation comprises:
providing an indication of an option to switch to the manual mode of operation, wherein the indication of an option to switch to the manual mode of operation is provided by one or more of a display, a speaker, an indicator light and a mobile device in wireless communication with the vehicle; and
detecting an inactivity when the vehicle is in the second autonomous mode of operation, wherein the inactivity relates to the option to switch to the manual mode of operation;
the method further comprising, in response to detecting the inactivity, controlling the vehicle in a third autonomous mode of operation.
24. The method of claim 23, wherein detecting the inactivity comprises:
receiving information that is indicative of a movement of an on-board passenger in the vehicle; and
detecting the inactivity based on the information.
25. The method of claim 23, wherein controlling the vehicle in the third autonomous mode of operation comprises:
obtaining-sensor data using one or more sensors of the vehicle, and
controlling the vehicle based on the sensor data.
26. The method of claim 25, wherein controlling the vehicle based on the sensor data comprises enabling hazard lights of the vehicle and reducing a speed of the vehicle.
27. The method of claim 21, wherein controlling the vehicle in the second autonomous mode comprises maintaining a predetermined distance from other vehicles/objects in a vicinity of the vehicle.
28. The method of claim 21, further comprising operating the vehicle in the second autonomous mode until the computer system determines that some predetermined condition is met.
29. A vehicle comprising:
one or more sensors; and
a controller configured to:
control a vehicle in a first autonomous mode, wherein controlling the vehicle in the first autonomous mode comprises controlling the vehicle based on map data
detect an inadequacy in the map data, wherein detecting the inadequacy in the map data comprises determining there is no relevant map data for a given area; and
in response to detecting the inadequacy in the map data, control the vehicle in a second autonomous mode, wherein controlling the vehicle in the second autonomous mode comprises transitioning to a manual mode of operation.
30. The vehicle of claim 29, wherein the one or more sensors comprise one or more of a camera, a radar system, and a LIDAR system.
31. The vehicle of claim 29, wherein transitioning to the manual mode of operation comprises:
providing an indication of an option to switch to the manual mode of operation, wherein the indication of an option to switch to the manual mode of operation is provided by one or more of a display, a speaker, an indicator light and a mobile device in wireless communication with the vehicle; and
detecting an inactivity when the vehicle is in the second autonomous mode of operation, wherein the inactivity relates to the option to switch to the manual mode of operation;
wherein the controller is further configure to, in response to detecting the inactivity, control the vehicle in a third autonomous mode of operation.
32. A non-transitory computer-readable storage medium having stored thereon instructions, that when executed by a computing device, cause the computing device to carry out functions comprising:
controlling a vehicle in a first autonomous mode, wherein controlling the vehicle in the first autonomous mode comprises controlling the vehicle based on map data;
detecting an inadequacy in the map data, wherein detecting the inadequacy in the map data comprises determining there is no relevant map data for a given area; and
in response to detecting the inadequacy in the map data, controlling the vehicle in a second autonomous mode, wherein controlling the vehicle in the second autonomous mode comprises transitioning to a manual mode of operation.
33. The non-transitory computer-readable storage medium of claim 32, wherein transitioning to the manual mode of operation comprises:
providing an indication of an option to switch to the manual mode of operation, wherein the indication of an option to switch to the manual mode of operation is provided by one or more of a display, a speaker, an indicator light and a mobile device in wireless communication with the vehicle; and
detecting an inactivity when the vehicle is in the second autonomous mode of operation, wherein the inactivity relates to the option to switch to the manual mode of operation, and wherein detecting the inactivity comprises receiving information that is indicative of a movement of an on-board passenger in the vehicle and detecting the inactivity based on the information;
wherein the functions further comprise, in response to detecting the inactivity, controlling the vehicle in a third autonomous mode of operation.
34. The non-transitory computer-readable storage medium of claim 33, wherein controlling the vehicle in the third autonomous mode of operation comprises:
obtaining sensor data using one or more sensors of the vehicle, and
controlling the vehicle based on the sensor data.
35. The non-transitory computer-readable storage medium of claim 34, wherein controlling the vehicle based on the sensor data comprises enabling hazard lights of the vehicle and reducing a speed of the vehicle.
36. The non-transitory computer-readable storage medium of claim 34, wherein controlling the vehicle based on the sensor data comprises increasing a distance between the vehicle and a second vehicle.
37. The non-transitory computer-readable storage medium of claim 32, further comprising operating the vehicle in the second autonomous mode until the computer system determines that some predetermined condition is met.
38. The method of claim 21, wherein transitioning to the manual mode of operation comprises:
providing an indication of an option to switch to the manual mode of operation, wherein the indication of an option to switch to the manual mode of operation is provided by one or more of a display, a speaker, an indicator light and a mobile device in wireless communication with the vehicle; and
receiving an input from an on-board passenger of the vehicle.
39. The method of claim 21, wherein transitioning to the manual mode of operation comprises:
providing an indication of an option to switch to the manual mode of operation; and
causing the vehicle to switch to the manual mode of operation.
40. The vehicle of claim 29, further comprising a touchscreen having a user interface, wherein transitioning to the manual mode of operation comprises:
providing, via the touchscreen, an indication of an option to switch to the manual mode of operation; and
receiving, via the user interface of the touchscreen, an input from an on-board passenger of the vehicle.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/367,122 USRE47058E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US16/110,050 US20180364734A1 (en) | 2012-05-07 | 2018-08-23 | Controlling a Vehicle Having Inadequate Map Data |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/465,348 US8521352B1 (en) | 2012-05-07 | 2012-05-07 | Controlling a vehicle having inadequate map data |
US13/943,867 US8676430B1 (en) | 2012-05-07 | 2013-07-17 | Controlling a vehicle having inadequate map data |
US14/164,565 US8903591B1 (en) | 2012-05-07 | 2014-01-27 | Controlling a vehicle having inadequate map data |
US15/367,122 USRE47058E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/164,565 Reissue US8903591B1 (en) | 2012-05-07 | 2014-01-27 | Controlling a vehicle having inadequate map data |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/110,050 Continuation US20180364734A1 (en) | 2012-05-07 | 2018-08-23 | Controlling a Vehicle Having Inadequate Map Data |
Publications (1)
Publication Number | Publication Date |
---|---|
USRE47058E1 true USRE47058E1 (en) | 2018-09-25 |
Family
ID=48999826
Family Applications (9)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/465,348 Active US8521352B1 (en) | 2012-05-07 | 2012-05-07 | Controlling a vehicle having inadequate map data |
US13/943,867 Active US8676430B1 (en) | 2012-05-07 | 2013-07-17 | Controlling a vehicle having inadequate map data |
US14/164,565 Ceased US8903591B1 (en) | 2012-05-07 | 2014-01-27 | Controlling a vehicle having inadequate map data |
US15/367,127 Active USRE46972E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US15/367,115 Active USRE46982E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US15/367,118 Active USRE46966E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US15/367,122 Active USRE47058E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US15/367,112 Active USRE47002E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US16/110,050 Abandoned US20180364734A1 (en) | 2012-05-07 | 2018-08-23 | Controlling a Vehicle Having Inadequate Map Data |
Family Applications Before (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/465,348 Active US8521352B1 (en) | 2012-05-07 | 2012-05-07 | Controlling a vehicle having inadequate map data |
US13/943,867 Active US8676430B1 (en) | 2012-05-07 | 2013-07-17 | Controlling a vehicle having inadequate map data |
US14/164,565 Ceased US8903591B1 (en) | 2012-05-07 | 2014-01-27 | Controlling a vehicle having inadequate map data |
US15/367,127 Active USRE46972E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US15/367,115 Active USRE46982E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US15/367,118 Active USRE46966E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/367,112 Active USRE47002E1 (en) | 2012-05-07 | 2016-12-01 | Controlling a vehicle having inadequate map data |
US16/110,050 Abandoned US20180364734A1 (en) | 2012-05-07 | 2018-08-23 | Controlling a Vehicle Having Inadequate Map Data |
Country Status (1)
Country | Link |
---|---|
US (9) | US8521352B1 (en) |
Families Citing this family (149)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2760724C (en) | 2009-05-01 | 2017-01-24 | The University Of Sydney | Control system for autonomous operation |
EA201171337A1 (en) | 2009-05-01 | 2012-05-30 | Дзе Юниверсити Оф Сидней | COMPLEX AUTOMATED SYSTEM |
AP2011006008A0 (en) * | 2009-05-01 | 2011-12-31 | Univ Sydney | Integrated automation system with picture compilation system. |
US9760092B2 (en) | 2012-03-16 | 2017-09-12 | Waymo Llc | Actively modifying a field of view of an autonomous vehicle in view of constraints |
WO2013188911A1 (en) | 2012-06-18 | 2013-12-27 | The University Of Sydney | Systems and methods for processing geophysical data |
US8838322B1 (en) * | 2012-08-14 | 2014-09-16 | Google Inc. | System to automatically measure perception sensor latency in an autonomous vehicle |
US8996228B1 (en) * | 2012-09-05 | 2015-03-31 | Google Inc. | Construction zone object detection using light detection and ranging |
US9056395B1 (en) * | 2012-09-05 | 2015-06-16 | Google Inc. | Construction zone sign detection using light detection and ranging |
US9221396B1 (en) | 2012-09-27 | 2015-12-29 | Google Inc. | Cross-validating sensors of an autonomous vehicle |
US20140297168A1 (en) * | 2013-03-26 | 2014-10-02 | Ge Aviation Systems Llc | Method of optically locating and guiding a vehicle relative to an airport |
US8954205B2 (en) * | 2013-06-01 | 2015-02-10 | Savari, Inc. | System and method for road side equipment of interest selection for active safety applications |
US9310804B1 (en) | 2013-11-21 | 2016-04-12 | Google Inc. | Use of prior maps for estimation of lane boundaries |
US9499139B2 (en) | 2013-12-05 | 2016-11-22 | Magna Electronics Inc. | Vehicle monitoring system |
US9037337B1 (en) * | 2013-12-13 | 2015-05-19 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Secondary sources of navigation data for improved control of an automonous vehicle |
WO2015100483A1 (en) | 2014-01-06 | 2015-07-09 | Geodigital International Inc. | Determining portions of a roadway model requiring updating |
US9666069B2 (en) * | 2014-02-14 | 2017-05-30 | Ford Global Technologies, Llc | Autonomous vehicle handling and performance adjustment |
US9465388B1 (en) | 2014-03-03 | 2016-10-11 | Google Inc. | Remote assistance for an autonomous vehicle in low confidence situations |
US9720410B2 (en) * | 2014-03-03 | 2017-08-01 | Waymo Llc | Remote assistance for autonomous vehicles in predetermined situations |
US9436182B2 (en) | 2014-05-23 | 2016-09-06 | Google Inc. | Autonomous vehicles |
US9631933B1 (en) | 2014-05-23 | 2017-04-25 | Google Inc. | Specifying unavailable locations for autonomous vehicles |
JP6201927B2 (en) * | 2014-08-01 | 2017-09-27 | トヨタ自動車株式会社 | Vehicle control device |
GB201419883D0 (en) | 2014-11-07 | 2014-12-24 | F Robotics Acquisitions Ltd | Domestic robotic system and method |
US10451425B2 (en) * | 2014-12-05 | 2019-10-22 | Apple Inc. | Autonomous navigation system |
US10216196B2 (en) | 2015-02-01 | 2019-02-26 | Prosper Technology, Llc | Methods to operate autonomous vehicles to pilot vehicles in groups or convoys |
US9139199B2 (en) | 2015-02-01 | 2015-09-22 | Thomas Danaher Harvey | Methods for dense parking of remotely controlled or autonomous vehicles |
WO2016126321A1 (en) | 2015-02-06 | 2016-08-11 | Delphi Technologies, Inc. | Method and apparatus for controlling an autonomous vehicle |
US20180012492A1 (en) | 2015-02-06 | 2018-01-11 | Delphi Technologies, Inc. | Method of automatically controlling an autonomous vehicle based on electronic messages from roadside infrastructure or other vehicles |
US9616773B2 (en) | 2015-05-11 | 2017-04-11 | Uber Technologies, Inc. | Detecting objects within a vehicle in connection with a service |
CA2985539C (en) * | 2015-05-13 | 2023-04-04 | Uber Technologies, Inc. | Autonomous vehicle operated with guide assistance |
US9494439B1 (en) | 2015-05-13 | 2016-11-15 | Uber Technologies, Inc. | Autonomous vehicle operated with guide assistance of human driven vehicles |
US10345809B2 (en) * | 2015-05-13 | 2019-07-09 | Uber Technologies, Inc. | Providing remote assistance to an autonomous vehicle |
US9547309B2 (en) | 2015-05-13 | 2017-01-17 | Uber Technologies, Inc. | Selecting vehicle type for providing transport |
DE102015007531B3 (en) | 2015-06-11 | 2016-09-01 | Audi Ag | Method for traffic control in a parking environment |
US9733096B2 (en) | 2015-06-22 | 2017-08-15 | Waymo Llc | Determining pickup and destination locations for autonomous vehicles |
US9869560B2 (en) | 2015-07-31 | 2018-01-16 | International Business Machines Corporation | Self-driving vehicle's response to a proximate emergency vehicle |
US9785145B2 (en) | 2015-08-07 | 2017-10-10 | International Business Machines Corporation | Controlling driving modes of self-driving vehicles |
US9483948B1 (en) | 2015-08-07 | 2016-11-01 | International Business Machines Corporation | Automated control of interactions between self-driving vehicles and pedestrians |
US9721397B2 (en) | 2015-08-11 | 2017-08-01 | International Business Machines Corporation | Automatic toll booth interaction with self-driving vehicles |
US9718471B2 (en) | 2015-08-18 | 2017-08-01 | International Business Machines Corporation | Automated spatial separation of self-driving vehicles from manually operated vehicles |
US9481366B1 (en) | 2015-08-19 | 2016-11-01 | International Business Machines Corporation | Automated control of interactions between self-driving vehicles and animals |
US9896100B2 (en) | 2015-08-24 | 2018-02-20 | International Business Machines Corporation | Automated spatial separation of self-driving vehicles from other vehicles based on occupant preferences |
US9731726B2 (en) | 2015-09-02 | 2017-08-15 | International Business Machines Corporation | Redirecting self-driving vehicles to a product provider based on physiological states of occupants of the self-driving vehicles |
US9513632B1 (en) | 2015-09-16 | 2016-12-06 | International Business Machines Corporation | Driving mode alerts from self-driving vehicles |
US10139828B2 (en) | 2015-09-24 | 2018-11-27 | Uber Technologies, Inc. | Autonomous vehicle operated with safety augmentation |
US9566986B1 (en) | 2015-09-25 | 2017-02-14 | International Business Machines Corporation | Controlling driving modes of self-driving vehicles |
JP6567376B2 (en) * | 2015-09-25 | 2019-08-28 | パナソニック株式会社 | apparatus |
US9937922B2 (en) * | 2015-10-06 | 2018-04-10 | Ford Global Technologies, Llc | Collision avoidance using auditory data augmented with map data |
US9481367B1 (en) | 2015-10-14 | 2016-11-01 | International Business Machines Corporation | Automated control of interactions between self-driving vehicles and animals |
US9834224B2 (en) | 2015-10-15 | 2017-12-05 | International Business Machines Corporation | Controlling driving modes of self-driving vehicles |
US9944291B2 (en) | 2015-10-27 | 2018-04-17 | International Business Machines Corporation | Controlling driving modes of self-driving vehicles |
JP6761426B2 (en) * | 2015-10-27 | 2020-09-23 | 株式会社小糸製作所 | Vehicle lighting, vehicle systems and vehicles |
US9751532B2 (en) | 2015-10-27 | 2017-09-05 | International Business Machines Corporation | Controlling spacing of self-driving vehicles based on social network relationships |
US10607293B2 (en) | 2015-10-30 | 2020-03-31 | International Business Machines Corporation | Automated insurance toggling for self-driving vehicles |
US9513629B1 (en) * | 2015-10-30 | 2016-12-06 | Sony Mobile Communications, Inc. | Methods and devices for heart rate controlled drones |
US10176525B2 (en) | 2015-11-09 | 2019-01-08 | International Business Machines Corporation | Dynamically adjusting insurance policy parameters for a self-driving vehicle |
US9791861B2 (en) | 2015-11-12 | 2017-10-17 | International Business Machines Corporation | Autonomously servicing self-driving vehicles |
WO2017087984A1 (en) | 2015-11-20 | 2017-05-26 | Uber Technologies, Inc. | Controlling autonomous vehicles in connection with transport services |
TW201718297A (en) * | 2015-11-27 | 2017-06-01 | 鴻海精密工業股份有限公司 | System and method for switching driving mode of vehicle |
US10061326B2 (en) | 2015-12-09 | 2018-08-28 | International Business Machines Corporation | Mishap amelioration based on second-order sensing by a self-driving vehicle |
US10712160B2 (en) | 2015-12-10 | 2020-07-14 | Uatc, Llc | Vehicle traction map for autonomous vehicles |
US9840256B1 (en) | 2015-12-16 | 2017-12-12 | Uber Technologies, Inc. | Predictive sensor array configuration system for an autonomous vehicle |
US9841763B1 (en) | 2015-12-16 | 2017-12-12 | Uber Technologies, Inc. | Predictive sensor array configuration system for an autonomous vehicle |
US9625264B1 (en) * | 2016-01-20 | 2017-04-18 | Denso Corporation | Systems and methods for displaying route information |
JP6508072B2 (en) | 2016-01-26 | 2019-05-08 | 株式会社デンソー | Notification control apparatus and notification control method |
US9836973B2 (en) | 2016-01-27 | 2017-12-05 | International Business Machines Corporation | Selectively controlling a self-driving vehicle's access to a roadway |
US10901431B1 (en) * | 2017-01-19 | 2021-01-26 | AI Incorporated | System and method for guiding heading of a mobile robotic device |
US10386847B1 (en) * | 2016-02-19 | 2019-08-20 | AI Incorporated | System and method for guiding heading of a mobile robotic device |
US11726490B1 (en) | 2016-02-19 | 2023-08-15 | AI Incorporated | System and method for guiding heading of a mobile robotic device |
US9990548B2 (en) | 2016-03-09 | 2018-06-05 | Uber Technologies, Inc. | Traffic signal analysis system |
JP2017182463A (en) * | 2016-03-30 | 2017-10-05 | パイオニア株式会社 | Driving control device, driving control method, program for driving control, and recording medium |
US10317900B2 (en) * | 2016-05-13 | 2019-06-11 | GM Global Technology Operations LLC | Controlling autonomous-vehicle functions and output based on occupant position and attention |
US10685391B2 (en) | 2016-05-24 | 2020-06-16 | International Business Machines Corporation | Directing movement of a self-driving vehicle based on sales activity |
WO2017205822A1 (en) | 2016-05-27 | 2017-11-30 | Uber Technologies, Inc. | Facilitating rider pick-up for a self-driving vehicle |
WO2017210222A1 (en) * | 2016-05-30 | 2017-12-07 | Faraday&Future Inc. | Generating and fusing traffic scenarios for automated driving systems |
EP3468469A4 (en) | 2016-06-13 | 2020-02-19 | Xevo Inc. | Method and system for providing behavior of vehicle operator using virtuous cycle |
WO2018006082A2 (en) * | 2016-07-01 | 2018-01-04 | Uber Technologies, Inc. | Autonomous vehicle control using submaps |
US10739786B2 (en) | 2016-07-01 | 2020-08-11 | Uatc, Llc | System and method for managing submaps for controlling autonomous vehicles |
US10438493B2 (en) | 2016-08-24 | 2019-10-08 | Uber Technologies, Inc. | Hybrid trip planning for autonomous vehicles |
US10093322B2 (en) | 2016-09-15 | 2018-10-09 | International Business Machines Corporation | Automatically providing explanations for actions taken by a self-driving vehicle |
US10643256B2 (en) | 2016-09-16 | 2020-05-05 | International Business Machines Corporation | Configuring a self-driving vehicle for charitable donations pickup and delivery |
US10452068B2 (en) * | 2016-10-17 | 2019-10-22 | Uber Technologies, Inc. | Neural network system for autonomous vehicle control |
US10296001B2 (en) | 2016-10-27 | 2019-05-21 | Uber Technologies, Inc. | Radar multipath processing |
US11623647B2 (en) * | 2016-10-27 | 2023-04-11 | Toyota Motor Engineering & Manufacturing North America, Inc. | Driver and vehicle monitoring feedback system for an autonomous vehicle |
US10726640B2 (en) | 2016-11-15 | 2020-07-28 | At&T Mobility Ii Llc | Facilitation of smart communications hub to support driverless vehicles in 5G networks or other next generation networks |
US11402850B2 (en) | 2016-12-09 | 2022-08-02 | Diversey, Inc. | Robotic cleaning device with operating speed variation based on environment |
WO2018119423A1 (en) * | 2016-12-22 | 2018-06-28 | Surround. Io Corporation | Method and system for providing artificial intelligence analytic (aia) services for performance prediction |
DE102017200072A1 (en) * | 2017-01-04 | 2018-07-05 | Robert Bosch Gmbh | Method for validating a digital map for a vehicle |
US10259452B2 (en) | 2017-01-04 | 2019-04-16 | International Business Machines Corporation | Self-driving vehicle collision management system |
US10363893B2 (en) | 2017-01-05 | 2019-07-30 | International Business Machines Corporation | Self-driving vehicle contextual lock control system |
US10529147B2 (en) | 2017-01-05 | 2020-01-07 | International Business Machines Corporation | Self-driving vehicle road safety flare deploying system |
JP6678776B2 (en) * | 2017-01-17 | 2020-04-08 | 株式会社日立製作所 | Travel control device for moving objects |
US10254121B2 (en) * | 2017-01-23 | 2019-04-09 | Uber Technologies, Inc. | Dynamic routing for self-driving vehicles |
DE102017203022A1 (en) | 2017-02-24 | 2018-08-30 | Bayerische Motoren Werke Aktiengesellschaft | System and method for the safe and efficient provision of at least semi-autonomous driving modes |
US10152060B2 (en) | 2017-03-08 | 2018-12-11 | International Business Machines Corporation | Protecting contents of a smart vault being transported by a self-driving vehicle |
US10124688B2 (en) * | 2017-03-08 | 2018-11-13 | Toyota Research Institute, Inc. | Systems and methods for rendezvousing with an autonomous modular vehicle to provide energy |
US20180328745A1 (en) * | 2017-05-09 | 2018-11-15 | Uber Technologies, Inc. | Coverage plan generation and implementation |
US10942525B2 (en) | 2017-05-09 | 2021-03-09 | Uatc, Llc | Navigational constraints for autonomous vehicles |
JP6867483B2 (en) * | 2017-06-07 | 2021-04-28 | 日立Astemo株式会社 | Vehicle control unit |
US10761542B1 (en) | 2017-07-11 | 2020-09-01 | Waymo Llc | Methods and systems for keeping remote assistance operators alert |
JP7003464B2 (en) * | 2017-07-11 | 2022-01-20 | 株式会社デンソー | Vehicle control device, vehicle control method |
JP6984232B2 (en) | 2017-08-25 | 2021-12-17 | トヨタ自動車株式会社 | Autonomous driving device |
JP6780611B2 (en) | 2017-08-25 | 2020-11-04 | トヨタ自動車株式会社 | Autonomous driving device |
JP6922582B2 (en) * | 2017-09-15 | 2021-08-18 | トヨタ自動車株式会社 | Travel control device, travel control system, and travel control method |
US10293489B1 (en) * | 2017-12-15 | 2019-05-21 | Ankobot (Shanghai) Smart Technologies Co., Ltd. | Control method and system, and cleaning robot using the same |
US10989538B2 (en) | 2017-12-15 | 2021-04-27 | Uatc, Llc | IMU data offset compensation for an autonomous vehicle |
US11084490B2 (en) | 2018-04-11 | 2021-08-10 | Hyundai Motor Company | Apparatus and method for controlling drive of vehicle |
EP3552902A1 (en) | 2018-04-11 | 2019-10-16 | Hyundai Motor Company | Apparatus and method for providing a driving path to a vehicle |
US11077854B2 (en) | 2018-04-11 | 2021-08-03 | Hyundai Motor Company | Apparatus for controlling lane change of vehicle, system having the same and method thereof |
EP3552901A3 (en) | 2018-04-11 | 2020-04-29 | Hyundai Motor Company | Apparatus and method for providing safety strategy in vehicle |
US11173910B2 (en) | 2018-04-11 | 2021-11-16 | Hyundai Motor Company | Lane change controller for vehicle system including the same, and method thereof |
US11597403B2 (en) | 2018-04-11 | 2023-03-07 | Hyundai Motor Company | Apparatus for displaying driving state of vehicle, system including the same and method thereof |
US10843710B2 (en) | 2018-04-11 | 2020-11-24 | Hyundai Motor Company | Apparatus and method for providing notification of control authority transition in vehicle |
US11334067B2 (en) | 2018-04-11 | 2022-05-17 | Hyundai Motor Company | Apparatus and method for providing safety strategy in vehicle |
EP3552913B1 (en) | 2018-04-11 | 2021-08-18 | Hyundai Motor Company | Apparatus and method for controlling to enable autonomous system in vehicle |
US10836394B2 (en) | 2018-04-11 | 2020-11-17 | Hyundai Motor Company | Apparatus and method for lane change control |
US11351989B2 (en) | 2018-04-11 | 2022-06-07 | Hyundai Motor Company | Vehicle driving controller, system including the same, and method thereof |
EP3569460B1 (en) | 2018-04-11 | 2024-03-20 | Hyundai Motor Company | Apparatus and method for controlling driving in vehicle |
US11084491B2 (en) * | 2018-04-11 | 2021-08-10 | Hyundai Motor Company | Apparatus and method for providing safety strategy in vehicle |
US11548509B2 (en) | 2018-04-11 | 2023-01-10 | Hyundai Motor Company | Apparatus and method for controlling lane change in vehicle |
US11334753B2 (en) | 2018-04-30 | 2022-05-17 | Uatc, Llc | Traffic signal state classification for autonomous vehicles |
JP6985207B2 (en) | 2018-05-09 | 2021-12-22 | トヨタ自動車株式会社 | Autonomous driving system |
US11287816B2 (en) | 2018-06-11 | 2022-03-29 | Uatc, Llc | Navigational constraints for autonomous vehicles |
US11099561B1 (en) * | 2018-06-19 | 2021-08-24 | Zoox, Inc. | Control of an autonomous vehicle in unmapped regions |
US10909866B2 (en) | 2018-07-20 | 2021-02-02 | Cybernet Systems Corp. | Autonomous transportation system and methods |
US11699207B2 (en) | 2018-08-20 | 2023-07-11 | Waymo Llc | Camera assessment techniques for autonomous vehicles |
US11227409B1 (en) | 2018-08-20 | 2022-01-18 | Waymo Llc | Camera assessment techniques for autonomous vehicles |
US11068724B2 (en) * | 2018-10-11 | 2021-07-20 | Baidu Usa Llc | Deep learning continuous lane lines detection system for autonomous vehicles |
JP7107155B2 (en) | 2018-10-17 | 2022-07-27 | トヨタ自動車株式会社 | vehicle controller |
EP3647728B1 (en) | 2018-11-05 | 2023-06-21 | Toyota Jidosha Kabushiki Kaisha | Map information system |
US10533862B1 (en) * | 2018-11-28 | 2020-01-14 | Uber Technologies, Inc. | Biasing map matched trajectories based on planned route information |
US11287266B2 (en) | 2019-03-13 | 2022-03-29 | Here Global B.V. | Maplets for maintaining and updating a self-healing high definition map |
US11280622B2 (en) | 2019-03-13 | 2022-03-22 | Here Global B.V. | Maplets for maintaining and updating a self-healing high definition map |
US11402220B2 (en) | 2019-03-13 | 2022-08-02 | Here Global B.V. | Maplets for maintaining and updating a self-healing high definition map |
US11096026B2 (en) * | 2019-03-13 | 2021-08-17 | Here Global B.V. | Road network change detection and local propagation of detected change |
US11255680B2 (en) | 2019-03-13 | 2022-02-22 | Here Global B.V. | Maplets for maintaining and updating a self-healing high definition map |
US11287267B2 (en) | 2019-03-13 | 2022-03-29 | Here Global B.V. | Maplets for maintaining and updating a self-healing high definition map |
US11181922B2 (en) * | 2019-03-29 | 2021-11-23 | Zoox, Inc. | Extension of autonomous driving functionality to new regions |
GB2584618B (en) * | 2019-05-23 | 2022-03-23 | Jaguar Land Rover Ltd | Disabling navigation data for a vehicle |
US11549815B2 (en) | 2019-06-28 | 2023-01-10 | GM Cruise Holdings LLC. | Map change detection |
US11142214B2 (en) * | 2019-08-06 | 2021-10-12 | Bendix Commercial Vehicle Systems Llc | System, controller and method for maintaining an advanced driver assistance system as active |
DE102019123353A1 (en) * | 2019-08-30 | 2021-03-04 | Bayerische Motoren Werke Aktiengesellschaft | Method and system for validating an environment map for use in a vehicle |
US11999372B2 (en) * | 2019-09-12 | 2024-06-04 | Motional Ad Llc | Operation of an autonomous vehicle based on availability of navigational information |
US11472442B2 (en) | 2020-04-23 | 2022-10-18 | Zoox, Inc. | Map consistency checker |
JP7235015B2 (en) * | 2020-07-17 | 2023-03-08 | トヨタ自動車株式会社 | automatic steering system |
US11761784B2 (en) | 2020-11-24 | 2023-09-19 | Waymo Llc | Reachability user experience interfaces for autonomous vehicles |
US20220326023A1 (en) * | 2021-04-09 | 2022-10-13 | Zoox, Inc. | Verifying reliability of data used for autonomous driving |
KR102668808B1 (en) * | 2021-12-20 | 2024-05-24 | 한국전자기술연구원 | Autonomous driving mobile robot and method using schematic map |
US20230303111A1 (en) * | 2022-03-22 | 2023-09-28 | Here Global B.V. | Autonomous vehicle navigation using non-connected map fragments |
US20230324194A1 (en) * | 2022-04-12 | 2023-10-12 | Nvidia Corporation | Translating route information between data structures for autonomous systems and applications |
Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5036935A (en) * | 1989-03-08 | 1991-08-06 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Travel control device for unmanned vehicle |
US5122957A (en) * | 1989-02-28 | 1992-06-16 | Nissan Motor Company, Limited | Autonomous vehicle for automatically/autonomously running on route of travel and its method using fuzzy control |
US5170352A (en) * | 1990-05-07 | 1992-12-08 | Fmc Corporation | Multi-purpose autonomous vehicle with path plotting |
US5229941A (en) * | 1988-04-14 | 1993-07-20 | Nissan Motor Company, Limtied | Autonomous vehicle automatically running on route and its method |
US5307419A (en) * | 1990-11-30 | 1994-04-26 | Honda Giken Kogyo Kabushiki Kaisha | Control device of an autonomously moving body and evaluation method for data thereof |
US5774069A (en) * | 1995-12-05 | 1998-06-30 | Toyota Jidosha Kabushiki Kaisha | Auto-drive control unit for vehicles |
US5875412A (en) * | 1994-08-03 | 1999-02-23 | Siemens Automotive L.P. | Vehicle navigation and route guidance system |
US6151539A (en) * | 1997-11-03 | 2000-11-21 | Volkswagen Ag | Autonomous vehicle arrangement and method for controlling an autonomous vehicle |
US20030058444A1 (en) * | 1998-11-30 | 2003-03-27 | Hitachi, Ltd. | Inspection method, apparatus and system for circuit pattern |
US20030134648A1 (en) * | 2001-10-04 | 2003-07-17 | Reed Mark Jefferson | Machine for providing a dynamic data base of geographic location information for a plurality of wireless devices and process for making same |
US7268700B1 (en) * | 1998-01-27 | 2007-09-11 | Hoffberg Steven M | Mobile communication device |
US20090248231A1 (en) * | 2007-03-06 | 2009-10-01 | Yamaha Hatsudoki Kabushiki Kaisha | Vehicle |
US20100256836A1 (en) * | 2009-04-06 | 2010-10-07 | Gm Global Technology Operations, Inc. | Autonomous vehicle management |
US8078338B2 (en) * | 2004-10-22 | 2011-12-13 | Irobot Corporation | System and method for behavior based control of an autonomous vehicle |
US8108092B2 (en) * | 2006-07-14 | 2012-01-31 | Irobot Corporation | Autonomous behaviors for a remote vehicle |
US8618922B2 (en) * | 2010-03-30 | 2013-12-31 | GM Global Technology Operations LLC | Method and system for ensuring operation of limited-ability autonomous driving vehicles |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7979172B2 (en) * | 1997-10-22 | 2011-07-12 | Intelligent Technologies International, Inc. | Autonomous vehicle travel control systems and methods |
DE19749086C1 (en) * | 1997-11-06 | 1999-08-12 | Daimler Chrysler Ag | Device for determining data indicating the course of the lane |
US7510038B2 (en) * | 2003-06-11 | 2009-03-31 | Delphi Technologies, Inc. | Steering system with lane keeping integration |
JP4721279B2 (en) * | 2006-03-29 | 2011-07-13 | 富士重工業株式会社 | Lane tracking support device |
US8699754B2 (en) * | 2008-04-24 | 2014-04-15 | GM Global Technology Operations LLC | Clear path detection through road modeling |
JP5066123B2 (en) * | 2009-03-24 | 2012-11-07 | 日立オートモティブシステムズ株式会社 | Vehicle driving support device |
JP5135321B2 (en) * | 2009-11-13 | 2013-02-06 | 株式会社日立製作所 | Autonomous traveling device |
US20110190972A1 (en) * | 2010-02-02 | 2011-08-04 | Gm Global Technology Operations, Inc. | Grid unlock |
-
2012
- 2012-05-07 US US13/465,348 patent/US8521352B1/en active Active
-
2013
- 2013-07-17 US US13/943,867 patent/US8676430B1/en active Active
-
2014
- 2014-01-27 US US14/164,565 patent/US8903591B1/en not_active Ceased
-
2016
- 2016-12-01 US US15/367,127 patent/USRE46972E1/en active Active
- 2016-12-01 US US15/367,115 patent/USRE46982E1/en active Active
- 2016-12-01 US US15/367,118 patent/USRE46966E1/en active Active
- 2016-12-01 US US15/367,122 patent/USRE47058E1/en active Active
- 2016-12-01 US US15/367,112 patent/USRE47002E1/en active Active
-
2018
- 2018-08-23 US US16/110,050 patent/US20180364734A1/en not_active Abandoned
Patent Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5229941A (en) * | 1988-04-14 | 1993-07-20 | Nissan Motor Company, Limtied | Autonomous vehicle automatically running on route and its method |
US5122957A (en) * | 1989-02-28 | 1992-06-16 | Nissan Motor Company, Limited | Autonomous vehicle for automatically/autonomously running on route of travel and its method using fuzzy control |
US5036935A (en) * | 1989-03-08 | 1991-08-06 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Travel control device for unmanned vehicle |
US5170352A (en) * | 1990-05-07 | 1992-12-08 | Fmc Corporation | Multi-purpose autonomous vehicle with path plotting |
US5307419A (en) * | 1990-11-30 | 1994-04-26 | Honda Giken Kogyo Kabushiki Kaisha | Control device of an autonomously moving body and evaluation method for data thereof |
US5875412A (en) * | 1994-08-03 | 1999-02-23 | Siemens Automotive L.P. | Vehicle navigation and route guidance system |
US5774069A (en) * | 1995-12-05 | 1998-06-30 | Toyota Jidosha Kabushiki Kaisha | Auto-drive control unit for vehicles |
US6151539A (en) * | 1997-11-03 | 2000-11-21 | Volkswagen Ag | Autonomous vehicle arrangement and method for controlling an autonomous vehicle |
US7268700B1 (en) * | 1998-01-27 | 2007-09-11 | Hoffberg Steven M | Mobile communication device |
US20030058444A1 (en) * | 1998-11-30 | 2003-03-27 | Hitachi, Ltd. | Inspection method, apparatus and system for circuit pattern |
US20030134648A1 (en) * | 2001-10-04 | 2003-07-17 | Reed Mark Jefferson | Machine for providing a dynamic data base of geographic location information for a plurality of wireless devices and process for making same |
US8078338B2 (en) * | 2004-10-22 | 2011-12-13 | Irobot Corporation | System and method for behavior based control of an autonomous vehicle |
US8108092B2 (en) * | 2006-07-14 | 2012-01-31 | Irobot Corporation | Autonomous behaviors for a remote vehicle |
US20090248231A1 (en) * | 2007-03-06 | 2009-10-01 | Yamaha Hatsudoki Kabushiki Kaisha | Vehicle |
US20100256836A1 (en) * | 2009-04-06 | 2010-10-07 | Gm Global Technology Operations, Inc. | Autonomous vehicle management |
US8618922B2 (en) * | 2010-03-30 | 2013-12-31 | GM Global Technology Operations LLC | Method and system for ensuring operation of limited-ability autonomous driving vehicles |
Non-Patent Citations (4)
Title |
---|
Non-Final Office Action dated Sep. 12, 2017 for U.S. Appl. No. 15/367,112. |
Non-Final Office Action dated Sep. 22, 2017 for U.S. Appl. No. 15/367,118. |
Non-Final Office Action dated Sep. 22, 2017 for U.S. Appl. No. 15/367,127. |
Non-Final Office Action dated Sep. 8, 2017 for U.S. Appl. No. 15/367,115. |
Also Published As
Publication number | Publication date |
---|---|
USRE47002E1 (en) | 2018-08-21 |
US8903591B1 (en) | 2014-12-02 |
USRE46966E1 (en) | 2018-07-24 |
USRE46982E1 (en) | 2018-08-07 |
US20180364734A1 (en) | 2018-12-20 |
US8521352B1 (en) | 2013-08-27 |
US8676430B1 (en) | 2014-03-18 |
USRE46972E1 (en) | 2018-07-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
USRE47058E1 (en) | Controlling a vehicle having inadequate map data | |
US11281918B1 (en) | 3D position estimation of objects from a monocular camera using a set of known 3D points on an underlying surface | |
US11068726B1 (en) | Static obstacle detection | |
US10181084B2 (en) | Combining multiple estimates of an environment into a consolidated estimate for an autonomous vehicle | |
US8676427B1 (en) | Controlling autonomous vehicle using audio data | |
US9440652B1 (en) | Filtering noisy/high-intensity regions in laser-based lane marker detection | |
US9330571B2 (en) | Modifying behavior of autonomous vehicle based on predicted behavior of other vehicles | |
US9120485B1 (en) | Methods and systems for smooth trajectory generation for a self-driving vehicle | |
US9213337B1 (en) | Detecting lane closures and lane shifts by an autonomous vehicle | |
US9121703B1 (en) | Methods and systems for controlling operation of a laser device | |
EP2917082B1 (en) | Methods and systems to aid autonomous driving through a lane merge | |
US9336436B1 (en) | Methods and systems for pedestrian avoidance | |
EP3266667B1 (en) | Safely navigating on roads through maintaining safe distance from other vehicles | |
US9928431B2 (en) | Verifying a target object with reverse-parallax analysis | |
US9310804B1 (en) | Use of prior maps for estimation of lane boundaries | |
US20180329423A1 (en) | System To Optimize Sensor Parameters In An Autonomous Vehicle | |
EP4206038A1 (en) | Actively modifying a field of view of an autonomous vehicle in view of constraints | |
US8838322B1 (en) | System to automatically measure perception sensor latency in an autonomous vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
CC | Certificate of correction | ||
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |