SG11202005671RA - Software validation for autonomous vehicles - Google Patents

Software validation for autonomous vehicles

Info

Publication number
SG11202005671RA
SG11202005671RA SG11202005671RA SG11202005671RA SG11202005671RA SG 11202005671R A SG11202005671R A SG 11202005671RA SG 11202005671R A SG11202005671R A SG 11202005671RA SG 11202005671R A SG11202005671R A SG 11202005671RA SG 11202005671R A SG11202005671R A SG 11202005671RA
Authority
SG
Singapore
Prior art keywords
autonomous vehicles
software validation
validation
software
autonomous
Prior art date
Application number
SG11202005671RA
Other languages
English (en)
Inventor
Franklin Morley
Omer Baror
Nathaniel Fairfield
Miner Crary
Original Assignee
Waymo Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Waymo Llc filed Critical Waymo Llc
Publication of SG11202005671RA publication Critical patent/SG11202005671RA/en

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/14—Adaptive cruise control
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3604—Software analysis for verifying properties of programs
    • G06F11/3608—Software analysis for verifying properties of programs using formal methods, e.g. model checking, abstract interpretation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00—Conjoint control of vehicle sub-units of different type or different function
    • B60W10/18—Conjoint control of vehicle sub-units of different type or different function including control of braking systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3692—Test management for test results analysis
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
    • B60Y2300/00—Purposes or special features of road vehicle drive control systems
    • B60Y2300/08—Predicting or avoiding probable or impending collision
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
    • B60Y2300/00—Purposes or special features of road vehicle drive control systems
    • B60Y2300/14—Cruise control
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0088—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • General Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Automation & Control Theory (AREA)
  • Software Systems (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Traffic Control Systems (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Game Theory and Decision Science (AREA)
  • Medical Informatics (AREA)
  • Business, Economics & Management (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Debugging And Monitoring (AREA)
SG11202005671RA 2018-01-08 2019-01-08 Software validation for autonomous vehicles SG11202005671RA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/864,239 US10831636B2 (en) 2018-01-08 2018-01-08 Software validation for autonomous vehicles
PCT/US2019/012713 WO2019136447A1 (en) 2018-01-08 2019-01-08 Software validation for autonomous vehicles

Publications (1)

Publication Number Publication Date
SG11202005671RA true SG11202005671RA (en) 2020-07-29

Family

ID=67139542

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202005671RA SG11202005671RA (en) 2018-01-08 2019-01-08 Software validation for autonomous vehicles

Country Status (8)

Country Link
US (3) US10831636B2 (ko)
EP (1) EP3710327B1 (ko)
JP (1) JP7183273B2 (ko)
KR (1) KR102355257B1 (ko)
CN (1) CN111565990B (ko)
AU (2) AU2019205817B2 (ko)
SG (1) SG11202005671RA (ko)
WO (1) WO2019136447A1 (ko)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3525374B1 (en) * 2018-02-07 2021-10-06 Volkswagen Aktiengesellschaft Method for data communication between at least two participants of a wireless communication system, corresponding control unit and vehicle equipped with a control unit as well as computer program
JP6806107B2 (ja) * 2018-03-20 2021-01-06 日本電気株式会社 障害物認識支援装置、障害物認識支援方法、プログラム
EP3584748A1 (de) * 2018-06-20 2019-12-25 Siemens Aktiengesellschaft Verfahren zur erzeugung eines testdatensatzes, verfahren zum testen, verfahren zum betreiben eines systems, vorrichtung, steuerungssystem, computerprogrammprodukt, computerlesbares medium, erzeugung und verwendung
US10896116B1 (en) * 2018-10-19 2021-01-19 Waymo Llc Detecting performance regressions in software for controlling autonomous vehicles
US20200211394A1 (en) * 2018-12-26 2020-07-02 Zoox, Inc. Collision avoidance system
US11332132B2 (en) * 2019-08-30 2022-05-17 Argo AI, LLC Method of handling occlusions at intersections in operation of autonomous vehicle
US11494533B2 (en) * 2019-11-27 2022-11-08 Waymo Llc Simulations with modified agents for testing autonomous vehicle software
DE102020204867A1 (de) * 2020-04-17 2021-10-21 Volkswagen Aktiengesellschaft Verfahren und System zum Betreiben einer Fahrmanöverplanung mindestens eines zumindest teilautomatisiert fahrenden Fahrzeugs
US11886193B1 (en) * 2020-06-04 2024-01-30 Nuro, Inc. Methods and apparatus for using scene-based metrics to gate readiness of autonomous systems
EP3940487B1 (en) * 2020-07-14 2023-09-20 Zenuity AB Estimation of probability of collision with increasing severity level for autonomous vehicles
CN111881520B (zh) * 2020-07-31 2022-01-11 广州文远知行科技有限公司 一种自动驾驶测试的异常检测方法、装置、计算机设备及存储介质
KR102335372B1 (ko) * 2020-10-19 2021-12-06 주식회사 오비고 QC(Quality Control) 검증앱을 이용하여 자율주행차량의 동작을 검증하는 방법 및 관제 서버
CN112559371B (zh) * 2020-12-24 2023-07-28 北京百度网讯科技有限公司 一种自动驾驶测试方法、装置及电子设备
JP2024508255A (ja) * 2021-02-12 2024-02-26 ファイブ、エーアイ、リミテッド 軌道プランナのパフォーマンス・テスト
US11932260B2 (en) 2021-03-30 2024-03-19 Motional Ad Llc Selecting testing scenarios for evaluating the performance of autonomous vehicles
CN113076261B (zh) * 2021-04-29 2024-06-21 安徽江淮汽车集团股份有限公司 自动泊车测试方法、设备、存储介质及装置
US11834070B2 (en) * 2021-07-08 2023-12-05 Waymo Llc Probabilistic simulation sampling from agent data
US20230102929A1 (en) * 2021-09-24 2023-03-30 Embark Trucks, Inc. Autonomous vehicle automated scenario characterization
KR102625974B1 (ko) * 2021-11-29 2024-01-18 주식회사 오비고 자율주행차량의 운행 검증에 필요한 검증 시나리오를 편집하는 방법 및 이를 이용한 서버
KR102434475B1 (ko) * 2022-01-21 2022-08-19 주식회사 모라이 자율 주행 알고리즘의 성능 평가 방법 및 시스템
CN114501516B (zh) * 2022-02-14 2024-03-12 成都市以太节点科技有限公司 一种车地无线通信切换室内测试方法及系统
WO2023186296A1 (en) * 2022-03-30 2023-10-05 Siemens Aktiengesellschaft Determination of an impact impa of deployment of an autonomous vehicle in an environment
US20230356750A1 (en) * 2022-05-09 2023-11-09 Motional Ad Llc Autonomous Vehicle Validation using Real-World Adversarial Events
KR102579590B1 (ko) * 2022-12-28 2023-09-18 도로교통공단 도로교통법 기반 자율주행차 운전능력 평가시나리오 생성 시스템
DE102023000357B3 (de) 2023-02-06 2024-06-06 Mercedes-Benz Group AG Verfahren zum Erzeugen von Testdaten für eine Simulation eines Assistenzsystems eines zumindest teilweise assistiert betriebenen Kraftfahrzeugs, Computerprogrammprodukt, computerlesbares Speichermedium sowie elektronische Recheneinrichtung

Family Cites Families (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4677691B2 (ja) 2001-07-24 2011-04-27 株式会社日立製作所 自動車の制御方法
US8924049B2 (en) * 2003-01-06 2014-12-30 General Electric Company System and method for controlling movement of vehicles
WO2004090659A2 (en) * 2003-04-10 2004-10-21 Mukesh Dalal Optimizing active decision making using simulated decision making
US20070260438A1 (en) * 2006-05-08 2007-11-08 Langer William J Vehicle testing and simulation using integrated simulation model and physical parts
US7308327B2 (en) * 2006-05-12 2007-12-11 Ford Motor Company Method of application protocol monitoring for programmable logic controllers
GB0611960D0 (en) * 2006-06-16 2006-07-26 Ibm Software testing method and system
US20080091352A1 (en) * 2006-10-11 2008-04-17 O'hare James K Automobile collision avoidance system
US8626565B2 (en) * 2008-06-30 2014-01-07 Autonomous Solutions, Inc. Vehicle dispatching method and system
US20100057405A1 (en) * 2008-08-28 2010-03-04 Sony Corporation Automated software testing environment
US8473171B2 (en) * 2008-10-09 2013-06-25 GM Global Technology Operations LLC Apparatus and method for optimizing a vehicle collision preparation response
US8126642B2 (en) * 2008-10-24 2012-02-28 Gray & Company, Inc. Control and systems for autonomously driven vehicles
US8126736B2 (en) * 2009-01-23 2012-02-28 Warsaw Orthopedic, Inc. Methods and systems for diagnosing, treating, or tracking spinal disorders
US20100228427A1 (en) * 2009-03-05 2010-09-09 Massachusetts Institute Of Technology Predictive semi-autonomous vehicle navigation system
WO2013066809A1 (en) * 2011-11-01 2013-05-10 Raytheon Company System to establish trustworthiness of autonomous agent
KR101703144B1 (ko) * 2012-02-09 2017-02-06 한국전자통신연구원 차량의 자율주행 장치 및 그 방법
US8881126B2 (en) * 2012-07-31 2014-11-04 Oracle International Corporation Systems and methods for testing a compiler through compile-time decision feedback
US8781987B1 (en) * 2012-12-31 2014-07-15 Gary Stephen Shuster Decision making using algorithmic or programmatic analysis
KR20140095882A (ko) * 2013-01-25 2014-08-04 삼성전자주식회사 모바일 장치를 검증하기 위한 테스트 시스템 및 이의 구동 방법
DE102013213171A1 (de) * 2013-07-04 2015-01-08 Robert Bosch Gmbh Verfahren und Vorrichtung zum Betreiben eines Kraftfahrzeugs in einem automatisierten Fahrbetrieb
JP2015049187A (ja) * 2013-09-03 2015-03-16 株式会社日立製作所 シミュレーション走行ルート生成方法およびそのシステム
EP2865576B1 (en) 2013-10-22 2018-07-04 Honda Research Institute Europe GmbH Composite confidence estimation for predictive driver assistant systems
US9406177B2 (en) 2013-12-20 2016-08-02 Ford Global Technologies, Llc Fault handling in an autonomous vehicle
US9650051B2 (en) * 2013-12-22 2017-05-16 Lytx, Inc. Autonomous driving comparison and evaluation
US10380693B2 (en) 2014-02-25 2019-08-13 State Farm Mutual Automobile Insurance Company Systems and methods for generating data that is representative of an insurance policy for an autonomous vehicle
US10354330B1 (en) 2014-05-20 2019-07-16 State Farm Mutual Automobile Insurance Company Autonomous feature use monitoring and insurance pricing
EP2990290B1 (en) * 2014-09-01 2019-11-06 Honda Research Institute Europe GmbH Method and system for post-collision manoeuvre planning and vehicle equipped with such system
WO2016130719A2 (en) * 2015-02-10 2016-08-18 Amnon Shashua Sparse map for autonomous vehicle navigation
US20160314224A1 (en) 2015-04-24 2016-10-27 Northrop Grumman Systems Corporation Autonomous vehicle simulation system
US20160357262A1 (en) * 2015-06-05 2016-12-08 Arafat M.A. ANSARI Smart vehicle
US9604641B2 (en) * 2015-06-16 2017-03-28 Honda Motor Co., Ltd. System and method for providing vehicle collision avoidance at an intersection
US9483948B1 (en) * 2015-08-07 2016-11-01 International Business Machines Corporation Automated control of interactions between self-driving vehicles and pedestrians
DE102015010167B4 (de) * 2015-08-11 2017-12-07 Dspace Digital Signal Processing And Control Engineering Gmbh Berechnung einer Solltrajektorie
US9805605B2 (en) * 2015-08-12 2017-10-31 Madhusoodhan Ramanujam Using autonomous vehicles in a taxi service
US9587952B1 (en) 2015-09-09 2017-03-07 Allstate Insurance Company Altering autonomous or semi-autonomous vehicle operation based on route traversal values
US9751506B2 (en) * 2015-10-27 2017-09-05 GM Global Technology Operations LLC Algorithms for avoiding automotive crashes at left and right turn intersections
US10496766B2 (en) * 2015-11-05 2019-12-03 Zoox, Inc. Simulation system and methods for autonomous vehicles
DE102016220670A1 (de) * 2015-11-06 2017-05-11 Ford Global Technologies, Llc Verfahren und System zum Testen von Software für autonome Fahrzeuge
DE102016220913A1 (de) * 2015-11-06 2017-05-11 Ford Global Technologies, Llc Verfahren und Vorrichtung zur Generierung von Testfällen für autonome Fahrzeuge
US10521215B2 (en) * 2015-12-10 2019-12-31 Intel Corporation Technologies for customized crowd-sourced features, automated safety and quality assurance with a technical computing environment
US10073965B2 (en) * 2015-12-15 2018-09-11 Nagravision S.A. Methods and systems for validating an autonomous system that includes a dynamic-code module and a static-code module
US9581461B1 (en) * 2016-01-05 2017-02-28 Allstate Insurance Company Data processing system communicating with a map data processing system to generate a display of one or more segments of one or more vehicle routes
US10474964B2 (en) * 2016-01-26 2019-11-12 Ford Global Technologies, Llc Training algorithm for collision avoidance
US10552573B2 (en) * 2016-03-18 2020-02-04 Toyota Jidosha Kabushiki Kaisha Vehicle simulation device for crowd-sourced vehicle simulation data
US10346564B2 (en) 2016-03-30 2019-07-09 Toyota Jidosha Kabushiki Kaisha Dynamic virtual object generation for testing autonomous vehicles in simulated driving scenarios
US10054944B2 (en) * 2016-04-01 2018-08-21 Jaguar Land Rover Limited System and method for configuring autonomous vehicle responses based on a driver profile
CN105911986A (zh) 2016-04-25 2016-08-31 百度在线网络技术（北京）有限公司 无人驾驶车辆感知测试系统和测试方法
ITUA20163204A1 (it) * 2016-05-06 2017-11-06 Cnh Ind Italia Spa Apparato per la prevenzione automatica delle collisioni.
CN106153352B (zh) * 2016-07-04 2018-08-10 江苏大学 一种无人驾驶车辆测试验证平台及其测试方法
CN115343947A (zh) * 2016-09-23 2022-11-15 苹果公司 自主车辆的运动控制决策
US10489529B2 (en) * 2016-10-14 2019-11-26 Zoox, Inc. Scenario description language
US10421460B2 (en) * 2016-11-09 2019-09-24 Baidu Usa Llc Evaluation framework for decision making of autonomous driving vehicle
EP3352028A1 (de) * 2017-01-23 2018-07-25 dSPACE digital signal processing and control engineering GmbH Verfahren zum test einer steuergerätefunktion eines steuergeräts eines fahrzeugs
CN106951627A (zh) * 2017-03-15 2017-07-14 北京百度网讯科技有限公司 车辆自动驾驶的仿真测试方法、装置、设备及计算机可读存储介质
WO2018180143A1 (ja) * 2017-03-31 2018-10-04 ソニー株式会社 情報処理装置及び情報処理方法、コンピュータ・プログラム、並びにプログラム製造方法
US11282016B2 (en) * 2017-05-23 2022-03-22 Uatc, Llc Individualized risk vehicle matching for an on-demand transportation service
US10884902B2 (en) * 2017-05-23 2021-01-05 Uatc, Llc Software version verification for autonomous vehicles
CN107264534B (zh) * 2017-05-23 2019-07-09 北京理工大学 基于驾驶员经验模型的智能驾驶控制系统和方法、车辆
US10431023B1 (en) * 2017-08-21 2019-10-01 Uber Technologies, Inc. Systems and methods to test an autonomous vehicle
US10885240B2 (en) * 2017-11-02 2021-01-05 Uatc, Llc Deterministic simulation framework for autonomous vehicle testing
AU2018267541A1 (en) 2017-11-20 2019-06-06 Ashok Krishnan Systems and methods of training vehicles
US10860018B2 (en) * 2017-11-30 2020-12-08 Tusimple, Inc. System and method for generating simulated vehicles with configured behaviors for analyzing autonomous vehicle motion planners
US10303178B1 (en) * 2017-12-15 2019-05-28 Waymo Llc Collision mitigation static occupancy grid
DE102021109126A1 (de) * 2021-04-13 2022-10-13 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren zum Testen eines Produkts

Also Published As

Publication number Publication date
EP3710327A1 (en) 2020-09-23
AU2019205817A1 (en) 2020-07-09
JP7183273B2 (ja) 2022-12-05
KR102355257B1 (ko) 2022-02-08
US11210200B2 (en) 2021-12-28
AU2022202150B2 (en) 2022-07-14
CN111565990A (zh) 2020-08-21
US10831636B2 (en) 2020-11-10
EP3710327B1 (en) 2023-11-08
US20220100635A1 (en) 2022-03-31
WO2019136447A1 (en) 2019-07-11
EP3710327A4 (en) 2021-09-01
AU2022202150A1 (en) 2022-04-21
US20190213103A1 (en) 2019-07-11
AU2019205817B2 (en) 2022-01-27
CN111565990B (zh) 2023-07-25
KR20200085363A (ko) 2020-07-14
US20210004313A1 (en) 2021-01-07
JP2021509646A (ja) 2021-04-01
US11645189B2 (en) 2023-05-09

Similar Documents

Publication Publication Date Title
SG11202005671RA (en) Software validation for autonomous vehicles
GB2570887B (en) A system for a vehicle
SG11202102709YA (en) Unmanned vehicle
IL282278A (en) Design of an autonomous vehicle
SG11202000872UA (en) Arranging stop locations for autonomous vehicles
CA185123S (en) Vehicle
ZAA201801133S (en) Vehicle
CA185613S (en) Vehicle
SG10201700342YA (en) Control system for vehicle
GB201713491D0 (en) Permissions for partially autonomous vehicle operation
GB201805011D0 (en) Unmanned aeriel vehicle
GB201801030D0 (en) Control interface for autonomous vehicle
CA185265S (en) Vehicle
GB2595083B (en) A vehicle system
GB2580201B (en) Floor system for a vehicle
CA185264S (en) Vehicle
PT3538423T (pt) Chassi para um veículo
GB202109366D0 (en) A vehicle system
GB2552027B (en) A vehicle system for determining terrain type
GB2593844B (en) Vehicle system
GB201704328D0 (en) Vehicle odometry system
HUE064722T2 (hu) Jármû
GB201616281D0 (en) Vehicle ancillary system
GB201816866D0 (en) Autonomous vehicles
GB2580782B (en) Vehicles