DE102021111462A1 - Computerimplementiertes Verfahren zum Szenario-basierten Testen und/oder Homologation von zu testenden zumindest teilweise autonomen Fahrfunktionen durch Key Performance Indicators (KPI) - Google Patents

Computerimplementiertes Verfahren zum Szenario-basierten Testen und/oder Homologation von zu testenden zumindest teilweise autonomen Fahrfunktionen durch Key Performance Indicators (KPI) Download PDF

Info

Publication number
DE102021111462A1
DE102021111462A1 DE102021111462.4A DE102021111462A DE102021111462A1 DE 102021111462 A1 DE102021111462 A1 DE 102021111462A1 DE 102021111462 A DE102021111462 A DE 102021111462A DE 102021111462 A1 DE102021111462 A1 DE 102021111462A1
Authority
DE
Germany
Prior art keywords
kpi
plug
computer
simulation
test
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
DE102021111462.4A
Other languages
German (de)
English (en)
Inventor
Sebastian BANNENBERG
Steffen BERINGER
Eduard Miller
Markus Deppe
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DSPACE SE & CO KG, DE
Original Assignee
Dspace GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dspace GmbH filed Critical Dspace GmbH
Priority to DE102021111462.4A priority Critical patent/DE102021111462A1/de
Priority to EP22163416.5A priority patent/EP4105811B1/de
Priority to CN202210453808.XA priority patent/CN115372014A/zh
Priority to JP2022076252A priority patent/JP2022172469A/ja
Priority to US17/735,215 priority patent/US20220358024A1/en
Publication of DE102021111462A1 publication Critical patent/DE102021111462A1/de
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/36—Software reuse
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3428—Benchmarking
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M17/00—Testing of vehicles
    • G01M17/007—Wheeled or endless-tracked vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/18—Propelling the vehicle
    • B60W30/18009—Propelling the vehicle related to particular drive situations
    • B60W30/18145—Cornering
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/18—Propelling the vehicle
    • B60W30/18009—Propelling the vehicle related to particular drive situations
    • B60W30/18163—Lane change; Overtaking manoeuvres
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/04—Traffic conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/06—Road conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • B60W60/001—Planning or execution of driving tasks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3457—Performance evaluation by simulation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Prevention of errors by analysis, debugging or testing of software
    • G06F11/3668—Testing of software
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/10—Geometric CAD
    • G06F30/15—Vehicle, aircraft or watercraft design
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/20—Design optimisation, verification or simulation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00—Input parameters relating to infrastructure
    • B60W2552/10—Number of lanes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/20—Ambient conditions, e.g. wind or rain
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2754/00—Output or target parameters relating to objects
    • B60W2754/10—Spatial relation or speed relative to objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Geometry (AREA)
  • Transportation (AREA)
  • Quality & Reliability (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Physics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Debugging And Monitoring (AREA)
DE102021111462.4A 2021-05-04 2021-05-04 Computerimplementiertes Verfahren zum Szenario-basierten Testen und/oder Homologation von zu testenden zumindest teilweise autonomen Fahrfunktionen durch Key Performance Indicators (KPI) Pending DE102021111462A1 (de)

Priority Applications (5)

Application Number Priority Date Filing Date Title
DE102021111462.4A DE102021111462A1 (de) 2021-05-04 2021-05-04 Computerimplementiertes Verfahren zum Szenario-basierten Testen und/oder Homologation von zu testenden zumindest teilweise autonomen Fahrfunktionen durch Key Performance Indicators (KPI)
EP22163416.5A EP4105811B1 (de) 2021-05-04 2022-03-22 Computerimplementiertes verfahren zum szenariobasierten testen und/oder homologation von zu testenden zumindest teilweise autonomen fahrfunktionen durch key performance indicators (kpi)
CN202210453808.XA CN115372014A (zh) 2021-05-04 2022-04-27 测试和/或认证待测试的驾驶功能的计算机实现的方法
JP2022076252A JP2022172469A (ja) 2021-05-04 2022-05-02 重要性能評価指標（ｋｐｉ）によるテストすべき少なくとも部分的に自律的な走行機能のシナリオベースのテストおよび／またはホモロゲーションのためのコンピュータ実装方法
US17/735,215 US20220358024A1 (en) 2021-05-04 2022-05-03 Computer-implemented method for scenario-based testing and / or homologation of at least partially autonomous driving functions to be tested by means of key performance indicators (kpi)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102021111462.4A DE102021111462A1 (de) 2021-05-04 2021-05-04 Computerimplementiertes Verfahren zum Szenario-basierten Testen und/oder Homologation von zu testenden zumindest teilweise autonomen Fahrfunktionen durch Key Performance Indicators (KPI)

Publications (1)

Publication Number Publication Date
DE102021111462A1 true DE102021111462A1 (de) 2022-11-10

Family

ID=80930259

Family Applications (1)

Application Number Title Priority Date Filing Date
DE102021111462.4A Pending DE102021111462A1 (de) 2021-05-04 2021-05-04 Computerimplementiertes Verfahren zum Szenario-basierten Testen und/oder Homologation von zu testenden zumindest teilweise autonomen Fahrfunktionen durch Key Performance Indicators (KPI)

Country Status (5)

Country Link
US (1) US20220358024A1 (https=)
EP (1) EP4105811B1 (https=)
JP (1) JP2022172469A (https=)
CN (1) CN115372014A (https=)
DE (1) DE102021111462A1 (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220277115A1 (en) * 2019-08-26 2022-09-01 Global Security Inc. Simulation system, simulation program, and simulation method
CN114647581A (zh) * 2022-03-24 2022-06-21 阳光电源股份有限公司 Hil测试的覆盖度检测方法、设备及存储介质
CN116302364B (zh) * 2023-05-17 2023-08-15 清华大学 自动驾驶可靠性测试方法、装置、设备、介质和程序产品

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017200180A1 (de) 2017-01-09 2018-07-12 Bayerische Motoren Werke Aktiengesellschaft Verfahren und Testeinheit zur Bewegungsprognose von Verkehrsteilnehmern bei einer passiv betriebenen Fahrzeugfunktion

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030061348A1 (en) * 2001-09-24 2003-03-27 Jacobs James W. System and method of providing information from a plurality of information sources
US20050091093A1 (en) * 2003-10-24 2005-04-28 Inernational Business Machines Corporation End-to-end business process solution creation
US20110153368A1 (en) * 2009-12-17 2011-06-23 XtremeGIS, Inc. User Interactive Reinsurance Risk Analysis Application
EE05651B1 (et) * 2010-03-19 2013-04-15 Abile Mobile O� Meetod ja süsteem reaalaja t?ukestiilis hajusnäidikulaua v?rkude jaoks
US9413890B2 (en) * 2014-01-08 2016-08-09 Avaya Inc. Systems and methods for monitoring and prioritizing metrics with dynamic work issue reassignment
US9130860B1 (en) * 2014-10-09 2015-09-08 Splunk, Inc. Monitoring service-level performance using key performance indicators derived from machine data
US9210056B1 (en) * 2014-10-09 2015-12-08 Splunk Inc. Service monitoring interface
US20170004263A1 (en) * 2015-07-02 2017-01-05 Think Anew LLC Method, system and application for monitoring key performance indicators and providing push notifications and survey status alerts
US10289782B1 (en) * 2016-06-01 2019-05-14 Cadence Design Systems, Inc. System and method for customizing key performance indicators in an electronic design
DE112019001605T5 (de) * 2018-03-27 2020-12-17 Nvidia Corporation Trainieren, testen und verifizieren von autonomen maschinen unter verwendung simulierter umgebungen
US20200202277A1 (en) * 2018-12-19 2020-06-25 International Business Machines Corporation Enhanced dynamic monitoring of on-demand key performance indicators
JPWO2020213371A1 (ja) * 2019-04-16 2021-11-04 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置
CN110579216B (zh) * 2019-09-12 2022-02-18 阿波罗智能技术(北京)有限公司 测试场景库构建方法、装置、电子设备和介质
US11643104B2 (en) * 2019-11-11 2023-05-09 Magna Electronics Inc. Vehicular autonomous control system utilizing superposition of matching metrics during testing
US20210294944A1 (en) * 2020-03-19 2021-09-23 Nvidia Corporation Virtual environment scenarios and observers for autonomous machine applications
US20220229954A1 (en) * 2021-01-19 2022-07-21 Ford Global Technologies, Llc Autonomous vehicle traffic simulation and road network modeling
US12269488B2 (en) * 2021-04-21 2025-04-08 Nvidia Corporation End-to-end evaluation of perception systems for autonomous systems and applications

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017200180A1 (de) 2017-01-09 2018-07-12 Bayerische Motoren Werke Aktiengesellschaft Verfahren und Testeinheit zur Bewegungsprognose von Verkehrsteilnehmern bei einer passiv betriebenen Fahrzeugfunktion

Also Published As

Publication number Publication date
US20220358024A1 (en) 2022-11-10
EP4105811B1 (de) 2025-07-23
JP2022172469A (ja) 2022-11-16
CN115372014A (zh) 2022-11-22
EP4105811A1 (de) 2022-12-21

Similar Documents

Publication Publication Date Title
EP4226248B1 (de) Verfahren und ein system zum testen eines fahrerassistenzsystems für ein fahrzeug
DE102018128289B4 (de) Verfahren und vorrichtung für eine autonome systemleistung und zur einstufung
EP4105811B1 (de) Computerimplementiertes verfahren zum szenariobasierten testen und/oder homologation von zu testenden zumindest teilweise autonomen fahrfunktionen durch key performance indicators (kpi)
EP4193135B1 (de) Computerimplementiertes verfahren zum bereitstellen eines test-verlaufs zu testender verkehrsszenarien
AT523834B1 (de) Verfahren und System zum Testen eines Fahrerassistenzsystems
EP4222470B1 (de) Computergestütztes verfahren und vorrichtung zur wahrscheinlichkeitsbasierten geschwindigkeitsprognose für fahrzeuge
DE102019124018A1 (de) Verfahren zum Optimieren von Tests von Regelsystemen für automatisierte Fahrdynamiksysteme
DE102015218361A1 (de) Verfahren und Testeinheit zur Verifizierung einer Fahrzeugfunktion
DE102021100395A1 (de) Computerimplementiertes Verfahren zur Bestimmung von Ähnlichkeitswerten von Verkehrsszenarien
DE102019134053A1 (de) Verfahren zur kontinuierlichen Absicherung im Fahrversuch applizierter automatisierter Fahrfunktionen
DE102021111724B4 (de) Verfahren und Computerprogramm zum Evaluieren eines Softwarestands eines Fahrerassistenzsystems
EP4702510A1 (de) System und verfahren zur erstellung von szenarien
DE102018005864A1 (de) Verfahren zum Testen eines Totwinkelassistenzsystems für ein Fahrzeug
EP4508621B1 (de) Verfahren zur prädiktion eines einflusses eines verkehrsteilnehmers auf zumindest einen anderen verkehrsteilnehmer und verfahren zum betrieb eines fahrzeugs
EP4086773A1 (de) Computerimplementiertes verfahren zum automatischen bereitstellen eines hinweises für testprozesse
DE102020120500A1 (de) Computerimplementiertes Verfahren zur Terminierung eines szenario-basierten Testprozesses eines Fahrassistenzsystems
DE102023117943B3 (de) Verfahren zu einer statistischen virtuellen Validierung von Fahrerassistenzsystemen
EP4155943A1 (de) Computerimplementiertes verfahren zum automatisierten testen und freigeben von funktionen eines fahrzeugs
DE102022114913A1 (de) Computerimplementiertes Verfahren zur Verwendung von gespeicherten Spezifikationsanteilen
DE102022129009A1 (de) Verfahren zum Testen von automatisierten Fahrzeugfunktionen
DE202021004237U1 (de) Computerlesbares Speichermedium und Rechenvorrichtung zum Evaluieren eines Softwarestands eines Fahrerassistenzsystems
DE102021003856A1 (de) Verfahren zum Betrieb eines automatisiert fahrenden Fahrzeuges
DE102022213262A1 (de) System und Verfahren zum Erstellen einer virtuellen Prüfungsumgebung anhand einer erkannten Häufigkeit von gleichen oder ähnlichen Szenarien
DE102022208936A1 (de) Verfahren zum Bestimmen mindestens einer Exposition

Legal Events

Date Code Title Description
R081 Change of applicant/patentee

Owner name: DSPACE GMBH, DE

Free format text: FORMER OWNER: DSPACE DIGITAL SIGNAL PROCESSING AND CONTROL ENGINEERING GMBH, 33102 PADERBORN, DE

Owner name: DSPACE SE & CO KG, DE

Free format text: FORMER OWNER: DSPACE DIGITAL SIGNAL PROCESSING AND CONTROL ENGINEERING GMBH, 33102 PADERBORN, DE

R081 Change of applicant/patentee

Owner name: DSPACE SE & CO KG, DE

Free format text: FORMER OWNER: DSPACE GMBH, 33102 PADERBORN, DE