EP3871134A1 - Method and device for testing a driver assistance system - Google Patents
Method and device for testing a driver assistance systemInfo
- Publication number
- EP3871134A1 EP3871134A1 EP19797196.3A EP19797196A EP3871134A1 EP 3871134 A1 EP3871134 A1 EP 3871134A1 EP 19797196 A EP19797196 A EP 19797196A EP 3871134 A1 EP3871134 A1 EP 3871134A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- traffic scenario
- traffic
- parameter
- test
- vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 124
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000012545 processing Methods 0.000 claims description 11
- 238000004088 simulation Methods 0.000 description 17
- 230000008859 change Effects 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000033228 biological regulation Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000007620 mathematical function Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M17/00—Testing of vehicles
- G01M17/007—Wheeled or endless-tracked vehicles
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B23/00—Testing or monitoring of control systems or parts thereof
- G05B23/02—Electric testing or monitoring
- G05B23/0205—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
- G05B23/0218—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults
- G05B23/0256—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults injecting test signals and analyzing monitored process response, e.g. injecting the test signal while interrupting the normal operation of the monitored system; superimposing the test signal onto a control signal during normal operation of the monitored system
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/001—Planning or execution of driving tasks
- B60W60/0011—Planning or execution of driving tasks involving control alternatives for a single driving scenario, e.g. planning several paths to avoid obstacles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2637—Vehicle, car, auto, wheelchair
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
Definitions
- the present invention relates to a method and a device for testing a driver assistance system for a vehicle in a test environment.
- ADAS advanced driver assistance systems
- Support ranges from the mere display of possibly relevant information (e.g. issuing a warning by a lane change assistant) to semi-autonomous interventions (e.g. regulation of the torque applied to the wheel axles by an anti-lock braking system) to fully autonomous interventions in the control of the vehicle (e.g. adaptive cruise control) thanks to an adaptive cruise control (ACC).
- ADAS advanced driver assistance systems
- the basis for such driver assistance systems is formed by sensor data, for example provided signals from ultrasound sensors, radar sensors or cameras, which can be used to determine the current driving situation and in response to this the function of the respective driver assistance system can be carried out.
- sensor data for example provided signals from ultrasound sensors, radar sensors or cameras, which can be used to determine the current driving situation and in response to this the function of the respective driver assistance system can be carried out.
- the current driving situation must be able to be classified in a highly reliable manner using the sensor data.
- certain rules or criteria associated with a driving situation are set up, and if they are fulfilled, it can be concluded that a known driving situation exists. Fulfilling the rule or criteria acts, for example, as a trigger for an action by the driver assistance system.
- a traffic scenario in which a neighboring vehicle in front of the vehicle equipped with the driver assistance system (EGO vehicle) can cut into the same lane can be recognized by the fact that a sensor-detected transverse distance decreases perpendicular to the direction of travel to the neighboring vehicle and finally, at least essentially, assumes the value 0 if the neighboring vehicle is immediately in front of the EGO vehicle.
- classified sensor data are generally provided with respect to a known traffic scenario and the driver assistance system to be tested is fed with these classified sensor data.
- a large number of sensor data which may also characterize slight variations in the traffic scenario, are generally required.
- WO 2017/210222 A1 discloses the automatic generation of simulation scenarios for validating a driver assistance system.
- a large number of such simulation scenarios can be generated in particular by varying recorded scenarios, the variations being based on a data stream which is generated by isolating differences between similar recorded scenarios.
- a first aspect of the invention relates to a, in particular computer-aided, method for testing a driver assistance system for a vehicle in a test environment, comprising the following working steps: (i) determining traffic scenario descriptions, each of which describes a specific traffic scenario, in particular a cut-in maneuver or a cut-out maneuver, characterize and have at least one parameter by means of which the respective traffic scenario can be adapted to boundary conditions, the traffic scenario descriptions preferably, in particular in each case, being stored in a traffic scenario file in which the at least one parameter is stored in a predetermined, in particular generic, format; (ii) Selecting at least one traffic scenario description based on an input by a user, in particular an indication of the at least one parameter or at least one value or entered by the user Range of values for the at least one parameter and / or of predetermined criteria; and (iii) generating a test case on the basis of the at least one selected traffic scenario description and at least one predetermined value, in particular entered by the user, for the at least one parameter and preferably further
- a boundary condition in the sense of the invention is, in particular, a traffic situation, weather, an initial speed of the vehicle with the driver assistance system to be tested (hereinafter: test vehicle) and / or other road users, a road geometry or a course of the road, a distance from the test vehicle one or more other road users, a configuration of the test vehicle and / or other road users such as a load, for example a trailer, and / or the like.
- test vehicle an initial speed of the vehicle with the driver assistance system to be tested
- a boundary condition can in particular be any conceivable factor that influences the control of the vehicle equipped with the driver assistance system by the driver assistance system.
- a test case in the sense of the invention is in particular a script, e.g. a sequence of actions by road users, which enables testing of a driver assistance system.
- a test case can be, for example, a script, on the basis of which a simulation for testing the driver assistance system can be carried out.
- a test environment in the sense of the invention is, in particular, the content of a simulation that generates a concrete (virtual) implementation of a traffic scenario.
- a test environment can be, for example, a simulated environment of the test vehicle, in which at least other road users, possibly also the test vehicle itself, move in a predefined manner, in particular carry out predetermined actions.
- a predetermined format in the sense of the invention is in particular a predefined (data) structure.
- a predetermined format can, for example, correspond to a certain scheme, for example a certain arrangement or sequence of several parameters and / or a certain coding of the at least one parameter in the traffic scenario file. It is conceivable, for example, that several parameters are stored in a table, in particular in a two- or three-dimensional, possibly also multidimensional, matrix.
- Determining traffic scenario descriptions within the meaning of the invention is in particular capturing, e.g. when performing real or simulated tests. Determining traffic scenario descriptions can also be reading in, e.g. from databases and / or the like.
- the invention is based in particular on the approach to select at least one traffic scenario description from preferably a plurality of traffic scenario descriptions, each characterizing a particular traffic scenario and preferably in a predetermined, in particular generic, format, and on the basis thereof at least one test case to generate a test environment that is suitable for testing a driver assistance system.
- the traffic scenarios characterized by the traffic scenario descriptions preferably correspond to specific traffic scenarios such as cut-in maneuvers (single-maneuvers) or a cut-out maneuvers (maneuvering out).
- the traffic scenario descriptions preferably describe the respective traffic scenario in a general, generic form, however, without the traffic scenario descriptions specifying a specific execution of these maneuvers.
- the test case on the other hand, preferably corresponds to a concrete implementation of the traffic scenario, which is characterized by the at least one selected description of the traffic scenario.
- Both the at least one traffic scenario description can be selected on the basis of a user input, for example by specifying at least one parameter or entered values or value ranges for one or more parameters which adapt, in particular, define boundary conditions of the traffic scenarios, and the at least one test case who has at least one selected traffic scenario description are generated.
- the parameters can serve, for example, as variables in the traffic scenarios.
- the user can input that the test vehicle, i.e. the vehicle equipped with the driver assistance system, drives straight ahead in a first lane at a speed selected by the user and is overtaken by another vehicle in an adjacent second lane, the other vehicle being in the first lane at a distance selected by the user from the test vehicle reevers.
- a database with traffic scenario files stored therein which contain the traffic scenario descriptions in the specified format, can be searched in the following in order to select traffic scenario descriptions with which the specific traffic scenario characterized by the user input can be implemented.
- the parameters and / or boundary conditions entered by the user can then, like values in a mathematical function, be inserted into the at least one selected traffic scenario description in order to generate at least one test case with which a simulation is carried out and the driver assistance system is thereby tested can be.
- At least one traffic scenario description in particular from a large number of traffic scenario descriptions, can be selected by the user input, it is possible to dispense with a possibly complex, scenario- or maneuver-specific preparation of data records for generating test environments.
- test runs for testing a driver assistance system can therefore be carried out particularly easily and quickly and / or in large numbers.
- the traffic scenario descriptions can be stored in a predetermined, preferably generic, format, access to a wide range of traffic scenarios is made possible.
- the invention makes it possible to further improve the testing of driver assistance systems, in particular to simplify them and / or to make them more flexible.
- the method further comprises the following step: performing a test run using the test case generated.
- the method also has the following work steps: (i) determining at least one data set which characterizes at least one, in particular real, traffic scenario; and (ii) identifying at least one parameter in the at least one determined data set, by means of which the respective traffic scenario can be adapted to boundary conditions, in particular an initial speed of an EGO vehicle, to which the traffic scenario relates.
- An EGO vehicle in the sense of the invention is in particular a vehicle from the point of view of which the, in particular real, traffic scenario is running.
- the identification of at least one parameter in the at least one data record allows, in a particularly reliable manner, subsequently to select at least one traffic scenario description from a multiplicity of traffic scenario descriptions based on the user input.
- at least one traffic scenario can thus be selected based on the identified parameter, e.g. all traffic scenario descriptions that characterize a traffic scenario corresponding to a determined data set and therefore also have the identified parameter.
- the number of possible traffic scenarios relevant for testing the driver assistance system can be increased in this way.
- the at least one data record is preferably determined on the basis of a sensor data stream that is generated, for example, by a sensor device for detecting the (real) vehicle environment of the EGO vehicle, in particular extracted from the sensor data stream.
- the sensor data stream can be processed, for example, in such a way that the vehicle environment of the EGO vehicle is classified, that is to say, for example, objects such as other road users, traffic signs, obstacles and / or the like are identified and labeled.
- the at least one data record can then be generated from the processed sensor data stream.
- the at least one determined data record is preferably based on prepared sensor data that was generated when a real vehicle environment was detected and that contains additional meta information, ie information derived from raw data and therefore going beyond the pure physical information contained in the sensor data stream.
- This meta information in particular allows the identification of the at least one parameter, by means of which the respective traffic scenario can be adapted to boundary conditions.
- the identification of the at least one parameter is carried out by means of a comparison of a classified vehicle environment in chronologically successive scenes of the at least one traffic scenario characterized by the at least one determined data record.
- a classified vehicle environment in the sense of the invention is in particular a description of the vehicle environment of a vehicle that goes beyond pure physical information.
- the classified vehicle environment which is preferably characterized by the data set provided, can in particular contain meta information which makes the classified vehicle environment comparable at different times.
- the classified vehicle environment preferably contains meta information, on the basis of which in individual scenes of the at least one traffic scenario characterized and characterized by the at least one determined data record, objects can be identified and labeled, e.g. whose positions, their speed, their configuration and / or the like are comparable to one another in the successive scenes.
- the at least one parameter can be identified in a particularly reliable and / or automated manner.
- the states of the elements of the vehicle environment ie, for example, the objects identified in the vehicle environment, such as other road users, are preferably derived from the classified vehicle environment in each scene of the at least one traffic scenario characterized by the at least one determined data set and compared with one another in chronologically successive scenes , especially subtracted from each other.
- a state of an element of the vehicle environment in the sense of the invention contains in particular at least one physical variable that characterizes the element, in particular relative to the EGO vehicle, for example the speed of the element, the position of the element, the configuration of the element and / or similar. If the state of an element changes in the successive scenes, the at least one parameter is preferably identified as the physical variable that causes the change in the state. As a result, the at least one parameter can be identified particularly easily.
- the speed and size of another road user can be taken from the classified vehicle environment in a first scene and compared with the speed or size of this road user in a subsequent second scene.
- the speed of the road user will usually change in the course of the traffic scenario and can therefore be identified as a parameter.
- the size of the road user usually does not change and is therefore not identified as a parameter.
- the method further comprises the following step: generating at least one traffic scenario description on the basis of the determined data record or the determined data records, the traffic scenario description characterizing the determined traffic scenario and the at least one identified parameter in the predetermined format is filed.
- the storage of the at least one identified parameter in the specific format corresponds in a preferred manner to the generation of a standardized format or a standardized traffic scenario description.
- a standardized definition of the at least one corresponding traffic scenario which is characterized by the at least one determined data record, is stored.
- the at least one data record extracted from a sensor data stream can thereby be provided in particular in a generic form as a description of the traffic scenario and subsequently selected to generate at least one test case.
- the method also has the following work step: storing the generated traffic scenario description, in particular the traffic scenario file, in a traffic scenario database, wherein further traffic scenario files are also stored in the traffic scenario database.
- This traffic scenario database is preferably set up as a No-SQL database and contains a standardized definition of the at least one link. reverse scenarios that are characterized by the at least one determined data set.
- the method further comprises at least one of the following work steps: (i) determining the predetermined values from a test run database; and / or (ii) determining the predetermined values from a user input, in particular via a user interface.
- at least one value or range of values for the at least one parameter which e.g. has proven to be useful in previous tests of a driver assistance system, read from the test run database and used to generate the at least one test case.
- a user can specify at least one value or range of values for the at least one parameter when inputting a user, in particular when inputting to select at least one traffic scenario description.
- test cases can be generated automatically and quickly and / or the user can be given a high degree of control over the generation of the test cases and thus over the checking of the driver assistance system.
- a second aspect of the invention relates to a device for testing a driver assistance system for a vehicle in a test environment, which has a means for determining traffic scenario descriptions, wherein the traffic scenario descriptions preferably each have a specific traffic scenario, in particular a cut-in maneuver or a cut-out maneuver, characterize it and have at least one parameter by means of which the respective traffic scenario can be adapted to boundary conditions.
- the means for determining traffic scenario descriptions is also preferably set up to store the traffic scenario descriptions, in particular in each case, in a traffic scenario file in which the at least one parameter is stored in a predetermined, in particular generic, format.
- the means for determining traffic scenario descriptions can in particular be set up as an interface or sensor device.
- the device preferably has a means for selecting at least one traffic scenario description on the basis of an input from a user and / or predefined criteria, the means for selecting at least one traffic scenario description in particular as a first module a data processing device, for example as appropriate software.
- the device preferably has a means for generating a test case on the basis of the at least one selected traffic scenario description and at least one predetermined value for the at least one parameter and preferably further traffic scenario descriptions, the test case with a concrete implementation of the the at least one selected traffic scenario description characterized traffic scenarios and preferably further traffic scenarios corresponding to the at least one predetermined value of the at least one parameter and is suitable for generating a test environment in which a driver assistance system can be subjected to a test run.
- the means for generating the test case can in particular be set up as a second module of the data processing device, for example as appropriate software.
- a means within the meaning of the present invention can be designed in terms of hardware and / or software, in particular one that is data or signal linked, preferably digital, processing, in particular microprocessor unit (CPU) or a, preferably with a memory and / or bus system Have module of such and / or one or more programs or program modules.
- the CPU can be designed to process commands implemented as a program stored in a memory system, to detect input signals from a data bus and / or to output signals to a data bus.
- a storage system can have one or more, in particular different, storage media, in particular optical, magnetic, solid-state and / or other non-volatile media.
- the program can be designed in such a way that it embodies or is capable of executing the methods described here, so that the CPU can carry out the steps of such methods and thus in particular can control and / or monitor a reciprocating piston engine.
- the device has a traffic scenario database in which traffic scenario descriptions are or are stored in the form of traffic scenario files, each of which has at least one parameter present in a predetermined, in particular generic, format, by means of which a through the respective traffic scenario description characterized traffic scenario can be adapted to boundary conditions.
- the device also has an input device by means of which a user can make an input for selecting at least one traffic scenario description, in particular from traffic scenario descriptions stored in the traffic scenario database.
- the device has a simulation device which is set up to carry out a test run using the test case generated.
- the simulation device can have, for example, a simulation environment such as MATLAB / Simulink, IPG CarMaker, PreScan, SUMO SCANer or Virtual Test Drive (VTD).
- FIG. 1 shows a preferred embodiment of a device according to the invention
- FIG. 1 shows a preferred embodiment of a device 100 according to the invention for testing a driver assistance system for a vehicle in a test environment.
- the device 100 has a traffic scenario database 2 with traffic scenario descriptions stored therein, each of which characterizes a specific traffic scenario, an input device 3 for selecting at least one of the traffic scenario descriptions stored in the traffic scenario database 2, and a data processing device 4 for creating a test case which, with a concrete realization of the traffic scenario selected by the at least one Description characterized traffic scenarios corresponds, based on the at least one selected traffic scenario description and a simulation device 5 for performing a test run using the test case generated, in particular a test environment generated based on the test case.
- the traffic scenario descriptions preferably characterize a specific traffic scenario, for example a cut-in maneuver or a cut-out maneuver, in a generic manner.
- the traffic scenario descriptions preferably each represent a traffic scenario, in particular at least one concrete driving maneuver of a vehicle involved in the traffic scenario, in an abstract form.
- the traffic scenario descriptions are preferably stored in the traffic scenario database 2 in the form of traffic scenario files. Because of the preferred generic character of the traffic scenario descriptions, the traffic scenario files can be stored in a predetermined, in particular generic, format, regardless of the (specific) traffic scenario characterized in each case. This enables or at least simplifies, for example, an identification and / or a parameterization of the traffic scenario characterized by the respective traffic scenario description.
- the traffic scenario descriptions stored in the traffic scenario database 2 can have, for example, at least one parameter, for example speeds and / or positions of the traffic participants contained in the traffic scenario, with which the respective traffic scenario can be adapted to boundary conditions.
- the at least one parameter is preferably contained in the traffic scenario files.
- the predefined format of the traffic scenario files can correspond to the predefined format of the at least one parameter with which the at least one parameter is stored in the traffic scenario file.
- the predetermined format of the traffic scenario files can be predetermined or formed by the structure with which the at least one parameter is stored in the traffic scenario database 2. This enables the parameterization of the traffic scenarios.
- At least one traffic scenario description can also be selected via the at least one parameter contained in the traffic scenario files.
- a user can use the input device 3 to specify or specify at least one parameter which is to be taken into account when creating test cases.
- the user can enter at least one value or range of values for the at least one parameter via the input device 3, so that those traffic scenario descriptions which have the corresponding parameter or in which the corresponding one can be selected can be selected in the database Parameter can take the entered value or range of values.
- the input device 3 can have, for example, a graphical user interface, in which the user can provide information on the selection of the at least one traffic scenario description, in particular the at least one parameter.
- the input device 3 thus preferably serves as a user interface.
- the data processing device 4 is preferably set up to take into account at least one predefined value for the at least one parameter for generating the test case on the basis of the at least one selected traffic scenario description, the at least one predefined value being provided, for example, by the input device 3 can.
- the traffic scenario characterized by the selected, preferably generic or abstract, traffic scenario description can be concretized, so that the test case preferably corresponds to a specific implementation of the traffic scenario.
- the simulation device 5 can preferably generate a test environment in which a driver assistance system can be subjected to a test run.
- the simulation device 5 can simulate a virtual, in particular dynamic, vehicle environment in which the reaction of the driver assistance system is tested in the traffic scenario specified by the test case.
- the parameterization of the traffic scenarios each of which is characterized by a description of the traffic scenario, allows the driver to be tested accordingly. assistance systems under different conditions, for example in different weather conditions, on different road segments, at different vehicle speeds, with or without a trailer and / or the like.
- FIG. 2 shows a preferred embodiment of a method 1 according to the invention for testing a driver assistance system for a vehicle in a test environment 6.
- a sensor data stream 7 generated when a real vehicle environment is detected by means of a sensor device is preferably processed.
- the sensor data stream 7 can in particular be prepared in such a way that parameterizable data records, each characterizing at least one traffic scenario, can be generated and stored in a database 2 as, in particular, generic traffic scenario descriptions.
- these traffic scenario descriptions serve as the basis for the generation of at least one test case with which the test environment 6 can be generated for testing the driver assistance system.
- the sensor data stream 7 is preferably processed in method step S1, in particular analyzed, e.g. by the vehicle environment mapped by the sensor data stream 7 is classified.
- elements of the vehicle environment can be identified and labeled in individual snapshots of the vehicle environment obtained by sensor data fusion, which correspond to individual scenes of a real (specific) traffic scenario.
- Meta information which goes beyond the pure physical information due to the sensory detection of the vehicle environment, is preferably generated.
- object lists of objects recognized in the vehicle environment, such as other road users or traffic signs can be generated in this frame.
- Such processing of the sensor data stream 7 can be implemented, for example, by a rule-based approach in which predetermined events are recognized and marked.
- an environment model is preferably generated on the basis of the sensor data stream 7, which, for example, represents the objects around the EGO vehicle equipped with the sensor device.
- step S2a on the basis of the sensor data stream 7 processed in this way, in particular from the meta-information generated in the process, such as an object list, at least one data record that contains at least one characterized, determined traffic scenario.
- processed sensor data corresponding to individual traffic scenarios which are identified, for example, by recognized predetermined events, can be selectively extracted from the sensor data stream 7. This can also be called scenario mining.
- At least one parameter is preferably identified for the at least one determined data set, by means of which the at least one traffic scenario characterized by the at least one determined data set is based on boundary conditions, such as weather conditions, a speed of the EGO vehicle and / or the like , can be adjusted.
- boundary conditions such as weather conditions, a speed of the EGO vehicle and / or the like
- the at least one traffic scenario characterized by the at least one determined data record can be parameterized.
- the identification of the at least one parameter can be achieved, for example, by using the classified vehicle environment, i.e. the at least one data record, the states of elements of the vehicle environment, for example of recognized objects such as other road users, are determined and compared with one another in successive scenes of the traffic scenario characterized by the at least one data record.
- a state of an element of the vehicle environment can be defined, for example, by physical variables such as a speed, position, configuration and / or the like.
- at least one parameter is identified in particular when a change in a state of an element occurs in the temporally successive scenes of the traffic scenario, for example a change in speed or position.
- method steps S2a and S2b can also be understood as determining traffic scenario descriptions and summarized in a method step S2c will.
- traffic scenario descriptions can also be determined in some other way, for example from other databases such as NCAP, DVP and / or accident databases (not shown).
- step S3 the at least one data record with the at least one traffic scenario parameterized in this way as, in particular generic, Traffic scenario description stored in a traffic scenario file and stored in the traffic scenario database 2.
- the at least one identified parameter can be stored in a predetermined, in particular generic, format in the traffic scenario file.
- step S4 at least one of the traffic scenario descriptions ascertained and stored in the traffic scenario database 2 can then be selected by inputting a user, for example via an input device 3.
- the user can specify at least one parameter with which the traffic scenarios characterized by the traffic scenario descriptions can be adapted to boundary conditions.
- the at least one traffic scenario description that is relevant or selected with regard to the user input is made available to a data processing device that, based on this traffic scenario description and at least one value, in particular by the user input, for the at least one parameter in a further method step S6 at least one test case is generated which corresponds to a concrete implementation of the traffic scenario characterized by the at least one selected traffic scenario description.
- the at least one test case generated can be used to generate a test environment for testing the driver assistance system.
- the user can influence, in particular configure, the test of the driver assistance system via his input, for example by specifying boundary conditions for the traffic scenario characterized by the at least one traffic scenario description, in particular the course of the traffic scenario, e.g. resolving a traffic situation, specified.
- the user can e.g. select appropriate parameters on the basis of which the at least one test case is created. It is particularly conceivable that the user directly selects relevant traffic scenario descriptions and, e.g. by specifying at least one value or range of values of a corresponding parameter.
- Such modified traffic scenario descriptions can be carried out in a further method step S5, possibly together with generated test cases, in the traffic scenario database, where you can be selected at a later point in time, especially faster, to create test cases.
- a test environment 6 for testing a driver assistance system is generated from the at least one test case generated by means of a simulation device 5.
- the simulation device 5 can have a simulation environment, such as MATLAB / Simulink, IPG CarMaker, PreScan, SUMO SCANer or Virtual Test Drive (VTD).
- the test environment 6 can be generated independently of the simulation environment used, since the traffic scenario descriptions in the traffic scenario database 2 are stored as traffic scenario files in a predetermined, in particular generic, format and, accordingly, the test cases in a standardized format, e.g. the OpenSCENARIO format, who can.
- FIG 3 shows an example of a traffic scenario description 1 1 in a schematic representation.
- the traffic scenario description 12 shown corresponds to a general description of a specific traffic scenario, in particular a driving maneuver such as a cut-in maneuver in the example shown, in which an EGO vehicle 8 to which the traffic scenario relates , from a first lane 9a to a second, adjacent lane 9b behind a preceding vehicle 10, as indicated by the arrow.
- a driver assistance system for example adaptive cruise control (ACC)
- ACC adaptive cruise control
- Such a traffic scenario description 12 characterizing a traffic scenario can be determined in various ways.
- traffic scenario descriptions can be loaded from NCAP, DVP and / or accident databases.
- sensor data can be collected which characterize the traffic scenario, for example by carrying out corresponding simulations or the EGO vehicle 8 equipped with a sensor device for detecting the vehicle environment is taking a test drive and a section of a sensor data stream generated by the sensor device, which corresponds to the traffic scenario when sensor data is extracted.
- the sensor data stream is distinguished, for example, by the fact that the vehicle 10 driving ahead is suddenly detected in the middle of a detection region 11 of a sensor unit of the sensor device, for example a LIDAR sensor, when the lanes 9a, 9b change .
- This event can therefore be interpreted as a trigger for the cut-in maneuver and, preferably together with other corresponding triggers, can be used to extract the sensor data from the sensor data stream.
- parameters are preferably identified in the following which determine the boundary conditions of the traffic scenario, for example the speed of the ego vehicle 8 and the vehicle 10 driving ahead, the distance of the ego vehicle 8 from the vehicle 10 driving ahead at the beginning and / or at the end of the cut-in maneuver, the lanes 9a, 9b and / or the like used by the vehicles 8, 10 each.
- the parameters identified in this way preferably determine how the cut-in maneuver proceeds.
- the parameters can in particular be identified by comparing different states of the two vehicles 8, 10 which are defined by the parameters and which occur during the course of the traffic scenario, in particular at the beginning and at the end of the traffic scenario, in particular subtractively from one another here.
- the parameters identified in this way are preferably stored at least as part of the traffic scenario description 12 in a traffic scenario file which, together with other traffic scenario files, for example from NCAP, DVP and / or accident Databases, which forms a traffic scenario database.
- the traffic scenario file is preferably provided with a marker (tag) which identifies the traffic scenario description 12 stored in the traffic scenario as corresponding to a cut-in maneuver.
- test vehicle On the basis of which a test environment can be generated in which the driver assistance system of the EGO vehicle 8 (hereinafter referred to as test vehicle, since it is equipped with the driver assistance system to be tested) can be tested the traffic scenario description 12 of the cut-in maneuver, which was determined as described above, is selected, eg by a user input, by means of which all traffic scenario descriptions 12 identified with the corresponding marking are called up. Values for the parameters of the selected traffic scenario description 12 can e.g. also by user input or by retrieving from a parameter database.
- the cut-in maneuver characterized by the selected traffic scenario description 12 is then preferably matched to the parameters set by the parameters and / or others, e.g. Boundary conditions defined by the user input are adapted.
- a value can be specified for the, in particular lateral, speed of the test vehicle 8, which value is lower than when the real cut-in maneuver was recorded. Accordingly, the implementation of the cut-in maneuver characterized by the test case proceeds more slowly or takes longer. In this way, at least one value or range of values can also be specified for other parameters in order to produce one or more implementations of the cut-in maneuver. Correspondingly, several different test cases can be generated easily and without great effort on the basis of the one traffic scenario description 12. Reference list
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Traffic Control Systems (AREA)
- Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
ATA50922/2018A AT521607B1 (en) | 2018-10-24 | 2018-10-24 | Method and device for testing a driver assistance system |
PCT/EP2019/078898 WO2020083996A1 (en) | 2018-10-24 | 2019-10-23 | Method and device for testing a driver assistance system |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3871134A1 true EP3871134A1 (en) | 2021-09-01 |
Family
ID=68424851
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19797196.3A Pending EP3871134A1 (en) | 2018-10-24 | 2019-10-23 | Method and device for testing a driver assistance system |
Country Status (7)
Country | Link |
---|---|
US (1) | US20220048536A1 (en) |
EP (1) | EP3871134A1 (en) |
JP (1) | JP2022505759A (en) |
KR (1) | KR20210078546A (en) |
CN (1) | CN113168524B (en) |
AT (1) | AT521607B1 (en) |
WO (1) | WO2020083996A1 (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102016220913A1 (en) * | 2015-11-06 | 2017-05-11 | Ford Global Technologies, Llc | Method and device for generating test cases for autonomous vehicles |
KR20220127131A (en) * | 2019-12-17 | 2022-09-19 | 포레텔릭스 엘티디. | System and method for monitoring correct operation of autonomous vehicle |
AT523834B1 (en) * | 2020-09-15 | 2021-12-15 | Avl List Gmbh | Method and system for testing a driver assistance system |
CN112306042B (en) * | 2020-10-30 | 2022-11-04 | 重庆长安汽车股份有限公司 | Automatic test system and method for automatic driving controller |
CN112434412A (en) * | 2020-11-14 | 2021-03-02 | 武汉中海庭数据技术有限公司 | SUMO and UNITY combined simulation traffic network method and system |
CN113570727B (en) * | 2021-06-16 | 2024-04-16 | 阿波罗智联(北京)科技有限公司 | Scene file generation method and device, electronic equipment and storage medium |
CN113704993B (en) * | 2021-08-25 | 2024-04-26 | 娄底职业技术学院 | Traffic scene digitizing method |
DE102021131115A1 (en) | 2021-11-26 | 2023-06-01 | Dr. Ing. H.C. F. Porsche Aktiengesellschaft | Process for scenario identification for an application of driver assistance systems |
CN113901285B (en) * | 2021-12-09 | 2022-03-15 | 深圳佑驾创新科技有限公司 | Vehicle road test method, device, electronic equipment and storage medium |
DE102022107846A1 (en) | 2022-04-01 | 2023-10-05 | Dr. Ing. H.C. F. Porsche Aktiengesellschaft | Method, system and computer program product for creating parameterized scenarios |
CN114740759A (en) * | 2022-04-18 | 2022-07-12 | 中国第一汽车股份有限公司 | Test method and device for automatic driving system, storage medium and electronic device |
DE102022119179A1 (en) | 2022-08-01 | 2024-02-01 | Dr. Ing. H.C. F. Porsche Aktiengesellschaft | Method, system and computer program product for testing and training a driver assistance system (ADAS) and/or an automated driving system (ADS) and/or a driving function |
CN115542882B (en) * | 2022-09-30 | 2024-02-27 | 东风汽车股份有限公司 | Controller interface configuration method and device |
CN115509212B (en) * | 2022-11-18 | 2023-03-14 | 联友智连科技有限公司 | Automated testing system and method based on VTD |
CN116108569A (en) * | 2023-04-10 | 2023-05-12 | 国汽(北京)智能网联汽车研究院有限公司 | Combined simulation method and device for vehicle, computer equipment and storage medium |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4371137B2 (en) * | 2006-11-10 | 2009-11-25 | トヨタ自動車株式会社 | Automatic operation control device |
DE102011088807A1 (en) * | 2011-12-16 | 2013-06-20 | Bayerische Motoren Werke Aktiengesellschaft | Method for developing and/or testing driver assistance system for motor car, involves determining set of scenarios and characterizing set of scenarios by parameter that is related to driving conditions of car |
DE102012004650A1 (en) * | 2012-03-07 | 2013-09-12 | Audi Ag | Method for testing the functionality of a driver assistance system installed in a test vehicle |
US8457827B1 (en) * | 2012-03-15 | 2013-06-04 | Google Inc. | Modifying behavior of autonomous vehicle based on predicted behavior of other vehicles |
DE102013200116A1 (en) * | 2013-01-08 | 2014-07-10 | Bayerische Motoren Werke Aktiengesellschaft | Method for developing and/or testing driver assistance system for motor vehicle, involves determining motor vehicle parameter, and transferring control function of vehicle between rider and corresponding driver assistance system |
AT514754B1 (en) * | 2013-09-05 | 2018-06-15 | Avl List Gmbh | Method and device for optimizing driver assistance systems |
AT513370B1 (en) * | 2013-11-05 | 2015-11-15 | Avl List Gmbh | Virtual test optimization for driver assistance systems |
DE102015104890A1 (en) * | 2015-03-30 | 2016-10-06 | Gpi Gesellschaft Für Prüfstanduntersuchungen Und Ingenieurdienstleistungen Mbh | Test system and test method for testing a vehicle and / or vehicle driver specific signal perception and response and configuration system and configuration method for vehicle and / or vehicle driver specific configuration of at least one driver system interface |
DE102016220913A1 (en) * | 2015-11-06 | 2017-05-11 | Ford Global Technologies, Llc | Method and device for generating test cases for autonomous vehicles |
DE102015224558A1 (en) * | 2015-12-08 | 2017-06-08 | Robert Bosch Gmbh | Method for validating a driver assistance function of a motor vehicle |
CN105718065B (en) * | 2016-01-27 | 2018-08-21 | 北京交通大学 | Interactive inspection analogue system under bus or train route cooperative surroundings |
US10552573B2 (en) * | 2016-03-18 | 2020-02-04 | Toyota Jidosha Kabushiki Kaisha | Vehicle simulation device for crowd-sourced vehicle simulation data |
DE102016205153A1 (en) * | 2016-03-29 | 2017-10-05 | Avl List Gmbh | A method for generating control data for rule-based driver assistance |
US11137763B2 (en) * | 2016-05-30 | 2021-10-05 | Faraday & Future Inc. | Generating and fusing traffic scenarios for automated driving systems |
DE102016008218A1 (en) * | 2016-07-06 | 2018-01-11 | Audi Ag | Method for improved recognition of objects by a driver assistance system |
DE102016116135A1 (en) * | 2016-08-30 | 2018-03-01 | Dspace Digital Signal Processing And Control Engineering Gmbh | Method for simulating a collision situation |
AT518792B1 (en) * | 2016-09-12 | 2018-01-15 | Avl List Gmbh | Modular test bench for complete vehicles ready to drive |
DE102016218277B4 (en) * | 2016-09-22 | 2021-08-12 | Benjamin May | Method for functional testing of a driver assistance system as well as control unit and reference device for a driver assistance system |
US10228693B2 (en) * | 2017-01-13 | 2019-03-12 | Ford Global Technologies, Llc | Generating simulated sensor data for training and validation of detection models |
WO2018176000A1 (en) * | 2017-03-23 | 2018-09-27 | DeepScale, Inc. | Data synthesis for autonomous control systems |
CN108646586A (en) * | 2018-03-20 | 2018-10-12 | 重庆邮电大学 | A kind of intelligent network connection automobile assemblage on-orbit, test verification System and method for |
CN108681264A (en) * | 2018-08-10 | 2018-10-19 | 成都合纵连横数字科技有限公司 | A kind of intelligent vehicle digitalized artificial test device |
US20200209874A1 (en) * | 2018-12-31 | 2020-07-02 | Chongqing Jinkang New Energy Vehicle, Ltd. | Combined virtual and real environment for autonomous vehicle planning and control testing |
US10636295B1 (en) * | 2019-01-30 | 2020-04-28 | StradVision, Inc. | Method and device for creating traffic scenario with domain adaptation on virtual driving environment for testing, validating, and training autonomous vehicle |
-
2018
- 2018-10-24 AT ATA50922/2018A patent/AT521607B1/en active
-
2019
- 2019-10-23 JP JP2021522417A patent/JP2022505759A/en active Pending
- 2019-10-23 CN CN201980079143.7A patent/CN113168524B/en active Active
- 2019-10-23 WO PCT/EP2019/078898 patent/WO2020083996A1/en unknown
- 2019-10-23 US US17/287,814 patent/US20220048536A1/en active Pending
- 2019-10-23 KR KR1020217015581A patent/KR20210078546A/en not_active Application Discontinuation
- 2019-10-23 EP EP19797196.3A patent/EP3871134A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
CN113168524A (en) | 2021-07-23 |
KR20210078546A (en) | 2021-06-28 |
AT521607B1 (en) | 2020-03-15 |
US20220048536A1 (en) | 2022-02-17 |
JP2022505759A (en) | 2022-01-14 |
AT521607A4 (en) | 2020-03-15 |
WO2020083996A1 (en) | 2020-04-30 |
CN113168524B (en) | 2024-06-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AT521607B1 (en) | Method and device for testing a driver assistance system | |
EP3438901A1 (en) | Test drive scenario database system for realistic virtual test drive scenarios | |
AT523834B1 (en) | Method and system for testing a driver assistance system | |
DE102016224291A1 (en) | Method for the computer-aided adaptation of a predetermined semi-automated driving system of a motor vehicle | |
DE102009028451A1 (en) | Collision monitoring for a motor vehicle | |
WO2021058223A1 (en) | Method for applying automated driving functions efficiently and in a simulated manner | |
WO2018068917A1 (en) | Categorization of vehicles in the environment of a motor vehicle | |
EP3789926A1 (en) | Method for detecting an adversarial fault in the input data of a neural network | |
DE102019008093A1 (en) | Method for merging sensor data from a large number of detection devices using a sparse occupancy grid, as well as a driver assistance system | |
WO2020051618A1 (en) | Analysis of dynamic spatial scenarios | |
WO2020048669A1 (en) | Method for determining a lane change indication of a vehicle, computer-readable storage medium, and vehicle | |
DE102016207463A1 (en) | Method and device for operating at least one vehicle with respect to at least one passable object in the vicinity of the at least one vehicle | |
DE102020113611A1 (en) | Method and safety system for securing an automated vehicle function and motor vehicle | |
DE102014210752A1 (en) | Method and device for monitoring a target trajectory of a vehicle | |
DE102016120066A1 (en) | A computer implemented method for controlling an object recognition system | |
DE102017208692A1 (en) | Method for providing training data for a functional test of a recognition device and database system | |
DE102018125712A1 (en) | Driving support method for a vehicle | |
WO2022251890A1 (en) | Method and system for testing a driver assistance system for a vehicle | |
EP4248418A2 (en) | Method and system for annotating sensor data | |
WO2022122553A1 (en) | Comparing digital representations of driving situations of a vehicle | |
AT524821A1 (en) | Method and system for generating scenario data for testing a driver assistance system of a vehicle | |
WO2020160801A1 (en) | Method, device, computer program and computer program product for operating a vehicle | |
DE102020203829A1 (en) | Method for monitoring a vehicle system for recognizing the surroundings of a vehicle | |
DE102019127322A1 (en) | Method for detecting objects in a vehicle environment, device for data processing, computer program product and computer-readable data carrier | |
DE102015202343A1 (en) | Method and system for performing automated driving maneuvers |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20210520 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20221209 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230503 |