Classifications

• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
  • G01M17/00—Testing of vehicles
  • G01M17/007—Wheeled or endless-tracked vehicles
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
  • G01M17/00—Testing of vehicles
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F11/00—Error detection; Error correction; Monitoring
  • G06F11/36—Prevention of errors by analysis, debugging or testing of software
  • G06F11/3668—Testing of software
  • G06F11/3672—Test management
  • G06F11/3684—Test management for test design, e.g. generating new test cases
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
  • G01M17/00—Testing of vehicles
  • G01M17/007—Wheeled or endless-tracked vehicles
  • G01M17/06—Steering behaviour; Rolling behaviour
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F11/00—Error detection; Error correction; Monitoring
  • G06F11/30—Monitoring
  • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
  • G06F11/3457—Performance evaluation by simulation
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F11/00—Error detection; Error correction; Monitoring
  • G06F11/36—Prevention of errors by analysis, debugging or testing of software
  • G06F11/3698—Environments for analysis, debugging or testing of software
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/20—Analysis of motion
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/70—Determining position or orientation of objects or cameras
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/20—Movements or behaviour, e.g. gesture recognition
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
  • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30196—Human being; Person
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
  • G09B9/00—Simulators for teaching or training purposes
  • G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
  • G09B9/04—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
  • G09B9/048—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles a model being viewed and manoeuvred from a remote point
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
  • G09B9/00—Simulators for teaching or training purposes
  • G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
  • G09B9/04—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
  • G09B9/05—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles the view from a vehicle being simulated

Definitions

• the invention relates to a method for operating a test bench for vehicles using simulation means and a motion detection system, a method for operating a test bench, a system for operating a test bench, a computer program and a computer program product.
• Autonomous or semi-autonomous vehicles are equipped with a large number of sensors and algorithms that convert the sensor signals into an image of the environment.
• ABS anti-lock braking system
• ESP electronic stability program
• Driver assistance systems that are already being used to increase active road safety are a parking assistant, an adaptive distance control system, also known as Adaptive Cruise Control (ACC), which adaptively adjusts a desired speed selected by the driver to a distance from a vehicle in front.
• ACC stop & go systems which in addition to the ACC causes the vehicle to continue driving automatically in traffic jams or when vehicles are stationary
• lane keeping or lane assist systems which automatically keep the vehicle in its lane and pre-crash systems which, in the event of a collision, prepare or initiate braking in order to take the kinetic energy out of the vehicle and, if necessary, initiate further measures if a collision is unavoidable.
• driver assistance systems increase safety on the road by warning the driver in critical situations until they initiate an independent intervention to avoid or reduce accidents, for example by activating an emergency braking function.
• driving comfort is increased by functions such as automatic parking, automatic lane keeping and automatic distance control.
• the safety and comfort gain of a driver assistance system is only perceived positively by the vehicle occupants if the support by the driver assistance system is safe, reliable and—as far as possible—comfortable.
• each driver assistance system depending on its function, must manage scenarios that occur in traffic with maximum safety for the vehicle itself and without endangering other vehicles or other road users.
• the respective degree of automation of vehicles is divided into so-called automation levels 1 to 5 (see, for example, the SAE J3016 standard).
• the present invention relates in particular to vehicles with driver assistance systems of automation level 3 to 5, which is generally regarded as highly automated (3 and 4) or autonomous (5) driving.
• ADAS/AD functions ADAS - Advanced Driver Assistance System
• AD - Autonomous Driving ADAS - Advanced Driver Assistance System
• Dummies are usually images of average people in terms of anatomical size and proportions, mostly males. Dummies are not only expensive, but also in their Handling is difficult and can therefore only provide one-off and not particularly realistic results on the behavior of the driver assistance systems.
• the document GB 2563400 discloses a method for testing vehicles and their algorithms in situations with pedestrians.
• a first aspect of the invention relates to a method for operating a test stand for vehicles using simulation means and a movement detection system, the method having the following work steps:
• a virtual test environment with at least one virtual living being and at least one virtual vehicle by means of the simulation means, one of the virtual living beings being a virtual representation of a real living being and one of the virtual vehicles being a virtual representation of a vehicle with the driver assistance system, with at least parts additionally of the vehicle are operated as a real test specimen on the test bench, with the driver assistance system being operated, in particular stimulated, on the basis of the virtual test environment.
• the real vehicle can be operated at least partially as a test object on a test stand.
• the method has: Stimulating a real living being in the motion detection system on the basis of the generated virtual environment by means of a stimulus and capturing motion data by means of the motion detection system (English: “Motion Capture System”), wherein the Movement data describe a time course of the pose of at least part of an anatomical structure of the real living being.
• the method also has: Recording the recorded movement data.
• the method can include the operation of a test bench with a virtual test environment.
• a second aspect of the invention relates to a method for operating a test bench using simulation means, in particular according to a first aspect of the invention, the method having:
• One vehicle also ego object or ego vehicle, which is a virtual representation of the vehicle with the driver assistance system, is operated at least partially as a test item on a test bench. In other words, at least parts of the vehicle are operated as a real test object on a test bench.
• the driver assistance system is operated, in particular stimulated, on the basis of the virtual test environment.
• the method includes capturing motion data, in particular by means of a motion capture system.
• the movement data describe or represent a chronological progression of the pose of the at least one part of an anatomical structure of a real living being.
• the method also includes the recording of a scenario, which, in particular through a reaction of the driver assistance system to the recorded movement data arises, with the recorded movement data and a reaction of the driver assistance system to the virtual living being being taken into account when generating the virtual test environment.
• the method preferably also includes the generation of test scenarios for testing a driver assistance system for vehicles.
• a third aspect of the invention relates to a system for operating a test stand for vehicles, which is set up and/or comprises in particular for carrying out a method, in particular a method according to the above aspects.
• the system preferably has simulation means that are set up to generate a virtual test environment with at least one virtual living being and at least one virtual vehicle, one of the virtual living beings being a representation of a real living being and one of the virtual vehicles being a virtual representation of a vehicle with the driver assistance system, with at least parts of the vehicle also being operated as a real test specimen on the test bench and for operating, in particular stimulating, the driver assistance system on the basis of the virtual test environment.
• the system preferably has a motion detection system for capturing motion data, the motion data describing a chronological progression of the pose of the at least one part of an anatomical structure of the real living being.
• the system preferably also has stimulation means, the stimulation means being set up for stimulating the real living being in the movement detection system on the basis of the generated virtual environment by means of a stimulus. Furthermore, the system preferably has storage means for recording the recorded movement data.
• a fourth aspect of the invention relates to a system for operating a test bench, in particular according to a system of the third aspect, having: Simulation means set up to generate a virtual test environment with at least one virtual living being and at least one virtual vehicle.
• One of the virtual creatures is a virtual representation of a real creature.
• One of the virtual vehicles is also a virtual representation of a vehicle with the driver assistance system.
• the system is also set up to operate the vehicle at least partially as a real test object on the test bench and to operate, in particular to stimulate, the driver assistance system on the basis of the virtual test environment.
• the system also has a means, in particular a motion detection system or an interface, which is set up to capture motion data, the motion data describing a chronological progression of the pose of the at least one part of an anatomical structure of the real living being.
• the system has storage means for recording a scenario that results from a reaction of the driver assistance system to the recorded movement data, the recorded movement data and a reaction of the driver assistance system to the virtual living being being taken into account when generating the virtual test environment.
• a system and/or a means within the meaning of the present invention can be designed in terms of hardware and/or software, in particular at least one, in particular digital, processing unit, in particular microprocessor unit ( CPU), graphics card (GPU) or the like, and / or have one or more programs or program modules.
• the processing unit can be designed to process commands that are implemented as a program stored in a memory system, to acquire input signals from a data bus and/or to output output signals to a data bus.
• a storage system can have one or more, in particular different, storage media, in particular optical, magnetic, solid-state and/or other non-volatile media.
• the program may be arranged to embody or perform the methods described herein is able so that the processing unit can carry out the steps of such a method and thus in particular can operate or monitor a device.
• a fifth aspect of the invention relates to a computer program or computer program product, the computer program or computer program product containing instructions, in particular stored on a computer-readable and/or non-volatile storage medium, which when executed by one or more computers or in particular a system for operating a test stand for vehicles cause the computer or the system to carry out a method for operating a test stand for vehicles using simulation means and a movement detection system, in particular according to embodiments as described above.
• a computer program product can have, in particular, be a, in particular, computer-readable and/or non-volatile storage medium for storing a program or instructions or with a program or with instructions stored thereon.
• execution of this program or these instructions by a system or controller causes the system or controller, in particular the computer or computers, to perform a method described here or one or more of its steps, or the program or the instructions are set up to do so
• a scenario within the meaning of the invention is preferably formed from a chronological sequence of, in particular static, scenes.
• the scenes indicate, for example, the spatial arrangement of the at least one object, in particular the at least one virtual living being, relative to the ego object, in particular the constellation of road users and/or in particular the constellation of immovable virtual objects, virtual living beings, in particular virtual road users, at.
• a scenario can contain, in particular, a driving situation in which a driver assistance system, called the ego vehicle, interacts with the driver assistance system equipped vehicle controls at least partially, z.
• B. performs at least one vehicle function of the ego vehicle autonomously.
• Movement data of at least one part of an anatomical structure of a real living being within the meaning of the invention is preferably understood to mean that at least the smallest part of a part of the body of the real living being that can be moved by a joint and/or a muscle is represented by the movement data and this movement data describe the course of this smallest part over time.
• a driving situation within the meaning of the invention preferably describes the circumstances that are to be taken into account for the selection of suitable behavior patterns of the driver assistance system at a specific point in time.
• a driving situation is therefore preferably subjective in that it represents the view of the ego vehicle. It also preferably includes relevant conditions, possibilities and factors influencing actions.
• a driving situation is more preferably derived from the scene by an information selection process based on transients, e.g. B. mission-specific as well as permanent goals and values.
• a driving behavior within the meaning of the invention is preferably a behavior of the driver assistance system through action and reaction in the surroundings of the vehicle.
• a quality within the meaning of the invention preferably characterizes the simulated scenario.
• a quality is preferably understood to mean a quality or condition of the simulated scenario in relation to its suitability for testing the driver assistance system. In this case, a more critical scenario preferably has a higher quality.
• the dangerousness of a driving situation, which emerges from the respective scenario for the tested driver assistance system, is preferably a measure of the quality of the scenario.
• a pose within the meaning of the invention is the spatial location, in particular the combination of position and orientation of an object, in particular a part of an anatomical structure of a living being.
• the pose can relate to a separately moveable anatomical part of the living being, which can be detected in particular in the overall context of the pose of the living being with a movement detection system.
• a detection can take place in particular via stereo cameras, infrared tracking, image recognition or with comparable systems, in particular motion detection systems and methods for motion detection in a three-dimensional volume in particular.
• a movement detection system can detect a movement in particular with markers, in particular with active or in particular with passive markers, or without markers, in particular via pattern recognition, silhouette tracking and/or the like.
• the movement detection system can in particular be connected to a test stand in data communication, in particular wirelessly or by wire.
• the motion detection system can be locally separate from the test stand.
• the invention is based on the idea of creating a realistic virtual representation of real living beings in test bench operation of a vehicle with a driver assistance system.
• a database with the recorded movement data can be created.
• This recorded movement data can be accessed and a test scenario, in particular scenarios, can be created.
• the recorded movement data can be combined and/or supplemented with other movement data.
• the recorded movement data can in particular form a movement atlas that serves as the basis for movement simulations of virtual living beings or avatars.
• the invention allows a test environment to be created that makes it possible to test or optimize a driver assistance system for interactions with living beings.
• situations can be presented that occur when real vehicles and real living beings interact, in particular at least for the living beings, would be dangerous.
• it is possible to generate potentially life-threatening situations for living beings, in particular to iterate with minor changes to the movement data, which are preferably computer-generated or calculated, so that a driver assistance system can be optimized and/or trained.
• a quality of the virtual test environment in particular of the scenario, in particular with regard to living beings, can be improved.
• the motion data recorded can be linked to the stimulus for the real living being in the motion detection system, and the stimulus associated with the motion data recorded can also be stored.
• the recorded movement data and a reaction of the driver assistance system to the recorded movement data can be taken into account when generating the virtual test environment.
• the recorded scenario can be linked to the recorded movement data and the movement data associated with the scenario that has arisen can also be stored.
• recorded movement data can be repeatedly taken into account when generating the virtual test environment.
• movement data is recorded only once and/or in particular for a chronological sequence of a pose that is outside of an area in which the movement detection system can detect movements to be repeated with the movement data, in particular in the virtual Test environment, which in particular can be larger than the detectable volume of the motion detection system.
• this makes it possible for the movement detection system to be designed smaller than the virtual test environment and still movement data of real living beings can be represented by the virtual simulation (representation) of the real living being in the virtual test environment.
• the movement atlas By linking the recorded movement data with at least one, in particular visual, haptic and/or acoustic stimulus, it is possible for the movement atlas to be able to store reactions and/or interactions of a real living being, in particular with the ego object, depending on the situation.
• These can in particular include a direct interaction of the living being with the ego object, preferably touching, pushing or the like, and can in particular use appropriate interfaces such as haptic gloves (English: “haptic (feedback) glove”) to guide the real living being in the movement Stimulate acquisition system.
• the recorded movement data can also include: a distance between the ego object and the virtual living being in the virtual test environment, the positions of the objects in the virtual test environment and/or their temporal derivatives, such as in particular a speed or acceleration, data on parts of the ego object or to the totality of the parts comprised by the ego-object.
• the repetition of recorded movement data in the virtual test environment can relate in particular to movement data that represent the course of the pose of at least part of an anatomical structure of the real living being.
• the repetition of the recorded movement data can in particular make it possible for a modified stimulus to be generated for the driver assistance system by repeating the time profile of the pose at a different location or at the same location in the virtual test environment.
• the driver assistance system can thereby optimize a reaction to stimuli that are repeated and/or occur at another point in the virtual test environment, in particular of the same type.
• poses or temporal progressions of poses, in particular unusual poses, which are usually perceived as unusual can be repeated, preferably as a stimulus or stimuli for the driver assistance system.
• Repeating the recorded movement data in the virtual test field can enable the driver assistance system to be trained (better) than non-repeatable movement data, in particular using a machine learning method.
• the range of possible scenarios is generally spanned by many dimensions, e.g. B. different road properties, behavior of other road users, weather conditions, etc.. Another dimension can be opened up by means of movement data. From this almost infinite and multidimensional parameter space, it is particularly relevant for testing the driver assistance systems to extract such parameter constellations for particularly critical scenarios, which can lead to unusual or dangerous driving situations. This can be limited in particular by linking the movement data with at least one stimulus.
• test object can be operated as hardware-in-the-loop, in particular as vehicle-in-the-loop.
• the detection can be linked to at least one, in particular a visual, haptic and/or acoustic stimulus for the living being in the movement detection system from the virtual test environment.
• a movement detection system can in particular be designed in such a way that one or more, in particular one stimulus or several different stimuli can be presented to the real living being in the movement detection system or played in at the same time. These can be directed, especially when it comes to acoustic stimuli, such as an acoustic stimulus from one or more directions, which is or can be locatable for the real living being, or essentially non-locatable acoustic stimuli, such as low-frequency stimuli in particular.
• This can make it possible for transaction data to be clustered, in particular with their links.
• a scenario with, in particular, clustered, movement data can advantageously be modified in order in particular to generate variations of the test scenarios, in particular of the virtual test environment.
• the repeated consideration of the recorded movement data in particular the repetition of the recorded movement data, can include changing the at least one part of the anatomical structure.
• the repetition of the movement data can include a change in the course over time of the pose of the at least one part of the anatomical structure.
• the virtual living being can be adapted in particular to different manifestations of the at least one part of the anatomical structure that can occur biologically in real living beings that are comparable to the real living being.
• changing the course of the pose over time can make it possible for part of a movement to be emphasized, in particular accelerated or slowed down.
• the driver assistance system can advantageously be trained and/or optimized in particular for different manifestations of a movement, in particular a chronological progression of a pose.
• the at least one part of the anatomical structure can be changed based on the empirical quantile of the part of the anatomical structure.
• a scenario can be adapted, in particular to the characteristics of the at least one part of the anatomical structure, according to an empirical quantile of real living beings, in particular according to a corresponding percentile of the at least one part of the anatomical structure.
• a time profile of the virtual test environment can be faster or slower than the time profile of the movement data or faster or slower than real time when repeatedly taking into account, in particular when repeating, the movement data. This can make it possible, in particular, if the time course is slower than real time, for example computationally expensive simulations can be carried out, in particular finite element simulations for structural optimization, numerical fluid dynamics simulations for shape optimization or thermodynamic simulations for system optimization.
• the repeated consideration in particular the repetition, can also include: repeated consideration, in particular the repetition, of second recorded movement data, which differ from the first recorded movement data, when generating the virtual test environment.
• a gesture can be repeated with another gesture in different configurations. This can make it possible that in particular the driver assistance system does not respond to a specific is trained or optimized over time, but that the driver assistance system is in particular also confronted with different time curves of poses and in particular can be optimized accordingly.
• the method can also have, in particular the following work steps: Determination of transition data from the first recorded movement data to the second recorded movement data, the transition data being a temporal and/or spatial transition from the first recorded movement data to the second recorded movement data describe.
• the procedure can also include:
• this way it can be made possible in particular for movement data that represent non-coherent temporal profiles of a pose to be reproduced and/or displayed in combination in the virtual test environment.
• this can make it possible for movement data that was not coherently recorded and/or recorded in the movement recording system to be able to be combined.
• this makes it possible for the movement data from different real living beings to be combined with one another, in particular from a combination of two or more movement data into one, in particular for an observer and/or the virtual representation of a vehicle, in particular for the ego object, which is at least partially operated as a test specimen on a test bench, in the virtual test environment, overall movement of a virtual living being in the virtual test environment.
• the method includes the fact that the first recorded movement data and the second recorded movement data can be combined in a randomized manner.
• the driver assistance system can react to, in particular unusual, movements that are detected in particular from the first Movement data and second recorded movement data are combined in a randomized manner, can be optimized and/or trained.
• the first recorded movement data and the second recorded movement data can be combined based on combinations of the first recorded movement data and the second recorded movement data, in particular the combination of the first recorded movement data and the second recorded movement data can be based on machine learning.
• machine learning can enable first movement data and second movement data to be combined in a manner that corresponds to a natural movement of the real living being.
• movement data can be combined in particular which have been recorded at different locations with movement detection systems and which are assigned in particular to different real living beings, but in particular belonging to the same species.
• the method can include that recorded movement data from different real living beings can be adjusted in such a way that the recorded movement data can be displayed in the virtual test environment as movement data of the virtual living being and in particular are adjusted in such a way that the movement data correspond to the anatomical conditions of the virtual living being. This can be done in particular using a machine learning method.
• the method can also include a test engineer being able to trigger a repetition of recorded movement data.
• a test engineer being able to trigger a repetition of recorded movement data. This can make it possible for a test engineer to intervene in the virtual test environment and/or to individually change, adapt and/or manipulate a scenario. This can in particular be temporal and/or spatial.
• a test engineer within the meaning of the invention is preferably an engineer who uses a system of virtual reality (English: “virtual reality”), augmented reality (English: “augmented reality”) or mixed reality (English: “mixed reality” ) can move and/or intervene in the virtual test environment.
• the test engineer can in particular placing, removing and/or manipulating objects in the scenario, in particular both temporally and spatially.
• the recording of the scenario can include parameters of the scenario, selected from the following group depending on the type of driver assistance system to be tested: speed, in particular an initial speed, of the vehicle; trajectory of the vehicle; lighting conditions; Weather; road surface; Number and position of static and/or dynamic objects, in particular virtual living beings, further in particular in relation to the vehicle; Speed and direction of movement of the dynamic objects, in particular movement data of the virtual living beings; condition of signaling systems, in particular traffic light systems; traffic signs; vertical elevation, width and/or trafficability of lanes, lane course, number of lanes; critical infrastructure such as building parts that obstruct the view.
• parameters of the scenario selected from the following group depending on the type of driver assistance system to be tested: speed, in particular an initial speed, of the vehicle; trajectory of the vehicle; lighting conditions; Weather; road surface; Number and position of static and/or dynamic objects, in particular virtual living beings, further in particular in relation to the vehicle; Speed and direction of movement of the dynamic objects, in particular movement data of the virtual living beings; condition of signaling systems
• Figure 1a a block diagram of a first embodiment of a
• Figure 1b a block diagram of a second embodiment of a
• FIG. 3 an example of scenarios in the virtual test environment
• Figure 4 an embodiment of a system for operating a
• FIGS. 5a to 5e exemplary embodiments of various components of a system for operating a test bench and the test bench.
• FIG. 1 shows a block diagram of an exemplary embodiment of a method 100 for operating a test bench 1 for a vehicle.
• Work step 101 relates to the creation of a virtual test environment, work step 102 to the stimulation of a real living being, work step 103 to the acquisition of movement data and work step 104 to the recording of the acquired movement data.
• method 100 can be repeated, as shown, so that in particular new and/or modified test scenarios for testing a driver assistance system can be generated.
• the method 100 includes in particular the stimulation 102 of a real living being on the basis of the generated virtual environment, the acquisition 103 of movement data with a movement acquisition system, and recording, in particular storing, 104 the acquired movement data, wherein the acquired movement data with at least one Stimulus for the real creature 2 in the motion detection system 12 are linked from the virtual test environment.
• the work step of determining 105 transition data, the work step of reproducing 106 transition data and the work step of repeatedly considering 107 movement data, in particular with transition data, are shown in dashed lines in FIG.
• the method can be repeated partially or at least substantially in its entirety. In particular, in this way different scenarios for testing and/or optimizing a driver assistance system can be generated and a test stand can be operated accordingly.
• the work steps shown with dashed lines are optional.
• FIG. 2 shows a block diagram of a further method 200 for operating a test bench.
• a virtual test environment is generated.
• movement data is recorded, in particular using a movement detection system, and in work step 203 a scenario is recorded.
• Steps 204, 205, 206 correspond to the steps 105, 106, 107 of the method 100 and are optional and therefore shown in dashed lines, with transition data being determined in the work steps, transition data being reproduced and movement data being repeatedly taken into account.
• the method 200 according to FIG. 2 differs from the method 100 according to FIG. 1 essentially in that scenario data are recorded which characterize a scenario.
• Movement data is recorded by means of an interface 22, in particular a user interface such as a movement detection system, and is in turn taken into account together with the reactions of the driver assistance system when generating the virtual test environment.
• the method 200 can preferably also be operated on the basis of the method 100, with the movement data recorded in the method 100 being transferred.
• FIG. 3 shows an exemplary virtual test environment that can be generated by methods 100, 200 for operating a test bench.
• a virtual vehicle 3' controlled by a driver assistance system drives in the right lane.
• other vehicles 5b, 5c, 5d are parked next to the lane, through which the virtual pedestrian 2' cannot be detected, or only with difficulty, by the sensors of the driver assistance system.
• FIG 4 shows an exemplary embodiment of a system 10 for operating a test bench 1 with a virtual test environment.
• This system 10 preferably has simulation means 11 for generating a virtual test environment with at least one virtual living being 2' and at least one virtual vehicle 3'.
• the system 10 can also have a first user interface 13 and preferably a second user interface 12.
• the at least one first user interface 13 can be used to output a virtual environment of the virtual pedestrian 2' to a first user 2.
• the user interface 13 can be a stimulation device such as an optical user interface, in particular a head-mounted device or a screen, and/or audio interfaces such as loudspeakers and possibly devices with which the sense of balance of the respective user can be influenced.
• the second user interface 12 is preferably set up to record inputs from the respective user 2 .
• This is preferably a Movement detection system 12, which can detect the poses and movements of the user 2 via various sensors and, for example, a treadmill.
• system 10 preferably has storage means 14 for recording the recorded movement data.
• system 10 preferably has a data memory 15 for providing scenario data which characterize a scenario in which the virtual pedestrian 2' is located.
• the simulation means 11 are preferably set up to simulate a virtual test environment of a virtual vehicle 3' on the basis of the scenario data. Furthermore, the simulation means 11 are preferably also set up to render this environment.
• an interface 6 of the test bench 1 is set up to output the virtual test environment to a driver assistance system of the vehicle 3 . If the driver assistance system has an optical camera K, such an interface 6 can be a screen, as shown in FIG. 4 .
• the means 11 for simulating calculate a response signal S′, which in turn is output to the camera K of the driver assistance system.
• the response signal S' can also be output to a radar of a driver assistance system via a radar stimulator.
• Other environments can be simulated for a lidar, an ultrasound or an infrared camera.
• the simulated virtual test environment can be output to sensor K of the driver assistance system by emulating signals.
• a signal can also be generated which is or is fed directly into the data processing unit of the driver assistance system Signal which is only processed by the software of the driver assistance system.
• the storage means 14 and the means for simulating 11 are preferably part of a data processing device.
• FIGS. 5a to 5e show exemplary embodiments of a system 10 with a movement detection system 12, the system 10 being shown in particular during the work step of detecting 103, 202 movement data, in which movements of the pedestrian 2 are detected via sensors.
• a pedestrian is equipped as a real living being 2 in such a way that his movements, in particular the movements of parts of his anatomy, can be recorded.
• the person depicted is on a treadmill, which can be used in particular to simulate motion sequences when moving. Furthermore, in particular the time course of a pose (of the at least one part of an anatomical structure) can be detected and/or recorded.
• This chronological progression of a pose can be detected and/or recorded as movement data.
• this movement data can then be transmitted to a virtual living being 2′, in particular an avatar.
• the virtual living being 2' then performs the same or at least essentially the same movements as the real living being 2.
• the movement data recorded by the real living being 2 can be transferred to a virtual living being 2', in particular an avatar, so that the avatar performs the same movements as the real living being 2.
• the virtual living being 2' is embedded in the test environment in such a way that the virtual living being 2', in particular the avatar, represents at least essentially the same chronological sequence of poses in the virtual test environment.
• Fig. 5c an exemplary virtual test environment is shown, which has a zebra crossing, two lanes, with a bus and another vehicle arranged behind it being arranged on the opposite lane, as well as a virtual pedestrian2' at the beginning of the zebra crossing, which crosses the lane of the ego -vehicle leads.
• objects already known or recognized by the driver assistance system are framed in the virtual test environment shown.
• the view of the virtual pedestrian 2 'cor relates with the view of the real person 2 in the motion detection system 12, the person 2 this view in particular with glasses of augmented reality (English: “augmented reality”), a pair of glasses for virtual reality (English: “virtual reality”) or glasses for mixed reality (English: “mixed reality”) can be displayed (in Fig. 5c not shown).
• glasses of augmented reality English: “augmented reality”
• a pair of glasses for virtual reality English: “virtual reality”
• glasses for mixed reality English: “mixed reality”
• the real living being 2 can then react to the situation or the scenario in the virtual test environment and this reaction is in turn represented in the virtual test environment by the recorded movement data of the real living being 2 with the virtual living being 2'.
• FIG. 5d shows a projection of the virtual test environment for sensors, in particular camera sensors, of test object 3 on a test stand 1 using a screen 6 .
• the virtual creature 2' can be seen on the road.
• the test environment can be presented to a test specimen 3 so that a driver assistance system associated with the test specimen 3 can detect the virtual living being 2' using its sensors.
• 5e shows a part of a real vehicle as a test object 3 on a test stand 1, as well as a projection 6 of the virtual test environment arranged in front of the vehicle 3 from the perspective of the virtual vehicle 3'.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• General Engineering & Computer Science (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Computer Hardware Design (AREA)
• Quality & Reliability (AREA)
• Multimedia (AREA)
• General Health & Medical Sciences (AREA)
• Health & Medical Sciences (AREA)
• Psychiatry (AREA)
• Social Psychology (AREA)
• Human Computer Interaction (AREA)
• Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
• Business, Economics & Management (AREA)
• Aviation & Aerospace Engineering (AREA)
• Educational Administration (AREA)
• Educational Technology (AREA)
• Traffic Control Systems (AREA)
• Automation & Control Theory (AREA)
• Transportation (AREA)
• Mechanical Engineering (AREA)

Priority Applications (5)

Applications Claiming Priority (2)

Related Child Applications (1)

Publications (1)

Family

ID=84537618

Family Applications (1)

Country Status (7)

Families Citing this family (3)

Citations (2)

Family Cites Families (2)

• 2021
  • 2021-11-09 AT ATA50891/2021A patent/AT525369B1/de active
• 2022
  • 2022-11-09 EP EP22826309.1A patent/EP4430375A1/de active Pending
  • 2022-11-09 KR KR1020247018873A patent/KR20240107155A/ko active Pending
  • 2022-11-09 WO PCT/AT2022/060388 patent/WO2023081948A1/de not_active Ceased
  • 2022-11-09 JP JP2024526698A patent/JP2024539389A/ja active Pending
  • 2022-11-09 CN CN202280087587.7A patent/CN118742799A/zh active Pending
• 2024
  • 2024-05-09 US US18/659,862 patent/US20240320132A1/en active Pending

Patent Citations (2)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events