WO2023110238A1 - Verfahren zur animierten darstellung einer objektwahrnehmung und einer fahrabsicht eines assistenzsystems eines fahrzeugs, assistenzsystem, computerprogramm sowie computerlesbares (speicher)medium - Google Patents
Verfahren zur animierten darstellung einer objektwahrnehmung und einer fahrabsicht eines assistenzsystems eines fahrzeugs, assistenzsystem, computerprogramm sowie computerlesbares (speicher)medium Download PDFInfo
- Publication number
- WO2023110238A1 WO2023110238A1 PCT/EP2022/081514 EP2022081514W WO2023110238A1 WO 2023110238 A1 WO2023110238 A1 WO 2023110238A1 EP 2022081514 W EP2022081514 W EP 2022081514W WO 2023110238 A1 WO2023110238 A1 WO 2023110238A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- assistance system
- vehicle
- driving intention
- perception
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/029—Steering assistants using warnings or proposing actions to the driver without influencing the steering system
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/1523—Matrix displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/161—Explanation of functions, e.g. instructions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/165—Videos and animations
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/177—Augmented reality
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/178—Warnings
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/179—Distances to obstacles or vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/18—Information management
- B60K2360/186—Displaying information according to relevancy
- B60K2360/1868—Displaying information according to relevancy according to driving situations
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/18—Information management
- B60K2360/191—Highlight information
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/21—Optical features of instruments using cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/40—Hardware adaptations for dashboards or instruments
- B60K2360/48—Sensors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/215—Selection or confirmation of options
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/40—Dynamic objects, e.g. animals, windblown objects
- B60W2554/404—Characteristics
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
- B60W2555/60—Traffic rules, e.g. speed limits or right of way
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
- B60Y2400/00—Special features of vehicle units
- B60Y2400/92—Driver displays
Definitions
- the present invention relates to a method for the animated display of at least one object perception and one driving intention of an assistance system of a vehicle.
- the present invention relates to an assistance system for a vehicle.
- the present invention relates to a computer program and a computer-readable (storage) medium.
- driver assistance systems are known from the prior art, which support a driver when maneuvering the vehicle.
- cruise control systems also known as adaptive cruise control, or ACC for short
- lane change assistance systems and other assistance systems for at least partially automated maneuvering of the vehicle are known.
- Such assistance systems usually include a plurality of environment sensors, with which objects in the environment of the vehicle can be detected. Depending on the detected objects in the area surrounding the vehicle, an at least partially automated maneuver can be planned using the assistance system. The objects detected in the environment can influence the control strategy of the assistance system during the at least partially automated maneuvering.
- the driver of the vehicle is currently responsible for an assistance system that conforms to the rules and works correctly. Consequently, it is essential that the driver of the vehicle - regardless of the current traffic situation - always has a good understanding of the system. It is therefore necessary for the driver to be informed about the driving intention of the assistance system and its object perception in corresponding traffic situations in order to be able to take corrective action if necessary.
- the publication DE 102020 106 380 A1 relates to a method for operating a driver assistance system of a vehicle with the steps: detecting objects in an environment of the vehicle using environment data, providing a display with displayed objects and a displayed environment, which the detected objects and / or describe the environment of the vehicle, executing a reaction of the driver assistance system depending on the displayed objects and / or the displayed environment, providing a user interface for changing the displayed objects and / or the displayed environment through an operator input and adapting the reaction of the driver assistance system depending on the change in the displayed objects and/or the displayed environment that occurred during the operator input.
- a method according to the invention is used for the animated display of at least one object perception and one driving intention of an assistance system for at least partially automated maneuvering of a vehicle.
- the method can also be used to operate the assistance system.
- the method includes displaying the at least one object perception by the assistance system if an object detected within the scope of the at least one object perception in an area surrounding the vehicle influences a control strategy of the at least partially automated maneuvering of the assistance system.
- the method includes an animation of the at least one object perception, the vehicle being represented by an avatar and the avatar interacting with the detected object as part of the animation.
- the avatar mimics the at least one object perception as part of the animation at least one additional action if the detected object in the environment of the vehicle influences the control strategy.
- the method includes a representation of the driver's intention of the assistance system, which describes an intention of the control strategy influenced on the basis of the detected object.
- the representation of the driving intention of the assistance system is animated, the driving intention being mimed by the avatar in order to improve a system understanding of a driver of the vehicle as part of the animation.
- At least partially automated driving or maneuvering includes automated driving with any degree of automation. Exemplary degrees of automation are assisted, partially automated, highly automated, fully automated and autonomous driving (with an increasing degree of automation in each case).
- object perception of an assistance system refers to the step of object detection and interpretation and is often referred to as a sense step in certain control paradigms of a robot, for example known as part of the sense-plan-act paradigm).
- driving intention of an assistance system means an actual intention or the actual action goal of the planning step.
- the actual intention or the actual goal of action can be achieved in different ways. For example, a reduction in the current driving speed of a vehicle can be achieved by reducing the drive torque and by braking. In particular, several different interventions may be necessary when implementing the driving intention.
- the term influenced control strategy, as used in this document, is therefore to be understood as meaning a changing driving intention of the assistance system based on object perception.
- the driver's understanding of the system for the assistance system for at least partially automated maneuvering of the vehicle can be improved.
- at least one object perception and one driving intention of the assistance system can be shown in animated form.
- the assistance system uses a camera to detect a traffic sign that describes the permissible maximum speed and, as a result, a reduction in the current speed limit If the vehicle's driving speed is required, the detected traffic sign influences the control strategy of the assistance system.
- the relevant information which serves to improve the understanding of the system for the assistance system of the vehicle, can then be shown to the driver in animated form for the driver of the vehicle. In this way, the driver can always be informed intuitively about the object perception of the assistance system and his driving intention.
- the assistance system can be, for example, a speed control system with a detection of the currently permissible maximum speed.
- the detected object can be the traffic sign, with the traffic sign depicted on the traffic sign describing the maximum permissible speed.
- the detected object can be any object in the vicinity of the vehicle, for example another road user, an obstacle, a lane marking or the like.
- the vehicle or the ego vehicle can be represented by an avatar.
- the avatar may be a Chinese dragon, a cowboy on horseback, a dog sled, or the like.
- an object such as a traffic sign, for example, is detected in the area surrounding the vehicle as part of the at least one object perception, the detected object can be displayed together with the avatar, which represents the vehicle.
- the object or the at least one object perception can be displayed in an animated manner—that is, in a manner that changes over time.
- Animating i.e. displaying a large number of individual images that suggest a moving image to the driver, can improve understanding of the system.
- the perceptibility of the displayed information can be increased by the driver.
- the avatar can interact with the captured object as part of the animation.
- Such an interaction can be, for example, in the case of the Chinese dragon, breathing fire in the direction of the detected object.
- the interaction can be represented, for example, in the form of a swinging lasso, with which the detected object is captured.
- the interaction of the avatar with the detected object mimics an additional action as part of the animation, the additional action being mimicked by the avatar only if the detected object in the area surrounding the vehicle control strategy influenced.
- the additional action can be mimed if a reduction in the current driving speed of the vehicle is required, or if the current driving speed is greater than the maximum speed.
- the driving intention of the assistance system can also be displayed as part of the animated display. While the control strategy can be influenced in a wide variety of ways, the driver's intention of the assistance system can explain the actual intention of the assistance system to the driver of the vehicle. The representation of the driving intention can be animated and thus contribute to an improvement in the driver's understanding of the system.
- the assistance system detects a traffic sign that allows a higher permissible maximum speed than the current driving speed of the vehicle
- the control strategy of the at least partially automated maneuvering of the assistance system can be influenced. For example, if the vehicle is displayed as a riding cowboy as part of the animation, the at least one object perception of the traffic sign can be displayed animated in such a way that the traffic sign is caught by the riding cowboy with a lasso. This first makes it clear to the driver of the vehicle that the object—in this case the traffic sign—was detected and the control strategy is influenced as a result.
- the driver of the vehicle is not yet aware of the consequences of influencing the control strategy.
- the fact that this can lead to a higher driving speed can be communicated to the driver by the assistance system's animated display of the driver's intention to drive.
- a horse of the riding cowboy can buck its hooves and—depending on the intended acceleration—gallop away more or less quickly.
- the method according to the invention for the animated display of the at least one object perception and the driving intention of the assistance system can be used to ensure that the driver perceives relevant information from the assistance system better and thus gains an improved understanding of the system.
- the driver's perception can be improved by the animated representation in comparison to a static representation.
- at least one animation parameter is determined as a function of the at least one object perception and/or as a function of the driving intention of the assistance system, with the at least one animation parameter influencing the animation.
- the avatar of the vehicle can vary as a function of the detected object and/or as a function of the driving intention.
- the additional action which the avatar mimics as part of the animation of the at least one object perception, depends on the object perception and/or on the driving intention of the assistance system.
- An animation parameter can also influence the speed of the animated display.
- the animation parameter can therefore be used to further improve the driver's perception of information from the assistance system and increase understanding of the system.
- the at least one animation parameter describes at least one urgency of carrying out the control strategy and the animation takes place as a function of the urgency. For example, due to another road user cutting in in front of the vehicle, a sharp reduction in the current driving speed of the vehicle may be necessary.
- the detected object in this example the other road user cutting in—can be detected by the assistance system as part of the object perception.
- the at least one animation parameter which describes at least one urgency of the implementation of the control strategy, can be determined, for example, by a period of time that describes the time until the vehicle collides with the other road user cutting in (also called time-to-collision). .
- the animation speed for example, to be influenced as a function of the at least one animation parameter or the urgency.
- the avatar mimics further actions as part of the animation of the at least one object perception. By miming further actions, the driver of the vehicle can be made aware of a currently critical situation and can intervene if necessary.
- the animated display takes place in such a way that the at least one object perception or the driving intention of the assistance system is perceived by the driver essentially through peripheral vision.
- the peripheral vision is the perception in the areas of the driver's field of vision that are not visible the central retina can be imaged. With peripheral (or indirect) vision, the driver is effectively looking past the animated display. Peripheral vision is very efficient at perceiving movement. On the one hand, the driver of the vehicle is not disturbed by the animated representation of object perception and driving intention, and on the other hand, efficient perception is ensured due to the animated representation - i.e. the movement - of the avatar due to peripheral vision. Overall, a synergetic effect results due to the animated representation in an area which is perceived by the driver of the vehicle through peripheral vision and is therefore outside of his actual field of vision—directed onto the road.
- the assistance system can include at least one environment sensor and an electronic control unit or a computing device.
- the assistance system can be set up in particular for at least partially automated maneuvering, ie for example for partially automated longitudinal and/or lateral guidance.
- a vehicle according to the invention in particular a passenger car, includes an assistance system according to the invention.
- Another aspect of the invention relates to a computer program, comprising instructions which, when the program is executed by a computing device, cause the computing device to display at least one object perception and one driving intention of an assistance system for at least partially automated maneuvering of a vehicle according to a method according to the invention on a display device in animated form.
- the invention relates to a computer-readable (storage) medium, comprising instructions which, when the program is executed by a computing device, cause the computing device to display at least one object perception and one driving intention of an assistance system for at least partially automated maneuvering of a vehicle according to a method according to the invention on a display device in animated form .
- the display device can be a monitor, part of an instrument cluster, a display, a head-up display or the like, for example.
- the computing device comprises in particular at least one processor.
- the computing device can have memory.
- the computing device can be formed by at least one electronic control unit.
- FIG. 1 shows a schematic representation of a display panel of a vehicle, the display panel comprising a display device on which an animated representation of an object perception is indicated,
- FIG. 2 shows a schematic representation of a display panel of a vehicle, which includes a display device on which an animated representation of an object perception and a driving intention is indicated, and
- FIG. 3 shows a schematic representation of the display device according to FIG. 2 in an enlarged form.
- the assistance system can be designed, for example, as a speed control system with traffic sign recognition, distance control and/or the like.
- the display device 3 shows the object perception of the assistance system schematically. As part of the object perception, the assistance system detects the stop sign 5.
- the stop sign 5 in the area 4 of the vehicle 1 is shown in the display device 3 by the virtual stop sign 5'.
- the stop line 6 in the surroundings 4 of the vehicle 1 is represented in the display device 3 by the virtual stop line 6'.
- the vehicle 1 is represented by an avatar 7 .
- the avatar 7 is shown as a Chinese dragon in the example of FIG.
- the assistance system takes over the longitudinal guidance of the vehicle 1 .
- the vehicle 1 is moving in the area 4 towards an intersection 8 .
- priority is given by stop sign 5.
- the stop sign 5 is detected by the assistance system as part of the object perception.
- the driver of the vehicle 1 is not necessarily aware that the stop sign 5 is being correctly detected by the assistance system of the vehicle 1 .
- the driver may not even be aware that the control strategy of the at least partially automated maneuvering of the assistance system, ie in particular the longitudinal control of vehicle 1, is being influenced by the assistance system.
- the driver of the vehicle 1 is therefore possibly not aware that the stop sign 5 has been detected and that the assistance system then changes the control strategy. In other words, the driver may not be aware that the assistance system of vehicle 1 intends to stop at stop line 6 .
- stop sign 5 is detected by the assistance system as part of the object perception can be made clear to the driver of the vehicle 1 as part of the animation of the at least one object perception by at least one additional action that the avatar mimics—shown here by spitting fire 9.
- the additional action mimicked by the avatar may be eating the virtual stop sign 5'.
- FIG. 2 shows a schematic representation of a display panel 2 of a vehicle 1 , the display panel 2 including a display device 3 on which an animated representation of an object perception and a driving intention of an assistance system of the vehicle 1 is indicated.
- surroundings 4 of vehicle 1 are shown from the perspective of a driver of vehicle 1 who is looking through the windshield of vehicle 1 .
- the vehicle 1 is moving in the area 4 on a freeway 10 with a roadway that has three lanes.
- the vehicle 1 is moving in the left lane 14 of the roadway.
- a constriction sign 11 marks the end of the left lane 14.
- the assistance system which in this example controls at least one lateral and longitudinal guidance of the vehicle 1, the driver of the vehicle 1 in the example shown here is not aware whether the constriction panel 11 and the end of the left lane 14 was correctly detected by the assistance system. This can be shown to the driver of the vehicle 1 by means of the display device 3 .
- the other road users 12 can be displayed on the display device 3 by means of additional avatars 12 ′ (shown as sheep in this example).
- the narrowing panel 11 can be represented on the display device 3 by a virtual narrowing panel 1T.
- the detection of the constriction panel 11 by the assistance system can again be made known to the driver by the mime of at least one additional action—here again shown as spitting fire 9—of the avatar 7 .
- the driver of vehicle 1 is not aware at this point in time of the consequences resulting from narrowing panel 11 for the control strategy or the driving intention of the assistance system.
- the assistance system could decelerate the vehicle 1 significantly in the left lane 14 and cut in behind the two other road users 12 .
- the assistance system Driving intention is to accelerate the vehicle 1 in order to then cut in between the two other road users 12.
- the driver's intention of the assistance system is to first accelerate the vehicle 1 and then cut in between the two other road users 12 .
- This is indicated by the trajectory 13 in the illustration.
- the avatar 7 (indicated here as a Chinese dragon by way of example) can move along the trajectory 13 and thus make the driving intention of the assistance system clear to the driver of the vehicle.
- an animation parameter can be determined, for example.
- Such an animation parameter can at least describe the urgency of carrying out the control strategy—thus, for example, acceleration—and can influence an animation speed. As a result, an urgency can be signaled to the driver of the vehicle 1 .
- FIG. 3 shows, in a schematic representation, the display device according to the traffic situation from FIG. 2 in an enlarged form.
Landscapes
- Engineering & Computer Science (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Automation & Control Theory (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Traffic Control Systems (AREA)
- Instrument Panels (AREA)
- Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202280076164.5A CN118265626A (zh) | 2021-12-15 | 2022-11-10 | 用于将车辆的辅助系统的对象感知和行驶意图以动画方式图示的方法、辅助系统、计算机程序和计算机可读(存储)介质 |
| KR1020247015255A KR20240089432A (ko) | 2021-12-15 | 2022-11-10 | 차량의 보조 시스템의 물체 인식 및 운전 의도를 애니메이션 방식으로 표시하기 위한 방법, 보조 시스템, 컴퓨터 프로그램 및 컴퓨터 판독 가능한 (저장) 매체 |
| JP2024530528A JP2024546603A (ja) | 2021-12-15 | 2022-11-10 | 物体認知及び車両のアシストシステムの走行意図をアニメで表現する方法、アシストシステム、コンピュータプログラム及びコンピュータ読取可能な(記憶)媒体 |
| US18/720,230 US12559125B2 (en) | 2021-12-15 | 2022-11-10 | Method for the animated representation of an object perception and of a driving intention of an assistance system of a vehicle, assistance system, computer program, and computer-readable (storage) medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102021133174.9 | 2021-12-15 | ||
| DE102021133174.9A DE102021133174A1 (de) | 2021-12-15 | 2021-12-15 | Verfahren zur animierten darstellung einer objektwahrnehmung und einer fahrabsicht eines assistenzsystems eines fahrzeugs, assistenzsystem, computerprogramm sowie computerlesbares (speicher)medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023110238A1 true WO2023110238A1 (de) | 2023-06-22 |
Family
ID=84389352
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2022/081514 Ceased WO2023110238A1 (de) | 2021-12-15 | 2022-11-10 | Verfahren zur animierten darstellung einer objektwahrnehmung und einer fahrabsicht eines assistenzsystems eines fahrzeugs, assistenzsystem, computerprogramm sowie computerlesbares (speicher)medium |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US12559125B2 (https=) |
| JP (1) | JP2024546603A (https=) |
| KR (1) | KR20240089432A (https=) |
| CN (1) | CN118265626A (https=) |
| DE (1) | DE102021133174A1 (https=) |
| WO (1) | WO2023110238A1 (https=) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023076841A1 (en) * | 2021-10-25 | 2023-05-04 | Atieva, Inc. | Contextual vehicle control with visual representation |
| CN121241270A (zh) | 2023-07-25 | 2025-12-30 | 株式会社Lg新能源 | 用于诊断电池的装置及其操作方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102012015002B4 (de) * | 2012-07-28 | 2016-09-15 | Volkswagen Aktiengesellschaft | Verfahren und Vorrichtung zum unterstützten Einparken |
| DE102015223248A1 (de) * | 2015-11-24 | 2017-05-24 | Continental Automotive Gmbh | Verfahren für ein Fahrerassistenzsystem |
| DE102018121274B4 (de) * | 2018-08-31 | 2020-07-16 | Connaught Electronics Ltd. | Verfahren zum Visualisieren einer Fahrabsicht, Computerprogrammprodukt und Visualisierungssystem |
| DE102020106380A1 (de) | 2020-03-09 | 2021-09-09 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zum Betreiben eines Fahrerassistenzsystems eines Fahrzeugs durch Anpassung von angezeigten Objekten, Fahrerassistenzsystem sowie Fahrzeug |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8830141B2 (en) * | 2009-04-02 | 2014-09-09 | GM Global Technology Operations LLC | Full-windshield head-up display enhancement: anti-reflective glass hard coat |
| DE102011121948A1 (de) | 2011-12-22 | 2013-06-27 | Gm Global Technology Operations, Llc | Vorausschau auf Aktionen eines autonomen Fahrsystems |
| US10657745B2 (en) * | 2016-04-19 | 2020-05-19 | Be Topnotch Llc | Autonomous car decision override |
| US10429846B2 (en) * | 2017-08-28 | 2019-10-01 | Uber Technologies, Inc. | Systems and methods for communicating intent of an autonomous vehicle |
| JP6630976B2 (ja) * | 2017-11-10 | 2020-01-15 | 本田技研工業株式会社 | 表示システム、表示方法、およびプログラム |
| US11625036B2 (en) | 2018-04-09 | 2023-04-11 | SafeAl, Inc. | User interface for presenting decisions |
| DE102019202581B4 (de) * | 2019-02-26 | 2021-09-02 | Volkswagen Aktiengesellschaft | Verfahren zum Betreiben eines Fahrerinformationssystems in einem Ego-Fahrzeug und Fahrerinformationssystem |
| GB2607172B (en) * | 2019-04-25 | 2023-11-01 | Motional Ad Llc | Graphical user interface for display of autonomous vehicle behaviors |
| CN115309482A (zh) * | 2021-04-20 | 2022-11-08 | 福特全球技术公司 | 一种车辆交互系统以及相应的车辆和方法 |
| US20230058508A1 (en) * | 2021-08-19 | 2023-02-23 | GM Global Technology Operations LLC | System amd method for providing situational awareness interfaces for a vehicle occupant |
-
2021
- 2021-12-15 DE DE102021133174.9A patent/DE102021133174A1/de active Pending
-
2022
- 2022-11-10 JP JP2024530528A patent/JP2024546603A/ja active Pending
- 2022-11-10 KR KR1020247015255A patent/KR20240089432A/ko active Pending
- 2022-11-10 CN CN202280076164.5A patent/CN118265626A/zh active Pending
- 2022-11-10 US US18/720,230 patent/US12559125B2/en active Active
- 2022-11-10 WO PCT/EP2022/081514 patent/WO2023110238A1/de not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102012015002B4 (de) * | 2012-07-28 | 2016-09-15 | Volkswagen Aktiengesellschaft | Verfahren und Vorrichtung zum unterstützten Einparken |
| DE102015223248A1 (de) * | 2015-11-24 | 2017-05-24 | Continental Automotive Gmbh | Verfahren für ein Fahrerassistenzsystem |
| DE102018121274B4 (de) * | 2018-08-31 | 2020-07-16 | Connaught Electronics Ltd. | Verfahren zum Visualisieren einer Fahrabsicht, Computerprogrammprodukt und Visualisierungssystem |
| DE102020106380A1 (de) | 2020-03-09 | 2021-09-09 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zum Betreiben eines Fahrerassistenzsystems eines Fahrzeugs durch Anpassung von angezeigten Objekten, Fahrerassistenzsystem sowie Fahrzeug |
Also Published As
| Publication number | Publication date |
|---|---|
| US20250042425A1 (en) | 2025-02-06 |
| JP2024546603A (ja) | 2024-12-26 |
| DE102021133174A1 (de) | 2023-06-15 |
| KR20240089432A (ko) | 2024-06-20 |
| CN118265626A (zh) | 2024-06-28 |
| US12559125B2 (en) | 2026-02-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3250426B1 (de) | Verfahren und vorrichtung zum betreiben eines fahrzeugs | |
| DE102009017152B4 (de) | Verfahren und Vorrichtung zur Längs- und Querführung eines Kraftfahrzeugs | |
| EP2253499B1 (de) | Kraftfahrzeug mit einem Fahrerassistenzsystem zur Querführung des Kraftfahrzeugs und Verfahren zur Unterstützung eines Fahrers eines Kraftfahrzeugs beim Halten einer Fahrspur | |
| EP3663146A1 (de) | Fahrassistenzsystem für einen kraftwagen, kraftwagen und verfahren zum betreiben eines kraftwagens | |
| EP3543059A1 (de) | Verfahren zur berechnung einer einblendung von zusatzinformationen für eine anzeige auf einer anzeigeeinheit, vorrichtung zur durchführung des verfahrens sowie kraftfahrzeug und computerprogramm | |
| EP3464002B1 (de) | Verfahren zur vermeidung einer kollision eines kraftfahrzeugs mit einem objekt auf grundlage eines maximal vorgebbaren radlenkwinkels, fahrerassistenzsystem sowie kraftfahrzeug | |
| WO2019166222A1 (de) | Verfahren zur berechnung einer ar-einblendung von zusatzinformationen für eine anzeige auf einer anzeigeeinheit, vorrichtung zur durchführung des verfahrens sowie kraftfahrzeug und computerprogramm | |
| DE102013013865B3 (de) | Verfahren zum Betrieb eines Kraftfahrzeugs mit einem Sicherheitssystem und einem vollautomatischen Fahrerassistenzsystem und Kraftfahrzeug | |
| DE102009020649A1 (de) | Verfahren und Vorrichtung zur Kollisionsvermeidung für ein Fahrzeug durch Ausweichen vor einem Hindernis | |
| WO2016000814A1 (de) | Verfahren zum betreiben eines kraftfahrzeugs in verschiedenen fahrmodi sowie kraftfahrzeug | |
| EP4132830B1 (de) | Verfahren zum betreiben eines fahrerassistenzsystems eines fahrzeugs mit fahrermoderation bei teilautomatisierten funktionen, fahrerassistenzsystem sowie fahrzeug | |
| EP1689615A1 (de) | Verfahren und vorrichtung zur warnung des fahrers eines kraftfahrzeugs | |
| DE102017011140A1 (de) | Steuerungssystem und Steuerungsverfahren zum Führen eines Kraftfahrzeugs und zum Vermeiden einer Kollision mit einem anderen Kraftfahrzeug | |
| WO2022128012A1 (de) | Verfahren zur planung eines zumindest teilweise automatisierten fahrvorgangs mittels eines fahrassistenzsystems | |
| WO2023110238A1 (de) | Verfahren zur animierten darstellung einer objektwahrnehmung und einer fahrabsicht eines assistenzsystems eines fahrzeugs, assistenzsystem, computerprogramm sowie computerlesbares (speicher)medium | |
| DE102016014379A1 (de) | Steuerungssystem und Steuerungsverfahren zum Führen eines Kraftfahrzeugs | |
| EP3177505B1 (de) | Bereitstellen von fahrhinweisen während eines parkmanövers | |
| DE102010028300A1 (de) | Kraftfahrzeug | |
| DE102005036219B4 (de) | Fahrerassistenzsystem | |
| WO2020038521A1 (de) | Konditionieren des fahrers eines kraftfahrzeugs für eine die systemgrenzen eines fahrsystems zum automatisierten fahren überschreitende fahrsituation | |
| EP4577438B1 (de) | Verfahren zum betreiben eines fahrerassistenzsystems eines fahrzeugs mit bereitstellung eines folgefahrtmodus zum folgen eines vorausfahrenden verkehrsteilnehmers, fahrerassistenzsystem sowie fahrzeug | |
| WO2013057201A1 (de) | Verfahren zur unterstützung eines fahrers mittels einer fahrerunterstützungsvorrichtung | |
| EP3747720A1 (de) | Verfahren zum betreiben eines fahrzeugs mit mehreren, vorgegebenen lenk-semiautonommodi und nicht-lenk-semiautonommodi, sowie fahrzeugführungssystem | |
| EP1897785B1 (de) | Fahrerassistenzsystem, Lenksystem und Verfahren zum Unterstützen des Fahrers eines Fahrzeugs | |
| DE102019104973A1 (de) | Verfahren sowie Steuergerät für ein System zum Steuern eines Kraftfahrzeugs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22817890 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 20247015255 Country of ref document: KR Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202280076164.5 Country of ref document: CN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2024530528 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18720230 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22817890 Country of ref document: EP Kind code of ref document: A1 |
|
| WWG | Wipo information: grant in national office |
Ref document number: 18720230 Country of ref document: US |