DE102019117700A1 - Method and control unit for outputting images relating to a traffic situation - Google Patents

Abstract

A control unit for displaying an image relating to a traffic situation on a screen of an ego vehicle is described. The control unit is set up to determine an image relating to a traffic situation in an environment of the ego vehicle on the basis of environment data from one or more environment sensors of the ego vehicle, the image having a time stamp relative to an on-board network time of the ego vehicle. The control unit is also set up to check whether the time stamp is more than a maximum permissible latency time before the reference time and / or whether the time stamp is invalid. In addition, the control unit is set up to prevent the image from being output on the screen if it has been determined that the time stamp is more than the maximum permissible latency period before the reference time and / or that the time stamp is invalid.

Description

The invention relates to the provision of pictorial information relating to the environment and / or the state of a vehicle on a screen of a vehicle, in particular a motor vehicle. The screen can also comprise or be a head-up display or the projection surface of a projector.

A vehicle can include one or more driver assistance systems that support a driver of the vehicle in the longitudinal and / or lateral guidance of the vehicle. Furthermore, the vehicle can have a screen on which information relating to the surroundings and / or the state of the vehicle is displayed to support the longitudinal and / or lateral guidance of the vehicle. For example, other road users in the immediate vicinity of the vehicle can be shown on the screen in order to support the driver of the vehicle when turning or changing lanes.

The output of pictorial information on a screen of a vehicle can lead to the distraction and / or confusion of the driver of the vehicle, which reduces the supporting effect of the output and which possibly reduces the safety of the vehicle. The present document deals with the technical task of enabling visual information to be output in a vehicle, by means of which the driver of the vehicle is supported in a reliable and safe manner in the longitudinal and / or lateral guidance of the vehicle.

The object is achieved in each case by the independent claims. Advantageous embodiments are described in the dependent claims, among others. It is pointed out that additional features of a patent claim dependent on an independent patent claim without the features of the independent patent claim or only in combination with a subset of the features of the independent patent claim can form a separate invention independent of the combination of all features of the independent patent claim, which can be made the subject of an independent claim, a divisional application or a subsequent application. This applies equally to the technical teachings described in the description, which can form an invention that is independent of the features of the independent patent claims.

In the following, different aspects of a control unit of an ego vehicle are described, which is designed to display an image, in particular an image of the surroundings, in relation to a traffic situation in the surroundings of the ego vehicle on a screen of the ego vehicle. The aspects described can be combined with one another in any way.

It should be noted that the control unit may include several different control devices and / or control modules of the vehicle. For example, image data can be generated for output on a screen by a first control device or by a first control module. Furthermore, a (longitudinal and / or lateral control) actuator of the ego vehicle can be controlled by one or more further control devices or control modules. The control unit described in this document can comprise the first control device or control modules and possibly the one or more further control devices or control modules.

The traffic situation in the environment of the ego vehicle can be recorded on the basis of the environment data from one or more environment sensors (e.g. a radar sensor, an image sensor, a lidar sensor, an ultrasonic sensor, etc.) of the ego vehicle. In particular, the information reproduced in the image (e.g. the road user symbols or symbols shown for one or more road users) can be determined on the basis of the surroundings data and / or on the basis of status data relating to the status of the vehicle.

The control unit for an ego vehicle described in this document can be set up to reproduce the state of a driving function of the ego vehicle on the screen of the ego vehicle. For example, it can be displayed whether a driving function (e.g. ACC or a lane departure warning system or a lane change assistant) is activated or not. In addition, information relating to a parameter (e.g. relating to a set distance for ACC) can be displayed. The information relating to a driving function can be represented, for example, by color coding the displayed road user symbols and / or the displayed lanes. For example, the symbol for a reference vehicle for ACC can be identified by a specific color. In a further example, a vehicle that is critical for a lane change, i.e. the symbol for this vehicle, can be identified in a different lane by a specific color.

A control unit for displaying a traffic situation on a screen of an ego vehicle is thus described. The traffic situation can be reproduced on the screen in a sequence or sequence of images. Each image can display one or more road user symbols that one or more corresponding road users in the vicinity of the ego Represent vehicle and / or the ego vehicle itself. Examples of road users are motor vehicles, such as cars, trucks, motorcycles, buses, etc. A road user symbol can be a predefined icon or pictogram. The one or more road users can thus be shown abstractly on the screen of the ego vehicle. Furthermore, the lane traveled by the ego vehicle can also be reproduced in an abstract manner by means of one or more symbolically displayed lanes on the screen. In this way, an effective and efficient representation of the traffic situation in the environment of the ego vehicle can be provided, which can be recorded in a simple and quick manner by the driver of the ego vehicle. Furthermore, by abstracting the represented traffic situation, it can be avoided that the driver of the ego vehicle avoids excessive attention from the actual surroundings of the ego vehicle. Safe operation of the ego vehicle can thus be made possible.

The control unit can be set up to display a road user symbol for a road user who is driving in an actual lane at a constant first lateral position within a lane displayed on the screen. An “actual lane” here refers to the lane of the roadway on which the ego vehicle is traveling. On the other hand, a “displayed lane” refers to a lane shown (abstractly) on the screen.

In particular, the control unit can be set up to recognize one or more (actual) lanes of the road on which the ego vehicle is traveling on the basis of the environment data. Furthermore, one or more road users can be detected. It can also be determined how the one or more road users are positioned relative to one another. In particular, it can be determined for a road user in which actual lane the road user is driving. In total, an environment model of the environment of the ego vehicle can be determined on the basis of the environment data.

The control unit can be set up to place the one or more road users, i.e. the corresponding one or more road user symbols for the one or more road users, on the screen. For example, the ego vehicle (i.e. an ego symbol for the ego vehicle) can be placed at a fixed position and / or in a defined area on the screen (e.g. in the middle and / or at a lower edge of the screen) . If necessary, the placement of the ego symbol can vary within the boundaries of the firmly defined area. The other road users in the vicinity of the ego vehicle (i.e. the road user symbols for the one or more other road users) and / or one or more symbols for one or more recognized lanes can then be placed on the screen relative to the ego vehicle. The individual symbols can be displayed in one or more displayed lanes on the screen (corresponding to the actual road users in one or more actual lanes).

The symbol for a road user (i.e. for a road user in the vicinity of the ego vehicle and / or for the ego vehicle itself) can be displayed as standard and / or permanently at a (fixed) first lateral position within a displayed lane. This can take place independently of the actual lateral position of the road user in the actual lane. The first lateral position is preferably arranged centrally with respect to the displayed lane. In this way, even in a complex traffic situation, a stable and clear display of the traffic situation can be provided on the screen (whereby the comfort and safety of the ego vehicle are increased).

The control unit can also be set up to detect a lane event in relation to a departure from the actual lane of the road user. In particular, the control unit can be set up to detect a lane event in relation to the fact that the road user (in particular the ego vehicle) has at least partially left, is leaving, could leave or should leave the actual lane. The lane event can be such that, as a result of the lane event, the traffic participant (in particular the ego vehicle) will change lanes with a relatively increased probability. Alternatively or in addition, the lane event can be related to a lateral positioning of the road user (in particular the ego vehicle) within the actual lane and / or to a lateral guidance of the road user (in particular the ego vehicle).

The lane event can include, for example, a warning from a lane departure warning system for the ego vehicle. Alternatively or in addition, the lane event can include a steering movement of a steering device (e.g. the steering wheel) of the ego vehicle, the steering movement having an amplitude that is greater than a (predefined) amplitude threshold value. The steering movement can, for example, be brought about automatically by an actuator of the vehicle and / or manually by intervention by the driver of the vehicle. As an alternative or in addition, the lane event can include an action by the driver of the ego vehicle in relation to a lane change, such as the setting of the ego vehicle's blinker. As an alternative or in addition, the lane event can include a lane change initiated by a lane change assistant of the ego vehicle. Alternatively or in addition, the lane event can include a lane change of the ego vehicle initiated and / or proposed by an active navigation system of the ego vehicle. As an alternative or in addition, the lane event can include an indication or an intervention by an emergency exit assistant of the ego vehicle in order to form an emergency exit.

A lane event can thus be detected, as a result of which the driver of the ego vehicle typically expects a particular lateral positioning of a road user (in particular the ego vehicle) within a displayed lane (in particular the ego lane).

In response to the detected lane event, the control unit can be set up to display the road user symbol for the road user (in particular for the ego vehicle) at a second lateral position within the displayed lane that differs from the first lateral position. The second lateral position can preferably be arranged on a right or on a left edge of the displayed lane. The road user symbol can be displayed for a certain period of time at the fixed and / or constant second lateral position, in particular independently of the actual lateral position of the road user in the actual lane. If necessary, the road user symbol can be displayed at the second lateral position until an event is detected which indicates that no lane change will take place and / or until a certain predefined period of time has expired. The road user symbol can then be displayed again at the first lateral position.

It is thus possible to selectively (if necessary exclusively) deviate from a fixed (and preferably central) lateral positioning of a road user symbol in the presence of a lane event. In this way, a stable and consistent representation of a traffic situation can be provided on the screen of the ego vehicle in order to increase the comfort and safety of the ego vehicle.

The control unit can be set up to display the road user symbol at a sequence of successive points in time regardless of the actual lateral position of the road user within the actual lane at the first or at the second lateral position within the displayed lane. In particular, the control unit can be set up to display the road user symbol independently of an actual lateral position of the road user within the actual lane at the first lateral position within the displayed lane, as long as no lane event is detected. In this way, a stable and clear representation of a traffic situation can be provided that can be quickly detected by the driver of the ego vehicle.

The control unit can be set up to display the road user symbol, apart from an animated transition to another displayed lane, exclusively at the first lateral position within the displayed lane if the road user is a road user in the vicinity of the ego vehicle. The symbol for a road user in the vicinity of the ego vehicle can thus, if necessary, only be displayed at a single lateral position within a displayed lane (apart from an animated transition to another lane). In this way, the clarity of the representation of a traffic situation can be further improved.

The control unit can be set up to determine (on the basis of the surroundings data) position data relating to an actual lateral position of a road user (in particular of the ego vehicle) within an actual lane. Furthermore, the control unit can be set up to assign the road user symbol to a lateral position from a limited set of possible lateral positions within the displayed lane as a function of the position data.

The limited number of possible lateral positions preferably has only three possible lateral positions. In particular, the limited set of possible lateral positions can include: a possible lateral position arranged on the left edge of the displayed lane; a possible lateral position located centrally within the displayed lane; and / or a possible lateral position arranged on the right edge of the displayed lane.

The control unit can be designed in such a way that the road user symbol, apart from an animated transition from one possible lateral position to another possible lateral position, is only displayed at exactly one of the possible lateral positions within the displayed lane at any time.

By limiting the possible lateral positions within a displayed lane, the clarity of the representation of a traffic situation can be further improved.

As already explained above, the road user who is shown in one of the few possible lateral positions within a displayed lane can be the ego vehicle, the ego vehicle driving in the actual ego lane. The road user symbol can then be the ego symbol for the ego vehicle that is displayed within the displayed ego lane. The ego lane and / or the ego symbol are preferably shown in the middle (in relation to the width of the screen) on the screen. In particular, the ego symbol can have a fixed, unchangeable position on the screen. If the positioning of the ego vehicle is changed, the one or more displayed lanes can be shifted. The representation of the ego symbol at a fixed position enables the driver of the ego vehicle to quickly grasp the traffic situation in the vicinity of the ego vehicle.

As already explained above, the control unit can be set up to bring about an animated transition of the road user symbol from the first lateral position to the second lateral position of the same displayed lane or to a specific lateral position of another lane. The clarity of the representation of the traffic situation for a driver of the ego vehicle can thus be increased further.

The control unit can be set up to display another road user symbol for another road user in the vicinity of the ego vehicle who is driving in a first actual lane at the first lateral position in a corresponding first displayed lane. Furthermore, the control unit can be set up to detect that the other road user is changing to a second actual lane. In response to this, the other road user symbol can be caused to be displayed on the screen at the first lateral position in a corresponding second displayed lane. An animated transition from the first lateral position in the first displayed lane to the first lateral position in the second displayed lane can optionally take place. The road user symbol of a road user from the surroundings of the ego vehicle can thus be moved from the first lateral position of the displayed exit lane to the first lateral position of the displayed target lane (in a sequence of images) when changing lanes. In this way, a lane change by a road user in the vicinity of the ego vehicle can be represented in an easy to grasp manner and made detectable for the driver of the ego vehicle.

The control unit for displaying a traffic situation on a screen of an ego vehicle can be set up to subdivide the surroundings of the ego vehicle into one or more sectors of the surroundings. The one or more surrounding sectors can have at least one surrounding sector in the direction of travel of the ego vehicle in front of a front line of the ego vehicle. The front line can for example run perpendicular to the longitudinal axis of the ego vehicle and / or along the front of the ego vehicle. As an alternative or in addition, the one or more surrounding sectors can include at least one surrounding sector to the left of and / or behind the ego vehicle and / or at least one surrounding sector to the right of and / or behind the ego vehicle.

• • Einen ersten Umfeldsektor, der sich ausgehend von der Frontlinie (nach hinten) in einer ersten Nachbar-Fahrspur links neben und ggf. hinter dem Ego-Fahrzeug erstreckt. Der erste Umfeldsektor existiert ggf. nur dann, wenn links neben der von dem Ego-Fahrzeug befahrenen Ego-Fahrspur eine erste Nachbar-Fahrspur angeordnet ist.
• • Einen zweiten Umfeldsektor, der sich ausgehend von der Frontlinie (nach vorne) in der ersten Nachbar-Fahrspur vor dem Ego-Fahrzeug erstreckt. Der zweite Umfeldsektor existiert ggf. nur dann, wenn die erste Nachbar-Fahrspur existiert.
• • Einen dritten Umfeldsektor, der sich ausgehend von der Frontlinie (nach vorne) in der Ego-Fahrspur vor dem Ego-Fahrzeug erstreckt.
• • Einen vierten Umfeldsektor, der sich ausgehend von der Frontlinie (nach vorne) in einer zweiten Nachbar-Fahrspur vor dem Ego-Fahrzeug erstreckt. Der vierte Umfeldsektor existiert ggf. nur dann, wenn rechts neben der von dem Ego-Fahrzeug befahrenen Ego-Fahrspur eine zweite Nachbar-Fahrspur angeordnet ist.
• • Einen fünften Umfeldsektor, der sich ausgehend von der Frontlinie (nach hinten) in der zweiten Nachbar-Fahrspur rechts neben und ggf. hinter dem Ego-Fahrzeug erstreckt. Der fünfte Umfeldsektor existiert ggf. nur dann, wenn die zweite Nachbar-Fahrspur existiert.

In a preferred example, the one or more surrounding sectors (possibly maximally or precisely) comprise the following five surrounding sectors:

• • A first surrounding sector, which, starting from the front line (to the rear), extends in a first neighboring lane to the left of and possibly behind the ego vehicle. The first surrounding sector may only exist if a first neighboring lane is arranged to the left of the ego lane traveled by the ego vehicle.
• • A second sector of the surroundings, which, starting from the front line (forward), extends in the first neighboring lane in front of the ego vehicle. The second surrounding sector may only exist if the first neighboring lane exists.
• • A third sector of the surroundings, which, starting from the front line (towards the front), extends in the ego lane in front of the ego vehicle.
• • A fourth sector of the surroundings which, starting from the front line (forwards), extends in a second neighboring lane in front of the ego vehicle. The fourth surrounding sector may only exist if a second neighboring lane is arranged to the right of the ego lane in which the ego vehicle is traveling.
• • A fifth surrounding sector, which extends from the front line (to the rear) in the second neighboring lane to the right of and possibly behind the ego vehicle. The fifth surrounding sector may only exist if the second neighboring lane exists.

The control unit can thus be set up to limit the representation of the surroundings of the ego vehicle to one or more (in particular to exactly five) sectors of the surroundings. So can the clarity of the display can be increased (especially when driving on a multi-lane road, such as a motorway).

Furthermore, the control unit can be set up to select a maximum of N road users in the respective environmental sector per surrounding sector. N can be the same for all surrounding sectors. The various road users in the vicinity of the ego vehicle can be detected on the basis of the environmental data. These road users can be assigned or assigned to the different sectors of the environment. For example, a set of M road users can be identified for the different sectors of the surroundings. M can be different for the different environmental sectors.

A maximum (or precisely) of N road users can then be selected from the set of road users in the different surrounding sectors per surrounding sector. In particular, the N road users for a surrounding sector can be selected from the set of M road users who are located in the surrounding sector. M can be larger, equal to or smaller than N. If M> N, then a subset of the road users who are in the surrounding sector can be selected, if M = N, then all road users who are in the surrounding sector can be selected, and / or if M <N (e.g. M = 0), only M road users may be selected.

In this case, the control unit can be set up to select up to (or precisely) N road users within a sector of the surroundings who are closest to the ego vehicle and / or who are closest to the front line of the ego vehicle. At a certain point in time, the up to N road users who are most relevant to the ego vehicle can be selected per surrounding sector.

In a preferred example, N = 1 (e.g. for all surrounding sectors). The road user who is most relevant to the ego vehicle can thus be selected in every sector of the surroundings. In this way, the clarity of the traffic situation shown can be increased in a special way.

The control unit can be set up to display (up to) N road user symbols for the maximum of N selected road users on the screen for each of the one or more surrounding sectors. Exactly one road user symbol can be displayed for each selected road user. In particular, the display of road user symbols in a sector of the surroundings can be limited to a maximum of N symbols. In this way, a particularly clear display of the relevant information about the surroundings of the ego vehicle can be provided in order to increase the comfort and safety of the ego vehicle.

The control unit can be set up to display each of the one or more environmental sectors in a different sub-area of the screen. As already explained above, the ego symbol can be displayed in a (possibly fixed and / or central) ego area on the screen. The one or more surrounding sectors can be displayed in one or more partial areas around the ego area. In particular, the first surrounding sector can be in a sub-area to the left of the ego area, the second surrounding sector in a sub-area to the left in front of the ego area, the third surrounding sector in a sub-area in front of the ego area, the fourth surrounding sector in a sub-area to the right in front of the ego Area and / or the fifth surrounding sector can be displayed in a sub-area to the right of the ego area.

Furthermore, the control unit can be set up to display (up to) N road user symbols for the maximum of N selected road users on the screen in each of the one or more sub-areas for the one or more surrounding sectors. The current traffic situation can thus be shown in a particularly clear manner on the screen of the ego vehicle.

Each of the one or more sectors surrounding the ego vehicle can be arranged in precisely one actual lane of the roadway on which the ego vehicle is traveling. These can be the ego lane, the (first) neighboring lane arranged directly to the left of the ego lane and the (second) neighboring lane arranged directly to the right of the ego lane.

The control unit can be set up to display the road user symbols in the one or more lanes displayed on the screen. In particular, an ego lane, a neighboring lane arranged to the left of the ego lane and a neighboring lane arranged to the right of the ego lane can be displayed on the screen. The road user symbols, as shown above, can preferably be displayed at one or more fixed possible lateral positions within the respective displayed lane. The clarity of a displayed traffic situation can thus be further increased.

The control unit can be set up to detect that a first road user has entered a receiving sector of the surroundings, starting from an emitting environmental sector. This can be detected on the basis of the environment data. It can thereby be detected, for example, that a road user has entered a receiving sector when 50% of the length of the road user has entered the receiving sector.

Furthermore, the control unit can be set up, in response to the fact that it has been detected that the first traffic participant has entered the receiving environmental sector, to display a first traffic user symbol for the first traffic participant in the sub-area of the screen for the receiving environmental sector. Changes in the traffic situation can thus be shown on the screen in a robust manner.

Furthermore, the control unit can be set up to hide the second road user symbol in the case that a second road user symbol was displayed for a second road user in the sub-area of the screen for the receiving environmental sector before the penetration of the first road user. In particular, the control unit can be set up to hide the second road user symbol only after a debouncing period has elapsed (e.g. between 1 and 3 seconds) after the first road user has entered the receiving sector. Alternatively or in addition, the control unit can be set up to check whether the first road user remains uninterrupted for the debouncing period within the receiving sector of the surroundings. The second road user symbol can then, if necessary, only be hidden after the first road user has remained uninterrupted for the debouncing period within the receiving sector of the surroundings. A changing traffic situation can thus be displayed on the screen in a particularly robust manner (in particular without flickering).

Furthermore, the control unit can be set up, in response to the fact that it has been detected that the first road user has entered the receiving environmental sector, to hide the first road user symbol for the first road user in the sub-area of the screen for the outputting environmental sector. The fading out can take place immediately or only after the debouncing time has expired. In particular, the control unit can be set up to hide the first road user symbol in the sub-area of the screen for the outputting environmental sector only when the first traffic user has continuously penetrated the receiving environmental sector for at least the debouncing period. Changes in the traffic situation can thus be shown on the screen in a robust manner.

The control unit can thus be designed in such a way that in the sub-area of the screen for a surrounding sector, apart from a delayed fading out of a road user symbol as a result of a road user entering the surrounding sector, only a maximum of N road user symbols for the maximum N selected road users for the surrounding sector being represented. Complex traffic situations can thus be displayed on the screen of the ego vehicle in a particularly clear and quickly comprehensible manner in order to increase the comfort and safety of the ego vehicle.

The control unit for displaying a traffic situation on the screen of the ego vehicle can be set up to display a first road user symbol for a first road user in a first sub-area of the screen. The first road user symbol can be the ego symbol of the ego vehicle. The first sub-area can be the ego area. The ego area can e.g. be arranged in the middle of the screen.

Furthermore, the control unit can be set up to display a second road user symbol for a second road user in a second sub-area of the screen. The relative positioning of the second sub-area (i.e. the second road user symbol) relative to the first sub-area (i.e. relative to the first road user symbol) typically depends on the positioning of the second road user relative to the first road user. This relative positioning can be determined on the basis of the surrounding data.

The road user symbol for a road user can comprise an abstract graphic representation of a specific type or a specific class of road users. For example, a car can be represented by the symbol of a car, a truck by the symbol of a truck and / or a motorcycle by the symbol of a motorcycle on the screen. The control unit can be set up to determine the class of the second road user from a plurality of predefined classes. Furthermore, the control unit can be set up to display a second traffic user symbol, which is dependent on the class of the second traffic user, on the screen.

The symbol for a class of road users can have a certain size that is typical for the class of road users, but which does not necessarily correspond to the actual size of the actual road user. The size of the second road user symbol can thus be at least partially independent of the (actual) size of the second road user. In particular, the size of the second road user symbol in relation to the size of the first road user symbol can be greater than the size of the second road user in relation to the size of the first road user.

By choosing standardized symbols for the road users of a traffic situation, the driver of the ego vehicle is able to quickly and reliably record the essential information for the traffic situation. On the other hand, the use of symbols with standardized sizes and / or with standardized animations (e.g. for changing lanes) can lead to a graphical overlap on the screen between two symbols for two road users (even if there is no actual collision between the two Road users). Such a graphic intersection of symbols is also referred to in this document as a virtual collision of symbols.

The control unit can be set up to determine that the first road user symbol and the second road user symbol approach one another in a specific and / or in a predefined way due to a change in the positioning of the second road user relative to the first road user. In particular, the control unit can be set up to determine that, due to a change in the positioning of the second road user relative to the first road user (which can be determined on the basis of the surroundings data), the second road user symbol in an edge zone for the first sub-area of the first road user Symbol penetrates. The edge zone can adjoin the first partial area and / or be arranged next to the first partial area. One or more edge zones can thus be provided around a road user symbol (in particular around the ego symbol of the ego vehicle) which can be viewed as buffer zones for the road user symbol. By providing one or more edge zones, possible virtual collisions between displayed symbols can be recognized more efficiently and reliably and avoided based on them.

Furthermore, the control unit can be set up to at least partially hide the first road user symbol and / or the second road user symbol in response to the detection of the approach and / or the penetration of the second road user symbol into an edge zone of the first road user symbol. In particular, the second road user symbol can be at least partially hidden. By at least partially (or possibly completely) hiding the second road user symbol, virtual collisions between symbols on the screen can be avoided in a reliable manner. In this way, a consistent representation of the traffic situation can be brought about, which increases the comfort and safety of the ego vehicle.

• • Eine erste Randzone in Fahrtrichtung des ersten Verkehrsteilnehmers vor dem ersten Verkehrsteilnehmer-Symbol. In der ersten Randzone kann ein progressives Ausblenden des zweiten Verkehrsteilnehmer-Symbols erfolgen (z.B. in Abhängigkeit von der Eindringtiefe des zweiten Verkehrsteilnehmer-Symbols in Längsrichtung).
• • Eine zweite Randzone zwischen der ersten Randzone und dem ersten Teilbereich. In der zweiten Randzone kann ein abruptes und vollständiges Ausblenden des zweiten Verkehrsteilnehmer-Symbols erfolgen.
• • Eine dritte Randzone in Bezug auf die Fahrtrichtung links neben dem ersten Verkehrsteilnehmer-Symbol. In der dritten Randzone kann ein progressives Ausblenden des zweiten Verkehrsteilnehmer-Symbols erfolgen (z.B. in Abhängigkeit von der Eindringtiefe des zweiten Verkehrsteilnehmer-Symbols in Querrichtung).
• • Eine vierte Randzone in Bezug auf die Fahrtrichtung rechts neben dem ersten Verkehrsteilnehmer-Symbol. In der vierten Randzone kann ein progressives Ausblenden des zweiten Verkehrsteilnehmer-Symbols erfolgen (z.B. in Abhängigkeit von der Eindringtiefe des zweiten Verkehrsteilnehmer-Symbols in Querrichtung).
• • Eine fünfte Randzone in Bezug auf die Fahrtrichtung hinter dem ersten Verkehrsteilnehmer-Symbol. In der fünften Randzone kann ein abruptes Einstellen eines erhöhten, festen Transparenzwertes (z.B. zwischen 40% und 60%) des zweiten Verkehrsteilnehmer-Symbols erfolgen.

The control unit can in particular be set up to take into account the following one or more edge zones for the first road user symbol:

• • A first edge zone in the direction of travel of the first road user in front of the first road user symbol. A progressive fading out of the second road user symbol can take place in the first edge zone (for example as a function of the depth of penetration of the second road user symbol in the longitudinal direction).
• • A second edge zone between the first edge zone and the first sub-area. In the second edge zone, the second road user symbol can be abruptly and completely hidden.
• • A third edge zone in relation to the direction of travel to the left of the first road user symbol. The second road user symbol can be progressively faded out in the third edge zone (for example as a function of the depth of penetration of the second road user symbol in the transverse direction).
• • A fourth edge zone in relation to the direction of travel to the right of the first road user symbol. In the fourth edge zone, the second road user symbol can be progressively faded out (for example as a function of the penetration depth of the second road user symbol in the transverse direction).
• • A fifth edge zone in relation to the direction of travel behind the first road user symbol. In the fifth edge zone, an increased, fixed transparency value (for example between 40% and 60%) of the second road user symbol can be set abruptly.

By providing different edge zones, a particularly efficient and quickly comprehensible representation of the traffic situation can be provided.

An edge zone can have a certain length (in the direction of travel of the first road user) and a certain width (transverse to the direction of travel of the first road user). The control unit can be set up to determine speed data (in particular on the basis of the surroundings data). The speed data can indicate the relative speed at which the second road user symbol is moving towards the edge zone of the first partial area. Alternatively or in addition, the speed data can indicate the relative speed between the first road user and the second road user. In particular, speed data can be determined in relation to a relative speed in the transverse direction and / or in relation to a relative speed in the longitudinal direction of the first road user and / or the second road user.

Furthermore, the control unit can be set up to adapt the dimension, in particular the length and / or the width, of the edge zone as a function of the speed data. In particular, the control unit can be set up to adapt the length of the edge zone depending on the speed data in relation to the relative speed in the longitudinal direction, and / or to adapt the width of the edge zone depending on the speed data in relation to the relative speed in the transverse direction.

The dimension of a peripheral zone can be increased with increasing relative speed and / or reduced with decreasing relative speed, in particular in such a way that the time in which the second road user symbol passes through the peripheral zone remains constant and / or is independent of the relative speed.

By adapting the dimension of an edge zone as a function of the relative speed between the symbols or between the road users, changes in the position of road users (collision-free) can be shown on the screen in a particularly consistent and comprehensible manner.

The control unit can be set up to determine the penetration depth with which the second road user symbol penetrates into an edge zone for the first partial area of the first road user symbol. The penetration depth up to what proportion of the length and / or the width of the edge zone the second road user symbol penetrated into the edge zone can be considered. At the beginning of the penetration, the penetration depth can be 0%, and with complete penetration over the entire length and / or the entire width of the edge zone, the penetration depth can be 100%. For the first edge zone, for example, the penetration depth can be considered in relation to the length of the first edge zone. On the other hand, in the case of the third and / or fourth edge zone, the depth of penetration can be considered in relation to the width of the respective edge zone.

The control unit can be set up to adapt the degree of masking and / or the transparency of the second road user symbol as a function of the penetration depth. In particular, the control unit can be set up to increase the transparency and / or the degree of masking out of the second road user symbol with increasing penetration depth and / or to reduce the transparency and / or the degree of masking out of the second road user symbol with decreasing depth of penetration.

For example, at 0% penetration depth, the transparency and / or the degree of masking can be 0%, and at 100% penetration depth the transparency and / or the degree of masking can be 100%. In between, for example, there can be a linear course of transparency and / or the degree of masking as a function of the penetration depth. By progressively hiding a symbol, changes in the position of road users (collision-free) can be shown on the screen in a particularly consistent and comprehensible manner.

The control unit can be set up to determine the type of edge zone from a plurality of predefined types. The plurality of types can include: a type in which the degree of transparency and / or fading out of an intruding road user symbol (fluently) increases with increasing penetration depth; a type in which the degree of transparency and / or the fading out of an intruding road user symbol is suddenly set to a fixed transparency value (e.g. between 40% and 60%) upon intrusion; and / or a type in which an intruding road user symbol is suddenly faded out upon intrusion.

Furthermore, the control unit can be set up to at least partially hide the second road user symbol depending on the type of edge zone. By taking into account different types of edge zones (at different edges of the first road user symbol), virtual collisions in different areas of the road user or the corresponding road user symbol can be avoided in a reliable and consistent manner.

The control unit can be configured to determine that the second road user is an object relevant to a driving function of the ego vehicle. For example, the second road user can be viewed as a relevant object for a distance and / or speed controller of the ego vehicle if the second road user is used as a control object for the distance and / or speed controller. Alternatively or additionally, the second road user can be viewed as a relevant object for a collision warning system of the ego vehicle if the collision warning system detects a risk of a possible (actual) collision of the ego vehicle with the second road user.

Furthermore, in response to the fact that the second road user was recognized as a relevant object for a driving function, the control unit can be set up to prevent the second road user symbol from being at least partially hidden. The fading out can also be prevented if the second road user symbol penetrates into an edge zone of the first partial area. In this way, the consistency of the display can be further increased. In particular, confusion of the driver of the ego vehicle due to the fading out of a relevant object can be avoided in a reliable manner.

The control unit can be set up to determine whether there is a risk of a collision between the second road user and the first road user due to the change in the positioning of the second road user relative to the first road user. This can be determined on the basis of the surrounding data. In particular, it can be determined whether the risk of an actual collision is greater or less than a predefined probability threshold value.

Furthermore, the control unit can be set up to prevent the at least partial hiding of the second road user symbol if it is determined that there is a risk of a collision between the second road user and the first road user. Alternatively or additionally, the control unit can be set up to at least partially hide the second road user symbol (in particular only then) if it is determined that there is no risk of a collision between the second road user and the first road user.

By taking into account the risk or the probability of an actual collision of a road user when a symbol is hidden for the road user, the consistency of the representation of the traffic situation can be further increased in order to further increase the comfort and safety of the ego vehicle.

A road user symbol can be hidden in such a way that the entire symbol is at least partially hidden (possibly even if the entire symbol has not penetrated into an edge zone). Alternatively, if necessary, only the part of the symbol that has penetrated the edge zone can be hidden (while the part of the symbol that has not penetrated is still displayed without being hidden and / or with 0% transparency). In particular, the last variant can further increase the consistency of the representation of the traffic situation in the vicinity of the ego vehicle.

The control unit can be set up to determine size information relating to the size (e.g. the length and / or the width) of the ego vehicle. The size (e.g. the length and / or the width) of an edge zone that borders the ego area or the ego symbol can then be adapted as a function of the size information. In particular, the size of the edge zone can be increased as the size of the ego vehicle increases (and vice versa). In this way, virtual collisions with increased consistency can be avoided.

The control unit can be set up to determine density information in relation to the traffic density of the traffic situation in the vicinity of the ego vehicle. The size (e.g. the length and / or the width) of the edge zone can then be adjusted depending on the density information. In particular, the size of the edge zone can be reduced with increasing traffic density (and vice versa). In this way, virtual collisions with increased consistency can be avoided.

As already explained above, the control unit can be set up to display a traffic situation on the screen of the ego vehicle, to display a traffic user symbol for a traffic user involved in the traffic situation on the screen. The road user symbol can indicate a class of the road user. The class of the road user can be determined by the control unit. The displayed class can correspond to the class to which the road user was assigned (e.g. on the basis of the environment data and / or on the basis of the environment model). The assigned class may be incorrect (e.g. due to inadequate environmental data and / or due to partial concealment of the road user).

Furthermore, the control unit can be set up to continuously determine over a minimum period that the road user has a different class. With others In other words, it can be checked repeatedly (for example at a sequence of times) whether the road user should be assigned to another class. This can be checked on the basis of the environmental data. It can then be determined that the road user has been permanently assigned to the fixed or the same other (specific) class for at least the minimum period of time. In particular, it can be determined that the road user has been assigned exclusively to the specific other class for at least the minimum period of time.

The control unit can also be set up to adapt the road user symbol displayed to the road user (only) to the (specific) other class if it has been continuously and / or exclusively determined for the minimum period that the road user has the specific other class. The minimum duration can, for example, be between 1 second and 3 seconds.

A delayed display of the (recognized) change in the class of a road user (by changing the class-dependent symbol shown) can thus be brought about. In this way, repeated changes to the displayed class and an associated confusion for the driver of the ego vehicle can be reliably avoided in order to increase the comfort and safety of the ego vehicle.

• • durchgehend (zumindest) für die Mindestzeitdauer bestimmt wurde, dass der Verkehrsteilnehmer der anderen Klasse angehört; und/oder
• • die Konfidenz dafür, dass der Verkehrsteilnehmer der anderen Klasse angehört, gleich wie oder größer als ein (vordefinierter) Konfidenz-Schwellenwert ist, und/oder
• • der Verkehrsteilnehmer eine (tatsächliche) Dimension, insbesondere eine (tatsächliche) Länge und/oder eine Breite, aufweist, die zu der typischen Dimension der anderen Klasse passt.

The control unit can be set up to only assign the road user involved in the traffic situation to the other class and / or only then to adapt the road user symbol for the road user to the other class when

• • it was determined continuously (at least) for the minimum period that the road user belongs to the other class; and or
• • the confidence that the road user belongs to the other class is equal to or greater than a (predefined) confidence threshold, and / or
• • the road user has an (actual) dimension, in particular an (actual) length and / or width, which fits the typical dimension of the other class.

By taking into account one or more conditions for changing a class-dependent road user symbol, a confusing, changing display of classes on the screen can be reliably avoided, thereby increasing the comfort and safety of the ego vehicle.

The control unit can be set up to prevent a future change in the class of a road user and / or a change in the road user symbol for the road user as soon as the road user has been assigned to the same class for at least a minimum stopping time. The minimum holding time can be, for example, between 2 seconds and 5 seconds. Future changes to the displayed class can thus be prevented if (based on the surrounding data) the road user has been assigned to the currently displayed class without interruption over a long period of time. The representation of the traffic situation can thus be further stabilized in order to further increase the comfort and safety of the ego vehicle.

The control unit can be set up to select the class of the road user from a list of predefined classes. The list of classes can include a passenger car (passenger car), a truck (truck), and / or a motorcycle. A limited list of possible classes (e.g. 5 or less, 4 or less, or 3 or fewer classes) can thus be considered. The quality of the classification can be increased by the restriction to a limited list of classes.

The control unit can be set up to display (precisely) a class-specific road user symbol for a road user on the screen for each class from the (limited) list of predefined classes. In this case, only exactly one class-specific road user symbol is preferably provided for each class. By using a limited number of different road user symbols for a correspondingly limited number of classes, the clarity of the representation of the traffic situation can be further increased.

The size, in particular the width and / or the length, of the class-specific road user symbol can for at least one or more classes (in particular for cars and / or motorcycles) independently of the actual size, in particular of the width and / or length of the Be a road user represented by the road user symbol. By displaying symbols for a class that have a uniform size, the clarity of the display of the traffic situation can be further increased.

On the other hand, the control unit can be set up (on the basis of the surroundings data) to determine length data relating to the length of a road user involved in the traffic situation. The length of the road user symbol for the Road users can then be adjusted depending on the length data. This can be used in particular for the class of trucks in order to be able to take into account the relatively large range of possible lengths of trucks in an efficient manner. By taking the length data into account, the consistency of the representation of the traffic situation can be further increased.

The control unit can be set up to increase the length of a road user symbol as a function of updated length data over time. For example, updated length data can be determined at a sequence of points in time (based on the surrounding data). If the length data indicate a greater length of the road user than previously assumed, the corresponding symbol can also be lengthened. On the other hand, a reduction in the length of the road user symbol can be prevented (regardless of the length data) (even if the length data are at least temporarily shorter). In this way, a consistent and stable representation of the traffic situation can be provided on the screen.

The control unit can be set up to determine (e.g. on the basis of the surroundings data) that a road user involved in the traffic situation is approaching the ego vehicle from behind. Typically, the class of a road user approaching the ego vehicle from behind cannot be determined with a high degree of confidence. The road user can therefore first be assigned to a standard class and / or a symbol for a standard class can first be displayed on the screen. The standard class can correspond to the class of cars. By using a standard class, the stability and / or the consistency of the representation of the traffic situation on the screen can be increased further.

The control unit can be set up to display an image relating to the traffic situation on the screen of the ego vehicle. In particular, a corresponding sequence of images can be displayed on the screen at a sequence of times. Each image can represent the traffic situation and / or the state of one or more driving functions of the ego vehicle at a specific point in time. For at least one or more of the road users involved in the traffic situation, a road user symbol can be displayed in the image. Furthermore, an ego symbol for the ego vehicle can be displayed in the image. Furthermore, one or more displayed lanes can be displayed. The image for a specific point in time can be compiled on the basis of the environment data and / or on the basis of status data relating to the status of one or more driving functions of the ego vehicle. By displaying a sequence of images at a sequence of points in time on the screen, the development over time of a traffic situation in the vicinity of the ego vehicle can be displayed in an efficient and reliable manner.

The control unit can thus be set up to determine an image relating to the traffic situation in the environment of the ego vehicle on the basis of environment data from one or more environment sensors of the ego vehicle (at a specific point in time). The image can have a time stamp relative to the electrical system time of the ego vehicle. The on-board network time can, for example, be provided by a time master in the ego vehicle.

In particular, the control unit can be set up to determine or compile the image in relation to the traffic situation on the basis of information from a plurality of information sources. Information from an information source can each have a time stamp. Exemplary sources of information are: the one or more environment sensors of the ego vehicle; a fusion unit of the ego vehicle for determining an environment model of the environment of the ego vehicle on the basis of the environment data (in particular by merging the environment data); and / or one or more driving functions of the ego vehicle for at least partially automated longitudinal and / or lateral guidance of the ego vehicle.

Information from different information sources can thus be taken into account in order to create an image relating to the traffic situation, the image being to be displayed on the screen at a specific display time. The control unit can be set up to determine the time stamp of the image in such a way that the time stamp of the image corresponds to the earliest time stamp and / or an invalid time stamp of the information used to determine the image. A “worst case” time stamp can thus be determined for the image, which shows the age of the oldest information in the image.

The control unit can be set up, in particular at a reference time for the image, to check whether the time stamp is more than a maximum permissible latency before the reference time and / or whether the time stamp is invalid. The reference time can be relative to the vehicle electrical system time. The reference time can be the output time for the image or the reference time can be a test time for the image at which the latency or delay of the image is checked. The latency can for example be between 0.5 Seconds and 1.5 seconds. It can thus be checked before the image is output on the screen whether the image is possibly out of date.

Furthermore, the control unit can be set up to prevent the output of the image on the screen if it has been determined that the time stamp is more than the maximum permissible latency before the reference time and / or that the time stamp is invalid. In particular, the control unit can be set up to only output the image on the screen if it has been determined that the time stamp is at most the maximum permissible latency before the reference time and that the time stamp is valid. If the image is not displayed on the screen, the screen can be deactivated or set to "black" or another information display (e.g. the display of a navigation device) can be activated.

By checking the time stamp of an image to be output, it can be reliably ensured that the information output on the screen with regard to the traffic situation is always up to date. This can increase the safety of the ego vehicle.

The control unit can be set up to use a sequence of reference times (e.g. a sequence of output times and / or test times) to determine a current image in relation to the traffic situation in the vicinity of the ego vehicle (with a current time stamp). Furthermore, the control unit can be set up to output the current image on the screen when it is determined that the time stamp of the current image is at most the maximum permissible latency before the respective reference time and that the time stamp is valid. If this is not the case, the output of the respective image can be prevented or an information display can be switched over. A reliable representation of the current traffic situation in the vicinity of the ego vehicle can thus be brought about for the duration of the operation of the ego vehicle.

The control unit can be set up to ensure that no image, not even a previous and / or previous image, is displayed on the screen in relation to the traffic situation in the vicinity of the ego vehicle if it has been determined that the time stamp has been increased by more than maximum permissible latency is before the reference time and / or that the time stamp is invalid. In this way, the reliability of the representation of the traffic situation and the safety of the ego vehicle can be further increased.

The control unit can be set up to output an image relating to the traffic situation in the vicinity of the ego vehicle on the screen only after a minimum interruption time has elapsed (which is between 1 and 3 seconds, for example) after the output of the image at the reference time has been prevented only if the image again fulfills the above requirement with regard to the maximum permissible latency). By temporarily preventing the output of images, the stability of the representation of the traffic situation can be increased. In particular, a flickering of the image displayed on the screen and an associated distraction and / or confusion of the driver of the ego vehicle can be avoided.

As already explained above, the control unit can be set up to determine an image with regard to the traffic situation in the surroundings of the ego vehicle on the basis of a fusion of the surroundings data from the one or more surroundings sensors. The fusion can take place in such a way that the fusion of the surroundings data has an invalid time stamp if the surroundings data of the one or more surroundings sensors are at least partially invalid and / or if the surroundings data of a certain (possibly critical) set of surroundings sensors have failed or are invalid and / or when the odometry of the ego vehicle has failed. The fact whether the fusion of the surrounding data is assigned an invalid time stamp can depend on the state of the ego vehicle and / or on the traffic situation and / or on an active driving function. In particular, an invalid time stamp can possibly only be assigned to the fusion of the environmental data in the event of a critical degradation situation of the environmental sensor system.

The control unit can also be set up to assign an invalid time stamp to the image if the fusion of the environment data has an invalid time stamp. The reliability of an image output on the screen with regard to the traffic situation can thus be further increased.

According to a further aspect, this document describes a system for an ego vehicle which comprises the control unit described in this document and a screen for the ego vehicle. The system can furthermore comprise one or more environment sensors.

According to a further aspect, a (road) motor vehicle (in particular a passenger car or a truck or a bus or a motorcycle) is described which comprises the control unit described in this document and / or the system described in this document.

According to a further aspect, a method (and a corresponding control unit) for displaying a traffic situation on a screen of an ego vehicle is described. The method includes the display of a road user symbol for at least one road user in the traffic situation who is driving in an actual lane at a constant first lateral position within a lane displayed on the screen. Furthermore, the method includes the detection of a lane event in relation to a departure from the actual lane of the road user. In particular, a lane event can be detected in relation to the fact that the road user has partially left, is leaving, is being left, could or should leave the actual lane. The method further comprises, in response to this, displaying the road user symbol at a second lateral position within the displayed lane that differs from the first lateral position.

According to a further aspect, a method (and a corresponding control unit) for displaying a traffic situation on a screen of an ego vehicle is described. The method comprises the selection of a maximum of N road users in each of one or more different environmental sectors of an environment of the ego vehicle. Furthermore, the method comprises the display, for each of the one or more surrounding sectors, of a respective road user symbol for each of the maximum N selected road users on the screen.

According to a further aspect, a method (and a corresponding control unit) for displaying a traffic situation on a screen of an ego vehicle is described. The method comprises displaying a first road user symbol for a first road user in a first sub-area of the screen and a second road user symbol for a second road user in a second sub-area of the screen, with a positioning of the second sub-area relative to the first sub-area of a Positioning of the second road user relative to the first road user depends. The method also includes determining that, due to a change in the positioning of the second road user relative to the first road user, the first and second road user symbols approach each other, in particular the second road user symbol in an edge zone for the first sub-area of the first road user Symbol penetrates. The method further comprises, in response thereto, causing the second road user symbol to be at least partially hidden.

According to a further aspect, a method (and a corresponding control unit) for displaying a traffic situation on a screen of an ego vehicle is described. The method comprises the display of a road user symbol for a road user involved in the traffic situation on the screen, the road user symbol indicating a class of the road user. Furthermore, the method comprises the continuous determination over a minimum period of time and / or over a minimum quality that the road user has a specific, constant, other class. In addition, the method comprises, in response thereto, adapting the traffic user symbol displayed to the traffic user to the specific other class.

According to a further aspect, a method (and a corresponding control unit) for displaying an image relating to a traffic situation on a screen of an ego vehicle is described. The method includes determining, based on environment data from one or more environment sensors of the ego vehicle, an image relating to a traffic situation in an environment of the ego vehicle, the image having a time stamp relative to an on-board network time of the ego vehicle. Furthermore, the method includes checking, in particular at a reference point in time of the vehicle electrical system time, whether the time stamp is more than a maximum permissible latency time before the reference point in time and / or whether the time stamp is invalid. The method further includes preventing the image from being output on the screen if it has been determined that the time stamp is more than the maximum permissible latency time before the reference time and / or that the time stamp is invalid.

According to a further aspect, a software (SW) program is described. The SW program can be set up to be executed on a processor (e.g. on a control unit of a vehicle) and thereby to execute at least one of the methods described in this document.

According to a further aspect, a storage medium is described. The storage medium can comprise a SW program which is set up to be executed on a processor and thereby to execute at least one of the methods described in this document.

It should be noted that the methods, devices and systems described in this document can be used both alone and in combination with other methods, devices and systems described in this document. Furthermore, any aspects of the methods, devices and systems described in this document can be combined with one another in diverse ways. In particular, the features of the claims can be combined with one another in diverse ways.

• 1a eine beispielhafte Verkehrssituation im Umfeld eines Ego-Fahrzeugs;
• 1b beispielhafte Komponenten eines Ego-Fahrzeugs;
• 2a ein beispielhaftes Bild in Bezug auf eine Verkehrssituation im Umfeld eines Ego-Fahrzeugs;
• 2b ein beispielhaftes System zur Ausgabe eines Bildes auf einem Bildschirm eines Ego-Fahrzeugs;
• 3a bis 3c beispielhafte Bilder zur Wiedergabe einer Verkehrssituation;
• 3d ein beispielhaftes Bild zur Darstellung einer Rettungsgasse;
• 4 beispielhafte Umfeldsektoren um ein Ego-Fahrzeug;
• 5 beispielhafte Randzonen eines Ego-Fahrzeugs;
• 6a ein Ablaufdiagramm eines beispielhaften Verfahrens zur Positionierung eines Verkehrsteilnehmer-Symbols innerhalb einer Fahrspur;
• 6b ein Ablaufdiagramm eines beispielhaften Verfahrens zur Anzeige von Verkehrsteilnehmer-Symbolen für Verkehrsteilnehmer im Umfeld eines Ego-Fahrzeugs;
• 6c ein Ablaufdiagramm eines beispielhaften Verfahrens zur Anzeige eines Verkehrsteilnehmer-Symbols in einer Randzone eines Ego-Fahrzeugs;
• 6d ein Ablaufdiagramm eines beispielhaften Verfahrens zur Anzeige eines klassenabhängigen Verkehrsteilnehmer-Symbols; und
• 6e ein Ablaufdiagramm eines beispielhaften Verfahrens zur Ausgabe eines Bildes auf einem Bildschirm eines Fahrzeugs.

The invention is described in more detail below on the basis of exemplary embodiments. Show it

• 1a an exemplary traffic situation in the vicinity of an ego vehicle;
• 1b exemplary components of an ego vehicle;
• 2a an exemplary image relating to a traffic situation in the vicinity of an ego vehicle;
• 2 B an exemplary system for displaying an image on a screen of an ego vehicle;
• 3a to 3c exemplary images for reproducing a traffic situation;
• 3d an exemplary image to show a rescue alley;
• 4th exemplary environmental sectors around an ego vehicle;
• 5 exemplary edge zones of an ego vehicle;
• 6a a flowchart of an exemplary method for positioning a road user symbol within a lane;
• 6b a flowchart of an exemplary method for displaying road user symbols for road users in the vicinity of an ego vehicle;
• 6c a flowchart of an exemplary method for displaying a road user symbol in an edge zone of an ego vehicle;
• 6d a flowchart of an exemplary method for displaying a class-dependent road user symbol; and
• 6e a flowchart of an exemplary method for outputting an image on a screen of a vehicle.

As explained at the outset, the present document deals with the output of visual information relating to a traffic situation in the environment of an ego vehicle on a screen of the ego vehicle. In this context shows 1a an exemplary traffic situation of an ego vehicle 110 on a multi-lane (actual) roadway 100 with an ego lane 101 on which the ego vehicle 110 drives, and with one or more neighboring lanes 102 , 103 . In the environment of the ego vehicle 110 there are several different other road users 120 (especially other vehicles). The other road users 120 can belong to different classes. Exemplary classes are: cars (passenger cars), trucks (trucks), buses, motorcycles, etc.

1b shows exemplary components of an ego vehicle 110 . The ego vehicle 110 includes one or more environment sensors 112 which are set up, environment data (ie sensor data) relating to the environment of the ego vehicle 110 capture. Exemplary environment sensors 112 are an image camera, a radar sensor, a lidar sensor, an ultrasonic sensor, etc.

Furthermore, the ego vehicle can 110 one or more actuators 113 for automated longitudinal and / or lateral guidance of the ego vehicle 110 include. Exemplary actuators 113 are a drive motor, a braking device and / or a steering device.

In addition, the ego vehicle can 110 a screen 114 which is set up to display images with N x M pixels, wherein N and / or M can be 100 or more, 200 or more or 500 or more. The screen 114 may for example comprise a TFT (thin film transistor) screen and / or an LCD (liquid crystal display) screen and / or an LED (light emitting diode) screen. As an alternative or in addition, the screen can comprise a head-up display and / or a projector which is set up to project an image onto a surface. The screen 114 can be in the interior of the ego vehicle 110 and / or on a dashboard or on a center console of the ego vehicle 110 be arranged.

A control unit 111 of the ego vehicle 110 can be set up, based on the environment data, an environment model in relation to the environment of the ego vehicle 110 to investigate. The environment model can, for example, be one or more other road users 120 in the environment of the ego vehicle 110 and / or the number of lanes 101 , 102 , 103 that of the ego vehicle 110 traffic lane 100 describe. The control unit 111 can be set up with one or more actuators 113 of the ego vehicle 110 to operate as a function of the environment model, for example to perform a driving function or a driver assistance function (such as a Lane Keeping Assist, Lane Change Assist, Adaptive Cruise Control, etc.).

Furthermore, the control unit 111 be set up, based on the environment data and / or on the basis of the environment model, an image with respect to the environment of the ego vehicle 110 to investigate. In particular, an image of the current traffic situation in the vicinity of the ego vehicle can be used for a sequence of successive points in time 110 be determined. The image or the sequence of images can then be viewed on the screen 114 of the ego vehicle 110 issued to the driver of the ego vehicle 110 in the longitudinal and / or lateral guidance of the ego vehicle 110 to support.

2a shows an exemplary picture 200 in relation to a traffic situation in the vicinity of the ego vehicle 110 . The picture 200 includes an (abstract) lane representation 201 the ego lane 101 as well as lane representations 202 , 203 for one or more neighboring lanes 102 , 103 . A lane representation 201 , 202 , 203 is also referred to in this document as an “indicated lane”.

Furthermore, the picture includes 200 Road user symbols 220 for one or more road users 120 in the environment of the ego vehicle 110 . A road user symbol can also be used 210 for the ego vehicle 110 are displayed, which is also referred to as an ego symbol and possibly depicts details of the ego vehicle and / or the state of the ego vehicle.

The picture 200 can be generated on the basis of the environment data and / or the environment model in such a way that the ego symbol 210 a fixed position (e.g. horizontally in the middle, in the lower area of the image 200 ) having. The fixed position can remain unchanged over time. So it becomes a driver of the ego vehicle 110 allows that in one picture 200 Information presented in relation to the environment of the ego vehicle 110 to grasp quickly (since the ego vehicle 110 or the ego symbol 210 quickly within the picture 200 can be localized).

2 B shows an exemplary system 250 to output an image 200 on the screen 114 of the ego vehicle 110 . The system 250 includes a time maser 251 that is set up, a synchronized electrical system time 253 within the ego vehicle 110 to provide.

Based on the surrounding data 252 from one or more environmental sensors 112 of the ego vehicle 110 becomes (e.g. by data fusion) in a fusion unit 254 an environment image and / or an environment model 255 the environment of the ego vehicle 110 generated. The environment data 252 of the individual environment sensors 112 each have a time stamp (relative to the vehicle electrical system time 253 ) on. The fusion unit 254 can be the time stamp of the environment data 252 use to environmental data 252 to merge with each other that refer to the same point in time or timestamp. The one from the fusion unit 254 Environment image provided 255 thus typically has a uniform time stamp.

Furthermore, one or more driving functions 256 (especially driver assistance systems) Functional information 257 to be provided. The function information 257 can, for example, provide information on whether a certain driving function 256 is activated and / or the function information 257 can refer to elements of the environment model or the environment image 255 eg refer to a rule target. Furthermore, the function information 257 Information relating to at least one active driving function 256 include that in the one on the screen 114 shown image 200 should be displayed. For example, with ACC the setpoint distance to the vehicle in front can be displayed. The function information 257 can have a time stamp which indicates the point in time at which the functional information was received 257 was valid.

An output unit 258 of the system 250 can be set up, taking into account the time stamp, an environment image and / or an environment model 255 with the appropriate functional information 257 to combine and further process as a whole to form image data 260 for the image to be displayed 200 to investigate. The image data 260 can look at the screen 114 be transmitted so that on the screen 114 the picture 200 is reproduced. The picture 200 typically assigns a uniform timestamp for everyone in the image 200 information displayed.

In a corresponding manner, one image can be used at a sequence of times (or for a sequence of time stamps) 200 can be generated and displayed. The individual pictures 200 comprise (abstracted) information relating to the environment of the ego vehicle 110 and / or function information 257 in relation to one or more active driving functions 256 of the ego vehicle 110 .

The relative positioning of the individual road users 120 to each other and / or relative to the ego vehicle 110 typically changes constantly. In particular, the lateral position of the individual road users can be 120 within the individual lanes 101 , 102 , 103 change over time. This typically has the consequence that the lateral position of the individual road user symbols also changes 220 within the lanes shown 201 , 202 , 203 in a sequence of Images 200 continuously changes. This leads to a restless and confusing representation of the surroundings of the ego vehicle 110 on the screen 114 . Furthermore, this can lead to the driver of the ego vehicle 110 through the constant changes on the screen 114 distracted from the actual driving task.

To calm the representation of the surroundings of the ego vehicle 110 can be set to be a road user icon 220 for a road user 120 only at a limited number (eg a maximum of three) of lateral positions within a depicted lane 201 , 202 , 203 is positioned (regardless of the actual lateral position of the road user 120 within the actual lane 101 , 102 , 103 ). In particular, the output unit 258 causes the road user symbols 220 the one or more road users 120 in the environment of the ego vehicle 110 in the picture 200 always at a fixed lateral position (e.g. in the middle) within the individual displayed lanes 201 , 202 , 203 being represented. So images can be taken at a sequence of points in time 200 are output, which in a calm manner schematically shows the environment of the ego vehicle 110 reproduce. As a result, a traffic situation can be caused by the driver of the ego vehicle 110 can be recorded reliably and quickly.

The lateral position of the ego symbol can also be used in a corresponding manner 210 for the ego vehicle 110 to a limited number of positions within the displayed ego lane 201 be limited. For example, the ego symbol 210 at a single standard position (e.g. in the middle) within the ego lane 201 being represented.

• • eine Betätigung des Lenkmittels (insbesondere des Lenkrads) des Ego-Fahrzeugs 110, um eine Querführung des Ego-Fahrzeugs 110 zu bewirken;
• • ein Eingriff in die Querführung des Ego-Fahrzeugs 110 durch eine Fahrfunktion 256 (z.B. für einen Spurwechsel);
• • eine Warnung in Bezug auf die Spurführung des Ego-Fahrzeugs 110 (z.B. eine Spurverlassenswarnung);
• • eine aktive Navigation des Ego-Fahrzeugs 110, die anzeigt, dass das Ego-Fahrzeug 110 in naher Zukunft die Fahrspur 101, 102, 103 wechseln sollte oder wird; und/oder
• • eine Aufforderung zum Bilden einer Rettungsgasse.

The control unit 111 of the ego vehicle 110 can be set up, a lane event in relation to the lateral guidance of the ego vehicle 110 and / or in relation to a positioning of the ego vehicle 110 within the ego lane 101 to detect. Exemplary events are:

• • an actuation of the steering means (in particular the steering wheel) of the ego vehicle 110 to lateral guidance of the ego vehicle 110 to effect;
• • an intervention in the lateral guidance of the ego vehicle 110 through a driving function 256 (e.g. to change lanes);
• • a warning regarding the lane guidance of the ego vehicle 110 (e.g. a lane departure warning);
• • active navigation of the ego vehicle 110 that indicates the ego vehicle 110 in the near future the lane 101 , 102 , 103 should or will change; and or
• • a request to form a rescue alley.

• • in einer linken lateralen Position dargestellt werden, wenn sich das Ego-Fahrzeug 110 relativ weit links innerhalb der Ego-Fahrspur 101 befindet;
• • in einer mittigen lateralen Position (z.B. der Standard-Position) dargestellt werden, wenn sich das Ego-Fahrzeug 110 relativ mittig innerhalb der Ego-Fahrspur 101 befindet; und/oder
• • in einer rechten lateralen Position dargestellt werden, wenn sich das Ego-Fahrzeug 110 relativ weit rechts innerhalb der Ego-Fahrspur 101 befindet; und/oder
• • in einer seitlichen lateralen Position dargestellt werden (z.B. rechts oder links), wenn sich das Ego-Fahrzeug 110 zwar relativ mittig innerhalb der Ego-Fahrspur 101 befindet, aber der Fahrer darauf hingewiesen werden soll, dass er das Fahrzeug 110 eher auf diese Seite (z.B. die rechte Seite oder die linke Seite) lenken sollte.

Furthermore, the control unit 111 set up the lateral position of the ego symbol 210 adapt in response to a detected lane event (deviating from the standard position). If necessary, only a limited number of positions can be made possible. For example, the ego symbol 210

• • Be shown in a left lateral position when the ego vehicle is 110 relatively far to the left within the ego lane 101 located;
• • be displayed in a central lateral position (eg the standard position) when the ego vehicle is 110 relatively centered within the ego lane 101 located; and or
• • Be shown in a right lateral position when the ego vehicle is 110 relatively far to the right within the ego lane 101 located; and or
• • Be shown in a lateral lateral position (eg right or left) when the ego vehicle is 110 although relatively in the middle within the ego lane 101 located, but the driver should be advised that he is driving the vehicle 110 should rather focus on this side (e.g. the right side or the left side).

A smooth and / or a steady transition in the representation of the ego symbol can optionally be used between the positions 210 respectively.

3a shows an exemplary arrangement of the ego symbol 210 and road user symbols 220 at a central lateral position in the respective displayed lane 201 , 202 , 203 . In 3a for the displayed ego lane 201 a center line 301 illustrated (which is typically not in the picture 200 is reproduced).

3b shows an exemplary arrangement of the ego symbol 210 in a left lateral Position within the displayed ego lane 201 . Road users symbols 220 are still at the central lateral position in the respective displayed lane 201 , 202 , 203 shown. Such a representation can, for example, after the detection of a lane event in the case of a lane change warning from the ego vehicle 110 to the neighboring lane 102 respectively.

3c shows an exemplary arrangement of the ego symbol 210 in a right lateral position within the displayed ego lane 201 . Road users symbols 220 are still at the central lateral position in the respective displayed lane 201 , 202 , 203 shown. Such a representation can, for example, after the detection of a lane event in the case of a lane change warning from the ego vehicle 110 to the neighboring lane 103 respectively.

3d shows an exemplary arrangement of the ego symbol 210 and road user symbols 220 when there is a request to form an emergency lane. In this case, the road user symbols can also be used as an exception 220 by one or more road users 120 in the environment of the ego vehicle 110 on the tracks shown in the example 201 and 202 deviating from the standard position (in particular the central lateral position) are arranged to the driver of the ego vehicle 110 clearly indicate that and, if necessary, how an emergency corridor is to be formed.

The control unit 111 of the ego vehicle 110 can thus be set up vehicles 110 , 120 that are in the environment display 200 on the screen 114 are shown, deviating from their respective real, lateral position, a certain lane 101 , 102 , 103 assign and within the ad 200 at a standard position (in particular in the middle) within the respective displayed lane 201 , 202 , 203 to represent. If necessary, the respective lateral position (in particular the lateral position of the ego symbol) can only be used in situations in which the lateral position is of particular relevance 210 ) can be visualized. This leads to a calming of the display 200 and reflects a logical subdivision of the vehicle environment, which can be used to structure the display in relation to the driving task.

• • Der Fahrer verlässt durch Lenkbewegungen einen festgelegten Bereich um die Mittellinie 301 der befahrenen Spur 101 und fährt somit deutlich außermittig in der Spur 101;
• • Die Assistenzfunktion „Spurverlassenswarnung“ gibt eine Warnung aus;
• • Die Assistenzfunktion „Spurwechselassistent“ führt einen automatisierten Spurwechsel aus;
• • Die Assistenzfunktion „Querführung mit aktiver Navigation“ weicht in der Regelung absichtlich von der Spurmitte ab, um einen erwarteten Spurwechsel vorzubereiten; und/oder
• • Die Assistenzfunktion „Rettungsgassenassistent“ weicht in der Regelung absichtlich von der Spurmitte ab, um eine Rettungsgasse zu bilden.

The lateral position of the ego symbol 210 can thus in cases of no particular relevance (exclusively) in the middle of the displayed ego lane 201 being represented. The control unit 111 can be set up, possibly only in the following cases (ie when one of the following lane events is present) the deviation of the ego vehicle 110 from the center line 301 the traveled lane 101 to visualize:

• • The driver leaves a defined area around the center line by steering movements 301 the traveled lane 101 and thus drives clearly off-center in the lane 101 ;
• • The assistance function “Lane Departure Warning” issues a warning;
• • The assistance function "Lane Change Assistant" performs an automated lane change;
• • The control of the assistance function "Lateral guidance with active navigation" intentionally deviates from the lane center in order to prepare for an expected lane change; and or
• • The control of the "emergency lane assistant" function intentionally deviates from the center of the lane in order to form an emergency lane.

The symbols 220 for the one or more surrounding vehicles 120 can each be centered in the respective displayed track 201 , 202 , 203 be positioned, with any surrounding vehicle 120 based on the surrounding data 252 and / or by processing a specific lane by a driver assistance function 101 , 102 , 103 is assigned. A lane change of another vehicle 120 can be synchronized with a reaction of the ego vehicle 110 can be visualized on the lane change. For example, the ego vehicle can brake automatically 110 in response to a front of the ego vehicle 110 cutting vehicle 120 synchronized with the vehicle's position change 120 in the advertising 200 respectively.

Resulting jumps in the lateral position of a road user 110 , 120 can by animated movement of the respective symbol 210 , 220 on the display 200 be smoothed.

• • ein erster Umfeldsektor 401 links neben und hinter dem Ego-Fahrzeug 110 (bis zu der Frontlinie 410 des Ego-Fahrzeugs 110). Der erste Umfeldsektor 401 kann z.B. vollständig innerhalb der direkt neben der Ego-Fahrspur 101 liegenden linksseitigen Nachbar-Fahrspur 102 angeordnet sein.
• • ein zweiter Umfeldsektor 402 links vor dem Ego-Fahrzeug 110 (ab der Frontlinie 410 der Front des Ego-Fahrzeugs 110). Der zweite Umfeldsektor 402 kann z.B. vollständig innerhalb der direkt neben der Ego-Fahrspur 101 liegenden linksseitigen Nachbar-Fahrspur 102 angeordnet sein.
• • ein dritter Umfeldsektor 403 vor dem Ego-Fahrzeug 110 (ab der Frontlinie 410 der Front des Ego-Fahrzeugs 110). Der dritte Umfeldsektor 403 kann z.B. vollständig innerhalb der Ego-Fahrspur 101 angeordnet sein.
• • ein vierter Umfeldsektor 404 rechts vor dem Ego-Fahrzeug 110 (ab der Frontlinie 410 der Front des Ego-Fahrzeugs 110). Der vierte Umfeldsektor 404 kann z.B. vollständig innerhalb der direkt neben der Ego-Fahrspur 101 liegenden rechtsseitigen Nachbar-Fahrspur 103 angeordnet sein.
• • ein fünfter Umfeldsektor 405 rechts neben und hinter dem Ego-Fahrzeug 110 (bis zu der Frontlinie 410 des Ego-Fahrzeugs 110). Der fünfte Umfeldsektor 405 kann z.B. vollständig innerhalb der direkt neben der Ego-Fahrspur 101 liegenden rechtsseitigen Nachbar-Fahrspur 103 angeordnet sein.

The representation of symbols 220 for all registered road users 120 in the environment of the ego vehicle 110 can overload the display or the image, especially in a dense traffic situation 200 on the screen 114 to lead. The control unit 111 of the ego vehicle 110 can be set up (as in 4th shown), the environment of the ego vehicle 110 in a limited number of environmental sectors 401 , 402 , 403 , 404 , 405 to subdivide. Exemplary environmental sectors are:

• • a first surrounding sector 401 to the left of and behind the ego vehicle 110 (up to the front line 410 of the ego vehicle 110 ). The first environmental sector 401 For example, it can be completely within the right next to the ego lane 101 lying left-hand neighbor lane 102 be arranged.
• • a second surrounding sector 402 left in front of the ego vehicle 110 (from the front line 410 the front of the ego vehicle 110 ). The second environmental sector 402 For example, it can be completely within the right next to the ego lane 101 lying left-hand neighbor lane 102 be arranged.
• • a third surrounding sector 403 in front of the ego vehicle 110 (from the front line 410 the front of the ego vehicle 110 ). The third Surrounding sector 403 can for example be completely within the ego lane 101 be arranged.
• • a fourth environmental sector 404 right in front of the ego vehicle 110 (from the front line 410 the front of the ego vehicle 110 ). The fourth environmental sector 404 For example, it can be completely within the right next to the ego lane 101 lying right-hand neighbor lane 103 be arranged.
• • a fifth environmental sector 405 to the right of and behind the ego vehicle 110 (up to the front line 410 of the ego vehicle 110 ). The fifth environmental sector 405 For example, it can be completely within the right next to the ego lane 101 lying right-hand neighbor lane 103 be arranged.

The control unit 111 can be set up for each environmental sector 401 , 402 , 403 , 404 , 405 a maximum of N, in particular a maximum of one, road user 120 identify the one in the picture 200 should be presented in relation to the surrounding situation. This can be done in any sector 401 , 402 , 403 , 404 , 405 the road user 120 with the highest relevance for the ego vehicle 110 and / or with the closest distance to the ego vehicle 110 to be chosen. In the picture 200 can then in every single sector of the environment 401 , 402 , 403 , 404 , 405 possibly only one road user symbol at a time 220 for the selected road user 120 being represented. In this way, the display or the image 200 on the screen 114 on those for the ego vehicle 110 relevant information remains limited. This enables the driver of the ego vehicle 110 to capture an environmental situation in a reliable and fast manner.

The vehicle environment can therefore be divided into different sectors 401 , 402 , 403 , 404 , 405 to be grouped. Furthermore, the images shown 200 be generated in such a way that in one sector 401 , 402 , 403 , 404 , 405 only one vehicle symbol at most 220 is shown. The definition of a limited number (e.g. five) of sectors 401 , 402 , 403 , 404 , 405 which is particularly relevant to the driving task of the ego vehicle 110 has calmed the display 200 . In particular, the number of foreign vehicles displayed 120 be reduced. Nevertheless, it can still be ensured that vehicles 120 relevant for the driving task are displayed.

• • maximal ein Fahrzeug 120 in der linken Nebenspur 102 bis Höhe 410 des Ego-Fahrzeugs 110;
• • maximal ein Fahrzeug 120 in der linken Nebenspur 102 vor dem Ego-Fahrzeug 110;
• • maximal ein Fahrzeug 120 auf der Ego-Spur 101 vor dem Ego-Fahrzeug 110;
• • maximal ein Fahrzeug 120 in der rechten Nebenspur 103 vor dem Ego-Fahrzeug 110; und/oder
• • maximal ein Fahrzeug 120 auf der rechten Nebenspur 103 bis zur Höhe 410 des Ego-Fahrzeugs 110.

The vehicles in particular are responsible for the driving task 120 in the immediate vicinity next to and in front of the ego vehicle 110 Relevance. In particular, vehicles 120 on secondary tracks are not taken into account. As a result, the following sectors can be formed (see 4th ):

• • a maximum of one vehicle 120 in the next left lane 102 up to height 410 of the ego vehicle 110 ;
• • a maximum of one vehicle 120 in the next left lane 102 in front of the ego vehicle 110 ;
• • a maximum of one vehicle 120 on the ego track 101 in front of the ego vehicle 110 ;
• • a maximum of one vehicle 120 in the right next lane 103 in front of the ego vehicle 110 ; and or
• • a maximum of one vehicle 120 in the right next lane 103 up to the height 410 of the ego vehicle 110 .

• • in dem zweiten, dritten und vierten Sektor 402, 403, 404 vor dem Ego-Fahrzeug 110): Es kann jeweils das Fahrzeug 120 ausgewählt werden, das dem Ego-Fahrzeug 110 am nächsten ist. Es kann somit das Fahrzeug 120 auswählt werden, das in dem jeweiligen Sektor 402, 403, 404 am weitesten hinten angeordnet ist. Diese Fahrzeuge 120 haben typischerweise die relativ höchste Relevanz für das Ego-Fahrzeug 110 in dem jeweiligen Sektor 402, 403, 404.
• • in dem ersten und fünften Sektor 401, 404: Es kann das Fahrzeug 120 ausgewählt werden, welches am weitesten vorne in dem jeweiligen Sektor 401, 404 positioniert ist. Diese Fahrzeug 120 haben typischerweise die größte Relevanz für das Ego-Fahrzeug 110. Des Weiteren ermöglicht die Auswahl dieser Fahrzeuge 120 einen grafischen sauberen Übergang eines Fahrzeugs 120 aus dem ersten Sektor 401 in den zweiten Sektor 402 bzw. aus dem fünften Sektor 405 in den dritten Sektor 403.

When choosing which vehicle 102 in the respective sector 401 , 402 , 403 , 404 , 405 is displayed, one or more of the following rules can be used:

• • in the second, third and fourth sectors 402 , 403 , 404 in front of the ego vehicle 110 ): The vehicle can 120 be selected that the ego vehicle 110 is closest. It can thus be the vehicle 120 be selected in the respective sector 402 , 403 , 404 is located furthest back. These vehicles 120 typically have the relatively highest relevance for the ego vehicle 110 in the respective sector 402 , 403 , 404 .
• • in the first and fifth sectors 401 , 404 : It can be the vehicle 120 be selected which is furthest forward in the respective sector 401 , 404 is positioned. This vehicle 120 typically have the greatest relevance to the ego vehicle 110 . Furthermore, the selection of these vehicles enables 120 a graphically clean transition of a vehicle 120 from the first sector 401 in the second sector 402 or from the fifth sector 405 in the third sector 403 .

At a sequence of points in time or over time, it can happen that a vehicle is arranged in a sector 120 changes to another sector (e.g. by changing lanes or by accelerating or falling back within the same lane) in which another vehicle has already been selected for display before the change. For a vehicle 120 that is in a new sector 401 , 402 , 403 , 404 , 405 occurs and as a relevant vehicle 120 can be selected directly in the respective sector 401 , 402 , 403 , 404 , 405 a symbol 220 being represented. On the other hand, for the (previously displayed) vehicle 120 a temporally extended hiding of the symbol 220 be effected (e.g. in a period between 200ms and 500ms).

There can thus be a debouncing for the fading in and / or out of symbols 220 in one sector 401 , 402 , 403 , 404 , 405 be provided to avoid annoying and confusing display effects by flickering symbols 220 on the screen 114 to avoid, for example, when a vehicle 120 repeatedly in a specific sector 401 , 402 , 403 , 404 , 405 dives in and out and another vehicle 120 "displaced" there by the display priority. The symbol. Can be used for an adjustable (relatively short) period of time 220 for a vehicle to be hidden 120 longer in the ad 200 being held. In addition, a soft fade in and / or fade out with a defined transition time can be used.

As already explained, the individual road users can 120 in the environment of the ego vehicle 110 each with a road user symbol 220 in the ad or picture 200 be represented. The symbol shown 220 for a road user 120 the type or class of the road user 120 depend. So can for a driver of the ego vehicle 110 the assignment of the individual actual road users 120 to a represented (abstract) symbol 220 be simplified. It becomes the driver of the ego vehicle 110 thus enables an environmental situation on the displayed image in a reliable and fast manner 200 capture.

The control unit 111 of the ego vehicle 110 can be set up on the basis of the environment data and / or on the basis of the environment model for everyone in the image 200 road users to be represented 120 determine a class from a plurality of predefined classes. The plurality of predefined classes can include, for example, a class for cars, a class for trucks and a class for motorcycles. Furthermore, the control unit 111 be set up, one of the class of the respective road user 120 dependent (abstract) symbol 220 in the picture 200 to represent.

The symbol 220 for a road user 120 can be at least partially independent of the actual dimensions of the road user 120 be. In particular, a standard symbol can be used for cars and / or motorcycles 220 with standard dimensions can be used. On the other hand, the length 302 of the symbol 220 for a truck can be adjusted to the actual and / or estimated length of the truck.

As part of the operation of the ego vehicle 110 it can happen that the classification of a road user 120 changed over time. For example, it can happen that a road user 120 based on the surrounding data 252 is initially classified as a car at a first point in time. Based on the surrounding data 252 at a subsequent second point in time, the road user can then 120 possibly classified as a truck. The classification of a road user 120 can therefore possibly be unstable.

• • wenn die neue Klasse mit einer relativ hohen Konfidenz ermittelt wurde, und/oder
• • wenn die neue Klasse in stabiler Weise für eine Mindestzeitdauer ermittelt wurde.

In order to have a stable output over time 200 to enable a change of the symbol shown 220 for a road user 120 may only be carried out if

• • if the new class was determined with a relatively high confidence, and / or
• • when the new class has been determined in a stable manner for a minimum period of time.

So can frequent changes of the for a road user 120 symbol shown 220 can be avoided, so that uncertainty of the driver of the ego vehicle 100 through a regularly changing visual output 200 can be avoided and so that the perceived display quality is increased.

The one in the environment display 200 illustrated vehicles 120 can thus be divided into a limited number (especially three) of classes: e.g. motorcycle, car and truck. Inside the ad 200 It should be ensured that the representation of the classification of a vehicle 120 does not change too often. A user study has shown, for example, that an occasional false display of the class of a vehicle 120 Drivers perceive it as less annoying and / or confusing than changing the displayed class relatively frequently.

Optionally, to further stabilize the displayed class for a road user 120 an initial start and / or standard class can be used (e.g. car), which may be held over time if there is no other class that is stable over time for the road user 120 can be determined. Especially for the first recognition of the class of a road user 120 In spatial angles that are less reliable with regard to classification (for example behind the vehicle), a standard classification can be used and / or harder or stricter transition conditions can be imposed for a transition to another class.

• • für das Fahrzeug 120 ausreichend zuverlässige Umfelddaten 252 zur Verfügung stehen;
• • sich das Fahrzeug 120 sich im Sichtbereich von ein oder mehreren Sensoren 106 für eine qualitativ hochwertige Breitenerfassung befindet;
• • die Breite des Fahrzeugs 120 über einem Schwellwert (für LKWs) oder (optional) unter einem Schwellwert (für Motorräder) liegt, und
• • die obigen Bedingungen für mehr als eine Mindestzeitdauer (z.B. zwischen 1 Sekunde und 3 Sekunden) vorliegen.

The transition of a road user can be controlled by a state machine 120 be controlled in another class. A transition for a vehicle 120 from a car to a truck or motorcycle can only be done if

• • for the vehicle 120 sufficiently reliable environmental data 252 be available;
• • the vehicle 120 in the field of vision of one or more sensors 106 for high quality width detection;
• • the width of the vehicle 120 is above a threshold value (for trucks) or (optionally) below a threshold value (for motorcycles), and
• • the above conditions exist for more than a minimum period of time (eg between 1 second and 3 seconds).

• • für den Verkehrsteilnehmer 120 ausreichend zuverlässige Umfelddaten 252 zur Verfügung stehen; und/oder
• • wenn die Klassifikation für mehr als eine Mindesthaltedauer (die sich ggf. von der o.g. Mindestzeitdauer unterscheiden kann) beibehalten wurde.

The transition back to a car can take place under the same transition conditions, but with a reverse width threshold test. As an alternative or in addition, the state machine can be designed in such a way that there is no further change in the classification of a road user 120 occurs when

• • for the road user 120 sufficiently reliable environmental data 252 be available; and or
• • if the classification has been retained for more than a minimum holding period (which may differ from the above-mentioned minimum period).

The symbols 220 in the advertising 200 are preferably shown in such a way that the symbols 220 do not overlap. So can the readability of the ad 200 and the comparability with the real traffic situation can be improved. An overlap of road users 120 in the advertising 200 can arise in particular in the longitudinal direction when graphic representations of road users 220 in the advertising 200 are larger (longer) than in the real traffic situation. If there is heavy traffic, the representatives will overlap 220 but not the real vehicles 120 .

An example of the use of symbols 220 with fixed dimensions (independent of the dimensions of the real vehicle) does not take this into account. Even if a division into classes (e.g. truck, car, motorcycle) is shown.

For a car and / or a motorcycle, a static length of the graphic representative or symbol 220 be chosen as these vehicles 120 typically have a relatively smaller length variance. Nevertheless, a dynamic adjustment of the length can optionally also be carried out for a car and / or a motorcycle 302 (on the basis of length data relating to the length of the respective road user 120 ). The length variance is typically relatively large for trucks. So can the length 302 of the symbol 220 for a truck, preferably adapted to the estimated length of the truck. In particular for trucks, a graphic representative or a symbol 220 can be used, which can increase or decrease in length. The control unit 111 (optional) be set up to only allow increases in length and no reductions in length. So can the ad 200 be further stabilized. Furthermore, overlaps on the display can be reliably achieved in this way 200 be avoided.

By animating the symbols 210 , 220 in the advertising 200 , through incorrectly interpreted sensor information, which leads to incorrect positioning of the symbols 210 , 220 cause or other effects, the symbol 220 of a road user 120 in the picture 200 with the ego symbol 210 collided. Such a purely graphic collision of symbols 210 , 220 can in particular also be present when the ego vehicle 110 and the road user 120 do not collide with each other in reality. Furthermore, the ego symbol shown very quickly leads to 210 approaching symbols 220 on his ego trail 201 to a perceived collision, even if this (shortly before the graphic collision) is on another lane 202 , 203 assigned or rejected by the environment model. This can, for example, in extreme cases when vehicles are parked 120 be the case on the ego vehicle 110 approaches in a narrow residential street and gives way shortly before. Both a graphic and a generally perceived collision in the displayed image 200 can from the driver of the ego vehicle 110 perceived as confusing.

As in 5 shown can be in the environment of the ego area 500 of the ego vehicle 110 and / or the ego symbol 210 one or more edge zones 501 , 502 , 503 , 504 , 505 be defined, e.g. the ego area 500 enclose. The control unit 111 may be set up to recognize that the icon 220 of a road user 120 in a peripheral zone 501 , 502 , 503 , 504 , 505 of the ego symbol 210 penetrates. In response, the symbol 220 of the road user 120 be at least partially hidden (e.g. made transparent to make the background visible) to avoid a visual or perceived collision with the ego symbol 210 to avoid. The degree to which the symbol is hidden 220 can depend on the penetration depth of the symbol 220 in the edge zone 501 , 502 , 503 , 504 , 505 depend. Fading out can therefore take place at different speeds and at different distances from the ego symbol 210 depending on the distance between the road user symbol 120 and / or depending on the relative speed between the other road user 120 and the ego vehicle 110 .

Until reaching an edge zone 501 , 502 , 503 , 504 , 505 becomes a road user symbol 220 preferably shown in full. The (at least partially) hiding of the road user symbol 220 preferably only takes place when the road user symbol appears 220 in a peripheral zone 501 , 502 , 503 , 504 , 505 .

The size (especially the length 511 and / or the width 512 ) of the individual edge zones 501 , 502 , 503 , 504 , 505 can depend on the relative speed between the ego vehicle 110 and the other road user 120 depend. Virtual collisions at different relative speeds can thus be avoided in a reliable manner.

Due to a possible discrepancy between the real size of a road user 120 and a graphic size of the corresponding symbol 220 and / or based on graphic animations to change the position of the symbol 220 , can be a possible collision of symbols 210 , 220 typically not based on the position data of the ego vehicle 110 and / or the road user 120 respectively. Rather, the hide logic described in this document acts primarily and / or exclusively directly on the graphic symbols 210 , 220 and on the graphic level. It can therefore (possibly alone) on the basis of the image data 260 for an image to be displayed 200 can be recognized that a symbols 220 in a peripheral zone 501 , 502 , 503 , 504 , 505 another symbol 210 penetrates.

Alternatively or in addition to defining edge zones 501 , 502 , 503 , 504 , 505 for the ego symbol 210 can symbol for each road user 220 Edge zones 501 , 502 , 503 , 504 , 505 around the area 500 of the respective road user symbol 220 To be defined. It can then be checked in each case whether the ego symbol 110 and / or another road user symbol 220 in the edge zone 501 , 502 , 503 , 504 , 505 of the respective road user symbol 220 penetrates.

• • eine erste Randzone 501, vor dem Symbol 210, 220. Da in Längsrichtung relativ hohe Relativgeschwindigkeiten und daraus folgend relativ starke virtuelle Längskollisionen möglich sind, kann vor die u.g. zweite Randzone 502 eine erste Randzone 501 vorgelagert werden, in der ein weiches und/oder progressives Ausblenden eines eindringenden Symbols 220 erfolgt. Je tiefer das Symbol 220 in die erste Randzone 501 eindringt, desto stärker wird das Symbol 220 ausgeblendet. Beispielsweise kann 73% Eindringtiefe zu 73% Transparenz des Symbols 220 führen. Die Länge 511 der ersten Randzone 501 kann zum Beispiel aus zwei Parametern mit Hilfe einer linearen Inter- bzw. Extrapolation bestimmt werden, wobei die zwei Parameter die Länge der ersten Randzone 501 bei Relativgeschwindigkeit 0 km/h respektive 100 km/h sind.
• • Sobald das Symbol 220 (nach Durchschreiten der ersten Randzone 501) die zweite Randzone 502 grafisch berührt, wird das Symbol 220 direkt ausgeblendet. Die Länge der zweiten Randzone 502 kann ggf. analog zu der ersten Randzone 501 über zwei Stützstellen parametrisiert werden.
• • Die seitliche dritte und vierte Randzone 503, 504 können analog zu der ersten Randzone 501 zu einem progressiven Ausblenden eines eindringenden Symbols 220 führen. Dabei kann die Breite 512 der jeweiligen Randzone 503, 504 über zwei Stützstellen parametrisiert werden. Die Breite 512 ist typischerweise relativ klein, um unterschiedliche Darstellungen der Querablage bzw. der lateralen Position des Ego-Fahrzeugs 110 und/oder eines anderen Verkehrsteilnehmers 120 innerhalb einer angezeigten Fahrspur 201, 202, 203 zu ermöglichen.

• • Die hinter einem Symbol 210, 220 liegende fünfte Randzone 505 kann zu einer festen Transparenz des eindringenden Symbols 220 führen (z.B. 50% Transparenz).

Exemplary edge zones are:

• • a first edge zone 501 , in front of the symbol 210 , 220 . Since relatively high relative speeds and, as a result, relatively strong virtual longitudinal collisions are possible in the longitudinal direction, the second edge zone below can be in front of the 502 a first edge zone 501 upstream, in which a soft and / or progressive fading of a penetrating symbol 220 he follows. The deeper the symbol 220 in the first edge zone 501 penetrates, the stronger the symbol becomes 220 hidden. For example, 73% penetration can result in 73% transparency of the symbol 220 to lead. The length 511 the first edge zone 501 can be determined, for example, from two parameters with the aid of a linear interpolation or extrapolation, the two parameters being the length of the first edge zone 501 at a relative speed of 0 km / h and 100 km / h, respectively.
• • Once the icon 220 (after crossing the first edge zone 501 ) the second edge zone 502 touched graphically, the symbol 220 hidden directly. The length of the second edge zone 502 can possibly be analogous to the first edge zone 501 can be parameterized via two support points.
• • The third and fourth lateral edge zone 503 , 504 can be analogous to the first edge zone 501 to a progressive fading of an invading symbol 220 to lead. The width can be 512 the respective edge zone 503 , 504 can be parameterized via two support points. The width 512 is typically relatively small in order to have different representations of the transverse storage or the lateral position of the ego vehicle 110 and / or another road user 120 within a displayed lane 201 , 202 , 203 to enable.

• • The one behind a symbol 210 , 220 lying fifth edge zone 505 can result in a fixed transparency of the penetrating symbol 220 lead (e.g. 50% transparency).

The size 511 , 512 of the individual edge zones 501 , 502 , 503 , 504 , 505 , the degree of transparency and / or the use of a hard or soft fade-out can depend on the current traffic situation (for example on the density of the traffic in the vicinity of the ego vehicle 110 ) be adjusted. In this way, the quality of the representation of a surrounding situation can be further improved.

The different peripheral zones 501 , 502 , 503 , 504 , 505 can possibly at least partially overlap. The transparency of a symbol 220 in the overlap area between two edge zones can then be determined by means of a maximum selection with regard to the transparency. In this way, the quality of the representation of a surrounding situation can be further improved.

In order to avoid possible oblique (virtual) collisions, the one or more front edge zones 501 , 502 be wider than the area 500 for the symbol 210 , 220 .

The symbol 220 of a vehicle 120 , which is the target for a driving function 256 of the ego vehicle 110 is marked can be excluded from the hide logic described in this document (if necessary only for one or more defined edge zones). The symbol 220 for a vehicle 120 , that for a driving function 256 relevant (e.g. a vehicle entering the vehicle, a vehicle leaving the vehicle, an overtaking vehicle), can be excluded from the masking logic. In this way, the quality of the representation of a surrounding situation can be further improved.

The sizes of the one or more edge zones 501 , 502 , 503 , 504 , 505 can dynamically adapt to the ego symbol displayed 210 for the ego vehicle 110 be adjusted. Ego vehicles of different sizes can thus be efficiently used 110 be taken into account.

Adjusting the size 511 , 512 an edge zone 501 , 502 , 503 , 504 , 505 to the relative speed can take place in such a way that the duration of the passage through an edge zone through a symbol 220 is independent of the relative speed.

As stated above, the output unit 258 of the ego vehicle 110 at a sequence of points in time a corresponding sequence of images 200 in relation to the traffic situation in the vicinity of the ego vehicle 110 be determined. Every picture 200 receives an assigned uniform time stamp that shows the time (relative to the on-board network time 253 the ego vehicle 110 ) the one in the picture 200 displayed information. The output unit 258 can be set up before outputting an image 200 the timestamp of the image 200 with the current electrical system time 253 to compare. When it is detected that the timestamp of the image 200 by more than a maximum permissible latency time before the current vehicle electrical system time 253 so the output of the image 200 on the screen 114 be prevented. In particular, it can then be arranged that no image 200 more on the screen 114 is output as long as the maximum permissible latency is not fallen below again. So can the output of outdated information on the screen 114 and associated confusion for the driver of the ego vehicle 110 can be avoided in a reliable and efficient manner.

The control unit 111 of the vehicle 110 can thus be set up (possibly using the display unit 258 ) time monitoring between the sensors 112 and the display area 114 perform the time delay between the input of a sensor signal 252 until it is displayed in the instrument cluster 114 of the ego vehicle 110 to eat. If the measured transit time exceeds a maximum permissible value, the environment display can 200 on the screen 114 deactivated.

For this purpose all sensor data 252 during the sensor fusion with the current electrical system time 253 be provided as a time stamp, the time stamp being passed on unchanged across all processing layers between the sensor fusion until it is displayed. The electrical system time 253 can by means of a time synchronization protocol (eg PTP (Precision Time Protocol), DMCS, and / or IEEE802.1AS) from a time master 251 among other things to the one or more participating control units 254 , 258 for the sensor processing and for the display area.

Before issuing an ad 200 becomes the signal timestamp of the display 220 with the current on-board network time 253 compared and when the permitted latency is exceeded (eg 1 second) the active environment display is displayed 200 on the screen 114 deactivated. The latency monitoring can be designed to note the last time stamp received and the time stamp cyclically against the vehicle electrical system time 253 to compare. This can lead to a complete failure of the sensor signals 252 can be reliably recognized, and the output of images in response 200 deactivated.

To flicker the display of the picture 200 on the screen 114 to avoid (with recurring activation and deactivation of the output) the reactivation of the output after deactivation may require a minimum stability time (e.g. of 2 seconds) in which the image signal can be output 260 is reliably provided again without any latency violation. Images can only be output again after the minimum stability time has elapsed 200 respectively.

The failure of a sensor 112 Without a subsequent degradation of the sensor fusion, the display of the surroundings typically does not turn off 200 , since the fusion occupies the time stamp normally in the event of partial degradation. On the other hand, if a sensor failure leads to a degradation of the sensor fusion, the time stamp in the output signals can be used 255 can be set to invalid, which leads to the environment display being switched off 200 leads. If the entire sensor fusion fails, the environment display is typically switched off 200 causes no new time stamps to be received during latency monitoring. Performs an increased bus load of a bus of the ego vehicle 110 To increase the system latency, so that signals arrive late at the latency monitoring, this can lead to the environment display being switched off depending on the bus load 200 to lead.

6a to 6e show flowcharts of exemplary methods for displaying information relating to a traffic situation in the vicinity of an ego vehicle 110 . The in each procedure 600 , 610 , 620 , 630 , 640 Aspects and / or features described can be combined with one another in any way.

6a shows a flow diagram of an exemplary method 600 for displaying a traffic situation on a screen 114 of an ego vehicle 110 . The procedure 600 can through a control unit 111 of the ego vehicle 110 are executed. The ego vehicle 110 drives on a roadway 100 with one or more lanes 101 , 102 , 103 . The lanes 101 , 102 , 103 the roadway 100 are used to distinguish between lanes 201 , 202 , 203 that are on the screen 114 are displayed, referred to as "actual lanes".

The procedure 600 includes representing 601 of a road user symbol 210 , 220 for a road user 110 , 120 the traffic situation in an actual lane 101 , 102 , 103 moves, at a constant first lateral position within one on the screen 114 displayed lane 201 , 202 , 203 . In other words, the road user symbol 210 , 220 can be displayed at a sequence of times in a fixed first lateral position, even if the road user 110 , 120 possibly within the actual lane 101 , 102 , 103 changed the lateral position. So can one for the driver of the ego vehicle 110 Clear and quickly comprehensible representation of the traffic situation can be output.

The procedure 600 may further include detecting 602 of a lane event in relation to that of the road user 110 , 120 the actual lane 201 , 202 , 203 will leave, could leave or should leave. The lane event can, for example, be based on sensor data from one or more sensors of the ego vehicle 110 can be detected.

In addition, the procedure 600 in response to the detecting 602 of a lane event, the display 603 of the road user symbol 210 , 220 at a second lateral position deviating from the first lateral position within the displayed lane 201 , 202 , 203 . The second lateral position can be at an edge of the displayed lane 201 , 202 , 203 lie.

Through the procedure 600 can eg be caused to be a road user symbol 210 , 220 (especially the ego symbol 210 for the ego vehicle 110 ), most of the time is displayed statically at the first lateral position in order to enable a clear and quickly comprehensible display of the traffic situation. Only in response to a lane event can a change to a second lateral position be effected, if necessary, in order to provide a representation of the traffic situation that is consistent with the driver's expectations. So can the comfort and safety of driving an ego vehicle 110 increase.

6b shows a further flow chart of a further method 610 for displaying a traffic situation on a screen 114 of an ego vehicle 110 . The procedure 610 can through a control unit 111 of the ego vehicle 110 are executed.

The procedure 610 includes choosing 611 of a maximum of N (e.g. with N = 1, or N≤2) road users 120 in each of one or more different environmental sectors 401 , 402 , 403 , 404 , 405 the environment of the ego vehicle 110 . The environment of the ego vehicle 110 can thus be divided into a limited number of surrounding sectors (eg five sectors or less). Furthermore, a limited number N of road users can (based on the environment data) in each sector 120 be identified. The N road users 120 can choose from a set of M road users 120 be selected that are in the respective environmental sector 401 , 402 , 403 , 404 , 405 (where M can be different for the different sectors). M can be larger, equal to or smaller than N. If M> N, then a subset of the road users 120 are selected that are located in the respective sector, if M = N, then all road users can 120 are selected that are located in the respective sector, and / or if M <N (for example M = 0), then only M road users can possibly 120 to be chosen.

The procedure also includes 610 representing 612 , for each of the one or more environmental sectors 401 , 402 , 403 , 404 , 405 , of up to N road user symbols each 220 for the maximum of N selected road users 120 on the screen 114 . In particular, the number of simultaneously displayed road user symbols 220 per surrounding sector can be limited to N (if necessary apart from situations in which a road user enters the sector 401 , 402 , 403 , 404 , 405 changes). In this way, a stable and quickly comprehensible representation of a traffic situation can be provided in order to increase the comfort and safety for driving an ego vehicle 110 to increase.

6c shows a flow chart of a further exemplary method 620 for displaying a traffic situation on a screen 114 of an ego vehicle 110 . The procedure 620 can through a control unit 111 of the ego vehicle 110 are executed.

The procedure 620 includes representing 621 of a first road user symbol 210 , 220 (e.g. the ego symbol 210 ) for a first Road users 110 , 120 (e.g. the ego vehicle 110 ) in a first sub-area 500 Of the screen 114 and the display of a second road user symbol 210 , 220 for a second road user 110 , 120 in a second part of the screen 114 . The positioning of the second sub-area relative to the first sub-area can depend on the positioning of the second road user 110 , 120 relative to the first road user 110 , 120 (in the actual traffic situation). The actual traffic situation and the arrangement of the first and second road user 110 , 120 can thus by a corresponding arrangement of the first and second road user symbols 210 , 220 on the screen 114 be reproduced.

The procedure 620 further comprises determining 622 that due to a change in the positioning of the second road user 110 , 120 relative to the first road user 110 , 120 , the second road user symbol 210 , 220 in a peripheral zone 501 , 502 , 503 , 504 , 505 for the first part 500 of the first road user symbol 210 , 220 penetrates. The edge zone 501 , 502 , 503 , 504 , 505 can be applied to the first section 500 adjoin. For example, it can be detected on the basis of the environment data that the second road user is 110 , 120 and the first road user 110 , 120 to move towards each other. This can be done by moving the symbols accordingly 210 , 220 on the screen 114 being represented. Based on the image data 260 for the image to be output 200 With regard to the traffic situation, it can be recognized (for example by evaluating the position of the individual pixels) that the second road user symbol 210 , 220 in a peripheral zone 501 , 502 , 503 , 504 , 505 of the first road user symbol 210 , 220 penetrates.

The method also includes 620 , in response to the second road user symbol 210 , 220 in the edge zone 501 , 502 , 503 , 504 , 505 penetrates, causing 623 that the second road user icon 210 , 220 is at least partially hidden. In particular (possibly only) the part of the second road user symbol can thereby 210 , 220 are at least partially hidden, which enters the edge zone.

By at least partially hiding a symbol 210 , 220 on the screen 114 in the event of an imminent danger of a graphic or at least perceived collision between symbols 210 , 220 can reliably cause uncertainty in the driver of the ego vehicle 110 be avoided. So can the comfort and safety of driving an ego vehicle 110 increase.

6d shows a flow chart of a further method 630 for displaying a traffic situation on a screen 114 of an ego vehicle 110 . The procedure 630 can through a control unit 111 of the ego vehicle 110 are executed.

The procedure 630 includes representing 631 of a road user symbol 220 for a road user involved in the traffic situation 120 on the screen 114 , with the road user symbol 220 a class of road user 120 indicates. The class of the road user 120 may have been determined in advance (possibly as a standard class). It can be used for different classes of road users 120 different symbols 220 be used. For example, a car can be represented by the symbol of a car, a motorcycle by the symbol of a motorcycle and / or a truck by the symbol of a truck on the screen 114 be represented.

Furthermore, the procedure 630 the continuous determination 632 over a minimum period of time that include the road user 120 has a different class. In other words, it can be recognized or determined (in particular on the basis of the environment data) for a minimum period that the road user 120 actually belongs to a different class. The class of the road user can optionally be repeated, in particular periodically 120 to be determined. It can also be recognized that the road user 120 has been repeatedly and permanently assigned to the same or fixed other class.

The procedure also includes 630 , in response to that the road user 120 has been permanently assigned to the same other class for a minimum period of time 633 for the road user 120 displayed road user symbol 220 to the other class. By changing the symbol after a delay (by the minimum duration) 220 A stable representation of a traffic situation can be provided for a new class. In particular, there can be jumps between the symbols 220 be avoided for different classes. So can the comfort and safety of driving an ego vehicle 110 increase.

6e shows a flow chart of a method 640 to display an image 200 in relation to a traffic situation on a screen 114 of an ego vehicle 110 . The procedure 640 can through a control unit 111 of the ego vehicle 110 are executed.

The procedure 640 includes determining 641 , based on the environment data from one or more environment sensors 112 of the ego vehicle 110 , of an image 200 in relation to a traffic situation in an environment of the ego vehicle 110 . The picture 200 can, as described in this document, symbols 210 , 220 for one or more road users 110 , 120 the traffic situation. The picture 200 can be determined such that the image 200 a uniform time stamp relative to the vehicle electrical system time 253 of the ego vehicle 110 having.

The procedure also includes 640 checking 642 , in particular at a reference time (which is relative to the vehicle electrical system time 253 is), whether the time stamp is more than a maximum permissible latency time before the reference time and / or whether the time stamp is invalid. The procedure 640 further comprises prohibiting 643 an output of the image 200 on the screen 114 (and possibly blacking out or switching the screen 114 to another display) if it has been determined that the timestamp is more than the maximum allowable latency before the reference time and / or that the timestamp is invalid. In this way, output of outdated information about the surroundings can be avoided in a reliable manner. So can the comfort and safety of driving an ego vehicle 110 increase.

The present invention is not restricted to the exemplary embodiments shown. In particular, it should be noted that the description and the figures are only intended to illustrate the principle of the proposed methods, devices and systems.

Claims (10)

Control unit (111) for displaying an image (200) relating to a traffic situation on a screen (114) of an ego vehicle (110); wherein the control unit (111) is set up, - on the basis of environment data from one or more environment sensors (112) of the ego vehicle (110) to determine an image (200) relating to a traffic situation in an environment of the ego vehicle (110); wherein the image (200) has a time stamp relative to an on-board network time (253) of the ego vehicle (110); - to check whether the time stamp is more than a maximum permissible latency time before a reference time and / or whether the time stamp is invalid; and - to prevent output of the image (200) on the screen (114), in particular to display a different image on the screen (114), if it has been determined that the time stamp is more than the maximum permissible latency before the reference time and / or that the timestamp is invalid. Control unit (111) according to Claim 1 wherein the control unit (111) is set up to determine the image (200) on the basis of information (252, 257) from a plurality of information sources (112, 256); wherein the information from an information source has a time stamp; and - to determine the time stamp of the image (200) such that the time stamp of the image (200) corresponds to the earliest time stamp and / or an invalid time stamp of the information (252, 257) used to determine the image (200). Control unit (111) according to Claim 2 wherein the plurality of information sources (112, 256) comprises, - the one or more environment sensors (112) of the ego vehicle (110); - A fusion unit (254) for determining an environment model of the environment of the ego vehicle (110) on the basis of the environment data of the one or more environment sensors (112); and / or - one or more driving functions (256) for at least partially automated longitudinal and / or lateral guidance of the ego vehicle (110). Control unit (111) according to one of the preceding claims, wherein the control unit (111) is set up to output the image (200) on the screen (114) only if it has been determined that the time stamp is at most the maximum permissible latency before the reference time and that the timestamp is valid. Control unit (111) according to one of the preceding claims, wherein the control unit (111) is set up to ensure that no image (200), including no previous image (200), in relation to the traffic situation in the vicinity of the ego vehicle (110 ) is displayed on the screen (114) if it has been determined that the time stamp is more than the maximum permissible latency time before the reference time and / or that the time stamp is invalid. Control unit (111) according to one of the preceding claims, wherein the control unit (111) is set up, after preventing the output of the image (200) at the reference point in time, only after a minimum interruption time has elapsed an image (200) relating to the traffic situation in the vicinity of the Output ego vehicle (110) on the screen (114). Control unit (111) according to one of the preceding claims, wherein the control unit (111) is set up - an image (200) relating to the traffic situation in the environment of the ego vehicle (110) based on a fusion of the environment data of the one or more environment sensors To determine (112); being the merger of Environment data has an invalid time stamp if the environment data of the one or more environment sensors (112) are at least partially invalid; and - to assign an invalid time stamp to the image (200) if the fusion of the surrounding data has an invalid time stamp. Control unit (111) according to one of the preceding claims, wherein the control unit (111) is set up - to include a respective road user symbol (220) in the image (200) for one or more road users (120) involved in the traffic situation; and - to include an ego symbol (210) in the image (200) for the ego vehicle (110). Control unit (111) according to one of the preceding claims, wherein the control unit (111) is set up at a sequence of reference times, - to determine a current image (200) in relation to the traffic situation in the vicinity of the ego vehicle (110); and - to output the current image (200) on the screen (114) when it is determined that the time stamp of the current image (200) is at most the maximum permissible latency before the respective reference time and that the time stamp is valid. Method (640) for displaying an image (200) relating to a traffic situation on a screen (114) of an ego vehicle (110); wherein the method (640) comprises, - Determination (641), based on environment data from one or more environment sensors (112) of the ego vehicle (110), of an image (200) in relation to a traffic situation in an environment of the ego vehicle (110); wherein the image (200) has a time stamp relative to an on-board network time (253) of the ego vehicle (110); - Checking (642) whether the time stamp is more than a maximum permissible latency time before a reference time and / or whether the time stamp is invalid; and - Prohibiting (643) an output of the image (200) on the screen (114) if it has been determined that the time stamp is more than the maximum permissible latency time before the reference time and / or that the time stamp is invalid.

Images