DE102022123805A1 - Method, device and computer program for assisting a driver of a vehicle - Google Patents

Abstract

A method (300) for supporting a driver of a motor vehicle is described. The method (300) includes the acquisition (301) of traffic sign information related to a traffic sign (201), as well as the processing (302) of the traffic sign information, wherein in the context of the processing (302) in particular data representing a part of an environment (202) of the vehicle (100) are generated in connection with the traffic sign (201). The method (300) also includes generating (303) driver information depending on the processed traffic sign information, in particular depending on and/or in conjunction with position information about a part of the environment (202) of the vehicle (100) and/or a map and/or or a representation of part of the environment (202) of the vehicle (100).

Description

The invention relates to a method, a device and a corresponding computer program which are designed to support the driver of a vehicle in driving the vehicle.

As part of driving the vehicle, the driver of a vehicle must gather comprehensive information regarding the vehicle's surroundings. Some of this information may not result in an immediate response from the driver. The driver typically has to remember this information for some time in order to behave in accordance with this information if necessary or to take the information into account when driving the vehicle. In particular, it can happen that the driver overlooks a (e.g. supposedly unimportant) part of the surrounding information or is no longer sure about its content, even if the meaning of the part of the surrounding information only becomes clear afterwards.

This document deals with the technical task of supporting the driver of a vehicle in an efficient and reliable manner in driving the vehicle, in particular in taking into account information relating to the vehicle's surroundings. In particular, the technical task is to increase the sovereignty, safety and comfort of driving the vehicle.

The task is solved by each of the independent claims. Advantageous embodiments are described, among other things, in the dependent claims. It should be noted that additional features of a patent claim dependent on an independent patent claim can form a separate invention independent of the combination of all the features of the independent patent claim, without the features of the independent patent claim or only in combination with a subset of the features of the independent patent claim can be made the subject of an independent claim, a division application or a subsequent application. This applies equally to technical teachings described in the description, which may constitute an invention independent of the features of the independent patent claims.

• • einen Bildausschnitt umfassend zumindest einen Teil des Verkehrszeichnens; und/oder
• • einen Inhalt und/oder Bedeutung des Verkehrszeichens; und/oder
• • einem Teil der Umgebung des Fahrzeugs, auf die sich das Verkehrszeichen bezieht.

According to one aspect, a method for supporting a driver of a vehicle (in particular a motor vehicle) is described. The method includes acquiring traffic sign information related to a traffic sign. The traffic sign information may relate to one or more of the following

• • an image section comprising at least part of the traffic sign; and or
• • a content and/or meaning of the traffic sign; and or
• • a part of the vehicle's surroundings to which the traffic sign refers.

The traffic sign information is preferably information that deviates from the content of the traffic sign (as such) and/or goes beyond this content. For example, the traffic sign information can concern things (e.g. objects or parts of space or road users) that have a certain meaning for the vehicle due to the traffic sign. For example, another road user must be given the right of way or another regulation or right, or the vehicle itself has the right of way or another regulation or right over another road user, etc.

The traffic sign can (also selectively) be any traffic sign or one assigned to any category in accordance with a standard or agreement (e.g. Vienna Convention, European Standard). The traffic sign can, for example, belong to or be a category of warning signs, prohibition signs, regulatory signs, mandatory signs, directional signs, signposts, border crossing signs, etc. In particular, the traffic sign is a traffic sign whose meaning depends on one or more further (each optional or variable) conditions, e.g. on another road user.

The traffic sign can be indicative of at least one right or regulation or an application of a law or regulation between at least two road users, e.g. for a right-of-way regulation, allowing merging, etc. (in its surroundings).

The traffic sign can optionally include a traffic light and/or at least a time-variable display. The traffic sign information can be determined based on sensor data, e.g. camera data from one or more cameras. In particular, the traffic sign information can be determined using a user device carried in the vehicle.

The method further includes processing the traffic sign information. Can do this As part of the processing, in particular data representing part of the vehicle's surroundings are processed and/or generated in connection with the traffic sign.

Processing the traffic sign information may include interpreting the meaning of the traffic sign. The processing, in particular interpretation, of the traffic sign information can take place in particular when the traffic sign has already been passed by the vehicle and/or when the traffic sign is no longer or no longer clearly visible to the driver of the vehicle.

The processing can take place depending on data that is determined or predicted (or can be determined or predicted) only after the traffic sign has already been passed by the vehicle and / or when the traffic sign is no longer or no longer correct for the driver of the vehicle is visible.

The traffic sign information is particularly preferably processed depending on an event (e.g. movement of the vehicle and/or movement of other road users, their arrangement relative to one another, a change in the driving situation or corresponding data) after the traffic sign has been passed by the vehicle and/or when that Traffic signs are no longer or no longer clearly visible to the driver of the vehicle.

Interpreting the meaning of the traffic sign can relate to the meaning that the traffic sign has in the respective (specific) case and/or (only) after the vehicle has passed the traffic sign and/or after the traffic sign has been given to the driver of the vehicle is no longer or no longer perfectly visible.

• • einer erwarteten, insbesondere prädizierten, und/oder eingetretenen, insbesondere erkannten, Fahrsituation;
• • ein oder mehreren baulichen Merkmalen einer von dem Fahrzeug befahrenen Fahrbahn und/oder Fahrbahnanordnung; und/oder
• • einer Information darüber, ob der Fahrer des Fahrzeugs das Verkehrszeichen sehen konnte oder gesehen hat.

Interpreting the meaning of the traffic sign can be done in connection with,

• • an expected, in particular predicted, and/or occurred, in particular recognized, driving situation;
• • one or more structural features of a roadway and/or roadway arrangement traveled by the vehicle; and or
• • Information about whether the driver of the vehicle could or did see the traffic sign.

Interpreting the meaning of the traffic sign in connection with the above-mentioned list entries is in particular to be understood as interpretation in relation to these list entries and/or in the context of these list entries, for example in relation to the (specific, possibly only detectable later) driving situation and/or in relation to structural features of the roadways or roadway arrangements or in the context of the driving situation and/or the features of the roadways or roadway arrangements.

For example, the specific meaning of the traffic sign can be interpreted in relation to a specific and/or changed driving situation, and/or in relation to parts of the driving situation that were previously hidden or could not be assessed or predicted.

For example, the processing and/or interpretation of the traffic sign information takes place depending on a driving situation that took place (at least partially) after the vehicle passed the traffic sign and/or after the traffic sign is no longer or no longer perfectly visible to the driver of the vehicle or was predicted.

For example, the meaning of the traffic sign can be interpreted in the face of or in the context of the driving situation that (still) occurred after passing the traffic sign or that became detectable and/or predictable after passing the traffic sign (possibly retrospectively). . A (further) special advantage can arise if the driver is no longer sure of the content and/or the (special) meaning of the traffic sign (e.g. in relation to the driving situation that subsequently occurred).

Therefore, the term “driving situation” in the context of this document can mean a driving situation or a part or a continuation of a driving situation that only occurs after the traffic sign has been passed or is perceptible (e.g. by the driver) or (with technical reasons). means) will be detectable and/or predictable (e.g. for the driver and/or with technical means).

Furthermore, the method includes generating and/or outputting driver information depending on the processed, in particular interpreted, traffic sign information, in particular depending on and/or in conjunction with position information about a part of the vehicle's surroundings and/or a map and/or a Representation of part of the vehicle's surroundings.

The driver information can indicate the meaning of the traffic sign, in particular the traffic sign that has already been passed by the vehicle, in relation to an expected one represent a driving situation that has occurred, in particular predicted, and/or that has occurred, in particular recognized.

The driver information can highlight certain or individual parts of driver information, in particular the graphical representation (which is described in the present document), and / or direct the driver's attention to the driver information, in particular by means of a visible and / or audible output ( e.g. sound output), include or be. For example, at least part of the driver information is highlighted (e.g. with a subsequently interpreted meaning) or the driver's attention is drawn to at least part of the driver information (e.g. using graphic and/or auditory means).

Preferably, the driver information can be generated and/or output primarily or only if the (interpreted) meaning of part of the traffic sign information exceeds a threshold value after passing the traffic sign and/or after it is no longer sufficiently visible to the driver of the vehicle /or has a certain value. For example, if the driving situation, in particular a part or a continuation of the driving situation that occurs (only) after passing the traffic sign, becomes detectable and/or predictable, for the journey of the vehicle, for the vehicle and/or for others Road users are essentially uncritical, driver information, in particular particularly striking, warning, particularly highlighted driver information, is dispensed with. This can effectively prevent the driver from being overloaded with information and/or stimuli, as this would statistically affect most cases.

Driver information generated and/or output in this way can provide particularly helpful driver support, in particular in order to increase traffic safety.

The method may include evaluating an action by the driver of the vehicle that was carried out or was executable after the vehicle passed the traffic sign, in particular taking into account the traffic sign and / or the result of interpreting the meaning of the traffic sign in relation to a current and /or predicted driving situation.

The driver information can be generated based on evaluating the traffic sign information, taking into account the result of processing or interpreting the meaning of the traffic sign in relation to a current and/or predicted driving situation. In this way, the quality of driver support can be further increased.

• • Ausgabe einer Information mit Mitteln des Fahrzeugs; und/oder
• • Aktivierung oder Vorbereitung der Komponente auf eine mögliche Gefahr.

The method can include generating a control signal that is dependent on interpreting the meaning of the traffic sign and/or on the current and/or predicted driving situation. The control signal can be sent to a component of the vehicle, in particular to:

• • Issuing information using the vehicle's means; and or
• • Activating or preparing the component for a possible hazard.

Preferably, the control signal can be generated by the user device carried in the vehicle and sent to the vehicle (e.g. transmitted wirelessly). In this way, the quality of driver support can be further increased.

• • einen bestimmten Fahrer;
• • ein bestimmtes Verkehrszeichen; und/oder
• • eine bestimmte Fahrsituation.

The method may include processing an aggregation of data (a plurality of previous traffic sign cases), in particular regarding:

• • a specific driver;
• • a specific traffic sign; and or
• • a specific driving situation.

In particular, a large number of data from a large number (e.g. more than 4, 8, 16, 32, 64) of the past cases can be aggregated with the data relating to the current (specific) case. The data from the large number of previous traffic sign cases may have been recorded and/or determined in the context of previous trips by one or more vehicles (e.g. from trips by the specific driver, from trips that passed the specific traffic sign, and/or from trips in which the specific driving situation existed).

• • zur Ausgabe einer Rückmeldung an einen bestimmten Fahrer oder an einen Fahrer mit einem, dem bestimmten Fahrer entsprechenden Fahrerprofil; und/oder
• • zur, insbesondere vorausschauenden, Ansteuerung einer Funktionalität des Fahrzeugs; und/oder
• • zur Ermittlung der Fahrerinformation.

The method may further include taking into account the result of the aggregation, in particular:

• • to issue feedback to a specific driver or to a driver with a driver profile corresponding to the specific driver; and or
• • for, in particular, predictive control of a functionality of the vehicle; and or
• • to determine driver information.

In this way, the quality of driver support can be further increased.

• • keine, eine verspätete oder eine nicht angemessene Reaktion des jeweiligen Fahrers erfolgt ist; und/oder
• • nach einem Passieren des Verkehrszeichens eine unvorteilhafte und/oder kritische Fahrsituation folgte; und/oder
• • eine, einen bestimmten Schwellwert übersteigende, Bedienaktionen des jeweiligen Fahrers, insbesondere ein Lenkeinschlag, eine Bremsung, eine Beschleunigung und/oder ein Ausweichmanöver, erfolgte.

When processing the aggregation of data, it can be checked whether in relation to the traffic sign and/or on a specific road section in connection with the traffic sign, in particular with a frequency that exceeds a certain threshold value

• • there was no reaction, a delayed reaction or an inappropriate reaction from the respective driver; and or
• • an unfavorable and/or critical driving situation followed after passing the traffic sign; and or
• • An operating action by the respective driver that exceeded a certain threshold value, in particular a steering angle, braking, acceleration and/or an evasive maneuver, took place.

The result can be taken into account as part of the procedure (particularly when determining driver information). In this way, the quality of driver support can be further increased.

• • Verändern einer oder mehrerer Auslöseschwellen, insbesondere Warnschwellen, der Funktionalität;
• • Verändern eines Zeitpunkts und/oder einer Position, an der die Fahrerinformation ausgegeben wird; und/oder
• • Erzeugen einer Vorabinformation vor der Ausgabe der Fahrerinformation; und/oder
• • Verändern einer Konfiguration der Funktionalität des Fahrzeugs.

The method can include controlling and/or adapting a functionality (e.g. a driver assistance function) of the vehicle depending on at least part of the traffic sign information, in particular:

• • Changing one or more trigger thresholds, in particular warning thresholds, of the functionality;
• • Changing a time and/or a position at which the driver information is output; and or
• • Generating advance information before issuing the driver information; and or
• • Changing a configuration of the functionality of the vehicle.

The control and/or adjustment can take place in particular depending on the aggregation of data from the large number of traffic sign cases, in particular a large number of corresponding traffic sign cases.

The control and/or adjustment of a functionality (e.g. a safety driver assistance function) can be done using the control signal already described. For example, a qualitative and/or quantitative measure of the control or adaptation of the at least one functionality of the vehicle can be selected depending on the information determined in the method (e.g. a pattern of the driving situation and/or road arrangement). In this way, the quality of driver support can be further increased.

• • Erfassen des Verkehrszeichens und/oder eines Teils der Umgebung des Fahrzeugs, insbesondere mit einer Hauptkamera des Anwendergeräts;
• • Übermitteln von Daten an ein Backend, insbesondere zur Aggregation der Daten;
• • Empfangen von Anpassungs- und/oder Steuerdaten aus dem Backend zum Ansteuern einer Funktionalität des Fahrzeugs;
• • Erkennen eines Blicks des Fahrers des Fahrzeugs, insbesondere mit einer Selfie-Kamera des Anwendergeräts;
• • Verarbeiten der Verkehrszeicheninformation;
• • Generieren der Fahrerinformation; und/oder
• • Generieren und Senden eines Steuerungssignals an eine Komponente des Fahrzeugs und/oder an eine weitere im Fahrzeug betreibbare Vorrichtung.

At least part of the method can be carried out using a user device (e.g. a smartphone) that can be carried in the vehicle, in particular operable on a windshield or rear window of the vehicle. In particular, one or more of the steps listed below can be carried out by the user device:

• • Capturing the traffic sign and/or part of the vehicle's surroundings, in particular with a main camera of the user device;
• • Transmitting data to a backend, particularly for data aggregation;
• • Receiving adaptation and/or control data from the backend to control functionality of the vehicle;
• • Detecting a look from the driver of the vehicle, in particular with a selfie camera of the user device;
• • Processing traffic sign information;
• • Generate driver information; and or
• • Generate and send a control signal to a component of the vehicle and/or to another device operable in the vehicle.

By using a user device to carry out (part of) the method, driver support can be provided in a particularly efficient and flexible manner.

• • Erfassen einer in Zusammenhang mit einem Verkehrszeichen stehenden Verkehrszeicheninformation;
• • Verarbeiten der Verkehrszeicheninformation, wobei im Rahmen des Verarbeitens insbesondere Daten repräsentierend einen Teil einer Umgebung des Fahrzeugs in Zusammenhang mit dem Verkehrszeichen erzeugt werden; und
• • Generieren einer Fahrerinformation abhängig von der verarbeiteten Verkehrszeicheninformation, insbesondere abhängig und/oder in Verbindung mit einer Positionsinformation zu einem Teil der Umgebung des Fahrzeugs und/oder einer Karte und/oder einer Darstellung eines Teils der Umgebung des Fahrzeugs.

According to a further aspect, a user device (eg a smartphone) for operation in a vehicle is described. The user device can be set up (e.g. using a corresponding computer program product, such as an app) to carry out one or more (e.g. all or essentially all) parts of the method. The user device is in particular set up to

• • Detecting traffic sign information related to a traffic sign;
• • Processing the traffic sign information, whereby in the course of the processing, in particular data representing a part of an environment of the vehicle in connection with the traffic sign is generated; and
• • Generate driver information depending on the processed traffic sign information tion, in particular dependent and/or in connection with position information about part of the vehicle's surroundings and/or a map and/or a representation of part of the vehicle's surroundings.

The user device is in particular a mobile and/or portable user device (e.g. that is independent of the vehicle or can be operated autonomously). This is particularly advantageous because it means that the function described can (also) be used in vehicles that have already been delivered, possibly older ones. This means that the function described in this document can achieve a high level of penetration (which would not be possible with new vehicles alone, for example). This can significantly increase general traffic safety (from which uninvolved parties may also benefit, at least indirectly).

• • Erfassen einer in Zusammenhang mit einem Verkehrszeichen stehenden Verkehrszeicheninformation;
• • Verarbeiten der Verkehrszeicheninformation, wobei im Rahmen des Verarbeitens insbesondere Daten repräsentierend einen Teil einer Umgebung des Fahrzeugs in Zusammenhang mit dem Verkehrszeichen erzeugt werden; und
• • Generieren einer Fahrerinformation abhängig von der verarbeiteten Verkehrszeicheninformation, insbesondere abhängig und/oder in Verbindung mit einer Positionsinformation zu einem Teil der Umgebung des Fahrzeugs und/oder einer Karte und/oder einer Darstellung eines Teils der Umgebung des Fahrzeugs.

According to a further aspect, a device for supporting a driver of a motor vehicle, the device being set up to

• • Detecting traffic sign information related to a traffic sign;
• • Processing the traffic sign information, whereby in the course of the processing, in particular data representing a part of an environment of the vehicle in connection with the traffic sign is generated; and
• • Generating driver information depending on the processed traffic sign information, in particular depending on and/or in conjunction with position information about part of the vehicle's surroundings and/or a map and/or a representation of part of the vehicle's surroundings.

According to a further aspect, a (road) motor vehicle (in particular a passenger car or a truck or a bus or a two-wheeler, in particular a motorcycle) is described which comprises the device described in this document. The device can be set up to carry out one or more parts or steps of the method.

According to a further aspect, a computer program, in particular a computer program product comprising a computer program, is described, wherein the computer program is designed to carry out at least one of the methods described in this document when it is executed on at least one computing unit. There can be several computer programs or a computer program product comprising several computer programs, which can be run, for example, on different computing units of the device or on several devices in order to carry out (if necessary together, in an information technology connection) at least one of the methods described in this document.

The computer program product can be designed as an update of a previous computer program, which includes the parts of the computer program or the corresponding program code, for example as part of a functional expansion, for example as part of a so-called “remote software update”. The computer program product includes in particular a medium readable by the data processing device, on which the program code is stored, or at least an encrypted file.

It should be noted that the methods, devices and systems described in this document can be used both alone and in combination with other methods, devices and systems described in this document. Furthermore, any aspects of the methods, devices and systems described in this document can be combined with one another in a variety of ways. In particular, the features of the claims can be combined with one another in a variety of ways. Furthermore, features listed in brackets are to be understood as optional features.

• 1a beispielhafte Komponenten eines Fahrzeugs;
• 1b ein beispielhaftes Anwendergerät;
• 2 eine beispielhafte Fahrsituation; und
• 3 ein Ablaufdiagramm eines beispielhaften Verfahrens zur Unterstützung eines Fahrers beim Erfassen des Umfelds des Fahrzeugs.

The invention is further described in more detail using exemplary embodiments. Show it

• 1a exemplary components of a vehicle;
• 1b an exemplary user device;
• 2 an exemplary driving situation; and
• 3 a flowchart of an exemplary method for supporting a driver in detecting the surroundings of the vehicle.

As stated at the beginning, this document deals with the efficient and reliable support of the driver of a vehicle in taking into account information relating to the vehicle's surroundings. In particular, the technical task is to increase the sovereignty, safety and comfort of the user of the vehicle (and, if necessary, other road users in the area).

In this context shows 1a an exemplary vehicle 100 with one or more environment sensors 102 (in particular with one or more cameras) that are set up to receive sensor data (e.g. camera data) in relation to the environment of the vehicle 100 to capture. The sensor data from the one or more environment sensors 102 can be evaluated by a (control) device 101, in particular in order to generate driver information for a driver of the vehicle 100. The driver information can be output via a user interface 104 of the vehicle 100.

The vehicle 100 may further comprise one or more (longitudinal and/or transverse guidance) actuators (e.g. a drive motor, a braking device and/or a steering device) which are set up to intervene in the longitudinal and/or transverse guidance of the vehicle 100 cause. The (control) device 101 can be set up to operate the one or more actuators depending on the sensor data of the one or more environmental sensors 102, for example in order to at least partially automatically guide the vehicle 100 longitudinally and/or transversely and/or to provide functionality of the vehicle 100 to provide.

1b shows an exemplary user device 110 with one or more environmental sensors 102 (eg with one or more cameras), a (control and/or evaluation) device 101 and a user interface 104 (eg with a screen). The measures described in this document can be carried out by the device 101 of a user device 110 (arranged in a vehicle 100) and/or by the device 101 of the vehicle 100.

The features described in this document in relation to the user device 110 can (also) be understood in relation to the (vehicle) device 101 or the part of the device 101 that is integrated in the vehicle 100, or vice versa. Preferably, the majority of the method is carried out using the appropriately configured user device 110.

2 shows a driving situation in which the vehicle 100 enters an environment 202 (eg an intersection area) and drives within the environment 202. In 2 Different successive times t0, 11, t2 are also shown during the driving situation. For example, the time interval between t1 and t0 is approximately 3, 5, 7, 11, 21 seconds or more. For example, the time interval between t2 and t0 is approximately 5, 7, 11, 21, 27 seconds or more.

For example, the vehicle 100 (e.g. the ego vehicle 100) is at time t0, at which the traffic sign 201 can (still) be detected by the driver of the vehicle 100 or by technical means of the vehicle 100, as well as at the times t1 and t2, at which the traffic sign 201 can no longer be detected (immediately or sufficiently). Furthermore, another road user 200 (who cannot be detected from the perspective of the vehicle 100 at time t0) is also symbolically represented at times t0 and t1 to t2.

At the entrance to the environment 202 (seen from the direction of travel of the vehicle 100), a traffic sign 201 (in particular a give way sign) is arranged, which the vehicle 100 must take into account. Failure to observe the traffic sign 201 could lead to a collision with another road user 200, 210 within the area 202. Through the traffic sign 201, the road users 200, 210 and/or the directions and/or lanes from which they come (for the vehicle 100) acquire a certain meaning (prescribed by one or more traffic rules).

The driving situation also includes the event (or parts of the driving situation) that cannot or cannot be completely detected by the vehicle 100 at time t0 and/or cannot be predicted or cannot be completely predicted. For example, one or more road users 200, 210 or their speed and direction of travel from the vehicle 100 (possibly through the direct perception of the driver of the vehicle 100 and/or using technical means) cannot be sufficiently detected or assessed. For example, a road user 200, 210 (approximately at time t0) may be obscured from the perspective of the vehicle 100 or cannot be sufficiently assessed (e.g. with regard to his intention).

This document also describes a functionality that can be carried out using means of the vehicle 100 and/or (possibly only) using a user device 110 carried in the vehicle 100 (e.g. using an app on a smartphone). This functionality can be based on automatic recording and buffering and processing of a traffic sign 201 (e.g. with a user device 110). The functionality (including appropriately equipped means) is part of the scope of the invention.

For example, the traffic sign 201 can be recorded automatically (e.g. after it has been recognized as such) and can then be displayed to the driver (at least primarily in cases in which the content or context of the traffic sign 201 has subsequently become more important or particularly important).

Driver information is preferred (e.g. shortly before or while driving on a road arrangement, an intersection, a roundabout, etc.) relating to the content and/or meaning (also to be understood as an interpretation) of the traffic sign 201 that has already been passed (which was arranged in front of the street arrangement, the intersection or the roundabout, etc.). In particular, the meaning of the traffic sign 201 can be displayed (as driver information) in the context of what has subsequently occurred or will occur.

This can also happen in particular if the driver has forgotten the content and/or the meaning of a traffic sign 201 that has just passed (looked at or not looked at, more or less consciously perceived), or regarding the content and/or meaning of the traffic sign 201 ( e.g. in the context of a driving situation that only occurred afterwards) is not safe.

• • einer daraufhin erwarteten (z.B. prädizierten) und/oder eingetretenen (z.B. erkannten) Fahrsituation;
• • einem oder mehreren baulichen Merkmalen der Fahrbahnen bzw. der Fahrbahnanordnung; und/oder
• • einer Information darüber, ob der Fahrer das Verkehrszeichen 201 gesehen hat, insbesondere ob der Fahrerblick in einem hinreichenden Maße auf das Verkehrszeichen 201 gerichtet war.

The method described in this document can include an automatic interpretation of the meaning of the traffic sign 201 that has already passed, in particular that is no longer or no longer conveniently visible to the driver, in particular in connection with:

• • a driving situation that was then expected (e.g. predicted) and/or occurred (e.g. recognized);
• • one or more structural features of the roadways or the roadway arrangement; and or
• • Information about whether the driver saw traffic sign 201, in particular whether the driver's gaze was sufficiently directed at traffic sign 201.

As a result, driver information can also be generated (e.g. directly from the user device 110), in particular comprising a recommendation for action and/or a control signal (e.g. a trigger) for a vehicle system and/or for a functionality of the vehicle 100.

The method described can be implemented efficiently with an (appropriately designed) SW application for a user device 110. This means the process can be used in existing vehicles. This can (also) significantly increase general traffic safety (ultimately for the general public).

In one variant, the user device 100 (e.g. a smartphone) can be operated on the windshield and/or on the rear window (e.g. in a holder provided for carrying out the method) of a vehicle 100 and the traffic sign information about a traffic sign 201 can be recorded with a camera 102 of the User device 110 (e.g. with the smartphone camera) can be captured.

The method described in this document is particularly effective when the vehicle 100 has already driven past a traffic sign 201 (or has driven to such an extent that the traffic sign 201 is no longer sufficiently visible and/or interpretable for the driver).

In addition, a large number of features or combinations of features are described in this document, which contribute to supporting the interpretation of the meaning of a traffic sign 201 and/or the representation of the traffic sign 201 to the driver. As already explained, the method can be provided in a particularly efficient manner as a SW application on a user device 110. Alternatively or additionally, the method can be provided as a vehicle function or as a function operated at least partially with means of the user device 110 and at least partially with means of the vehicle 100.

• • der hinter und/oder seitlich von dem Verkehrszeichen 201 liegt; und/oder
• • der hinter der Position des Fahrzeugs 100 zum Zeitpunkt t2 der Ausgabe der Fahrerinformation liegt.

2 shows an example driving situation. The driver information and/or the control of the at least one function can be output and/or effected to the driver of the vehicle 100 between times t1 and t2. The driver information can be generated on the basis of the traffic sign information that was at least partially already determined at time t0 and/or on the basis of (at least partially subsequently determined, predicted and/or subsequently interpreted) information about a part of the environment 202 of the traffic sign 201. Preferably, at least part of the environment 202 represented in the driver information is a part of the environment 202 (relative to the trajectory traveled by the vehicle 100)

• • which lies behind and/or to the side of the traffic sign 201; and or
• • which lies behind the position of the vehicle 100 at the time t2 of the output of the driver information.

3 shows a flowchart of an exemplary (possibly computer-implemented) method 300 for supporting a driver of a motor vehicle. The method 300 includes the acquisition 301 of traffic sign information related to a traffic sign 201, as well as the processing 302 of the traffic sign information, whereby in the context of the processing 302, in particular data representing a part of the environment 202 of the vehicle 100 are generated in connection with the traffic sign 201. The procedure also includes 300 generating 303 driver information depending on the processed traffic sign information, in particular depending on and/or in conjunction with position information about a part of the surroundings 202 of the vehicle 100 and/or a map and/or a representation of a part of the surroundings 202 of the vehicle 100.

A method 300 for supporting a driver of a vehicle 100 is thus described. The method 300 includes detecting 301 traffic sign information related to a traffic sign 201 (e.g. using one or more environmental sensors 102).

Furthermore, the method 300 includes the processing 302 of the traffic sign information, in particular data representing a part of the environment 202 of the vehicle 100 being generated in connection with the traffic sign 201.

The method 300 can further include generating 303 driver information, depending on the processed traffic sign information, in particular depending on and/or in conjunction with position information and/or a map and/or a representation of part of the environment 202.

The method 300 can be carried out using means of the vehicle 100 and/or using means of a user device 110 that can be carried in the vehicle 100.

The recording of the traffic sign information can take place in front of a road arrangement of a certain type (e.g. intersection, entrance, cross street, roundabout, etc.). This can be done with a first camera 102 of a user device 110 operated in the vehicle 100 and/or based on the data from previous recordings. The traffic sign information can relate to certain parts of the environment 202 (typically located behind and/or to the side of the traffic sign 201).

The traffic sign information is preferably information that goes beyond the content of the traffic sign 201 (as such) (and possibly deviates from the content itself). For example, the traffic sign information relates to the surroundings 202 of the traffic sign 201, in particular the surroundings 202, which extends partially or largely (from the direction of travel of the vehicle 100) behind the traffic sign 201.

For example, it can extend to an area 202 of approximately 10 meters in front of the traffic sign 201 and/or at least 30, 50, 100, 200 meters behind the traffic sign 201 and/or to the side of the traffic sign 201.

For example, the traffic sign information can be characteristic of the content of the traffic sign 201 (recognized in method 300) and/or of one or more parts of the environment 202 to which the traffic sign 201 relates.

Depending on the design variant, the method 300 can include recognizing a traffic sign 201 (as such). In a (simplified) embodiment, (preprocessed, processed, or essentially unprocessed) image information (e.g. based on an image sensor 102) can be captured. In one case, a part of the traffic sign 201 and/or a part of the environment 202, in particular after an automatic recognition that it is (any) traffic sign 201, can be captured as image data (e.g. photographed and/or cached). The captured image data (e.g. a section of the environment that represents a significant part of the traffic sign 201 can (in one case) be output as part of the driver information (e.g. subsequently, approximately in the time interval between t1 and t2).

Incidentally, the method 300 does not necessarily require automatic recognition of the content of the traffic sign 201.

The part of the environment 202 of the vehicle 100 can (initially) comprise or be a data model and/or data representing information (graphically or later graphically displayable).

The driver information can include or be a graphical representation generated depending on the traffic sign information, in particular on the basis of the traffic sign information. The graphical representation or the corresponding data model can in particular be (e.g. completely or partially, in particular in places) reduced, abstracted and/or highlighted information representing the surroundings of the traffic sign 201 (e.g. parts of the surroundings 202 located after and/or to the side of the traffic sign 201 ).

• • hinter dem Verkehrszeichen 201 und/oder seitlich von dem Verkehrszeichen 201 befindet; und/oder
• • hinter der Position des Fahrzeugs 100 zum Zeitpunkt der Ausgabe der Fahrerinformation befindet.

The driver information generated (output) in the method 300 can relate to a part of the surroundings of the traffic sign 201, which is (in the direction of travel of the vehicle 100 or in relation to the trajectory traveled by the vehicle 100):

• • located behind traffic sign 201 and/or to the side of traffic sign 201; and or
• • located behind the position of the vehicle 100 at the time the driver information is issued.

In a preferred embodiment, the driver information includes a graphic representation that represents part of the environment 202 of the traffic sign 201, in particular in a (e.g. completely or appropriately, partially, in particular in places) reduced, abstracted and/or symbolic form.

The graphic representation can include or be at least partially or in places a symbolic, abstract representation. The graphical representation may represent a portion of the environment 202 from a perspective that differs from the current and/or previous perspective of the driver of the vehicle 100. Preferably, the graphical representation can include a raised visual perspective (in relation to the height of the vehicle). This can represent (e.g. in the time interval between t1 and t2) the current driving situation determined (e.g. at a time between t1 and t2) or predicted for the next few seconds (after t1 or t2).

In particular, the one or more other road users 200, 210 can be represented in the driver information, in particular in the graphical representation, according to their currently valid and/or predicted positions or arrangements.

The representation can be reduced (e.g. in comparison with an almost photorealistic representation) to approximately 50, 30, 20, 10% of the original information (e.g. by highlighting, omitting and/or reducing less relevant objects, surfaces, textures). In particular, the graphical representation can (selectively) be in the schematic 2 include marked features.

For example, a part of the graphic representation can be generated and/or output primarily or only if the (interpreted) meaning of a part of the traffic sign information is no longer sufficiently visible to the driver of the vehicle 100 after passing the traffic sign 201 or after the traffic sign 201 is, exceeds a threshold value and/or assumes a certain value. For example, one or more classes of meanings can be (pre)defined, which (should) lead to the generation or output of the graphical representation or the highlighting of certain parts of the graphical representation.

The output of the graphical representation can also be seen as a highlighting of a part of the representation (e.g. certain road areas and/or road users) and/or as an indication of the graphical representation (e.g. output of a sound (e.g. from the direction in which the graphical representation is intended). displayed to the driver of the vehicle).

For example, primarily or only if the (e.g. by the in the 2 schematically represented road users 200, 210) driving situation, in particular a part of the driving situation that occurs (only) after passing the traffic sign 201, becomes detectable and / or predictable, for the journey of the vehicle 100, for the vehicle 100 and / or for other road users 200, 210 acquires a certain or great importance, driver information (eg particularly striking, warning, particularly highlighted) is generated.

For example, the driver information can include or be a highlighting of the spatial parts (e.g. road surfaces) and/or road users 200, 210, which have acquired a certain significance for the journey of the vehicle 100 due to the traffic sign 201, within the graphic representation.

The highlighting can be a changed, in particular locally changed, parameter for contrast, color, texture, border and/or changed brightness (e.g. flashing, pulsing).

The graphical representation can be output, in particular displayed, via a user interface 104 (of the user device 110 and/or the vehicle 100).

For example, the graphical representation only or primarily includes spatial areas, immovable objects and/or road users that are (particularly) relevant for interpreting the meaning of the traffic sign 201 that has been passed, in particular in the context of the subsequent driving situation, or subsequently, after passing the traffic sign 201 or . if this is no longer sufficiently visible to the driver, it has become (particularly) relevant.

For example, if the driving situation, in particular a part of the driving situation that occurs after passing the traffic sign 201, becomes detectable and/or predictable for the journey of the vehicle 100, for the vehicle 100 and/or for other road users 200, 210 in the environment 202 is uncritical (also to be understood as subsequently uncritical or unreasonable proves relevant), driver information (e.g. particularly striking, warning and/or highlighted), in particular driver information as a whole, can be dispensed with. This can also relieve the driver's perception (which is typically burdened by various instruments and stimuli).

For example, the driver information may concern a meaning of the traffic sign 201, which (only) becomes apparent in the context of what became apparent after passing the traffic sign 201. Therefore, the driver information can include, in particular highlight, information relating to a specific meaning of the traffic sign 201, which only becomes particularly relevant after passing the traffic sign 201 and/or which only becomes particularly relevant in the then recognizable or predictable driving situation.

The driver information can also be generated if the driver has forgotten a traffic sign 201 that has just passed and/or is not sure about the content and/or meaning of the traffic sign 201 (e.g. in the context of a driving situation that only occurred afterwards).

For example, the driver information also or primarily takes into account circumstances that only occurred after passing the traffic sign 201, became recognizable and/or predictable and/or became particularly significant and/or are likely (e.g. with a probability exceeding a certain threshold value). Therefore, the method 300 can contribute to confident use of the vehicle 100 and/or to increasing the safety of the vehicle 100 and the surroundings 202.

Preferably, the driving information is also and/or primarily or essentially only generated, output and/or highlighted (by any means) if the content of the traffic sign 201 subsequently or due to a (e.g. unexpected) change in the driving situation is special has acquired significance or has become particularly important and/or is to be used in an identified or probable driving situation.

• • einen Bildausschnitt umfassend einen Teil des Verkehrszeichnens 201; und/oder
• • den Inhalt des Verkehrszeichens 201; und/oder
• • einem Teil der Umgebung 202, auf die sich das Verkehrszeichen 201 bezieht.

The traffic sign information may refer to:

• • an image section comprising a part of the traffic sign 201; and or
• • the content of traffic sign 201; and or
• • a part of the area 202 to which traffic sign 201 refers.

• • einer daraufhin erwarteten (z.B. prädizierten) und/oder eingetretenen (z.B. erkannten) Fahrsituation;
• • einem oder mehreren baulichen Merkmalen der Fahrbahnen bzw. Fahrbahnanordnung; und/oder
• • einer Information darüber, ob der Fahrer des Fahrzeugs 100 das Verkehrszeichen 201 sehen konnte oder gesehen hat.

The method 300 can include processing an interpretation of a meaning of the traffic sign 201 that has already passed, in particular that is no longer visible to the driver or is no longer visible to the driver properly (eg conveniently). The interpretation can take place in particular in connection with:

• • a driving situation that was then expected (e.g. predicted) and/or occurred (e.g. recognized);
• • one or more structural features of the roadways or roadway arrangement; and or
• • Information about whether the driver of the vehicle 100 could or has seen the traffic sign 201.

The information about whether the driver of the vehicle 100 could or has seen the traffic sign 201 may include or be one or more probability measures. For example, a probability measure can be determined, in particular estimated, and taken into account as to whether the driver saw the traffic sign 201 and/or interpreted it correctly himself.

The interpretation of the traffic sign information can relate to a driving situation, in particular with a certain probability.

In the context of the present document, the term “driving situation” can be understood, for example, as a specific situation characterized by an arrangement, action, or interaction of road users 200, 210 or by certain driving parameters of road users 200, 210. In particular, the meaning of the term "situation" or "driving situation" differs from a meaning often used colloquially of the term "traffic situation", which rather includes general categories such as "free traffic", "dense traffic", "slow-moving traffic", “Traffic jam”, “end of traffic jam” etc. corresponds. In particular, a driving situation is (rather) characterized by influences from specific road users 200, 210 or from the (concrete) movements of the road users 200, 210 (not just their statistical quantity or entropy).

In particular, a driving situation is (rather) characterized by a specific pattern (also to be understood as a data pattern), for example a pattern characterizing an arrangement and/or speed of the objects and/or a pattern of the parameters of the driving situation. The driving situation can also be characterized by a spatial pattern of the so-called open spaces in the area surrounding the vehicle 100. For example, one can Trigger condition refers to such features or corresponding parameters of the driving situation.

• • eine (bestimmte) räumliche Verteilung der Verkehrsteilnehmer 200, 210 und/oder der Bewegungsparameter der Verkehrsteilnehmer 200, 210, insbesondere ein Anordnungsmuster der Verkehrsteilnehmer 200, 210 in der Umgebung 202 des (realen) Fahrzeugs 100;
• • eine (bestimmte) räumliche Verteilung unbeweglicher Objekte in der Umgebung 202 des Fahrzeugs 100;
• • eine relative Position und/oder ein relativer Bewegungsparameter zu bestimmten Arten von Spurmarkierungen, Verkehrszeichen 201, Ampeln (nicht notwendigerweise zu bestimmten Ampeln, etc.);
• • eine Information über die Vorfahrt des Fahrzeugs 100, insbesondere gegenüber bestimmten Verkehrsteilnehmern 200, 210 und/oder Verkehrsteilnehmern 200, 210, die tatsächlich oder zumindest potentiell aus bestimmten Richtungen, z.B. einer querenden Straße von rechts oder von links kommen oder kommen können; und/oder
• • eine Information zu einer, z.B. einen Grenzwert überschreitenden, Handlung eines Verkehrsteilnehmers 200, 210 in der Umgebung 202 des Fahrzeugs 100, wie z.B. ein Hupen, Lichthupen, Drängeln, Überholen des Fahrzeugs 100, ein Überholversuch und dergleichen.

Preferably, the at least one driving situation can be characterized by one or more features listed below:

• • a (certain) spatial distribution of the road users 200, 210 and/or the movement parameters of the road users 200, 210, in particular an arrangement pattern of the road users 200, 210 in the environment 202 of the (real) vehicle 100;
• • a (certain) spatial distribution of immovable objects in the environment 202 of the vehicle 100;
• • a relative position and/or a relative movement parameter to certain types of lane markings, traffic signs 201, traffic lights (not necessarily to certain traffic lights, etc.);
• • information about the right of way of the vehicle 100, in particular towards certain road users 200, 210 and/or road users 200, 210 who actually or at least potentially come or can come from certain directions, for example a crossing street from the right or from the left; and or
• • Information about an action by a road user 200, 210 in the area 202 of the vehicle 100, for example exceeding a limit value, such as honking, flashing lights, jostling, overtaking the vehicle 100, an attempt to overtake and the like.

Furthermore, the driving situation can be characterized by one or more parameters in connection with relevant traffic rules, traffic signs 201, right-of-way, traffic lights and/or traffic light phases.

The at least one driving situation can preferably be a driving situation that exceeds certain limit values or a driving situation that is characterized by parameters that exceed certain limit values. For example, the at least one driving situation can be a driving situation with an undesirable or dangerous approach to an object or a road user 200, 210, an acceleration value that exceeds a limit value, an undesirable arrangement to other road users 200, 210, etc . act.

The driving situation can be a special situation (e.g. that occurs comparatively rarely) or a dangerous driving situation, e.g. a driving situation for which an increased risk is determined or assumed.

The driver information can represent a meaning of the traffic sign 201 that has already been passed in relation to a driving situation that is then expected (e.g. predicted) and/or has occurred (e.g. recognized).

In one example, the driver information can represent (comprise or highlight) a situation that has a certain meaning due to a traffic sign 201 that is no longer directly visible (e.g. the intersection) and possibly in the context of what has subsequently occurred or will occur or has received (in the meantime).

For example, the driver information can have a reference to one or more directions and/or lanes, which are characterized in that road users 200, 210 coming from them have a right of way or over which the vehicle 100 has a right of way.

Preferably, driver information, in particular comprising a recommendation for action and/or a control signal for the vehicle 100 and/or another device operated in the vehicle 100, can also be generated. For example, the graphical representation can be generated and/or output on the user device 110.

Alternatively or additionally, the (driver) information can be output on the user device 110 that a control signal has been sent to the vehicle 100 and/or that a specific change in functionality of the vehicle 100 has been initiated.

• • teilweise fotorealistische; und/oder
• • teilweise abstrahierte; und/oder
• • teilweise reduzierte; und/oder
• • durch den Ersatz realer Objekte durch korrespondierende grafische Modelle gekennzeichnete

The output driver information may include a symbolic representation of one or more objects in the environment 202 and/or information from a digital map. For example, a representation, in particular three-dimensional, can be generated that:

• • partly photorealistic; and or
• • partially abstracted; and or
• • partially reduced; and or
• • characterized by the replacement of real objects with corresponding graphic models

representation.

The driver information described above can be generated in particular if It was recognized that the driver's gaze was not and/or is not directed sufficiently at traffic sign 201.

The recognition of the driver's gaze (e.g. the direction of gaze, duration of perception) can be effected with another sensor (e.g. the selfie camera) 102 of the user device 110.

The method 300 can include evaluating an action carried out or executable by the driver of the vehicle 100 after the vehicle 100 has passed the traffic sign 201, in particular taking into account the at least one traffic sign 201 and/or the result of the interpretation of the meaning of the traffic sign 201 in relation to the then current and/or predicted driving situation.

The driver's action can be or include a reaction of the driver, in particular to one or more objects, situations or changes perceived after passing the traffic sign 201.

For example, a difference can be recognized between a recognized intention and/or reaction of the driver and an appropriate intention or reaction (which should be present) (e.g. according to the traffic rules and/or the driving situation). For example, a difference can be made between a recognized intention and/or reaction of the driver to a driving situation (e.g. not yet recognizable before passing the traffic sign 201, which occurred or was predicted at the given time) and an intention and/or reaction that was made taking into account one or several traffic rules and/or the driving situation would be correct and/or appropriate.

• • Information über den Inhalt des passierten Verkehrszeichens 201;
• • die Position des (passierten insbesondere übersehenen) Verkehrszeichens 201 in Relation zu seiner Umgebung 202 (z.B. Kreuzung, Einfahrt, Ausfahrt, Zebrastreifen, Pfosten, Ampel, Gebäude, Fahrbahnmarkierungen und/oder Fahrbahnbegrenzungen);
• • einen Zusammenhang zwischen dem passierten Verkehrszeichen 201 und einem oder mehreren Verkehrsteilnehmern 200, 210 aus einer (erst später erkennbaren) Fahrsituation; und/oder
• • eine Hervorhebung von mehr oder minder kritischen Objekten und/oder Beziehungen zwischen den Objekten, im Zusammenhang mit der Bedeutung des passierten Verkehrszeichens 201; beispielsweise eine Hervorhebung einer Gefahr und/oder von vergleichsweise ungefährlichen Objekten, im Zusammenhang mit dem passierten Verkehrszeichen 201.

Depending on the evaluation, driver information can be output, in particular characterizing:

• • Information about the content of the traffic sign 201 passed;
• • the position of the (passed, especially overlooked) traffic sign 201 in relation to its surroundings 202 (e.g. intersection, entrance, exit, zebra crossing, post, traffic light, building, road markings and/or road boundaries);
• • a connection between the traffic sign 201 passed and one or more road users 200, 210 from a driving situation (which can only be recognized later); and or
• • a highlighting of more or less critical objects and/or relationships between the objects in connection with the meaning of the traffic sign 201 passed; for example, highlighting a danger and/or comparatively harmless objects in connection with the traffic sign 201 that was passed.

For example, (e.g. within a reduced, abstracted and/or at least partially symbolically represented environment of the traffic sign 201) road users 200, 210 can be highlighted (e.g. marked in color) who, due to the meaning of the traffic sign 201 passed, have a specific (special) meaning for the Have vehicle 100.

The method 300 can include generating and initiating a control signal that is dependent on the evaluation of the meaning of the traffic sign 201 and/or on the current and/or predicted driving situation. The control signal can be transmitted to a component of the vehicle 100, in particular to output information using means of the vehicle 100 and/or to activate or prepare the component for a possible danger (for the vehicle 100 and/or for another road user 200, 210 ).

Such an influence, for example from the user device 110 on a vehicle system, is particularly useful because the one or more cameras 102 and/or the image processing of the user device 110 (in particular the smartphone) and/or the orientation of the user device 110 may provide better data than, for example, that Vehicle system can deliver.

• • einen bestimmten Fahrer;
• • ein bestimmtes Verkehrszeichen 201; und/oder
• • eine bestimmte Fahrsituation.

The processing may include an aggregation of data (regarding a large number of traffic sign cases), in particular regarding:

• • a specific driver;
• • a specific traffic sign 201; and or
• • a specific driving situation.

The data may have been aggregated in a backend (e.g. based on a large number of previous trips that passed a traffic sign 201).

• • zur Ausgabe eines verallgemeinerten Feedbacks an einen bestimmten Fahrer oder an einen Fahrer mit einem ähnlichen Fahrerprofil; und/oder
• • zur, insbesondere vorausschauenden, Ansteuerung einer Funktionalität des Fahrzeugs 100.

The result of the aggregation can then be taken into account as part of method 300, in particular:

• • to provide generalized feedback to a specific driver or to a driver with a similar driver profile; and or
• • for, in particular, predictive control of a functionality of the vehicle 100.

The aggregation can relate to data from a large number, for example at least 100, 10 ³ , 10 ⁴ , 10 ⁶ , of cases, and can in particular include an evaluation of statistical clusters.

For example, the functionality can be configured in relation to a specific driver, the driver's group of people, a specific roadway location, a roadway location of a specific type, and/or a specific driving situation or driving situation of a specific type.

• • keine, eine verspätete oder eine nicht angemessene Reaktion des (jeweiligen) Fahrer folgte; und/oder
• • nach dem Passieren des Verkehrszeichens 201 eine unvorteilhafte Fahrsituation folgte; und/oder
• • eine einen bestimmten Schwellwert übersteigende Bedienaktion des Fahrers des Fahrzeugs 100 (z.B. ein relativ starker Lenkeinschlag, eine Bremsung, eine Beschleunigung, ein Ausweichmanöver, etc.) folgte.

During the aggregation, it can be determined that with regard to certain traffic signs 201 and/or on certain road sections, in particular with a frequency that exceeds a certain threshold value:

• • there was no reaction, a delayed reaction or an inappropriate reaction from the (respective) driver; and or
• • an unfavorable driving situation followed after passing traffic sign 201; and or
• • An operating action by the driver of the vehicle 100 that exceeded a certain threshold value (eg a relatively strong steering angle, braking, acceleration, an evasive maneuver, etc.) followed.

• • Verändern eines oder mehrerer Parameter, einer Logik und/oder einer Funktionsweise des Verfahrens 300; und/oder
• • Verändern eines oder mehrerer Parameter, einer Logik und/oder eines Verhaltens einer weiteren Funktionalität, insbesondere in Bezug auf denselben Fahrer und/oder einen weiteren Fahrer bzw. Nutzer des Anwendergerätes 110.

For example, (depending on the result of aggregating the data):

• • Changing one or more parameters, logic and/or functionality of method 300; and or
• • Changing one or more parameters, logic and/or behavior of a further functionality, in particular in relation to the same driver and/or another driver or user of the user device 110.

• • Veränderung einer oder mehrerer Auslöseschwellen, insbesondere Warnschwellen der Funktionalität;
• • Veränderung des Zeitpunkts und/oder der Position, an der die Fahrerinformation ausgegeben wird, und/oder einer oder mehrerer Auslöseschwellen, ab der die Funktionalität wirksam sind;
• • Erzeugen einer Vorabinformation vor der Ausgabe der Fahrerinformation; und/oder
• • Veränderung einer Konfiguration der Funktionalität des Fahrzeugs 100.

The method 300 may include controlling and/or executing a functionality of the vehicle 100 depending on one or more pieces of information determined in the method 300 (eg depending on part of the traffic sign information). This may include in particular

• • Change in one or more trigger thresholds, in particular functionality warning thresholds;
• • Changing the time and/or position at which the driver information is issued and/or one or more trigger thresholds from which the functionality takes effect;
• • Generating advance information before issuing the driver information; and or
• • Changing a configuration of the functionality of the vehicle 100.

The control can take place in particular depending on the aggregation of the data from a large number of cases, in particular a large number of similar cases.

This can be the position in relation to a specific road arrangement (possibly a road arrangement or a specific pattern of the road arrangement), e.g. a position in relation to a junction, intersection, roundabout, etc.

The traffic sign 201 can include a traffic light and/or at least one time-variable display (e.g. display or pictogram display).

• • Erfassen des Verkehrszeichens 201 und/oder eines Teils der Umgebung 202, insbesondere mit der Hauptkamera 102 des Anwendergeräts 110;
• • Übermitteln der Daten in ein Backend, insbesondere zur Aggregation der Daten;
• • Empfangen von Anpassungsdaten aus dem Backend zum Ansteuern der Funktionalität des Fahrzeugs 100;
• • Erkennung des Blicks des Fahrers des Fahrzeugs 100, insbesondere mit der Selfie-Kamera 102 des Anwendergeräts 110;
• • Verarbeiten der Information;
• • Generieren der Fahrerinformation;
• • Veranlassen eines Steuerungssignals an eine weitere Komponente, z.B. Vorrichtung 101, des Fahrzeugs 100 und/oder an eine weitere im Fahrzeug 100 betreibbare Vorrichtung.

At least part of the method 300 can be carried out by means of a user device 110 that can be carried in the vehicle 100, in particular operable on the windshield or rear window. In particular, one or more of the steps listed below can be carried out by the user device 110:

• • Capturing the traffic sign 201 and/or a part of the environment 202, in particular with the main camera 102 of the user device 110;
• • Transmitting the data to a backend, especially for data aggregation;
• • Receive customization data from the backend to control the functionality of the vehicle 100;
• • Recognition of the gaze of the driver of the vehicle 100, in particular with the selfie camera 102 of the user device 110;
• • Processing the information;
• • Generate driver information;
• • Initiating a control signal to a further component, for example device 101, of the vehicle 100 and/or to a further device operable in the vehicle 100.

• • Erfassen einer im Zusammenhang mit einem Verkehrszeichen 201 stehenden Verkehrszeicheninformation;
• • Verarbeiten der Verkehrszeicheninformation, wobei dabei insbesondere Daten repräsentierend einen Teil der Umgebung 202 des Fahrzeugs 100 im Zusammenhang mit dem Verkehrszeichen 201 erzeugt und/oder berücksichtigt werden; und
• • Generieren einer Fahrerinformation abhängig von der verarbeiteten Verkehrszeicheninformation, insbesondere abhängig und/oder in Verbindung mit Positionsinformation und/oder einer Karte und/oder einer Darstellung eines Teils der Umgebung 202.

Furthermore, a user device 110 for operation in a vehicle 100 is described in this document. The user device 110 can be set up to:

• • Detecting traffic sign information related to a traffic sign 201;
• • Processing the traffic sign information, in particular data representing a part of the environment 202 of the vehicle 100 being generated and/or taken into account in connection with the traffic sign 201; and
• • Generate driver information depending on the processed traffic sign information, in particular depending on and/or in conjunction with position information and/or a map and/or a representation of part of the environment 202.

The user device 110 can be in an operative connection with the vehicle 100.

Furthermore, this document describes a vehicle 100, wherein the vehicle 100 is set up to carry out the method 300 described in this document. The vehicle 100 can be in an operative connection with a user device 110.

In addition, this document describes a computer program product that is designed to correspond to the method 300 described.

The measures described can be provided in an efficient manner on a user device 110 (e.g. as an app on a smartphone), which makes it possible to retrofit vehicles 100 that have already been delivered with the function described in this document. Alternatively or additionally, the function can be implemented as pure vehicle functionality or as a combined function (vehicle + smartphone). The measures described can increase road safety in an efficient manner.

The present invention is not limited to the exemplary embodiments shown. In particular, it should be noted that the description and the figures are only intended to illustrate the principle of the proposed methods, devices and systems by way of example.

Claims (14)

Method (300) for supporting a driver of a motor vehicle (100); wherein the method (300) comprises, - Detecting (301) traffic sign information related to a traffic sign (201); - Processing (302) of the traffic sign information, wherein as part of the processing (302), in particular data representing a part of an environment (202) of the vehicle (100) is generated in connection with the traffic sign (201); and - Generating (303) driver information depending on the processed traffic sign information, in particular depending on and/or in conjunction with position information about a part of the surroundings (202) of the vehicle (100) and/or a map and/or a representation of a part of the surroundings (202) of the vehicle (100). Procedure (300) according to Claim 1 , wherein the traffic sign information relates to one or more of the following, - an image section comprising at least part of the traffic sign (201); and/or - a content and/or a meaning of the traffic sign (201); and/or - a part of the environment (202) of the vehicle (100) to which the traffic sign (201) refers. Method (300) according to one of the preceding claims, wherein - Processing (302) of the traffic sign information includes interpreting a meaning of the traffic sign (201), in particular when the traffic sign (201) has already been passed by the vehicle (100) and/or when the traffic sign (201) is for the driver the vehicle (100) is no longer or no longer perfectly visible; and - the meaning of the traffic sign (201) is interpreted in particular in connection with, - an expected, in particular predicted, and/or occurred, in particular recognized, driving situation; - one or more structural features of a roadway and/or roadway arrangement traveled by the vehicle (100); and or - Information about whether the driver of the vehicle (100) could or has seen the traffic sign (201). Method (300) according to one of the preceding claims, wherein the driver information represents a meaning of the traffic sign (201), in particular already passed by the vehicle (100), in relation to an expected, in particular predicted, and/or occurred, in particular recognized, driving situation . Method (300) according to one of the preceding claims, wherein the method (300) comprises evaluating an action of the driver of the vehicle (100) after the vehicle (100) has passed the traffic sign (201). was carried out or was executable, in particular taking into account the traffic sign (201) and/or a result of interpreting a meaning of the traffic sign (201) in relation to a current and/or predicted driving situation. Method (300) according to one of the preceding claims, wherein the method (300) comprises, - Generating a control signal dependent on interpreting a meaning of the traffic sign (201) and/or on a current and/or predicted driving situation; - Sending the control signal to a component of the vehicle (100), in particular for: - Outputting information using means (104) of the vehicle (100); and or - Activating or preparing the component for a possible hazard. Method (300) according to one of the preceding claims, wherein the method (300) comprises, - Processing an aggregation of data, in particular regarding: - a specific driver; - a specific traffic sign (201); and or - a specific driving situation; and - Taking into account an aggregation result, in particular: - to issue feedback to a specific driver or to a driver with a driver profile corresponding to the specific driver; and or - for, in particular predictive, control of a functionality of the vehicle (100). Procedure (300) according to Claim 7 , whereby when processing an aggregation of data, it is checked whether in relation to the traffic sign (201) and / or on a specific road section in connection with the traffic sign (201), in particular with a frequency exceeding a certain threshold value - none, a delayed or inappropriate reaction by the respective driver occurred; and/or - after passing the traffic sign (201), an unfavorable and/or critical driving situation followed; and/or - an operating action by the respective driver that exceeded a certain threshold value, in particular a steering angle, braking, acceleration and/or an evasive maneuver, took place. Method (300) according to one of the preceding claims, wherein the method (300) comprises controlling and/or adapting a functionality of the vehicle (100) depending on at least part of the traffic sign information, in particular: - Changing one or more trigger thresholds, in particular warning thresholds, of the functionality; - Changing a time and/or a position at which the driver information is output; and or - Generating advance information before issuing the driver information; and or - Changing a configuration of the functionality of the vehicle (100); wherein the control and/or adjustment takes place in particular depending on an aggregation of data from a large number of traffic sign cases, in particular a large number of corresponding traffic sign cases. Method (300) according to one of the preceding claims, wherein the traffic sign (201) comprises a traffic light and/or at least one time-variable display. Method (300) according to one of the preceding claims, wherein - at least part of the method (300) is carried out by means of a user device (110) which can be carried in the vehicle (100), in particular operable on a windshield or rear window of the vehicle (100); and - In particular, one or more of the steps listed below are carried out by the user device (110): - Detecting the traffic sign (201) and/or part of the surroundings (202) of the vehicle (100), in particular with a main camera (102) of the user device (110); - Transmitting data to a backend, in particular for data aggregation; - Receiving adaptation data from the backend to control functionality of the vehicle (100); -Recognizing a look from the driver of the vehicle (100), in particular with a selfie camera (102) of the user device (110); - Processing traffic sign information; - Generate driver information; - Generating and sending a control signal to a component of the vehicle (100) and/or to another device operable in the vehicle (100). User device (110) for operation in a vehicle (100), the user device (110) being set up to detect traffic sign information related to a traffic sign (201); - Processing the traffic sign information, whereby in the context of processing (302) in particular data representing part of a environment Exercise (202) of the vehicle (100) are generated in connection with the traffic sign (201); and - generating driver information depending on the processed traffic sign information, in particular depending on and/or in conjunction with position information about part of the environment (202) of the vehicle (100) and/or a map and/or a representation of part of the environment (202 ) of the vehicle (100). Device (101) for supporting a driver of a motor vehicle (100); wherein the device (101) is set up to - Detecting traffic sign information related to a traffic sign (201); - Processing the traffic sign information, wherein as part of the processing (302), in particular data representing a part of an environment (202) of the vehicle (100) in connection with the traffic sign (201) is generated; and - Generating driver information depending on the processed traffic sign information, in particular depending on and/or in conjunction with position information about a part of the surroundings (202) of the vehicle (100) and/or a map and/or a representation of a part of the surroundings (202) of the vehicle (100). Computer program, in particular a computer program product comprising a computer program, wherein the computer program is designed, when executed on at least one computing unit, according to the user device (110). Claim 13 or the device (101) according to 14 to operate and / or one or more steps of a method (300) according to one of Claims 1 until 12 to carry out.

Images