DE102022107730A1 - Method for operating a direction indicator device of a motor vehicle, control device, server device, and motor vehicle - Google Patents

Abstract

The invention relates to a method for operating a direction indicator device (16) of a motor vehicle (10), wherein a control device (12): receives traffic situation data from a motor vehicle system of the motor vehicle (10), which describe a traffic situation in which the motor vehicle (10) is located (S1); receives driver control data describing operation of the motor vehicle (10) by its driver (S2); based on the received driver control data, a driver's intention is predicted in relation to a driving maneuver planned by the driver in the traffic situation described (S3); and based on the traffic situation described by the received traffic situation data and based on the predicted driver intention, a target control of the direction indicators (24, 26, 28) of the direction indicator device (16) is determined (S8), the control of one or more direction indicators (24) assigned to the traffic situation described , 26, 28) of the direction indicator device (16). The control device (12) provides a control signal (S9) that describes the determined target control and transmits the provided control signal to the direction indicator device (16, S10).

Description

The invention relates to a method for operating a direction indicator device. A direction indicator device is a device, a device component or a device group that is set up in terms of lighting technology to announce a change in direction of travel, a lane change or a dangerous situation to road users in road traffic. A direction indicator device comprises at least one, preferably several, direction indicators or turn signals for activating and deactivating a flashing light and a warning light.

The direction indicator device is therefore part of vehicle lighting. However, turn signals or hazard warning lights are often used incorrectly, too late or not at all. Typical situations include turning without signaling, changing lanes without signaling, stopping or driving off without signaling, an indication of an intention to overtake even though the vehicle is already in the passing lane (i.e. jostling), and false-positive use of the indicator in a bend in the right-of-way and/or in a roundabout. Other typical situations of incorrect operation of a direction indicator device are forgetting to turn off the turn signal, for example after changing lanes, when the lane change is aborted or after a change of direction or when the change of direction is aborted; an incorrectly used hazard warning light; flashing when stopped on the side of the road or in a double row without posing a danger to traffic; incorrect use of hazard warning lights to indicate dangerous situations, for example at the end of a traffic jam or in an accident on the motorway; and/or automatic switching on and off. Incorrect use of the direction indicator device can lead to ambiguous, i.e. misleading, traffic situations and thus to misjudgment by other road users.

The WO 2010/045908 A1 describes a method for automatic direction indicator with the steps: detecting a driver activity and / or vehicle position using a lane keeper support system and / or a lane assistant and activating or deactivating a direction indicator depending on the detected driver activity or vehicle position.

The US 2019/0077308 A1 describes systems and methods for activating direction indicators of a motor vehicle.

One object underlying the invention is to improve the quality of control of the direction indicator device by a control device of the motor vehicle.

The object is achieved by the method according to the invention and the devices according to the invention according to the independent claims. Advantageous further training is provided by the claims below.

The invention is based on the idea, instead of observing a driver, i.e. instead of determining driver behavior by observing the driver, to predict a driver's intention based on the way the driver operates the motor vehicle, and to automatically control the direction indicator device based on the predicted driver's intention to be carried out. Data can preferably be used as an input and/or output channel using vehicle-to-X communication. Ideally, a generic pre-trained driver intent model can be used that can provide experience data for the widest possible use case, so that this experience data can be made available to other motor vehicles. This means that any driver can benefit from the experiences of a single driver, and a corresponding artificial intelligence can learn from it. The training data and/or experience data can preferably be made available in a cloud system. Unlike the prior art, where the driver is observed or where control is carried out depending on traffic rules and an approach to road markings, the system of the invention can “get to know” a driver based on his driving behavior.

It can advantageously be possible to automatically adapt the control of the direction indicator, which is particularly advantageous in countries with different legal regulations. For example, blinking behavior in roundabouts can be regulated differently in different countries.

The method according to the invention for operating a direction indicator device of a motor vehicle is carried out by a control device. A control device is understood to mean a device, a device component or a device group that is set up to receive signals, evaluate them, and provide control signals, for example to generate them, as well as transmit the provided control signals to other components. For this purpose, the control device can, for example, have a corresponding receiving unit, a data processing unit and a transmitting unit.

The control device receives traffic situation data from a motor vehicle system of the motor vehicle, the received traffic situation data describing a traffic situation in which the motor vehicle is located. The traffic situation data can preferably be received via vehicle-to-X communication, for example via vehicle-to-vehicle communication, or from a data server external to the vehicle. The received traffic situation data can also be described as driving situation data. The traffic situation data can, for example, describe traffic volume or a traffic jam.

The control device also receives driver control data, the received driver control data describing operation of the motor vehicle by its driver. For example, the driver control data can describe a steering sequence with corresponding steering angles and steering angles, as well as technical data on the driver's acceleration and braking behavior. Preferably, the control device can receive the driver control data within a predetermined test period. Including the driver control data eliminates the need to monitor the driver using cameras, for example. The driver control data is also much more accurate in terms of the driver's possible driving intention. A possible driver intention can in particular be a driving maneuver such as changing lanes or turning.

The control device predicts the driver's intention based on the received driver control data in relation to a driving maneuver planned by the driver in the traffic situation described. This provides more precise information about the driver's intentions than driver observation.

The control device determines a target control of the direction indicator device based on the traffic situation described by the received traffic situation data and based on the predicted driver intention. The determined target control describes a control of one or more direction indicators of the direction indicator device assigned to the traffic situation described. In other words, the determined target control describes a flashing, a deactivation of a turn signal or an activation and / or deactivation of a hazard warning light that is appropriate or very likely appropriate given the predicted driver's intention. Preferably, the control device determines the target control only based on the traffic situation data and based on the predicted driver intention. The target control is therefore much more precise than controlling the direction of travel depending on driver observation.

The control device provides a control signal, for example generates it, the control signal provided describing the determined target control. The control device then transmits the provided control signal to the direction indicator device.

This results in the advantages mentioned above.

Preferably, the control device can provide the traffic situation and the driving control data and transmit it to a deep learning engine. The data combination can optionally be included as a training data set for training the Depp learning engine.

A deep learning engine (“deep learning facility”) is a device, device component or program that can apply so-called deep learning (so-called deep learning, machine learning) to a variety of data. In other words, the deep learning engine is a sophisticated facility for performing deep learning, an implementation of artificial intelligence. In other words, both artificial intelligence, machine learning and deep learning can be implemented using the deep learning engine. The deep learning engine can, for example, be designed and/or designed as a deep, artificial neural network. In other words, the deep learning engine can be set up to use a machine learning method to generate a large number of empirical values and/or training data, which can also be referred to as a training data set, or a data set according to a predetermined algorithm and based on the large number already stored to evaluate empirical values, for example via a logic contained therein, for example a correlation. This also allows additional logical connections to be created in the deep learning engine.

Experience values or training data can, for example, be statistically summarized into different driver intentions assigned to a large number of traffic situation data and driver control data. For this training step, the control device can operate the deep learning engine.

The control device can operate the deep learning engine to process the provided traffic situation data and driver control data and thereby determine a driver intention prediction. This driver intent prediction includes or describes a probability speed with which the driver intends to perform a driving maneuver. The control device can then operate the deep learning engine to use the driver's intention prediction to derive a driving maneuver as the driver's intention that the driver intends with a predetermined minimum probability.

This embodiment of the method according to the invention significantly increases the variety of possible driving maneuvers and thus predicts the driver's intention much more precisely. The advantages mentioned above increase synergistically.

In a further embodiment of the method according to the invention, the control device checks whether the received driving control data describes an actuation of the direction indicator device in accordance with the determined target control. In other words, the control device in this embodiment checks whether the driver sets the turn signal or hazard warning lights correctly, or whether it is a false positive or a false negative. The control device can then only provide the control signal if the received driving control data describes an actuation of the direction indicator device that deviates from the determined target control. In other words, the control device only intervenes if the driver uses the direction indicator device incorrectly. In addition to a particularly high learning effect for the driver, which can be corrected and learned if the direction indicators are used incorrectly, this can also be used as a starting point for assessing the driver's driving skills.

In order to effectively counteract the problem situation described above, switching the direction indicator or the direction indicators and hazard warning lights on and/or off can be implemented in accordance with the following embodiment variants. The design variants can optionally be combined with each other as desired.

In one embodiment of the method according to the invention, the predicted driver intention can describe an actuation of one of the direction indicators. The control device can then distinguish between comfort flashing and permanent flashing when manual actuation of the direction indicator lever is detected. Comfort flashing is understood to mean a flashing sequence in which the direction indicator lever is only operated slightly, that is, for example, without the lever engaging, and/or in which the driver manually controls only a few repetitions of the flashing, for example only a 3-5 flashes once. Usually, the lever is only lightly tapped for convenient flashing. Optionally, the control device can, for example, detect a lane change due to a small steering angle and derive the comfort flashing from this.

In this embodiment, the control device specifies a duration of the flashing (and thus the number of repetitions of the flashing) depending on whether the predicted driver's intention describes a lane change, driving off of the motor vehicle, placing the motor vehicle in a lane, or a turning operation. Additionally or alternatively, the control device can deactivate the activated direction indicator after the driving maneuver has ended. The control device can then control comfort flashing, for example when changing lanes, if it predicts a lane change as the driver's intention, or a longer flashing duration compared to comfort flashing if the predicted driver intention describes a turn. Optionally, a distinction can be made before a turn or the planned turn. In another example, the control device can specify a long flashing duration despite comfort flashing initiated by the driver.

To enable a route-based direction display, the control device can, in a further variant, determine a travel route of the motor vehicle specified by a navigation device. A navigation device is a device, a device component or a device group that is set up to create travel routes and for navigation guidance. The navigation device can preferably be designed as a navigation device or navigation system of the motor vehicle.

The control device can then determine an upcoming change in direction based on location data of the motor vehicle, which describe a geographical position of the motor vehicle, and / or based on route guidance data, which describe a course of the travel route, and activate the direction indicator based on the determined change in direction using the control signal provided steer. Routing data can be, for example, map data and/or data collected using traffic sign recognition.

Additionally or alternatively, the control device can omit, block or withdraw the provision and/or transmission of the control signal for activating the direction indicator if the traffic situation does not allow the travel route to be followed safely or if several driving maneuvers are to be carried out before turning. The itinerary cannot be followed safely if, for example, the predicted one Describe the driver's intention to change lanes to the wrong lane if a turning lane is blocked, in the case of high traffic volumes, and in a situation of several motor vehicles driving parallel.

Additionally or alternatively, the control device can receive environmental observation data, preferably via vehicle-to-X communication or via its own sensors, for example via radar or LIDAR data. The environment observation data describes an environment of the motor vehicle in the traffic situation. If a current traffic situation and/or several pending driving maneuvers have to be carried out before turning, the control device can generate an advisory signal and transmit it to an output device of the motor vehicle, for example to a screen and/or a loudspeaker. The information signal generated and, for example, output by a screen can describe an indication of the several upcoming driving maneuvers.

Additionally or alternatively, the control device can determine or predict the completion and/or cancellation of a currently initiated driving maneuver based on the received driver control data, and control the deactivation of an activated direction indicator. For example, a currently initiated driving maneuver can be completed if the turn was successful, while the driving maneuver can be canceled if the driver does not turn.

With such a fusion with navigation data, the control of the direction indicator can be optimized, for example at construction sites, where, for example, the navigation system does not yet have any information that a lane has been closed due to the construction site. Preferably, camera data that monitors the surroundings of the motor vehicle can also be included, with the control device then being able to determine, for example, the construction site or the closed lane through, for example, image analysis.

In a further variant, the control device can support route-based control of the direction indicators through the driving intention recognition. For this purpose, the control device can receive driver observation data from a sensor device of the motor vehicle, i.e. from a device, a device group or a device component for detecting properties of the environment. The sensor device can preferably include a camera for monitoring the interior. In this variant, the control device can derive the behavior of the driver while driving based on the received driver observation data, and can additionally determine the target control of the direction indicator of the direction indicator device based on the derived driving behavior.

An example of a route-based direction indicator that is supported by driving intention recognition using driver observation is if the driver plans to stop following a travel route. The direction indicator cannot then be activated or can be deactivated again before the driving maneuver is completed. Here too, the direction indicator can optionally be deactivated automatically after the driving maneuver has been completed.

For example, if the driver wants to take a break and the driver's intention is, for example, to drive to a rest area, the direction indicators can be set much more precisely if the driver pulls in or out late.

In a variant relating to the warning flashing of the motor vehicle, the control device can use the traffic situation to determine a target control which provides for the activation of the warning flashing, and the control signal provided can describe the activation of the warning flashing. This also optimizes the use of the direction indicator device with regard to warning flashing.

Examples of this include automatic hazard warning lights or optional deactivation of the hazard lights. For this purpose, for example, data from the traffic environment of one's own vehicle and optionally from driver observation can be used, for example to recognize the collision at the end of a traffic jam or one's own vehicle as a traffic obstacle.

In particular, a traffic density can be taken into account here, which can be determined, for example, using a camera, and/or for which, for example, information from mobile online services and/or information from other infrastructures can be used. This can, for example, be information about whether there is, for example, a motor vehicle in the immediate vicinity that has been involved in an accident and whose driver has set up a warning triangle.

The invention also includes the control device. The control device can have a data processing device or a processor device that is set up to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and/or at least one microcontroller and/or at least have an FPGA (Field Programmable Gate Array) and/or at least one DSP (Digital Signal Processor). Furthermore, the processor device can have a program code that is designed to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device. The control device can preferably be designed as a control device, control chip, computer, control device or user program (“app”).

Preferably, the control device can include the deep learning engine. The deep learning engine can preferably be set up to carry out the above-mentioned steps of a deep learning engine.

The above object is achieved by a server device for operation on the Internet, for example a data server, a backend and/or a data cloud, the server device having an embodiment of the storage medium according to the invention and/or an embodiment of the control device according to the invention. The server device is in particular a server device external to the motor vehicle.

The invention also includes a motor vehicle which has a direction indicator device and an embodiment of the control device according to the invention. The motor vehicle is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

The invention also relates to a computer or a computer program product, comprising instructions which, when the program is executed by a computer, cause the computer to carry out an embodiment of the method according to the invention.

The invention also relates to a computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to carry out an embodiment of the method according to the invention.

The invention also includes developments of the control device according to the invention, the server device according to the invention and the motor vehicle according to the invention, which have features as have already been described in connection with the developments of the method according to the invention. For this reason, the corresponding developments of the control device according to the invention, the server device according to the invention and the motor vehicle according to the invention are not described again here.

The invention also includes the combinations of the features of the described embodiments.

• 1 eine schematische Darstellung zu einem ersten Ausführungsbeispiel des erfindungsgemäßen Verfahrens und der erfindungsgemäßen Vorrichtungen; und
• 2 eine schematische Darstellung zu einem weiteren Ausführungsbeispiel des erfindungsgemäßen Verfahrens und der erfindungsgemäßen Vorrichtungen.

Exemplary embodiments of the invention are described below. This shows:

• 1 a schematic representation of a first exemplary embodiment of the method according to the invention and the devices according to the invention; and
• 2 a schematic representation of a further exemplary embodiment of the method according to the invention and the devices according to the invention.

The exemplary embodiments explained below are preferred exemplary embodiments of the invention. In the exemplary embodiments, the components described each represent individual features of the invention that can be viewed independently of one another, which also develop the invention independently of one another and are therefore to be viewed as part of the invention individually or in a combination other than that shown. Furthermore, the exemplary embodiments described can also be supplemented by further features of the invention that have already been described.

In the figures, functionally identical elements are each provided with the same reference numerals.

The 1 illustrates the principle of the method according to the invention and the device according to the invention using a first exemplary embodiment. In other words, it shows 1 a system overview. The shows this 1 a motor vehicle 10, for example a passenger car, which can include the control device 12. The control device 12 can, for example, be designed as a control device or control chip and have a communication interface 14, preferably a communication interface 14 for motor vehicle-to-X communication. A mobile phone connection and/or an Internet connection can preferably be used for data communication. Optionally, the motor vehicle 10 can have an antenna 15 for, for example, determining the positioning of the motor vehicle, for example for receiving location data of the motor vehicle, for example a GPS receiver; and/or, for example, a DAB+ antenna, a radio antenna and/or an antenna 15 for mobile online services. The antenna 15 can then preferably be part of the communication interface 14.

Within the motor vehicle 10, in particular for communication with a direction indicator device 16, communication can take place via a wired data communication connection 18, for example a data bus of the motor vehicle 10, or also with a common wireless data communication connection 18, for example a WiFi connection or Bluetooth LE- Connection.

Optionally, the control device 12 can include a processor device 20 and/or a data memory 22.

The direction indicator device 16 can be in the example of 1 as a direction indicator preferably include two direction indicators 24 on a motor vehicle front, two side direction indicators 26, and two direction indicators 28 on the rear of the motor vehicle. For reasons of better clarity, the data communication connections 18 of the direction indicators 24, 26, 28 are to the direction indicator device 16 1 Not shown.

In the 1 an optional deep learning engine 30 is shown as a component of the control device 12. Alternatively to the representation in the figure, the deep learning engine 30 can also be, for example, a deep learning engine 30 external to the vehicle, which can, for example, be part of a data server external to the vehicle (not shown in the figure). Accordingly, the data transmission between control device 12 and a deep learning engine 30 external to the vehicle can take place via, for example, a mobile phone connection or Internet connection.

A sensor device 32 of the motor vehicle 10 can ideally have a front sensor system 34 with, for example, a radar and/or a LIDAR and/or an ultrasound-based sensor. Additionally or alternatively, the sensor device 32 can include a front camera 36 and, optionally, a driver observation sensor system (in the 1 Not shown). Such an optional driver observation sensor can be located inside the motor vehicle 10 (in the 1 not visible). Advantageously, the sensor device 32 can additionally include a rear sensor system 38, which can preferably have a radar and/or a LIDAR and/or a camera and/or an ultrasound-based sensor system.

In the example of 1 the control device 12 in S1 receives traffic situation data, for example via the communication interface 14, which can describe, for example, a traffic jam or a busy multi-lane road. In addition, the control device 12 receives driver control data in S2, which describes, for example, the driver's steering behavior, as well as longitudinal acceleration. Corresponding steering wheel sensors and acceleration sensors are known to those skilled in the art from the prior art. For example, if the motor vehicle 10 drives close to another motor vehicle in front (in the 1 not shown) and the driver steers clearly to the left, the control device 12 can predict, for example, an overtaking maneuver as the driver's intention (S3).

Optionally, in S4, the control device 12 can transmit the traffic situation data and the driver control data to the deep learning engine 30 (S4) and then operate it (S5), determine a driver intention forecast (S6) and derive the overtaking maneuver based on the driver intention forecast (S7 ).

As a target control for the direction indicators 24, 26, 28, the control device 12 can determine an activation of the left front direction indicator 24 (S8). The control device 12 can generate a corresponding control signal (S9) and transmit this to the direction indicator device 16 (S10).

Optionally, it can be provided that the control device 12 checks beforehand (S11) whether the driver activates the left front turn signal on his own initiative. Since this is the case, for example, in the example of 1 cannot be the case, the control signal is provided by the control device 12 (S9) and transmitted to the direction indicator device 16 (S10).

For example, if the driver has only lightly tapped the steering column switch to operate the left direction indicator 24 and thus initiated comfort flashing, the control device 12 can specify the duration of the flashing based on the predicted lane change (S12), so that the left front direction indicator 24 is not only activated three to five times flashes, but for example ten times, or until the motor vehicle 10 is in the left lane. Ideally, the control device 12 can then deactivate the direction indicator 24 again (S13).

Location data that the control device 12 receives, for example via the communication interface 14 from a satellite or a data server external to the vehicle (in the 1 not shown), and based on a course of a travel route, the control device 12 can determine in S14, for example, that the motor vehicle 10 is in Shortly you have to switch back to the right lane and turn right. The right front direction indicator 24 can then be controlled accordingly (S15). If the control device 12 receives environmental observation data (S16), they can, for example, describe a current traffic situation, for example a traffic jam, and accordingly the control device 12 can generate an indication signal indicating the traffic jam (S17) and send it to an output device of the motor vehicle 10, for example Example of a screen of a combination instrument, transferred (S18). Optionally, the traffic environment can be evaluated (S21).

If the sensor device 32 additionally receives driver observation data (S19), the driver's behavior while driving can be derived (S20) and this can be taken into account when determining S8 the target control of the direction indicators 24, 26, 28. Such driver observation data can, for example, describe the driver's facial expressions or how the driver generally behaves in the motor vehicle. An optional driver observation sensor system can preferably include one or more interior cameras.

The 2 shows an exemplary action diagram for a further embodiment of the method according to the invention. The 2 shows a server device 40 external to the vehicle, which can be designed, for example, as a backend or data cloud. The control device 12, which can be designed, for example, as an “electronic control unit” (“ECU”), i.e. as a microcontroller or control device, can include the deep learning engine 30, which uses artificial intelligence to evaluate the traffic accident, the driving intention and optionally can also take over the navigation. Alternatively, the server device 40 may have the deep learning engine 30, which is then in close communication with the control device 12.

The control device 12 can preferably take over the sensor and/or data fusion S22.

In addition to the method already described above, the data sets can also be summarized in a vehicle data set 42, which can preferably be used for user-centered learning S23. For user-centered learning S23 using the vehicle data set 42, a user-specific basic model can be provided that can specify how the deep learning engine 30 should react. The basic model can describe the driver's user preferences, learned route data in which the driver 56 has correctly set the direction indicator 24, 26, 28, and/or legal requirements. The deep learning engine 30 can optionally also learn if, for example, the driver 56 corrects a control of the deep learning engine 30.

For example, data 44 about route planning, data from the longitudinal pole switch and/or hazard warning lights can be received as input data and input signals. Preferably, additional location data 46 can be included, which can be received via a location signal, for example a GPS signal. Further input data and input signals can be: sensor signals 48 from, for example, the front sensor system 34, in particular data from radar, camera, ultrasound, and/or LIDAR; data 50 provided by corresponding signals from online services and/or DAB+ traffic data; Data 52 that can be sent and received via motor vehicle-to-X by appropriate signals; and sensor data 54 from a rear sensor system 38, in particular data from a rear radar, from an ultrasound-based rear sensor system, a rear camera and/or LIDAR.

The evaluation from S21 can then be provided, for example, as a display S24 in, for example, a combination instrument, and in the form of the control signal generated in S9 for activating and / or deactivating the direction indicator 24, 26, 28 or the direction indicators 24, 26, 28, and /or a hazard warning light system (S25). The display S24 allows a driver 56 to be much better informed. The activation and/or deactivation of the direction indicators 24, 26, 28 (S25) helps other road users 58 to adapt very well to the driving behavior of the motor vehicle 10.

Overall, the exemplary embodiments show how an autonomous direction indicator 24, 26, 28 and hazard warning lights, preferably based on artificial intelligence, are made possible.

• 1) Automatische Unterscheidung zwischen Komfortblinken (3-5 maliges Blinken) und (dauerhaftem) Blinken:
  • - Blinkerhebel wird manuell betätigt (ohne Rastung); und/oder
  • - Es wird automatisch die Dauer des Blinkens reguliert (Spurwechsel >> kurz, 3-5 Mal, Abbiegen >> lang, dauerhaft) ; und/oder
  • - Dabei kann zum Beispiel zwischen Losfahren, Anhalten, Spurwechsel und dem Einordnen kurz vor einer Abbiegung oder dem geplanten Abbiegen unterschieden werden; und/oder
  • - Der Blinker wird jeweils automatisch nach der Beendigung des Manövers (zum Beispiel Abbiegevorgang, Spurwechsel) deaktiviert
• 2) Routenbasierter Fahrtrichtungsanzeiger 24, 26, 28
  • - Die Fahrt folgt einer mithilfe des Navigationssystems geplanten Route; und/oder
  • - An Wegpunkten dieser Route, an denen eine Richtungsänderung vorgesehen und angezeigt werden muss erfolgt eine automatische Ansteuerung des Fahrtrichtungsanzeigers 24, 26, 28, vorzugsweise mithilfe der künstlichen Intelligenz; und/oder
  • - Informationen über die Streckenführung, anhand derer über die Notwendigkeit der Anzeige entschieden werden kann, können den Kartendaten und/oder der Verkehrszeichenerkennung entnommen werden; und/oder
  • - Wenn es die Verkehrs- und Fahrsituation nicht zulässt, dass der Route sicher gefolgt werden kann (zum Beispiel falscher Fahrstreifen, blockierte Abbiegespur, hohes Verkehrsaufkommen, parallel fahrende Fahrzeuge) oder allgemein mehrere Fahrmanöver vor dem des Abbiegens durchgeführt werden müssen, kann der Fahrtrichtungsanzeiger 24, 26, 28 nicht angesteuert werden
  • - Informationen über die Verkehrslage oder die Anzahl notwendiger Fahrmanöver vor dem Abbiegen, kann mithilfe der Kl aus einer Fusion der Informationen aus der Umfeldbeobachtung erfolgen (zum Beispiel Car2X, Radar, LIDAR)
  • - In diesen Fällen könnte frühzeitig und eventuell erneut auf das anstehende Manöver (zum Beispiel dem Folgen der Route) hingewiesen werden; und/oder
  • - Wird das Manöver abgeschlossen (z.B. Abbiegen erfolgreich) oder abgebrochen (zum Beispiel nicht abgebogen), kann der Fahrtrichtungsanzeiger 24, 26, 28 automatisch deaktiviert werden.
• 3) Routenbasierter Fahrtrichtungsanzeiger 24, 26, 28 unterstützt durch Fahrabsichtserkennung
  • - Im Vergleich zum zuvor Beschriebenen kann die vorzugsweise mithilfe einer künstlichen Intelligenz eine Fahrerbeobachtung als zusätzlicher Parameter in die Ansteuerung des Fahrtrichtungsanzeigers 24, 26, 28 mit eingehen; und/oder
  • - Wird vor oder während eines Manövers erkannt, dass sich die Fahrabsicht des Fahrers geändert hat, zum Beispiel er plant der Route nicht weiter zu folgen, kann der Fahrtrichtungsanzeiger 24, 26, 28 nicht angesteuert werden, beziehungsweise vor der Beendigung des Manövers wieder deaktiviert werden; und/oder
  • - Auch hier kann nach dem Abschluss des Manövers der Fahrtrichtungsanzeiger 24, 26, 28 automatisch deaktiviert werden.
• 4) Fahrtrichtungsanzeiger 24, 26, 28 entsprechend der Fahrabsicht
  • - Im Vergleich zum zuvor Beschriebenen kann die vorzugsweise mithilfe einer künstlichen Intelligenz auf Basis von Fahrzeugsensoren abgeschätzte Fahrabsicht ein geplantes Fahrmanöver frühzeitig erkennen und der Fahrtrichtungsanzeiger 24, 26, 28 geschaltet werden; und/oder
  • - So kann zum Beispiel eine Unterscheidung zwischen dem geplanten Abbiegen und geplanten Spurwechsel auf Basis der Fahrabsichtserkennung erfolgen; und/oder
  • - Der Blinkvorgang dauert so lange, bis das Fahrmanöver vollständig abgeschlossen ist.
• 5) Automatisches Warnblinken
  • - In Situationen, in denen das Warnblinken nach der Straßenverkehrsordnung erforderlich ist oder als allgemein gebräuchliche Warnung verwendet wird, aktiviert und deaktiviert vorzugsweise die künstliche Intelligenz den Warnblinker automatisch; und/oder
  • - Dazu können Daten aus dem Verkehrsumfeld und des eigenen Fahrzeugs sowie der Fahrerbeobachtung verwendet werden, um zum Beispiel das Auffahren auf ein Stauende oder das eigene Fahrzeug als Verkehrshindernis zu erkennen.

In order to counteract the problem situations described at the beginning, the direction indicators 24, 26, 28 and hazard warning lights can be switched on and off in accordance with the following embodiment variants, whereby the following embodiment variants can optionally also be combined in different combinations:

• 1) Automatic distinction between comfort flashing (3-5 flashes) and (continuous) flashing:
  • - Indicator lever is operated manually (without detent); and or
  • - The duration of the flashing is automatically regulated (lane change >> short, 3-5 times, turning >> long, permanent) ; and or
  • - For example, a distinction can be made between driving off, stopping, changing lanes and getting into the lane shortly before a turn or the planned turn; and or
  • - The turn signal is automatically deactivated after the maneuver has been completed (e.g. turning, changing lanes).
• 2) Route-based direction indicators 24, 26, 28
  • - The journey follows a route planned using the navigation system; and or
  • - At waypoints on this route where a change of direction must be planned and displayed, the direction indicator 24, 26, 28 is automatically activated, preferably with the help of artificial intelligence; and or
  • - Information about the route, which can be used to decide whether the display is necessary, can be obtained from the map data and/or traffic sign recognition; and or
  • - If the traffic and driving situation does not allow the route to be followed safely (e.g. wrong lane, blocked turning lane, high traffic volume, vehicles driving parallel) or generally several driving maneuvers have to be carried out before turning, the direction indicator 24 can be used , 26, 28 cannot be controlled
  • - Information about the traffic situation or the number of necessary driving maneuvers before turning can be obtained using the Kl from a fusion of information from surrounding observation (e.g. Car2X, radar, LIDAR)
  • - In these cases, the upcoming maneuver (e.g. following the route) could be pointed out early and possibly again; and or
  • - If the maneuver is completed (e.g. turning successfully) or canceled (e.g. not turning), the direction indicator 24, 26, 28 can be automatically deactivated.
• 3) Route-based direction indicators 24, 26, 28 supported by driving intention recognition
  • - In comparison to what was described above, driver observation can be included as an additional parameter in the control of the direction indicator 24, 26, 28, preferably with the help of artificial intelligence; and or
  • - If it is recognized before or during a maneuver that the driver's driving intention has changed, for example he does not plan to continue following the route, the direction indicator 24, 26, 28 cannot be activated or can be deactivated again before the maneuver is completed ; and or
  • - Here too, the direction indicators 24, 26, 28 can be deactivated automatically after the maneuver has been completed.
• 4) Direction indicators 24, 26, 28 according to the driving intention
  • - In comparison to what was described above, the driving intention, which is preferably estimated using artificial intelligence based on vehicle sensors, can detect a planned driving maneuver at an early stage and the direction indicator 24, 26, 28 can be switched; and or
  • - For example, a distinction can be made between planned turning and planned lane changes based on driving intention recognition; and or
  • - The flashing process lasts until the driving maneuver is completely completed.
• 5) Automatic warning flashing
  • - In situations where hazard warning lights are required by the Highway Code or used as a common warning, artificial intelligence preferably activates and deactivates the hazard lights automatically; and or
  • - For this purpose, data from the traffic environment and your own vehicle as well as driver observation can be used, for example to recognize driving into the end of a traffic jam or your own vehicle as a traffic obstacle.

Example scenarios:

• Der Fahrer möchte das der Fahrtrichtungsanzeiger 24, 26, 28 automatisch betätigen, zum Beispiel:
  • - Der Fahrer fährt rechts ran, um andere Verkehrsteilnehmer zu informieren/warnen.
  • - Der Fahrer fährt vom Fahrbahnrand wieder los, um den rückwärtigen Verkehr zu informieren/warnen.
  • - Der Fahrer parkt aus.
  • - Der Fahrer schert zum Überholen aus.
  • - Es ist während des Überholvorgangs wieder sicher einzuscheren.
  • - Der Fahrer schert nach dem Überholvorgang wieder ein.
  • - Der Fahrer möchte sich von einem Beschleunigungsstreifen einsortieren.
  • - Der Fahrer beabsichtigt abzubiegen.
  • - Der Fahrer beabsichtigt die Spur zu wechseln.
  • - Der Fahrer beabsichtigt zu wenden.

The autonomous switching of the direction indicator 24, 26, 28 can be used, for example, in the following situations:

• The driver would like to activate the direction indicators 24, 26, 28 automatically, for example:
  • - The driver pulls over to the right to inform/warn other road users.
  • - The driver drives away from the edge of the road to inform/warn the traffic behind.
  • - The driver pulls out.
  • - The driver pulls out to overtake.
  • - It must be safely cut back in during overtaking.
  • - The driver pulls back in after overtaking.
  • - The driver wants to move out of an acceleration lane.
  • - The driver intends to turn.
  • - The driver intends to change lanes.
  • - The driver intends to turn.

• - der Fahrer das Ausparken beendet hat.
• - der Überholvorgang abgeschlossen ist.
• - der Überholvorgang abgebrochen wurde.
• - der Fahrer sich vom Beschleunigungsstreifen wieder einsortiert hat.
• - der Fahrer das Abbiegen beendet hat.
• - der Fahrer das Abbiegen abgebrochen hat.
• - der Fahrer die Spur gewechselt hat.
• - der Fahrer das Spurwechselmanöver abgebrochen hat.
• - das Wendemanöver des Fahrers abgeschlossen ist.
• - der Fahrer das Wendemanöver abgebrochen hat.

The driver wants the direction indicator 24, 26, 28 to be deactivated automatically if, for example:

• - the driver has finished pulling out of the parking space.
• - the overtaking process is completed.
• - the overtaking process was aborted.
• - the driver has moved back from the acceleration lane.
• - the driver has finished turning.
• - the driver stopped turning.
• - the driver changed lanes.
• - the driver has aborted the lane change maneuver.
• - the driver's turning maneuver is completed.
• - the driver has aborted the turning maneuver.

Advantageously, there is an automatic adaptation of the control of the direction indicator 24, 26, 28 to, for example, legal regulations in different countries (for example flashing in roundabouts); as well as only sensible and correct use of the direction indicators 24, 26, 28 and/or the hazard warning lights.

• - Navigations- und Streckendaten (zum Beispiel GPS gestützt) inklusive Routenplaner
• - Multifunktionskamera (vorzugsweise Verkehrszeichen-, Fahrspur-/Fahrbahn- und Objekterkennung)
• - Weitere Fahrzeugsensorik und Informationskanäle zur Beobachtung des Verkehrsumfelds, zum Beispiel: Car-2-X, Front- und/oder Heckradar, LIDAR, Ultraschall, und/oder Fahrerabsichterkennung und/oder Fahrerbeobachtung (zum Beispiel Innenraumkameras, Lenkwinkelsensoren, Kapazitives Lenkrad, Pedal- und Sitzsensoren, Geschwindigkeit), und/oder Recheneinheit (das heißt die Steuereinrichtung 12) mit optionaler künstlicher Intelligenz, Lenkstockschalter zur Betätigung des Fahrtrichtungsanzeigers 24, 26, 28, Warnblinktaster, vorgeschriebene Fahrtrichtungsanzeiger 24, 26, 28 / Blinkleuchten am Fahrzeug. Bedienelemente wie Lenkstockschalter und/oder Warnblinktaster können, falls nicht gesetzlich vorgeschrieben, bei vollständig autonomen Systemen entfallen.

Optional system components (can also be combined):

• - Navigation and route data (e.g. GPS supported) including route planner
• - Multifunctional camera (preferably traffic sign, lane/roadway and object detection)
• - Other vehicle sensors and information channels for observing the traffic environment, for example: Car-2-X, front and/or rear radar, LIDAR, ultrasound, and/or driver intention detection and/or driver observation (for example interior cameras, steering angle sensors, capacitive steering wheel, pedal and seat sensors, speed), and/or computing unit (i.e. the control device 12) with optional artificial intelligence, steering column switch for actuating the direction indicators 24, 26, 28, hazard warning lights, prescribed direction indicators 24, 26, 28 / flashing lights on the vehicle. Controls such as steering column switches and/or hazard warning lights can be omitted in fully autonomous systems unless required by law.

The characteristics can apply depending on the equipment variant (the number/type of sensors available).

Effect diagram (see Fig. 2)

The approach does not require driver observation (driver model) and offers a generic model with all the information from the vehicle sensors, which always correctly activates and/or deactivates the direction indicator 24, 26, 28 based on, for example, the legal requirements and the traffic situation.

Preferably, a generic, pre-trained driver observation model can also be stored, which adapts to the driver during runtime. This could also be used as fine tuning of the algorithm based on driver preferences within the framework of legal regulations.

Reference symbol list

10

motor vehicle

12

Control device

14

Communication interface

15

antenna

16

Direction indicator device

18

Data communication connection

20

Processor setup

22

Data storage

24

Direction indicators

26

Direction indicators

28

Direction indicators

30

Deep learning engine

32

Sensor device

34

Front sensors

36

Front camera

38

Rear sensors

40

Server device

42

Vehicle record

44

Data

46

Data

48

Sensor data

50

Data

52

Data

54

Sensor data

56

driver

58

Road users

S1 - S24

Procedural steps

QUOTES INCLUDED IN THE DESCRIPTION

This list of documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• WO 2010/045908 A1 [0003]
• US 2019/0077308 A1 [0004]

Claims (11)

Method for operating a direction indicator device (16) of a motor vehicle (10), wherein a control device (12): - receives traffic situation data from a motor vehicle system of the motor vehicle (10), which describe a traffic situation in which the motor vehicle (10) is located (S1), - Receives driver control data describing operation of the motor vehicle (10) by its driver (S2), - based on the received driver control data, a driver's intention is predicted in relation to a driving maneuver planned by the driver in the traffic situation described (S3), - based on the traffic situation described by the received traffic situation data and based on the predicted driver intention, a target control of the direction indicators (24, 26, 28) of the direction indicator device (16) is determined (S8), the control of one or more direction indicators (24) assigned to the traffic situation described , 26, 28) of the direction indicator device (16), - Provides a control signal (S9) that describes the determined target control, and - transmits the control signal provided to the direction indicator device (16) (S10). Procedure according to Claim 1 , wherein the control device (12): - provides the traffic situation data and the driver control data and transmits it to a deep learning engine (30) (S4), - the deep learning engine (30, S5), in which a large number of Different driver intentions assigned to traffic situation data and driver control data are statistically summarized, operates to process the traffic situation data and driver control data provided and thereby determine a driver intention forecast (S6), the driver intention forecast comprising a probability with which the driver intends a driving maneuver, and - the deep Learning engine (30) operates in order to derive a driving maneuver as the driver's intention based on the driver's intention prediction (S7), which the driver intends with a predetermined minimum probability. Method according to one of the preceding claims, wherein the control device (12): - checks (S11) whether the received driver control data describes actuation of the direction indicator device (16) in accordance with the determined target control, and - The control signal is only provided (S9) if the received driver control data describes an actuation of the direction indicator device (16) that deviates from the determined target control. Method according to one of the preceding claims, wherein the predicted driver intention describes an actuation of one of the direction indicators (24, 26, 28), and wherein the control device (12) distinguishes between a comfort flashing and a permanent flashing when a manual actuation of the direction indicator lever is detected, and: - depending on whether the predicted driver's intention describes a lane change, a departure of the motor vehicle (10), a placement of the motor vehicle (10) in a lane or a turning process: specifies a duration of the flashing (S12); and or - the activated direction indicator (24, 26, 28) is deactivated after completing the driving maneuver (S13). Method according to one of the preceding claims, wherein the control device (12) determines a travel route of the motor vehicle (10) specified by a navigation device, and: - based on location data of the motor vehicle (10), which describe a geographical position of the motor vehicle, and/or route guidance data which describe a course of the travel route, an upcoming change in direction is determined (S14), and based on the determined change in direction, the control signal provided is activated Direction indicator (24, 26, 28) controls (S15); and or - omits the provision (S9) and/or transmission (S10) of the control signal for activating the direction indicator (24, 26, 28) if the traffic situation does not allow the travel route to be followed safely, or if several driving maneuvers are required before turning should be carried out, and/or - Receives environment observation data (S16) which describes an environment of the motor vehicle (10) in the traffic situation; and, if a current traffic situation and/or several upcoming driving maneuvers have to be carried out before a turn, an advisory signal is generated (S17) and transmitted to an output device of the motor vehicle (10) (S18), the generated advisory signal describing an indication of the several upcoming driving maneuvers ; and or - based on the received driver control data, determines or predicts completion and/or cancellation of a currently initiated driving maneuver, and controls deactivation of an activated direction indicator (24, 26, 28). Method according to one of the preceding claims, wherein the control device (12): - receives driver observation data from a sensor device (32) of the motor vehicle (10). (S19), - derives driver behavior of the driver while driving based on the received driver observation data (S20), and, - the target control of the direction indicators (24, 26, 28) of the direction indicator device (16) is additionally determined based on the derived driver behavior (S8 ). Method according to one of the preceding claims, wherein the control device (12) uses the traffic situation to determine a target control (S8) which provides for activation of a hazard warning light, and wherein the control signal provided describes the activation of the hazard warning light. Control device (12) which is set up to carry out a method according to one of the preceding claims. Control device (12). Claim 8 , which includes a deep learning engine (30) which is set up to carry out the steps relating to the deep learning engine (30). Server device (40) for operation on the Internet, which has a control device (12). Claim 8 or 9 having. Motor vehicle (10), which has a direction indicator device (16), and a control device (12). Claim 8 or 9 .

Images