EP3546308B1 - Method for operating a control device, motor vehicle and computer program - Google Patents

Method for operating a control device, motor vehicle and computer program Download PDF

Info

Publication number
EP3546308B1
EP3546308B1 EP19152380.2A EP19152380A EP3546308B1 EP 3546308 B1 EP3546308 B1 EP 3546308B1 EP 19152380 A EP19152380 A EP 19152380A EP 3546308 B1 EP3546308 B1 EP 3546308B1
Authority
EP
European Patent Office
Prior art keywords
data
motor vehicle
control device
collision
environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19152380.2A
Other languages
German (de)
French (fr)
Other versions
EP3546308A1 (en
Inventor
Christian Al Haddad
Alejandra Escudero Chaverra
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Audi AG
Original Assignee
Audi AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Audi AG filed Critical Audi AG
Publication of EP3546308A1 publication Critical patent/EP3546308A1/en
Application granted granted Critical
Publication of EP3546308B1 publication Critical patent/EP3546308B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/08Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/08Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841Registering performance data
    • G07C5/085Registering performance data using electronic data carriers
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/08Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841Registering performance data
    • G07C5/085Registering performance data using electronic data carriers
    • G07C5/0866Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera

Definitions

  • the invention relates to a method for operating a control device of a motor vehicle, the control device being designed for fully automatic guidance of the motor vehicle by evaluating driving situation data including environment data from at least one environment sensor of the motor vehicle, which are fed to the control device.
  • the invention also relates to a motor vehicle and a computer program.
  • Input situations from different information sources are merged within a control unit of the vehicle system in order to evaluate input data, which in particular include driving situation data describing the current driving situation, to determine control signals describing driving interventions to corresponding actuators of the motor vehicle.
  • input data which in particular include driving situation data describing the current driving situation
  • control signals describing driving interventions to corresponding actuators of the motor vehicle.
  • control signals are sent to actuators that perform driving interventions, for example a motor, a steering device and the like.
  • Environment data which are supplied by various environment sensors of the motor vehicle, represent a significant portion of the driving situation data.
  • environment sensors can include, for example, radar sensors, lidar sensors, ultrasonic sensors and, in particular, cameras, the image data of which, as environmental data, can usually be evaluated by various image processing algorithms and converted into useful information describing the driving situation. Due to the high quality and thus the amount of image data of modern cameras, it is known to use high-speed data connections and high-speed interfaces to the control device in order to be able to transmit the large amount of image data generated to the control device quickly, so that the image data in the contained information describing the driving situation can be reacted to as quickly as possible.
  • the control devices themselves have a mostly rather small-sized buffer memory in which driving situation data from at least one previous time step can also be held, in particular also with regard to tracking changes in the driving situation.
  • DE 100 29 401 A1 relates to a method for event-related storage of vehicle system data, an interface to a vehicle system bus being used.
  • Vehicle system bus data present on the vehicle system bus can be stored in a memory upon receipt of a storage command via the vehicle system bus.
  • driver command data and boundary condition data are recorded.
  • the storage event can be a recognized vehicle accident.
  • Such an approach also only reacts when an accident has occurred and has the further disadvantage that the vehicle system bus is often significantly too slow, which means that further delays occur which can lead to no data at all being transferred in the event of a power failure or the like in an accident the driver's operating activities can be saved more.
  • DE 10 2004 045 813 A1 relates to a system and a method for predictive detection of an accident risk situation.
  • it is sensed in the blind spot of the motor vehicle in order to be able to detect data relating to a potential accident object.
  • At least one suitable occupant protection measure can be activated as a function of the data recorded by the blind spot sensor device.
  • the probability of a side accident can be estimated in different ways using suitable algorithms.
  • Other possibilities for increasing the safety of vehicle occupants, in particular the driver, who monitor for collisions, have also already been proposed.
  • EP 0 891 903 A2 relates to an automatic emergency braking function, which is intended to give the driver a high degree of decision-making authority when avoiding obstacles, without foregoing the advantages of a collision limitation system that supports the driver in the event of an actual collision situation. Accordingly, provision is made to give the driver of the vehicle the opportunity for as long as possible to avoid the collision by taking actions himself, such as braking and / or steering operations. Only when a collision can clearly no longer be avoided due to the physical driving conditions resulting from the driving state of the vehicle and the collision constellation, is the vehicle braked before the collision by an automatically triggered and preferably strongest possible deceleration This minimizes the consequences of accidents for the driver and vehicle.
  • the environmental data or sensor signals supplied by the detection device there can be stored in a memory device, in particular also image signals from a camera device.
  • DE 10 2013 212 092 A1 relates to a method and a device for operating a pedestrian protection device of a vehicle.
  • a type of collision object is to be determined, and with regard to the data of the environment sensors that describe this collision object, a freeze state can be established when a threshold value for the impact probability is exceeded, in order to have data about the collision object in any case.
  • DE 10 2016 222 219 A1 relates to a driver assistance system for a motor vehicle in which the vehicle's geographic positions, which have an increased probability of triggering a collision avoidance system, are stored in a self-learning manner in order to take into account the stored vehicle position in preparation for a hazard warning or emergency braking when the spatial environment is driven again. Further data can also be saved with the vehicle position.
  • DE 10 2015 218 762 A1 discloses a method and apparatus for accident data storage for a vehicle. It is proposed there, in the event of an imminent vehicle accident being detected, not only to give accident-relevant vehicle data to an interface to an in-vehicle storage device for storing the accident-relevant vehicle data, but also to an interface to a transmission device for transmitting the accident-relevant vehicle data to at least one external storage device for Saving the vehicle data relevant to the accident. It can thus be achieved that no information can be lost which could be important for reconstructing the accident.
  • DE10231558 discloses the automatic triggering of a deceleration of a vehicle, with data from an environment sensor system with which the vehicle is equipped and data describing the vehicle's own movement being read in to determine a current hazard potential, which is compared with a threshold value or a triggering threshold to trigger a preparation of a braking system or a braking.
  • the invention is based on the object of specifying a possibility for better documentation of accidents in a fully automatically operated motor vehicle.
  • the invention therefore proposes to provide a dedicated, additional storage means within the control unit itself and also to generate a trigger signal within the control unit itself by evaluating driving situation data, which indicates a very likely impending collision accident of the motor vehicle in order to continuously read at least part of the current environment data to store this storage means, so that an excellent basis is created for evaluating the occurrence of the accident at a later point in time, for example with regard to a question of guilt and / or a possibly occurring error in the fully automatic driving of the motor vehicle.
  • the storage means is preferably used in addition to a smaller, continuously used buffer memory of the control device, so that even larger amounts of data, as can be expected from image data from a camera, for example, can be held within the storage means over the longer period of time.
  • the present invention makes particular use of the fact that, on the one hand, it has already been proposed in the prior art to determine collision probabilities from driving situation data, and on the other hand, the corresponding driving situation data are already available within the control unit, which also controls the fully automatic guidance of the motor vehicle , so that a collision probability can also be determined here, which can be used to trigger a trigger signal, which therefore allows environment data (and preferably also further driving situation data and / or operating data of the motor vehicle) to be started before a collision occurs Record documentation within the control unit. An additional documentation period is thus gained.
  • a storage means is used that allows fast access times.
  • An SSD and / or eMMC can therefore preferably be used as the storage means, so that the documentation data useful for documentation, in particular the part of the surrounding data, can be saved as quickly as possible in the event of an impending accident.
  • the trigger signal is an internal signal of the control unit, ensures maximum utilization of the available time Saving at least the part of the environment data and possibly further documentation data.
  • the part of the environment data to be stored when the threshold value is exceeded by the collision probability is selected to include at least image data from a camera as the environment sensor.
  • the part of the surroundings data to be stored can preferably also include radar data from a radar sensor as an surroundings sensor, since radar data can also provide particularly useful information when analyzing an accident, in particular on the relative speeds and / or distances.
  • the environment data, in particular the part of the environment data to be stored is at least partially transmitted to the control device via a high-speed interface.
  • the threshold value can expediently be selected in a range from 40 to 70%, in particular as 50%.
  • a value of 50% has proven to be useful when using conventional algorithms for determining the collision speed, as they are known in the prior art, in order to obtain both a suitably dimensioned period of time before the actual collision, but not to do so often to generate the trigger signal, thus covering too many cases of false alarms that are not followed by an actual accident.
  • the trigger signal when the trigger signal is received, at least a part of the memory space stored in an earlier period of time is available in the case of a free storage space in the storage means which falls below a limit value Environment data are deleted. In this way, sufficient or, in particular, all of the free storage space of the storage means is available and can be used for relevant data.
  • previously stored environmental data can also be deleted, for example if, without the occurrence of an actual accident, after the threshold value has been exceeded by the collision probability, at least part of the environmental data was stored for a period of time until the further threshold value or the further threshold value was undershot again .
  • the same threshold value can be used for both activation and deactivation; If necessary, a slightly lower value than the threshold value for generating the trigger signal can be selected as an additional threshold value in order to avoid saving for short periods of time that is then immediately aborted and in any case to achieve continuous recording over a significant period of time, even if there is no accident. For example, 50% can be selected as the threshold value for generating the trigger signal, and 40% as the further threshold value.
  • the evaluation of the collision probability after the collision has occurred which can be detected, for example, by a collision sensor of the motor vehicle, can expediently be terminated if electrical energy is still present within the control device.
  • provision can be made, for example, to store at least part of the environment data in the storage means for a predetermined period of time after the occurrence of the collision or to end the period of storage in the storage means as soon as the collision occurs.
  • the invention also relates to a motor vehicle having a vehicle system for fully automatic guidance of the motor vehicle with a control device designed to carry out the method according to the invention and at least one environment sensor. All statements relating to the method according to the invention can be applied analogously to the motor vehicle according to the invention, with which the advantages already mentioned can therefore also be obtained.
  • a computer program according to the invention can, for example, be loaded directly into a memory of a control unit of a motor vehicle and has program means to execute the steps of a method according to the invention when the computer program is executed in the control unit of the motor vehicle.
  • the computer program can be stored on an electronically readable data carrier, which therefore includes electronically readable control information stored thereon, which record at least one computer program according to the invention and are designed in such a way that they carry out a method according to the invention when the data carrier is used in a control unit of a motor vehicle.
  • Fig. 1 shows a schematic diagram of a motor vehicle 1 according to the invention, which has a vehicle system 2 with a control unit 3 designed for completely automatic guidance of the motor vehicle.
  • the control unit 3 receives as driving situation data in addition to operating data of the motor vehicle 1 environment data from environment sensors of the motor vehicle 1, cameras 4 and radar sensors 5 being shown here by way of example.
  • a high-speed data connection with a corresponding high-speed interface on the control device 3 is used in order to have them quickly and reliably available within the control device 3, particularly in the case of larger amounts of data, such as the image data from the camera 4.
  • the driving situation data are evaluated in the control unit 3 in order to generate control signals describing driving interventions for corresponding actuators of the motor vehicle 1, a motor 6, a braking device 7 and a steering system 8 being shown here only by way of example.
  • the motor vehicle 1 can furthermore also comprise crash sensors 9 embodied as acceleration sensors, for example. These also supply their corresponding sensor data to the control unit 3.
  • crash sensors 9 embodied as acceleration sensors, for example. These also supply their corresponding sensor data to the control unit 3.
  • control device 3 shows the structure of the control device 3 in more detail. At least some of the environment data, in particular the environment data of the cameras 4, are received via a high-speed interface 10.
  • the control device 3 also has further interfaces, for example to a vehicle bus system and / or for other direct connections.
  • a guide unit 13 is used to complete the automatic guidance operation of the motor vehicle 3 is realized.
  • the computing device 12 also realizes a collision documentation unit 14.
  • Driving situation data that are evaluated by the computing device 12 are temporarily stored in a buffer memory 15 of the control device 3.
  • the control device 3 also has a memory means 16 which is larger than the buffer memory 15 in terms of memory space, in this case an SSD, in which documentation data relating to an accident of the motor vehicle 1 can be recorded.
  • the collision documentation unit 14 further evaluates the driving situation data in order to determine a collision probability of the motor vehicle 1 with a foreign object. If this probability of collision exceeds a threshold value, in this case 50%, an internal trigger signal is generated in the control unit 3, which ensures that a defined part of the environment data, together with other defined driving situation data and / or operating data of the motor vehicle 1, is continuously stored in the storage means from now on 16 is stored, whereby this can also be at least partially deleted first if the trigger signal is received, in particular if documentation data is still stored on it that originates from a driving situation in which there was a high probability of a collision but no accident occurred.
  • a threshold value in this case 50%
  • the defined, to be stored part of the environment data in the present case includes at least the image data of the cameras 4 and the radar data of the radar sensors 5.
  • the period for which such current documentation data are stored in the storage means 16 can be measured on the one hand until the collision probability is below the or another threshold value, here 40% falls. If, however, a collision actually occurs, which can be determined by the collision sensors 9, the occurrence of the collision can also mark the end of the storage; However, it is also conceivable, in particular if the power supply of the control device 3 is maintained, to store further documentation data including at least the defined part of the environment data in the storage means 16 for a predetermined period of time beyond the time of the collision.
  • documentation data is stored in a high-quality evaluation and analysis of the amount received before a collision occurs.
  • the documentation data can be read out and analyzed at a later point in time.
  • the probability of a collision can also be used for other purposes, for example in a safety system which is also implemented by the control device 3 and which preconditions the occupant restraint or the like.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Traffic Control Systems (AREA)

Description

Die Erfindung betrifft ein Verfahren zum Betrieb eines Steuergeräts eines Kraftfahrzeugs, wobei das Steuergerät zur vollständig automatischen Führung des Kraftfahrzeugs ausgebildet ist, indem Fahrsituationsdaten umfassend Umfelddaten wenigstens eines Umfeldsensors des Kraftfahrzeugs, die dem Steuergerät zugeführt werden, ausgewertet werden. Daneben betrifft die Erfindung ein Kraftfahrzeug und ein Computerprogramm.The invention relates to a method for operating a control device of a motor vehicle, the control device being designed for fully automatic guidance of the motor vehicle by evaluating driving situation data including environment data from at least one environment sensor of the motor vehicle, which are fed to the control device. The invention also relates to a motor vehicle and a computer program.

Kraftfahrzeuge mit Fahrzeugsystemen, die eine vollständig automatische Führung des Kraftfahrzeugs, mithin einen autonomen Betrieb des Kraftfahrzeugs, erlauben, wurden im Stand der Technik bereits vorgeschlagen. Dabei werden Eingangssituationen aus unterschiedlichen Informationsquellen innerhalb eines Steuergeräts des Fahrzeugsystems zusammengeführt, um als Eingangsdaten, die insbesondere die aktuelle Fahrsituation beschreibende Fahrsituationsdaten umfassen, zur Ermittlung von Fahreingriffe beschreibenden Steuersignalen an entsprechende Aktoren des Kraftfahrzeugs auszuwerten. Von dem Steuergerät, das den Betrieb des Kraftfahrzeugs vollständig automatisch, mithin autonom, steuert, werden Steuersignale an Fahreingriffe vornehmende Aktoren, beispielsweise einen Motor, eine Lenkeinrichtung und dergleichen, gesendet.Motor vehicles with vehicle systems which allow completely automatic guidance of the motor vehicle, and therefore autonomous operation of the motor vehicle, have already been proposed in the prior art. Input situations from different information sources are merged within a control unit of the vehicle system in order to evaluate input data, which in particular include driving situation data describing the current driving situation, to determine control signals describing driving interventions to corresponding actuators of the motor vehicle. From the control unit, which controls the operation of the motor vehicle completely automatically, that is to say autonomously, control signals are sent to actuators that perform driving interventions, for example a motor, a steering device and the like.

Einen wesentlichen Anteil der Fahrsituationsdaten stellen Umfelddaten dar, die von verschiedenen Umfeldsensoren des Kraftfahrzeugs geliefert werden. Derartige Umfeldsensoren können beispielsweise Radarsensoren, Lidarsensoren, Ultraschallsensoren und insbesondere auch Kameras umfassen, deren Bilddaten als Umfelddaten üblicherweise durch verschiedene Bildverarbeitungsalgorithmen ausgewertet und in nützliche, die Fahrsituation beschreibende Informationen umgewandelt werden können. Auf Grund der hohen Qualität und somit Menge der Bilddaten moderner Kameras ist es hierfür bekannt, Hochgeschwindigkeits-Datenverbindungen und Hochgeschwindigkeitsschnittstellen zu dem Steuergerät zu nutzen, um die große Menge an generierten Bilddaten schnell an das Steuergerät übermitteln zu können, so dass auf die in den Bilddaten enthaltene, die Fahrsituation beschreibende Informationen möglichst schnell reagiert werden kann. Die Steuergeräte selbst weisen dabei einen meist eher klein dimensionierten Pufferspeicher auf, in dem auch Fahrsituationsdaten wenigstens eines vorangegangenen Zeitschritts noch vorgehalten werden können, insbesondere auch im Hinblick auf die Nachverfolgung von Veränderungen in der Fahrsituation.Environment data, which are supplied by various environment sensors of the motor vehicle, represent a significant portion of the driving situation data. Such environment sensors can include, for example, radar sensors, lidar sensors, ultrasonic sensors and, in particular, cameras, the image data of which, as environmental data, can usually be evaluated by various image processing algorithms and converted into useful information describing the driving situation. Due to the high quality and thus the amount of image data of modern cameras, it is known to use high-speed data connections and high-speed interfaces to the control device in order to be able to transmit the large amount of image data generated to the control device quickly, so that the image data in the contained information describing the driving situation can be reacted to as quickly as possible. The control devices themselves have a mostly rather small-sized buffer memory in which driving situation data from at least one previous time step can also be held, in particular also with regard to tracking changes in the driving situation.

Eine wesentliche Aufgabe bei vollständig automatisch betriebenen Kraftfahrzeugen ist die Dokumentation von Unfällen. Nachdem das Kraftfahrzeug autonom betrieben wird, gilt die Aufmerksamkeit der Insassen üblicherweise nicht der Fahrsituation, so dass insbesondere bei der Klärung der Schuldfrage bei Unfällen weiteres Beweismaterial notwendig ist. Um dieses zu sichern, wurde im Stand der Technik bereits vorgeschlagen, bei einem detektierten Unfall, insbesondere also einer detektierten Kollision des Kraftfahrzeugs mit einem Objekt, was beispielsweise über einen Crashsensor geschehen kann, die zu diesem Zeitpunkt aktuellen Fahrsituationsdaten wenigstens teilweise zur späteren Auswertung abzuspeichern, insbesondere, was die Bilddaten wenigstens einer Kamera des Kraftfahrzeugs angeht. Dabei kann beispielsweise der Inhalt des bereits genannten "Pufferspeichers" bei der Detektion einer Kollision mittels eines Kollisionssensors (Crashsensors) "eingefroren" werden. Es sind auch Ausgestaltungen bekannt, bei denen der im Kollisionsfall auftretende Stromverlust innerhalb des Steuergeräts dazu führt, dass der letzte Inhalt des Pufferspeichers zur späteren Auswertung erhalten bleibt.Documenting accidents is an essential task in fully automated motor vehicles. After the motor vehicle is operated autonomously, the occupants usually do not focus on the driving situation, so that further evidence is necessary, especially when clarifying the question of guilt in the event of an accident. In order to ensure this, it has already been proposed in the prior art, in the event of a detected accident, in particular a detected collision of the motor vehicle with an object, which can happen for example via a crash sensor, at least partially to save the current driving situation data for later evaluation, in particular with regard to the image data of at least one camera of the motor vehicle. In this case, for example, the content of the aforementioned “buffer memory” can be “frozen” when a collision is detected by means of a collision sensor (crash sensor). Refinements are also known in which the loss of power that occurs in the event of a collision within the control device means that the last content of the buffer memory is retained for later evaluation.

Dabei kann es allerdings zu dem Problem kommen, dass die zu diesem Zeitpunkt gespeicherten Fahrsituationsdaten nicht ausreichend sind, um den Unfallhergang hinreichend zu rekonstruieren bzw. eine Schuldfrage zu klären. Das bedeutet also, das vorliegende Datenmaterial kann zu gering für die beispielsweise gesetzlich geforderten Zwecke sein. Dies gilt insbesondere dann, wenn durch die Kollision die Sensorik bzw. die Stromversorgung innerhalb des Kraftfahrzeugs ausfällt und somit nur Fahrsituationsdaten vom unmittelbaren Unfallzeitpunkt vorliegen.However, this can lead to the problem that the driving situation data stored at this point in time are not sufficient for the To adequately reconstruct the course of the accident or to clarify a question of guilt. This means that the data available may be too small for the purposes required by law, for example. This applies in particular if the sensor system or the power supply within the motor vehicle fails due to the collision and therefore only driving situation data from the immediate time of the accident are available.

DE 100 29 401 A1 betrifft ein Verfahren zum ereignisbedingten Abspeichern von Fahrzeugsystemdaten, wobei eine Schnittstelle zu einem Fahrzeugsystembus verwendet wird. An dem Fahrzeugsystembus anliegende Fahrzeugsystembusdaten können bei Empfang eines Abspeicherbefehls über den Fahrzeugsystembus in einen Speicher abgespeichert werden. Dabei werden insbesondere Fahrer-Befehlsdaten und Randbedingungsdaten aufgezeichnet. Bei dem Abspeicherereignis kann es sich um einen erkannten Fahrzeugunfall handeln. Auch ein derartiger Ansatz reagiert erst, wenn ein Unfall stattgefunden hat und weist den weiteren Nachteil auf, dass der Fahrzeugsystembus häufig deutlich zu langsam ist, mithin weitere Verzögerungen auftreten, die dazu führen können, dass bei Stromausfall oder dergleichen bei einem Unfall gar keine Daten über die Bedientätigkeit des Fahrers mehr abgespeichert werden können. DE 100 29 401 A1 relates to a method for event-related storage of vehicle system data, an interface to a vehicle system bus being used. Vehicle system bus data present on the vehicle system bus can be stored in a memory upon receipt of a storage command via the vehicle system bus. In particular, driver command data and boundary condition data are recorded. The storage event can be a recognized vehicle accident. Such an approach also only reacts when an accident has occurred and has the further disadvantage that the vehicle system bus is often significantly too slow, which means that further delays occur which can lead to no data at all being transferred in the event of a power failure or the like in an accident the driver's operating activities can be saved more.

DE 10 2004 045 813 A1 betrifft ein System und ein Verfahren für ein vorausschauendes Detektieren einer Unfallgefahrensituation. Hierbei wird insbesondere im toten Winkel des Kraftfahrzeugs sensiert, um Daten bezüglich eines potentiellen Unfallobjektes detektieren zu können. Mindestens eine geeignete Insassenschutzmaßnahme kann in Abhängigkeit von den durch die Tote-Winkel-Sensiereinrichtung erfassten Daten aktiviert werden. Insbesondere kann die Wahrscheinlichkeit für einen Seitenunfall auf unterschiedliche Art und Weise mittels geeigneter Algorithmen abgeschätzt werden. Auch andere Möglichkeiten zur Erhöhung der Sicherheit von Insassen von Kraftfahrzeugen, insbesondere des Fahrers, die auf Kollisionen überwachen, wurden bereits vorgeschlagen. DE 10 2004 045 813 A1 relates to a system and a method for predictive detection of an accident risk situation. In particular, it is sensed in the blind spot of the motor vehicle in order to be able to detect data relating to a potential accident object. At least one suitable occupant protection measure can be activated as a function of the data recorded by the blind spot sensor device. In particular, the probability of a side accident can be estimated in different ways using suitable algorithms. Other possibilities for increasing the safety of vehicle occupants, in particular the driver, who monitor for collisions, have also already been proposed.

EP 0 891 903 A2 betrifft eine automatische Notbremsfunktion, die dem Fahrer ein Höchstmaß an Entscheidungssouveränität beim Ausweichen gegenüber Hindernissen ermöglichen soll, ohne im Falle einer tatsächlichen Kollisionssituation auf die Vorteile eines den Fahrer unterstützenden Systems zur Kollisionsbegrenzung zu verzichten. Entsprechend wird vorgesehen, dem Fahrer des Fahrzeuges solange wie möglich die Gelegenheit zu geben, durch von ihm selbst vorzunehmende Handlungen wie Brems- und/oder Lenkoperationen die Kollision zu vermeiden. Erst wenn sich aufgrund der fahrphysikalischen Gegebenheiten, die sich aus dem Fahrzustand des Fahrzeuges sowie der Kollisionskonstellation ergibt, eine Kollision eindeutig nicht mehr zu vermeiden ist, wird durch eine automatisch ausgelöste und vorzugsweise möglichst starke Verzögerung des Fahrzeuges dieses vor der Kollision so abgebremst, dass die Unfallfolgen für Fahrer und Fahrzeug dadurch minimiert werden. Die von der dortigen Erfassungseinrichtung gelieferten Umgebungsdaten beziehungsweise Sensorsignale können in einer Speichereinrichtung abgespeichert werden, insbesondere auch Bildsignale einer Kameraeinrichtung. EP 0 891 903 A2 relates to an automatic emergency braking function, which is intended to give the driver a high degree of decision-making authority when avoiding obstacles, without foregoing the advantages of a collision limitation system that supports the driver in the event of an actual collision situation. Accordingly, provision is made to give the driver of the vehicle the opportunity for as long as possible to avoid the collision by taking actions himself, such as braking and / or steering operations. Only when a collision can clearly no longer be avoided due to the physical driving conditions resulting from the driving state of the vehicle and the collision constellation, is the vehicle braked before the collision by an automatically triggered and preferably strongest possible deceleration This minimizes the consequences of accidents for the driver and vehicle. The environmental data or sensor signals supplied by the detection device there can be stored in a memory device, in particular also image signals from a camera device.

DE 10 2013 212 092 A1 betrifft ein Verfahren und eine Vorrichtung zum Betreiben einer Fußgängerschutzeinrichtung eines Fahrzeuges. Dabei soll eine Art des Kollisionsobjekts festgestellt werden, wobei bezüglich der Daten der Umfeldsensoren, die dieses Kollisionsobjekt beschreiben, bei Überschreiten eines Schwellwerts für die Aufprallwahrscheinlichkeit ein Freeze-Zustand hergestellt werden kann, um in jedem Fall Daten über das Kollisionsobjekt vorliegen zu haben. DE 10 2013 212 092 A1 relates to a method and a device for operating a pedestrian protection device of a vehicle. A type of collision object is to be determined, and with regard to the data of the environment sensors that describe this collision object, a freeze state can be established when a threshold value for the impact probability is exceeded, in order to have data about the collision object in any case.

DE 10 2016 222 219 A1 betrifft ein Fahrerassistenzsystem für ein Kraftfahrzeug, bei dem Geo-Positionen des Fahrzeugs, die eine erhöhte Auslösewahrscheinlichkeit eines Kollisionsvermeidungssystems aufweisen, selbstlernend abgespeichert werden, um bei erneutem Befahren der räumlichen Umgebung um die gespeicherte Fahrzeugposition zur Vorbereitung einer Gefahrenwarnung oder Gefahrenbremsung zu berücksichtigen. Mit der Fahrzeugposition können auch weitere Daten abgespeichert werden. DE 10 2016 222 219 A1 relates to a driver assistance system for a motor vehicle in which the vehicle's geographic positions, which have an increased probability of triggering a collision avoidance system, are stored in a self-learning manner in order to take into account the stored vehicle position in preparation for a hazard warning or emergency braking when the spatial environment is driven again. Further data can also be saved with the vehicle position.

DE 10 2015 218 762 A1 offenbart ein Verfahren und eine Vorrichtung zur Unfalldatenspeicherung für ein Fahrzeug. Dort wird vorgeschlagen, bei einem erkannten, bevorstehenden Unfall des Fahrzeuges unfallrelevante Fahrzeugdaten nicht nur an eine Schnittstelle zu einer fahrzeuginternen Speichereinrichtung zum Speichern der unfallrelevanten Fahrzeugdaten zu geben, sondern auch an eine Schnittstelle zu einer Übertragungseinrichtung zum Übertragen der unfallrelevanten Fahrzeugdaten an zumindest eine fahrzeugexterne Speichereinrichtung zum Speichern der unfallrelevanten Fahrzeugdaten. Somit kann erreicht werden, dass keine Informationen verloren gehen können, die zum Rekonstruieren des Unfalls wichtig sein können. DE 10 2015 218 762 A1 discloses a method and apparatus for accident data storage for a vehicle. It is proposed there, in the event of an imminent vehicle accident being detected, not only to give accident-relevant vehicle data to an interface to an in-vehicle storage device for storing the accident-relevant vehicle data, but also to an interface to a transmission device for transmitting the accident-relevant vehicle data to at least one external storage device for Saving the vehicle data relevant to the accident. It can thus be achieved that no information can be lost which could be important for reconstructing the accident.

DE10231558 offenbart das automatische Auslösen einer Verzögerung eines Fahrzeugs, wobei Daten von einer Umfeldsensorik, mit der das Fahrzeug ausgerüstet ist, und Daten, die die eigene Fahrzeugbewegung beschreiben, eingelesen werden, um ein aktuelles Gefährdungspotenzial zu bestimmen, welches mit einem Schwellenwert bzw. einer Auslöseschwelle verglichen wird, um eine Vorbereitung eines Bremssystems bzw. eine Bremsung auszulösen. DE10231558 discloses the automatic triggering of a deceleration of a vehicle, with data from an environment sensor system with which the vehicle is equipped and data describing the vehicle's own movement being read in to determine a current hazard potential, which is compared with a threshold value or a triggering threshold to trigger a preparation of a braking system or a braking.

Der Erfindung liegt die Aufgabe zu Grunde, eine Möglichkeit zur besseren Dokumentation von Unfällen eines vollständig automatisch betriebenen Kraftfahrzeugs anzugeben.The invention is based on the object of specifying a possibility for better documentation of accidents in a fully automatically operated motor vehicle.

Zur Lösung dieser Aufgabe sind bei einem Verfahren der eingangs genannten Art erfindungsgemäß die Merkmale des Anspruchs 1 vorgesehen.To achieve this object, the features of claim 1 are provided according to the invention in a method of the type mentioned at the beginning.

Die Erfindung schlägt mithin vor, ein dediziertes, zusätzliches Speichermittel innerhalb des Steuergeräts selbst vorzusehen und ebenso innerhalb des Steuergeräts selbst durch Auswertung von Fahrsituationsdaten ein Triggersignal zu generieren, das auf einen höchstwahrscheinlich bevorstehenden Kollisionsunfall des Kraftfahrzeugs hinweist, um wenigstens einen Teil der aktuellen Umfelddaten kontinuierlich in dieses Speichermittel einzuspeichern, so dass eine hervorragende Grundlage geschaffen wird, zu einem späteren Zeitpunkt das Zustandekommen des Unfalls auszuwerten, beispielsweise bezüglich einer Schuldfrage und/oder eines möglicherweise stattgefundenen Fehlers bei der vollständig automatischen Führung des Kraftfahrzeugs. Dabei wird das Speichermittel bevorzugt zusätzlich zu einem kleiner dimensionierten, kontinuierlich genutzten Pufferspeicher des Steuergeräts verwendet, so dass auch größere Datenmengen, wie sie beispielsweise durch Bilddaten einer Kamera zu erwarten sind, über den längeren Zeitraum innerhalb des Speichermittels vorgehalten werden können. Gerade im Hinblick auf moderne, in ihrer Qualität ständig ansteigende Umfeldsensoren steigt auch das von diesen Umfeldsensoren erhaltene Datenvolumen pro Zeitschritt, so dass innerhalb eines Pufferspeichers nur ein unzureichender Teil von Umfelddaten vorgehalten werden könnte. Im Rahmen der vorliegenden Erfindung wird dabei insbesondere ausgenutzt, dass es zum einen im Stand der Technik bereits vorgeschlagen wurde, Kollisionswahrscheinlichkeiten aus Fahrsituationsdaten zu ermitteln, zum anderen aber die entsprechenden Fahrsituationsdaten innerhalb des Steuergeräts, welches auch die vollständig automatische Führung des Kraftfahrzeugs steuert, ohnehin vorliegen, so dass sich auch hier eine Kollisionswahrscheinlichkeit ermitteln lässt, die zum Auslösen eines Triggersignals genutzt werden kann, das es mithin erlaubt, bereits vor dem Eintritt einer Kollision damit zu beginnen, Umfelddaten (und vorzugsweise auch weitere Fahrsituationsdaten und/oder Betriebsdaten des Kraftfahrzeugs) zur Dokumentation innerhalb des Steuergeräts aufzuzeichnen. Es wird also ein zusätzlicher Dokumentationszeitraum gewonnen.The invention therefore proposes to provide a dedicated, additional storage means within the control unit itself and also to generate a trigger signal within the control unit itself by evaluating driving situation data, which indicates a very likely impending collision accident of the motor vehicle in order to continuously read at least part of the current environment data to store this storage means, so that an excellent basis is created for evaluating the occurrence of the accident at a later point in time, for example with regard to a question of guilt and / or a possibly occurring error in the fully automatic driving of the motor vehicle. Included the storage means is preferably used in addition to a smaller, continuously used buffer memory of the control device, so that even larger amounts of data, as can be expected from image data from a camera, for example, can be held within the storage means over the longer period of time. Especially with regard to modern environment sensors, the quality of which is constantly increasing, that of Data volume received by these environment sensors per time step, so that only an insufficient part of the environment data could be kept within a buffer memory. The present invention makes particular use of the fact that, on the one hand, it has already been proposed in the prior art to determine collision probabilities from driving situation data, and on the other hand, the corresponding driving situation data are already available within the control unit, which also controls the fully automatic guidance of the motor vehicle , so that a collision probability can also be determined here, which can be used to trigger a trigger signal, which therefore allows environment data (and preferably also further driving situation data and / or operating data of the motor vehicle) to be started before a collision occurs Record documentation within the control unit. An additional documentation period is thus gained.

Dadurch, dass sowohl die Ermittlung der Kollisionswahrscheinlichkeit als auch die Erzeugung des Triggersignals innerhalb des Steuergeräts selbst stattfindet und auch das Speichermittel innerhalb des Steuergeräts selber vorgesehen ist, muss kein langsamer Fahrzeugbus genutzt werden, der eine deutliche Verzögerung in der Aufzeichnung der Umfelddaten mit sich bringen würde. Vielmehr kann äußerst schnell innerhalb des Steuergeräts auf einen bevorstehenden Unfall reagiert werden und eine erweiterte Aufzeichnung und Vorhaltung wenigstens eines Teiles der Umfelddaten, insbesondere von Bilddaten einer Kamera, erfolgen.Because both the determination of the probability of a collision and the generation of the trigger signal take place within the control unit itself and the storage means is also provided within the control unit itself, there is no need to use a slow vehicle bus, which would cause a significant delay in the recording of the surrounding data . Rather, it is possible to react extremely quickly to an impending accident within the control device and to record and maintain at least some of the surrounding data, in particular image data from a camera, in an extended manner.

In diesem Zusammenhang ist es zudem von besonderem Vorteil, wenn ein schnelle Zugriffszeiten erlaubendes Speichermittel verwendet wird. Vorzugsweise kann mithin ein SSD und/oder eMMC als Speichermittel verwendet werden, so dass so schnell wie möglich bei einem bevorstehenden Unfall ein Speichern der zur Dokumentation zweckmäßigen Dokumentationsdaten, insbesondere also des Teils der Umfelddaten, erfolgen kann. Dies gemeinsam mit der Tatsache, dass das Triggersignal ein internes Signal des Steuergeräts ist, sorgt für eine maximale Ausnutzung der verfügbaren Zeit zum Speichern wenigstens des Teils der Umfelddaten sowie gegebenenfalls weiterer Dokumentationsdaten.In this context it is also of particular advantage if a storage means is used that allows fast access times. An SSD and / or eMMC can therefore preferably be used as the storage means, so that the documentation data useful for documentation, in particular the part of the surrounding data, can be saved as quickly as possible in the event of an impending accident. This, together with the fact that the trigger signal is an internal signal of the control unit, ensures maximum utilization of the available time Saving at least the part of the environment data and possibly further documentation data.

Zusammenfassend wird also bereits vor der Kollision begonnen, wenigstens einen Teil der Umfelddaten in ein innerhalb des Steuergeräts vorgesehenes Speichermittel einzuspeichern, so dass eine früher beginnende Dokumentation der Kollision genauso möglich wird wie ein Vorhalt einer größeren Menge von Informationen zur Dokumentation der Kollision.In summary, before the collision, at least part of the environment data is started to be stored in a storage means provided within the control device, so that documentation of the collision that begins earlier is just as possible as a provision of a larger amount of information to document the collision.

Wie bereits erwähnt, ist es im Rahmen der vorliegenden Erfindung besonders zweckmäßig, wenn der bei Überschreitung des Schwellwerts durch die Kollisionswahrscheinlichkeit zu speichernde Teil der Umfelddaten wenigstens Bilddaten einer Kamera als Umfeldsensor umfassend gewählt wird. Der zu speichernde Teil der Umfelddaten kann bevorzugt ferner Radardaten eines Radarsensors als Umfeldsensor umfassen, nachdem auch Radardaten bei der Analyse eines Unfalls besonders nützliche Informationen liefern können, insbesondere zu den relativen Geschwindigkeiten und/oder Abständen. Gerade hinsichtlich der Kamera ist es ferner vorteilhaft, wenn die Umfelddaten, insbesondere der zu speichernde Teil der Umfelddaten, wenigstens teilweise über eine Hochgeschwindigkeitsschnittstelle an das Steuergerät übermittelt werden.As already mentioned, it is particularly expedient within the scope of the present invention if the part of the environment data to be stored when the threshold value is exceeded by the collision probability is selected to include at least image data from a camera as the environment sensor. The part of the surroundings data to be stored can preferably also include radar data from a radar sensor as an surroundings sensor, since radar data can also provide particularly useful information when analyzing an accident, in particular on the relative speeds and / or distances. With regard to the camera in particular, it is also advantageous if the environment data, in particular the part of the environment data to be stored, is at least partially transmitted to the control device via a high-speed interface.

Der Schwellwert kann zweckmäßigerweise in einem Bereich von 40 bis 70 %, insbesondere als 50 %, gewählt werden. Dabei hat sich ein Wert von 50 % bei der Verwendung üblicher Algorithmen zur Ermittlung der Kollisionsgeschwindigkeit, wie sie im Stand der Technik bekannt sind, als zweckmäßig erwiesen, um sowohl einen geeignet dimensionierten Zeitraum auch vor der eigentlichen Kollision zu erhalten, zum anderen aber nicht zu häufig das Triggersignal zu erzeugen, mithin zu viele Fälle von Fehlalarm, auf die kein tatsächlicher Unfall folgt, abzudecken.The threshold value can expediently be selected in a range from 40 to 70%, in particular as 50%. A value of 50% has proven to be useful when using conventional algorithms for determining the collision speed, as they are known in the prior art, in order to obtain both a suitably dimensioned period of time before the actual collision, but not to do so often to generate the trigger signal, thus covering too many cases of false alarms that are not followed by an actual accident.

Erfindungsgemäß ist vorgesehen, dass mit dem Erhalt des Triggersignals bei einem einen Grenzwert unterschreitenden freien Speicherplatz des Speichermittels wenigstens ein Teil der in einem früheren Zeitraum gespeicherten Umfelddaten gelöscht werden. Auf diese Weise steht ein hinreichender oder insbesondere auch der komplette freie Speicherplatz des Speichermittels zur Verfügung und kann für relevante Daten genutzt werden.According to the invention, it is provided that when the trigger signal is received, at least a part of the memory space stored in an earlier period of time is available in the case of a free storage space in the storage means which falls below a limit value Environment data are deleted. In this way, sufficient or, in particular, all of the free storage space of the storage means is available and can be used for relevant data.

In einer derartigen Ausgestaltung können insbesondere auch zuvor gespeicherte Umfelddaten gelöscht werden, beispielsweise, wenn ohne Eintritt eines tatsächlichen Unfalls nach einer Überschreitung des Schwellwerts durch die Kollisionswahrscheinlichkeit wenigstens der Teil der Umfelddaten für einen Zeitraum gespeichert wurde, bis der bzw. der weitere Schwellwert wieder unterschritten war. Dabei sei im Übrigen noch angemerkt, dass sowohl zur Aktivierung als auch zur Deaktivierung zweckmäßig derselbe Schwellwert herangezogen werden kann; gegebenenfalls kann als weiterer Schwellwert auch ein etwas niedrigerer Wert als der Schwellwert zur Erzeugung des Triggersignals gewählt werden, um ein Speichern für kurze Zeiträume, dass dann sofort wieder abgebrochen wird, zu vermeiden und in jedem Fall eine kontinuierliche Aufzeichnung über einen nennenswerten Zeitraum zu erreichen, auch wenn gegebenenfalls kein Unfall stattfinden wird. Beispielsweise kann als der Schwellwert zur Erzeugung des Triggersignals 50 %, als weiterer Schwellwert 40 % gewählt werden.In such a refinement, in particular, previously stored environmental data can also be deleted, for example if, without the occurrence of an actual accident, after the threshold value has been exceeded by the collision probability, at least part of the environmental data was stored for a period of time until the further threshold value or the further threshold value was undershot again . It should also be noted that the same threshold value can be used for both activation and deactivation; If necessary, a slightly lower value than the threshold value for generating the trigger signal can be selected as an additional threshold value in order to avoid saving for short periods of time that is then immediately aborted and in any case to achieve continuous recording over a significant period of time, even if there is no accident. For example, 50% can be selected as the threshold value for generating the trigger signal, and 40% as the further threshold value.

Dabei sei darauf hingewiesen, dass zweckmäßig die Auswertung der Kollisionswahrscheinlichkeit nach Eintritt der Kollision, die beispielsweise durch einen Kollisionssensor des Kraftfahrzeugs festgestellt werden kann, abgebrochen werden kann, wenn dann noch elektrische Energie innerhalb des Steuergeräts vorliegt. In einem solchen Fall kann beispielsweise vorgesehen sein, noch für eine vorbestimmte Zeitspanne nach dem Eintreten der Kollision wenigstens den Teil der Umfelddaten in dem Speichermittel abzuspeichern oder aber bereits mit dem Eintritt der Kollision den Zeitraum des Speicherns im Speichermittel zu beenden.It should be pointed out that the evaluation of the collision probability after the collision has occurred, which can be detected, for example, by a collision sensor of the motor vehicle, can expediently be terminated if electrical energy is still present within the control device. In such a case, provision can be made, for example, to store at least part of the environment data in the storage means for a predetermined period of time after the occurrence of the collision or to end the period of storage in the storage means as soon as the collision occurs.

Zur Ermittlung der Kollisionswahrscheinlichkeit können verschiedenste, im Stand der Technik im Hinblick auf Sicherheitssysteme bereits vorgeschlagene Berechnungsverfahren bzw. Algorithmen herangezogen werden, die vorliegend nicht mehr genauer dargelegt werden müssen. Insbesondere kann vorgesehen sein, dass zur Ermittlung der Kollisionswahrscheinlichkeit eine Prädiktion des Verhaltens von durch die Fahrsituationsdaten beschriebenen Verkehrsteilnehmern, umfassend das eigene Kraftfahrzeug, vorgenommen wird. Bekannte Ansätze, insbesondere in Sicherheitssystemen, nutzen also Vorausberechnungsalgorithmen, um festzustellen, wie wahrscheinlich eine Kollision in einem Vorausberechnungszeitraum ist.To determine the probability of a collision, a wide variety of calculation methods or algorithms that have already been proposed in the prior art with regard to safety systems can be used, which do not need to be explained in more detail here. In particular, can It can be provided that, in order to determine the probability of a collision, a prediction of the behavior of road users described by the driving situation data, including their own motor vehicle, is carried out. Known approaches, especially in security systems, use forecast algorithms to determine how likely a collision is in a forecast period.

Neben dem Verfahren betrifft die Erfindung auch ein Kraftfahrzeug, aufweisend ein Fahrzeugsystem zur vollständig automatischen Führung des Kraftfahrzeugs mit einem zur Durchführung des erfindungsgemäßen Verfahrens ausgebildeten Steuergerät und wenigstens einem Umfeldsensor. Sämtliche Ausführungen bezüglich des erfindungsgemäßen Verfahrens lassen sich analog auf das erfindungsgemäße Kraftfahrzeug übertragen, mit welchem mithin ebenso die bereits genannten Vorteile erhalten werden können.In addition to the method, the invention also relates to a motor vehicle having a vehicle system for fully automatic guidance of the motor vehicle with a control device designed to carry out the method according to the invention and at least one environment sensor. All statements relating to the method according to the invention can be applied analogously to the motor vehicle according to the invention, with which the advantages already mentioned can therefore also be obtained.

Ein erfindungsgemäßes Computerprogramm ist beispielsweise direkt in einen Speicher eines Steuergeräts eines Kraftfahrzeugs ladbar und weist Programmmittel auf, um die Schritte eines erfindungsgemäßen Verfahrens auszuführen, wenn das Computerprogramm in dem Steuergerät des Kraftfahrzeugs ausgeführt wird. Das Computerprogramm kann auf einem elektronisch lesbaren Datenträger gespeichert sein, welcher mithin darauf gespeicherte elektronisch lesbare Steuerinformationen umfasst, welche zumindest ein erfindungsgemäßes Computerprogramm erfassen und derart ausgestaltet sind, dass sie bei Verwendung des Datenträgers in einem Steuergerät eines Kraftfahrzeugs ein erfindungsgemäßes Verfahren durchführen.A computer program according to the invention can, for example, be loaded directly into a memory of a control unit of a motor vehicle and has program means to execute the steps of a method according to the invention when the computer program is executed in the control unit of the motor vehicle. The computer program can be stored on an electronically readable data carrier, which therefore includes electronically readable control information stored thereon, which record at least one computer program according to the invention and are designed in such a way that they carry out a method according to the invention when the data carrier is used in a control unit of a motor vehicle.

Weitere Vorteile und Einzelheiten der vorliegenden Erfindung ergeben sich aus den im Folgenden beschriebenen Ausführungsbeispielen sowie anhand der Zeichnungen. Dabei zeigen:

Fig. 1
eine Prinzipskizze eines erfindungsgemäßen Kraftfahrzeugs, und
Fig. 2
den Aufbau eines Steuergeräts eines Kraftfahrzeugs gemäß Fig. 1.
Further advantages and details of the present invention emerge from the exemplary embodiments described below and on the basis of the drawings. Show:
Fig. 1
a schematic diagram of a motor vehicle according to the invention, and
Fig. 2
the structure of a control unit of a motor vehicle according to Fig. 1 .

Fig. 1 zeigt eine Prinzipskizze eines erfindungsgemäßen Kraftfahrzeugs 1, welches ein zur vollständig automatischen Führung des Kraftfahrzeugs ausgebildetes Fahrzeugsystem 2 mit einem Steuergerät 3 aufweist. Um seine grundsätzlich bekannte vollständig automatische Fahrzeugführungsfunktion auszuführen, erhält das Steuergerät 3 als Fahrsituationsdaten neben Betriebsdaten des Kraftfahrzeugs 1 Umfelddaten von Umfeldsensoren des Kraftfahrzeugs 1, wobei hier beispielhaft Kameras 4 und Radarsensoren 5 gezeigt sind. Um insbesondere bei größeren Datenmengen, wie den Bilddaten der Kamera 4, diese schnell und verlässlich innerhalb des Steuergeräts 3 zur Verfügung zu haben, wird eine Hochgeschwindigkeitsdatenverbindung mit einer entsprechenden Hochgeschwindigkeitsschnittstelle an dem Steuergerät 3 verwendet. Fig. 1 shows a schematic diagram of a motor vehicle 1 according to the invention, which has a vehicle system 2 with a control unit 3 designed for completely automatic guidance of the motor vehicle. In order to perform its fully automatic vehicle guidance function, which is known in principle, the control unit 3 receives as driving situation data in addition to operating data of the motor vehicle 1 environment data from environment sensors of the motor vehicle 1, cameras 4 and radar sensors 5 being shown here by way of example. A high-speed data connection with a corresponding high-speed interface on the control device 3 is used in order to have them quickly and reliably available within the control device 3, particularly in the case of larger amounts of data, such as the image data from the camera 4.

In dem Steuergerät 3 werden die Fahrsituationsdaten ausgewertet, um Fahreingriffe beschreibende Steuersignale für entsprechende Aktoren des Kraftfahrzeugs 1 zu erzeugen, wobei vorliegend lediglich beispielhaft ein Motor 6, eine Bremseinrichtung 7 und ein Lenksystem 8 gezeigt sind.The driving situation data are evaluated in the control unit 3 in order to generate control signals describing driving interventions for corresponding actuators of the motor vehicle 1, a motor 6, a braking device 7 and a steering system 8 being shown here only by way of example.

Zur Detektion einer tatsächlich stattfindenden Kollision kann das Kraftfahrzeug 1 ferner auch beispielsweise als Beschleunigungssensoren ausgebildete Crashsensoren 9 umfassen. Diese liefern ihre entsprechenden Sensordaten ebenso an das Steuergerät 3.To detect a collision actually taking place, the motor vehicle 1 can furthermore also comprise crash sensors 9 embodied as acceleration sensors, for example. These also supply their corresponding sensor data to the control unit 3.

Fig. 3 zeigt den Aufbau des Steuergeräts 3 genauer. Wenigstens ein Teil der Umfelddaten, insbesondere die Umfelddaten der Kameras 4, werden über eine Hochgeschwindigkeitsschnittstelle 10 entgegengenommen. Das Steuergerät 3 weist zudem noch weitere Interfaces auf, beispielsweise zu einem Fahrzeugbussystem und/oder für andere Direktverbindungen.3 shows the structure of the control device 3 in more detail. At least some of the environment data, in particular the environment data of the cameras 4, are received via a high-speed interface 10. The control device 3 also has further interfaces, for example to a vehicle bus system and / or for other direct connections.

In einer Recheneinrichtung 12 des Steuergeräts 3, die einen oder mehrere Prozessoren umfassen kann, wird durch eine Führungseinheit 13 der vollständig automatische Führungsbetrieb des Kraftfahrzeugs 3 realisiert. Zusätzlich hierzu bzw. in diese integriert, wird durch die Recheneinrichtung 12 jedoch auch eine Kollisionsdokumentationseinheit 14 realisiert. Fahrsituationsdaten, die durch die Recheneinrichtung 12 ausgewertet werden, werden zeitweise in einem Pufferspeicher 15 des Steuergeräts 3 abgespeichert. Zusätzlich zu dem Pufferspeicher 15 weist das Steuergerät 3 jedoch auch ein vom Speicherplatz her größer als der Pufferspeicher 15 dimensioniertes Speichermittel 16, vorliegend ein SSD, auf, in dem Dokumentationsdaten bezüglich eines Unfalls des Kraftfahrzeugs 1 aufgezeichnet werden können.In a computing device 12 of the control device 3, which can include one or more processors, a guide unit 13 is used to complete the automatic guidance operation of the motor vehicle 3 is realized. In addition to this or integrated into it, the computing device 12 also realizes a collision documentation unit 14. Driving situation data that are evaluated by the computing device 12 are temporarily stored in a buffer memory 15 of the control device 3. In addition to the buffer memory 15, the control device 3, however, also has a memory means 16 which is larger than the buffer memory 15 in terms of memory space, in this case an SSD, in which documentation data relating to an accident of the motor vehicle 1 can be recorded.

Hierzu wertet die Kollisionsdokumentationseinheit 14 die Fahrsituationsdaten weitergehend aus, um eine Kollisionswahrscheinlichkeit des Kraftfahrzeugs 1 mit einem Fremdobjekt zu ermitteln. Übersteigt diese Kollisionswahrscheinlichkeit einen Schwellwert, hier 50 %, wird ein internes Triggersignal in dem Steuergerät 3 erzeugt, welches dafür sorgt, dass ein definierter Teil der Umfelddaten, gemeinsam mit anderen definierten Fahrsituationsdaten und/oder Betriebsdaten des Kraftfahrzeugs 1, ab nun kontinuierlich in das Speichermittel 16 eingespeichert wird, wobei dieses bei Erhalt des Triggersignals gegebenenfalls auch zuerst wenigstens teilweise gelöscht werden kann, insbesondere, falls darauf noch Dokumentationsdaten gespeichert sind, die aus einer Fahrsituation stammen, in der zwar eine hohe Kollisionswahrscheinlichkeit vorlag, aber kein Unfall stattgefunden hat. Der definierte, zu speichernde Teil der Umfelddaten umfasst vorliegend wenigstens die Bilddaten der Kameras 4 und die Radardaten der Radarsensoren 5. Der Zeitraum, für den solcherlei jeweils aktuelle Dokumentationsdaten in dem Speichermittel 16 eingespeichert werden, kann sich zum einen bemessen, bis die Kollisionswahrscheinlichkeit unter den oder einen weiteren Schwellwert, hier 40 % fällt. Tritt jedoch tatsächlich eine Kollision ein, was durch die Kollisionssensoren 9 feststellbar ist, kann auch der Eintritt der Kollision das Ende des Einspeicherns markieren; denkbar ist es jedoch auch, insbesondere, wenn die Stromversorgung des Steuergeräts 3 erhalten bleibt, für eine vorbestimmte Zeitspanne über den Kollisionszeitpunkt hinaus weiter Dokumentationsdaten umfassend wenigstens den definierten Teil der Umfelddaten in das Speichermittel 16 einzuspeichern.For this purpose, the collision documentation unit 14 further evaluates the driving situation data in order to determine a collision probability of the motor vehicle 1 with a foreign object. If this probability of collision exceeds a threshold value, in this case 50%, an internal trigger signal is generated in the control unit 3, which ensures that a defined part of the environment data, together with other defined driving situation data and / or operating data of the motor vehicle 1, is continuously stored in the storage means from now on 16 is stored, whereby this can also be at least partially deleted first if the trigger signal is received, in particular if documentation data is still stored on it that originates from a driving situation in which there was a high probability of a collision but no accident occurred. The defined, to be stored part of the environment data in the present case includes at least the image data of the cameras 4 and the radar data of the radar sensors 5. The period for which such current documentation data are stored in the storage means 16 can be measured on the one hand until the collision probability is below the or another threshold value, here 40% falls. If, however, a collision actually occurs, which can be determined by the collision sensors 9, the occurrence of the collision can also mark the end of the storage; However, it is also conceivable, in particular if the power supply of the control device 3 is maintained, to store further documentation data including at least the defined part of the environment data in the storage means 16 for a predetermined period of time beyond the time of the collision.

Auf diese Weise werden Dokumentationsdaten bereits vor einer eintretenden Kollision in eine hochqualitative Auswertung und Analyse des Unfalls erhaltender Menge aufbewahrt. Die Dokumentationsdaten können zu einem späteren Zeitpunkt ausgelesen und analysiert werden.In this way, documentation data is stored in a high-quality evaluation and analysis of the amount received before a collision occurs. The documentation data can be read out and analyzed at a later point in time.

Es sei noch darauf hingewiesen, dass die Kollisionswahrscheinlichkeit, die hier bestimmt wird, auch für andere Zwecke genutzt werden kann, beispielsweise in einem ebenso durch das Steuergerät 3 realisierten Sicherheitssystem, das Insassenrückhaltemittel präkonditioniert oder dergleichen.It should also be pointed out that the probability of a collision, which is determined here, can also be used for other purposes, for example in a safety system which is also implemented by the control device 3 and which preconditions the occupant restraint or the like.

Claims (7)

  1. Method for operating a control device (3) of a motor vehicle (1), wherein the control device (3) is configured for fully automatic guidance of the motor vehicle (1), in which driving situation data, comprising environment data of at least one environment sensor of the motor vehicle (1), which are supplied to the control device (3) are evaluated, wherein a collision probability for the occurrence of a collision with a foreign object is determined in the control device (3) by further evaluation of the driving situation data, wherein, if a threshold value for the collision probability is exceeded, a trigger signal is generated, the presence of which initiates continuous storage of at least part of the current environment data in a storage means (16) of the control device (3) in a period of time until at least the occurrence of the collision and/or until the collision probability falls below the and/or a further threshold value, so that it can be retrieved at a later time, wherein at least part of the environment data stored in an earlier period of time is deleted when the trigger signal is received if the free memory space of the storage means (16) is below a limit value.
  2. Method according to claim 1,
    characterised in that
    when the threshold value of the collision probability is exceeded the part of the environment data that is to be stored is selected to comprise at least image data from a camera (4) as an environment sensor and/or the environment data are at least partially transmitted via a high-speed interface (10) to the control device (3).
  3. Method according to claim 1 or 2,
    characterised in that
    the storage means (16) is used in addition to a smaller-dimensioned, continuously used buffer memory (15) of the control device (3).
  4. Method according to any one of the preceding claims,
    characterised in that
    the threshold value is selected to be in a range of 40 to 70%.
  5. Method according to any one of the preceding claims,
    characterised in that
    in order to determine the collision probability, a prediction is made of the behaviour of road users described by the driving situation data, including the motor vehicle (1) itself.
  6. Motor vehicle (1), having a vehicle system (2) for fully automatic guidance of the motor vehicle (1) comprising a control device (3) configured to carry out a method according to any one of the preceding claims and at least one environment sensor.
  7. Computer program which carries out the steps of a method according to any one of claims 1 to 5 when it is executed on a control device (3) of a motor vehicle (1) according to claim 6.
EP19152380.2A 2018-03-29 2019-01-17 Method for operating a control device, motor vehicle and computer program Active EP3546308B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102018204883.5A DE102018204883B4 (en) 2018-03-29 2018-03-29 Method for operating a control device, motor vehicle and computer program

Publications (2)

Publication Number Publication Date
EP3546308A1 EP3546308A1 (en) 2019-10-02
EP3546308B1 true EP3546308B1 (en) 2022-01-05

Family

ID=65324145

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19152380.2A Active EP3546308B1 (en) 2018-03-29 2019-01-17 Method for operating a control device, motor vehicle and computer program

Country Status (2)

Country Link
EP (1) EP3546308B1 (en)
DE (1) DE102018204883B4 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019209572A1 (en) * 2019-06-29 2020-12-31 Robert Bosch Gmbh Sensor unit for a vehicle and a vehicle with such a sensor unit
DE102020120537A1 (en) 2020-08-04 2022-02-10 Bayerische Motoren Werke Aktiengesellschaft Method and control unit for ensuring the energy supply in the event of an accident
EP4250257A1 (en) * 2022-03-22 2023-09-27 Zenseact AB Event buffer storage prioritization

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0891903B1 (en) * 1997-07-17 2009-02-11 Volkswagen Aktiengesellschaft Automatic emergency brake function
DE10029401A1 (en) * 2000-06-15 2001-12-20 Pascal Munnix Event-dependent storage of vehicle system data involves triggering control device generating storage command(s) on detecting storage event, transmitting to recording unit
DE10050243B4 (en) * 2000-10-11 2010-01-14 Volkswagen Ag System for diagnosis and / or accident documentation for vehicles, in particular motor vehicles
DE50207945D1 (en) * 2001-07-11 2006-10-05 Bosch Gmbh Robert METHOD AND DEVICE FOR THE AUTOMATIC TRIGGERING OF A VEHICLE
DE102004045813B4 (en) * 2004-09-22 2017-09-28 Robert Bosch Gmbh System and method for anticipating an accident hazard situation
DE102013212092B4 (en) * 2013-06-25 2024-01-25 Robert Bosch Gmbh Method and device for operating a pedestrian protection device of a vehicle, pedestrian protection device
DE102015218762A1 (en) * 2015-09-29 2017-03-30 Robert Bosch Gmbh Method and device for accident data storage for a vehicle
DE102016222219A1 (en) * 2016-11-11 2018-05-17 Robert Bosch Gmbh Driver assistance system for a motor vehicle

Also Published As

Publication number Publication date
DE102018204883A1 (en) 2019-10-02
DE102018204883B4 (en) 2020-09-17
EP3546308A1 (en) 2019-10-02

Similar Documents

Publication Publication Date Title
DE102007042481B4 (en) Vehicle control system for an automobile
EP2113437A2 (en) Method for ascertaining free areas in the vicinity of a motor vehicle in particular the vicinity relevant to driving the vehicle
EP2285632B1 (en) Driver assistance system
EP3546308B1 (en) Method for operating a control device, motor vehicle and computer program
DE102015004478A1 (en) A control system and method for enabling a shunting of another motor vehicle from a neighboring lane in the ACC operation of the own motor vehicle
DE102010021591A1 (en) Method for controlling the operation of a fully automatic, designed for independent vehicle management driver assistance system of a motor vehicle and motor vehicle
DE102020112686A1 (en) Adaptive autonomous emergency braking system taking into account the steering path and control method for the same
WO2018068917A1 (en) Categorization of vehicles in the environment of a motor vehicle
DE102009007885A1 (en) Method for identifying motor vehicles getting into own lane or getting out of own lane, involves automatically evaluating driving characteristics relative to lane exchange based on detected data i.e. image data of camera
DE102009045661A1 (en) Method for determining at least one passable area in the environment of a motor vehicle that is relevant in particular for the vehicle guidance
WO2020178098A1 (en) Method for the at least partially automated guidance of a motor vehicle
DE102014215274A1 (en) Method and device for operating a vehicle
DE102015107391A1 (en) Method for controlling a functional device of a motor vehicle on the basis of fused sensor data, control device, driver assistance system and motor vehicle
DE102020214031A1 (en) Method and device for controlling a safety device of a vehicle and safety system for a vehicle
DE102020214032A1 (en) Method and device for controlling a safety device of a vehicle and safety system for a vehicle
DE102007052093B4 (en) Detection of spontaneous changes in movement of pedestrians
DE102019217723A1 (en) DRIVING SAFETY CONTROL SYSTEM USING AMBIENT NOISE AND CONTROL METHOD THEREFOR
DE102010004057B4 (en) Methods and systems for monitoring vehicle movement
DE102019129904A1 (en) Automatic driving competence analysis
DE102019207518A1 (en) Risk reduction in road traffic
DE102019000060A1 (en) Controlling a vehicle using a control system
DE102018213103A1 (en) Procedure for safely towing a vehicle
DE102020202231A1 (en) Method and device for providing a training data set for training a machine learning method for estimating driver attention
DE102013013906B4 (en) Method for controlling at least one component of a motor vehicle to carry out a protective measure
DE102018130431A1 (en) Method for predicting an early lane change, driver assistance system, motor vehicle and computer program product

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20191126

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210910

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1460282

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220115

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502019003130

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20220105

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220505

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220405

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220405

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220406

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220505

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220131

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502019003130

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220117

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220131

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

26N No opposition filed

Effective date: 20221006

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220131

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220117

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240131

Year of fee payment: 6

Ref country code: GB

Payment date: 20240124

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190117

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240126

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220105