DE102023004114A1 - Method and device for reporting a traffic sign requiring correction - Google Patents

Abstract

The invention relates to a method (100) for reporting a traffic sign (Vz) that requires correction and is detected by a vehicle (2), comprising the steps: - transmission (101) of a visual recording of a traffic sign (Vz) detected by the vehicle (2). to a vehicle-external central computing unit (3) and/or to a vehicle-side evaluation unit (2.2), - comparison (102) of the visual recording of the traffic sign (Vz) with stored traffic sign information, - identification (103) of a traffic sign (Vz) in need of correction when determining a Deviation of the visual recording of the traffic sign (Vz) from the stored traffic sign information and transmission (104) of information about the traffic sign (Vz) requiring correction from the vehicle-external central computing unit (3) and / or the vehicle-side evaluation unit (2.2) to at least one central station and /or to other vehicles.The invention further relates to a device (1) for reporting a traffic sign (Vz) that requires correction.

Description

The invention relates to a method for reporting a traffic sign in need of correction according to the preamble of claim 1. The invention further relates to a device for reporting a traffic sign in need of correction according to the preamble of claim 6.

From the DE 10 2008 043 756 A1 a method for providing traffic sign information is known, which includes a step of storing traffic sign data of a plurality of traffic signs, a step of assigning traffic sign data of a stored traffic sign to a current position of a vehicle and a step of providing traffic sign information based on the traffic sign data assigned to the current position of the vehicle.

The invention is based on the object of specifying a method and an improved device for reporting a traffic sign that requires correction compared to the prior art.

The problem with regard to the method is solved according to the invention by a method according to the specified features of claim 1. The problem with regard to the device is solved according to the invention by a method according to the specified features of claim 6.

Advantageous embodiments of the invention are the subject of the subclaims.

• - Übermittlung einer vom Fahrzeug erfassten visuellen Aufnahme eines Verkehrszeichens an eine fahrzeugexterne zentrale Recheneinheit und/oder an eine fahrzeugseitige Auswerteeinheit,
• - Abgleich der visuellen Aufnahme des Verkehrszeichens mit hinterlegten Verkehrszeicheninformationen,
• - Identifizierung eines korrekturbedürftigen Verkehrszeichens bei Ermittlung einer Abweichung der visuellen Aufnahme des Verkehrszeichens von den hinterlegten Verkehrszeicheninformationen, und
• - Übermittlung einer Information über das korrekturbedürftige Verkehrszeichen von der fahrzeugexternen zentralen Recheneinheit und/oder der fahrzeugseitigen Auswerteeinheit an zumindest eine Zentrale und/oder an andere Fahrzeuge.

In the method according to the invention for reporting a traffic sign that requires correction, a traffic sign is detected by a vehicle, for example by means of at least one detection unit of the vehicle, the method comprising the following steps:

• - Transmission of a visual recording of a traffic sign recorded by the vehicle to a central processing unit external to the vehicle and/or to an evaluation unit on the vehicle,
• - Comparison of the visual recording of the traffic sign with stored traffic sign information,
• - Identification of a traffic sign requiring correction when determining a deviation of the visual recording of the traffic sign from the stored traffic sign information, and
• - Transmission of information about the traffic sign requiring correction from the vehicle-external central computing unit and/or the vehicle-side evaluation unit to at least one control center and/or to other vehicles.

In particular, the method is provided for recording and reporting traffic signs that require correction, for example traffic signs and/or signage.

It happens that the traffic signs are installed incorrectly. For example, traffic signs can be “upside down” after weather events, incorrect installation and vandalism. Traffic signs can be installed in such a way that they contradict the visibility principle of the StVO, for example because they are incorrectly aligned. For example, a traffic sign indicating a speed limit may not be aligned across the road, but horizontally to the road.

There are also situations in real road traffic in which the traffic signs and/or signage are contradictory or at least highly misleading. This applies, for example, to a case where a first sign at a location is for a traffic-calmed area, but on the other hand, another sign is placed in the immediate vicinity of the first sign, which indicates a prohibition on entry.

Additionally, vandalism can result in street signage that is impossible to see or is difficult to see.

The aim of the invention is to increase traffic safety or driving comfort, which can be negatively influenced, for example, by a faulty or misleading traffic sign, for example signage and/or a traffic sign. The responsible authorities can only correct the traffic sign if relevant problems are known or reported.

By automatically detecting incorrectly installed traffic signs and forwarding them to the responsible authorities, a systematic basis for troubleshooting is created. In addition, drivers of other vehicles can be made aware of incorrectly installed or misleading traffic signs, thereby increasing traffic safety.

Exemplary embodiments of the invention are explained in more detail below with reference to drawings.

• 1 schematisch eine Vorrichtung zur Durchführung eines erfindungsgemäßen Verfahrens zum Bereitstellen zumindest einer Information zu zumindest einem Verkehrszeichen, und
• 2 schematisch ein Ablaufdiagramm des erfindungsgemäßen Verfahrens zum Bereitstellen zumindest einer Information zu zumindest einem Verkehrszeichen.

Show:

• 1 schematically a device for carrying out a method according to the invention for providing at least one piece of information about at least one traffic sign, and
• 2 schematically a flowchart of the method according to the invention for providing at least one piece of information about at least one traffic sign.

Corresponding parts are provided with the same reference numbers in all figures.

1 shows schematically a device 1 for carrying out a method 100 for reporting a traffic sign Vz in need of correction and for providing at least one piece of information relating to the traffic sign Vz in need of correction.

The device 1 comprises at least one vehicle 2 and a central computing unit 3 that is external to the vehicle and can be brought into communication with the vehicle 2 or is stationary.

The vehicle 2 can be an automated, for example highly automated, partially automated or autonomously operated vehicle 2 and/or fleet vehicle. The central processing unit 3 can be cloud-based. The central computing unit 3 can be, for example, a server external to the vehicle, a server of a service provider or a so-called backend, for example vehicle backend and/or Internet backend.

The vehicle 2 can be an automated, for example highly automated, partially automated or autonomously operated vehicle 2. The vehicle 2 can be part of a vehicle fleet.

The vehicle 2 includes at least one detection unit 2.1 for detecting objects in a vehicle environment. The detection unit 2.1 can be an object recognition device for recognizing objects in a vehicle environment. The detection unit 2.1 can, for example, be part of a driver assistance system. The detection unit 2.1 can include at least one camera and/or a sensor.

For communication with the central processing unit 3, the vehicle 2 can include at least one communication unit, not shown in detail.

Furthermore, the vehicle 2 includes at least one evaluation unit 2.2 coupled to the detection unit 2.1 for evaluating data recorded by means of the detection unit 2.1. The evaluation unit 2.2 can be coupled to the communication unit and/or other control components of the vehicle 2 (not shown in detail).

In particular, the device 1 is intended for detecting and reporting traffic signs Vz that require correction, for example traffic signs and/or signage.

The device 1 can be part of a vehicle telematics and/or a vehicle assistance system.

It happens that the traffic signs Vz are installed incorrectly. For example, traffic signs Vz can be “upside down” after weather events, incorrect installation and vandalism. Traffic signs Vz can be installed in such a way that they contradict the visibility principle of the StVO, e.g. because they are incorrectly aligned. For example, a traffic sign Vz indicating a speed limit may not be aligned transversely to the road, but horizontally to the road.

There are also situations in real road traffic in which the traffic signs Vz, for example traffic signs and/or signage, are contradictory or at least very misleading in relation to one another. This concerns, for example, a case when a first traffic sign Vz applies to a traffic-calmed area at a location (according to sign 325/1), but on the other hand another traffic sign Vz is installed in the immediate vicinity of the first traffic sign Vz, which prohibits entry (according to sign 267) applies. For the traffic-calmed area, among other things, Walking speed may be required, but the ban means neither vehicles nor cyclists can use the entrance.

Additionally, vandalism can result in street signage that is impossible to see or is difficult to see.

The aim of the invention is to increase traffic safety or driving comfort, which can be negatively influenced, for example, by a faulty or misleading traffic sign Vz. The responsible authorities can only correct the traffic sign Vz if relevant problems are known or reported.

By means of the device 1, incorrect or misleading traffic signs Vz can be identified during driving and information relating to the incorrect or misleading traffic signs Vz can be sent to a central office, for example a responsible authority such as a State authority, to a city center and/or community center. The information can include a visual recording, i.e. an image, a position, type and severity of a need for correction and/or a time stamp.

• - eine mittels der Erfassungseinheit 2.1 erfasste visuelle Aufnahme des Verkehrszeichens Vz mit hinterlegten Verkehrszeicheninformationen abzugleichen,
• - ein korrekturbedürftiges Verkehrszeichen Vz bei Ermittlung einer Abweichung der visuellen Aufnahme des Verkehrszeichens Vz von den hinterlegten Verkehrszeicheninformationen zu identifizieren und
• - eine Information über das korrekturbedürftige Verkehrszeichen Vz an zumindest eine Zentrale und/oder an andere Fahrzeuge zu übermitteln, insbesondere zu melden.

The evaluation unit 2.2 and/or the vehicle-external central computing unit (3) are/is designed to

• - to compare a visual recording of the traffic sign Vz captured by the detection unit 2.1 with stored traffic sign information,
• - to identify a traffic sign Vz that requires correction when determining a deviation of the visual recording of the traffic sign Vz from the stored traffic sign information and
• - to transmit, in particular to report, information about the traffic sign Vz that requires correction to at least one control center and/or to other vehicles.

2 shows schematically a flowchart of a method 100 according to the invention for reporting a traffic sign Vz that requires correction and is detected by a vehicle 2.

In the method 100, the traffic sign Vz is detected by at least one detection unit 2.1 of a vehicle 2. The vehicle 2 can have at least one outward-facing camera. The vehicle 2 is connected or can be connected to a central computing unit 3 external to the vehicle, for example a backend. The vehicle 2 can be equipped with systems, programs and/or algorithms that can interpret traffic signs Vz.

In a first step, a visual recording of the traffic sign Vz recorded by the detection unit 2.1 is transmitted 101 to the vehicle-external central computing unit 3 and/or to the vehicle-side evaluation unit 2.2.

In a second step, a comparison 102 or comparison of the visual recording of the traffic sign Vz with stored traffic sign information is carried out in the vehicle-external central computing unit 3 and/or in the vehicle-side evaluation unit 2.2.

In a third step, an identification 103 of a traffic sign Vz requiring correction takes place when a deviation of the visual recording of the traffic sign Vz from the stored traffic sign information is determined.

In a fourth step, a transmission 104, in particular a message, of information about the traffic sign Vz requiring correction takes place from the vehicle-external central computing unit 3 and/or the vehicle-side evaluation unit 2.2 to at least one control center and/or to other vehicles.

• - einer inkorrekten, missverständlichen und/oder ungenauen Ausrichtung des Verkehrszeichens Vz und/oder
• - einer nicht ordnungsgemäßen Montage des Verkehrszeichens Vz und/oder
• - einer Verdeckung des Verkehrszeichens Vz durch ein anderes Objekt und/oder
• - einer Verschmutzung am Verkehrszeichen Vz und/oder
• - einer Zerstörung und/oder Beschädigung am Verkehrszeichen Vz und/oder
• - einer missverständlichen und/oder falschen Reihenfolge von Zusatzschildern im Bereich des Verkehrszeichens Vz und/oder
• - einer widersprüchlichen Kombination aus mehreren Verkehrszeichen Vz.

A traffic sign Vz requiring correction is identified if the stored traffic sign information cannot be clearly assigned to the visual recording of the traffic sign Vz due to:

• - an incorrect, misleading and/or imprecise alignment of the traffic sign Vz and/or
• - improper installation of the traffic sign Vz and/or
• - the traffic sign Vz is obscured by another object and/or
• - contamination on traffic signs Vz and/or
• - destruction and/or damage to traffic signs Vz and/or
• - a misleading and/or incorrect sequence of additional signs in the area of the traffic sign Vz and/or
• - a contradictory combination of several traffic signs Vz.

• - ein Bild und/oder
• - eine Position und/oder
• - eine Art und/oder Schwere einer Korrekturbedürftigkeit und/oder
• - ein Zeitstempel einer erstmaligen Detektion gespeichert wird.

At least one data point is assigned to the traffic sign Vz that requires correction, with at least

• - a picture and/or
• - a position and/or
• - a type and/or severity of a need for correction and/or
• - a timestamp of an initial detection is saved.

Data points can be transmitted to the control center and/or to other vehicles together with the information about the traffic sign Vz that requires correction.

The identification 103 of the traffic sign Vz requiring correction is carried out using an image processing method and/or machine learning.

When identifying 103 the traffic sign Vz requiring correction, at least one correction suggestion for interpreting the traffic sign Vz requiring correction is sent to a vehicle driver of the vehicle 2, with a number of several traffic sign alternatives being issued as a correction suggestion for confirmation by the vehicle driver.

• Seitens einer cloudbasierten zentralen Recheneinheit 3, nachfolgend auch Backend oder cloudbasiertes Backend genannt, können visuelle Aufnahmen eines Verkehrszeichens Vz, nachfolgend auch Straßenbeschilderung oder Verkehrsschild genannt, vom Fahrzeug 2 entgegengenommen werden, um korrekturbedürftige Verkehrsschilder bzw. Verkehrsschilderkombinationen zu identifizieren.

The method 100 is summarized below in other words:

• On the part of a cloud-based central computing unit 3, hereinafter also referred to as backend or cloud-based backend, visual recordings of a traffic sign Vz, hereinafter also referred to as road signs or traffic signs, can be received by the vehicle 2 in order to identify traffic signs or traffic sign combinations that require correction.

The method 100 can alternatively or optionally also be carried out in the vehicle 2, in particular by means of the vehicle-side evaluation unit 2.2, and only traffic signs that require correction can be transmitted to the backend.

The backend can prepare and compile temporal-spatial evaluations of a number of traffic signs that require correction.

• - Verkehrszeichen Vz mit einer inkorrekten, missverständlichen oder ungenauen Ausrichtung, wobei das Verkehrszeichen Vz beispielsweise nicht oder nicht exakt quer zur Fahrbahn steht;
• - Verkehrszeichen Vz mit nicht ordnungsgemäßer Montage, wobei das Verkehrszeichen Vz beispielsweise verkehrt herum montiert wurde und/oder sich gelockert hat und/oder schief-hängend ist, da es beispielsweise von einem Fahrzeug, beispielsweise einem Fahrrad, einem Bus oder Lastkraftwagen angefahren oder angestoßen wurde;
• - Verkehrszeichen Vz, die von Pflanzen verdeckt sind;
• - Verkehrszeichen Vz, die aufgrund von Verschmutzung nicht oder nicht vollständig lesbar sind;
• - Verkehrszeichen Vz, die Vandalismus ausgesetzt waren und beispielsweise beschädigt und/oder teilweise oder ganz überbeklebt wurden;
• - Verkehrszeichen Vz mit missverständlicher oder falscher Reihenfolge von Zusatzschilder unter einem anderen Verkehrszeichen Vz;
• - Verkehrszeichen Vz oder eine Kombination aus mehreren Verkehrszeichen Vz in räumlicher Nähe zueinander mit widersprüchlichen Kennzeichnungen.

Traffic signs Vz that require correction can be:

• - Traffic sign Vz with an incorrect, misleading or imprecise alignment, whereby the traffic sign Vz, for example, is not or not exactly perpendicular to the road;
• - Traffic sign Vz with incorrect assembly, whereby the traffic sign Vz was, for example, installed upside down and/or has become loose and/or is hanging askew, for example because it was hit or bumped into by a vehicle, for example a bicycle, a bus or a truck ;
• - traffic signs Vz, which are hidden by plants;
• - Traffic signs Vz that are not or not completely legible due to contamination;
• - Traffic signs Vz that were subjected to vandalism and were, for example, damaged and/or partially or completely covered over;
• - Traffic sign Vz with ambiguous or incorrect order of additional signs under another traffic sign Vz;
• - Traffic signs Vz or a combination of several traffic signs Vz in spatial proximity to one another with contradictory markings.

• - Bild, und/oder
• - Position, und/oder
• - Art und Schwere der Korrekturbedürftigkeit, und/oder
• - Zeitstempel der erstmaligen Detektion.

The following data points can be saved for each traffic sign Vz that requires correction, ie traffic sign or traffic sign combination:

• - Image, and/or
• - Position, and/or
• - Type and severity of the need for correction, and/or
• - Time stamp of the first detection.

The cloud-based backend can find traffic signs that require correction using image processing or machine learning methods.

• Schritt 1: Alle Verkehrszeichen Vz in einer visuellen Aufnahme erkennen.
• Schritt 2: Abgleich ob alle erkannten Verkehrszeichen Vz einer Definition in der StVO entsprechen.
• Schritt 3: Für jedes Verkehrszeichen Vz, das nicht in der StVO gefunden werden konnte:
  • - Das Bild bzw. die visuelle Aufnahme dreimal um 90 Grad drehen (oder siebenmal um 45 Grad etc.) und die Identifikation jeweils erneut versuchen;
  • - Korrekturbedürftige Verkehrsschilder an die zuständigen Landesbehörden, Städte oder Gemeinden melden;
  • - Informationen zu korrekturbedürftigen Verkehrsschildern an andere Fahrzeuge übertragen,
  • - Fahrer bzw. Fahrzeugführer des Fahrzeugs 2, welches das korrekturbedürftige Verkehrsschild erfasst hat, auf korrekturbedürfte Verkehrsschilder visuell, haptisch und/oder akustisch vorbereiten.

A simple exemplary process is described below to detect traffic signs installed the wrong way round:

• Step 1: Recognize all traffic signs Vz in a visual recording.
• Step 2: Compare whether all recognized traffic signs Vz correspond to a definition in the StVO.
• Step 3: For each traffic sign Vz that could not be found in the StVO:
  • - Rotate the image or visual recording three times by 90 degrees (or seven times by 45 degrees, etc.) and try the identification again each time;
  • - Report traffic signs in need of correction to the responsible state authorities, cities or municipalities;
  • - transmit information about traffic signs that require correction to other vehicles,
  • - Prepare the driver or driver of vehicle 2, which has detected the traffic sign requiring correction, visually, haptically and/or acoustically for traffic signs requiring correction.

The driver can be shown an option and/or a correction suggestion for interpreting the detected traffic sign Vz that requires correction by the vehicle 2 and/or by the central computing unit 3. For example, the driver can enter a suggested correction to the current signage. The vehicle 2, in particular the evaluation unit 2.2, and/or the central Computing unit 3 can suggest several alternatives to traffic signs to the driver for confirmation, with the alternatives that seem most likely from the system perspective being suggested.

The suggestions are presented to the driver in visual and/or acoustic form, with text and/or graphics or images being presented in the case of visual form.

The suggestions can also only contain one alternative or possibility. In this case, the driver has the opportunity to accept the system's suggestion, i.e. H. of the vehicle 2 and/or the central processing unit 3 to confirm or reject.

A preliminary interpretation is carried out by the backend or alternatively by vehicle 2.

Vehicles or drivers driving past the position of a traffic sign that has been recorded as requiring correction are asked by the backend to confirm whether the traffic sign requiring correction is still present at the corresponding position.

The confirmation or rejection of the driver or vehicle 2 is transmitted to the backend. In the event of a rejection, a database in the vehicle-side evaluation unit 2.2 and/or in the central computing unit 3 containing the traffic signs that require correction is cleaned up accordingly.

Reference symbol list

1

contraption

2

vehicle

2.1

Acquisition unit

2.2

Evaluation unit

3

central computing unit

100

Proceedings

101

transmission

102

adjustment

103

identification

104

transmission

Vz

Traffic signs

QUOTES INCLUDED IN THE DESCRIPTION

This list of documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• DE 102008043756 A1 [0002]

Claims (6)

Method (100) for reporting a traffic sign (Vz) in need of correction, which is detected by a vehicle (2), characterized by the following steps: - Transmission (101) of a visual recording of a traffic sign (Vz) recorded by the vehicle (2) to an external vehicle central computing unit (3) and/or to a vehicle-side evaluation unit (2.2), - comparison (102) of the visual recording of the traffic sign (Vz) with stored traffic sign information, - identification (103) of a traffic sign (Vz) in need of correction when determining a deviation in the visual Recording the traffic sign (Vz) from the stored traffic sign information, and - transmission (104) of information about the traffic sign (Vz) requiring correction from the vehicle-external central computing unit (3) and/or the vehicle-side evaluation unit (2.2) to at least one central station and/or to other vehicles. Procedure (100) according to Claim 1 , characterized in that a traffic sign (Vz) requiring correction is identified if the stored traffic sign information cannot be clearly assigned to the visual recording of the traffic sign due to: - an incorrect, misleading and / or imprecise alignment of the traffic sign (Vz) and / or - improper installation of the traffic sign (Vz) and/or - the traffic sign (Vz) being covered by another object and/or - contamination of the traffic sign (Vz) and/or - destruction and/or damage to the traffic sign (Vz) and/or - a misleading and/or incorrect sequence of additional signs in the area of the traffic sign (Vz) and/or - a contradictory combination of several traffic signs (Vz). Procedure (100) according to Claim 1 or 2 , characterized in that at least one data point is assigned to the traffic sign (Vz) requiring correction, the data point being at least - an image and / or - a position and / or - a type and / or severity of a need for correction and / or - a timestamp of a first Detection is saved. Method (100) according to one of the preceding claims, characterized in that the identification (103) of the traffic sign (Vz) requiring correction is carried out by an image processing method and/or by machine learning. Method (100) according to one of the preceding claims, characterized in that upon identification (103) of the traffic sign (Vz) requiring correction, at least one correction suggestion for interpreting the traffic sign (Vz) requiring correction is issued to a driver of the vehicle (2), whereby as a correction suggestion a number of several traffic sign alternatives are issued for confirmation by the vehicle driver. Device (1) for reporting a traffic sign (Vz) in need of correction, comprising at least - a vehicle (2) with at least one detection unit (2.1) for detecting a traffic sign (Vz) in a vehicle environment and an evaluation unit (2.2) coupled to the detection unit (2.1). ) and - a central computing unit (3) external to the vehicle, which can be brought into communication with the vehicle (2) or is stationary, characterized in that the evaluation unit (2.2) and / or the central computing unit (3) external to the vehicle are/is designed, - to compare a visual recording of the traffic sign (Vz) recorded by means of the detection unit (2.1) with stored traffic sign information, - to identify a traffic sign (Vz) in need of correction when determining a deviation of the visual recording of the traffic sign (Vz) from the stored traffic sign information and - information about to transmit the traffic sign (Vz) requiring correction to at least one control center and/or to other vehicles.

Images