EP3750776B1 - Verfahren und system zum erfassen eines eisenbahnsignals - Google Patents
Verfahren und system zum erfassen eines eisenbahnsignals Download PDFInfo
- Publication number
- EP3750776B1 EP3750776B1 EP19179792.7A EP19179792A EP3750776B1 EP 3750776 B1 EP3750776 B1 EP 3750776B1 EP 19179792 A EP19179792 A EP 19179792A EP 3750776 B1 EP3750776 B1 EP 3750776B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- image
- region
- train
- rail track
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/041—Obstacle detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L15/00—Indicators provided on the vehicle or train for signalling purposes
- B61L15/0058—On-board optimisation of vehicle or vehicle train operation
Definitions
- the invention relates to a method and a system for the detection of railway signals relevant for the rail track that is currently used by a train.
- the invention relates to a method and system for automatically detecting, whether a signal is present and relevant for the rail track that is actually used by a train. If needed, determination of the actual state of the signal, e.g. a stop (typically red), a go (typically green), or another state, is possible after the relevant signal has been detected.
- a stop typically red
- a go typically green
- another state is possible after the relevant signal has been detected.
- signal is defined and shall be understood as railway signal.
- the overall method can be used to assist a train driver to find the relevant signal for the respective train and to avoid human failure by misinterpretation of signals. Such misinterpretation can occur in particular on railway networks having many signals for different rail tracks that are visible at the same time.
- the method can also be used to provide derived and relevant signal information for automatic train operation.
- the identification of the relative position of the signal with respect to the rail track as well as the determination of the state of the signal is of high importance also for automatic train operation.
- one objective of the invention is to automatically detect the signals associated with the actual rail track currently being used by the train, in particular in order to assist the driver or for automatic train operation.
- a standard two-dimensional camera e.g. an area scan camera as image sensor, which produces two-dimensional images.
- image sensors are widely available, easy to assemble and in general simpler and more reliable than other systems for three-dimensional environmental perception, e.g. LIDARsensors.
- Sina Aminmansour Video Analytics for the Detection of Nearmiss Incidents at Railway Level Crossings and Signal Passed at Danger Events", Queensland University of Technology, 10 October 2017 , available at: https://eprints.qut.edu.au/112765/1/Sina_Aminmansour_Thesis.pd f (last accessed 18 March 2021) discloses a method and a system for detecting railway signals associated with rail tracks currently used by a train based on two dimensional images taken by a camera installed on the train. The rail track currently used by the train and signals are identified in the image and the placement of the signals with respect to the rail tracks is identified. Based on the information, if a signal is placed left or right of the rail tracks it is decided, if the signal belongs to the relevant track of the train.
- the invention solves this problem using a method of claim 1 for detecting a signal, which is associated with the rail track that is used by a train; this method comprises the following steps:
- the invention further solves this problem using a system of claim 3.
- Such a system is designed to detect a railway signal being associated with the rail track that is used by a train.
- the system comprises:
- the criteria for determining said association may be governed by regulatory constraints and/or constraints defined by the railway network operator.
- the invention can be used when a train is on a railtrack.
- Signals which are assigned to or associated with the respective rail track are typically placed at predefined positions with respect to the rail track. These positions are usually determined by the rules of a signal regulation and/or the operator of the railway network. For example, these predefined positions of the signals may be on the right-handside of said rail track. Therefore, the respective states of these signals being located on this predefined position with respect to the rail track are valid for the respective train.
- signals which are not placed at predefined positions and are not matching other association criteria as defined in the governing regulations for a given rail track, are not relevant for trains on this rail track.
- human failure is avoided or minimized.
- situations in which the driver ignores a signal relevant to the train, or in which the driver incorrectly considers the signal of another rail track relevant can be avoided.
- the derived and relevant signal information from the image region containing the signal is of particular use for the automatic train operation.
- steps can be used to further avoid false positive detections of signals that are not relevant for the actual rail track. These steps comprise:
- the system according to the invention can be improved by a geolocation unit connected to the processing unit, wherein
- an image sensor which is located in or on the train and which is at least partly directed in the driving direction of the train, i.e. the direction of travel or movement of the train, takes two-dimensional images I t of the surrounding area, in particular of the rail track and of the signals.
- image sensors can be simply mounted in the front part of the train.
- FIG. 1 One example of such an image I t is shown in Fig. 1 .
- the image contains rail track-regions T 1 , ..., T 4 each of which depicts one rail track.
- the image I t contains signal-regions S 1 , ..., S 4 , eachof which shows one signal.
- the image of the image sensor is transmitted to a processing unit, which is used to further execute the following steps (b) to (g).
- a classification method is used in order to automatically detect the rail track-regions T 1 , ..., T 4 and the signal-regions S 1 , ..., S 4 .
- Railtracks can be detected either using classical approaches, e.g. shown in Rui Fan and Naim Dahnoun "Real-Time Stereo Vision-Based Lane Detection System", 2018 or Han Ma et el. "Multiple Lane Detection Algorithm Based on Optimised Dense Disparity Map Estimation", 2018 .
- Classical approaches usually first extract the edges or lines from the rail track-regions and then apply curve fitting to refine the railtracks.
- machine learning algorithms which e.g. train an end-to-end neural network to segment the railtracks from the background; such methods are known from the state of the art, in particular from Davy Neven, Bert De Brabandere, Stamatios Georgoulis, Marc Proesmans and Luc Van Gool "Towards End-to-End Lane Detection: an Instance Segmentation Approach", 2018 or Min Bai et el. "Deep Multi-Sensor Lane Detection", 2018 .
- the position of the actual rail track within the image I t is determined. Therefore, the regions of the current rail track, i.e. the rail track T C that is actually used by the train, is identified.
- the rail track T C used by the train and the respective region of the rail track T C within the image I t can be found by searching one of the rail track regions T t containing rail tracks already identified in step (b) that goes through or overlaps with a predefined image area A p as shown in Fig. 2 .
- This image area A p usually depends on the orientation of the image sensor within the train. If an image sensor is heading straight in the direction of movement, the predefined image area A p is in the center of the lower part of the image I t .
- the image area A p can be easily defined after mounting the image sensor in or on the train by searching for a region of the image, which is close to the train and which shows a part of the rail track, independently of the curvature of the rail track.
- step (b) it is also possible to search for the regions T t having the maximum area or containing maximum pixels among the rail tracks identified in step (b).
- the rail track currently used is close to the image sensor, it typically covers a bigger region within the image I t than the other rail track regions.
- the rail track identified in step (c) is represented by a center path P c .
- the positions of the ground points G 1 , ..., G 4 of the signals S T are estimated with respect to the image I t .
- the ground point G 1 , ..., G 4 is the point within the image that shows the base point of the pole. More generally, the ground point is the point within the image I t that depicts a surface point, which is directly underneath the respective signal S, even if the signal is not mounted on a pole, but e.g. mounted on overhead infrastructure.
- the following prerequisites are typically needed. Firstly, the size, i.e. height and width, of the panels of the signals are known. If there are different types of signals available, said type has to be firstly estimated by the shape and/or content of the image region of the signal.
- a typical kind of signal could have a rectangular panel of 1.4-meters height and 0.7-meters width. Moreover, the signal could typically be mounted in a height of 4.85-meters to 6.95-meters (see Fig. 3 ).
- the image sensor is mounted on the train in a manner that its y-axis is - at least approximately - aligned vertically, and its x-axis is - at least approximately - aligned horizontally.
- the height h t and width w t of the image region of the signal can be obtained by different methods, such as detection of an axis-parallel bounding box, etc.
- ground point is at a position between 194 px and 278 px under the lower edge of the signal's image region S t .
- an average pole height for example of 6-meters can be used, which would lead to a y-distance d t of 240 px.
- the lower edge position y l,t is defined as the highest or least y-position, depending on the orientation of the y-axis of the image sensor.
- the horizontal center x m,t of the signal region is defined as the x-coordinate of the centroid of the signal region.
- the ground point G t can be determined by calculating an offset from an image position within the region of the signal S t , wherein the offset is defined by the size, in particular by a length on the region of the signal S t .
- the ground point G t can be determined by calculating width and height of a rectangular bounding box that is parallel to the image axes.
- the position of a ground point G t underneath the signal was estimated from the image by projection of the signal within the image I t to the ground plane.
- a perspective transformation R is determined, by which it is possible to transform the sensor image I t into the projection plane; as this projection plane is - in this very example - parallel to the ground plane, the transformation returns a bird's eye view image I B .
- the transformation R is a perspective transformation, that is based on visual properties of the image and/or mounting properties of the image sensor.
- One particular method to determine the transformation R is to find a trapezoidal region R T within the region Tc of the actual rail track. Based on the mounting properties of the image sensor and the assumption of a sufficiently flat and smooth track bed it is clear, that this trapezoidal region R T typically covers a rectangular region R R within a bird's eye view image I B .
- the perspective transformation is defined in such way, that it transforms at least a trapezoidal part of the region T c of the actual rail track to a rectangular region within the bird's eye view image I B .
- the perspective transformation R is in a further step (f) applied to the selected rail track, in particular to a central path P 1 , ..., P 4 within the rail track, and to the ground points that were determined in step (d). From these data it is possible to determine real-world distances, or it is at least possible to compare distances of ground points to the actual rail track.
- a ground point G t and its respective signal S t should be associated with the actual rail track only if the distance from the ground point G t to the region, in particular the path P c , of the selected rail track S t under said perspective transformation R is below a predefined threshold distance.
- a regulation sets out more complicated rules relating to the association of signals with rail tracks. These regulations can rely on the determined distances and/or relative placement, e.g. right or left from the rail track, only. However, it is also possible that there are more complex rules relating to the association of rail tracks and signals that are based on a sequence of detections or the position of the train and the signal in the railway network. These rules may rely on distances, relative placement and sequences of signals on the rail track.
- An advanced second embodiment of the invention uses the method as described above in order to determine images of signals that are associated with the actual rail track.
- this embodiment also relies on a geolocation-map, containing the location of the rail tracks t A , ..., t G as well as the position S A , ..., S L of the signals ( Fig. 5 ) .
- a geolocation-unit is used, the geolocation-unit being connected or integrated to the processing unit.
- the geolocation-unit provides the actual geolocation of the train which is further processed by the processing unit as follows.
- GNSS Global Navigation Satellite System
- SLAM Simultaneous Localization And Mapping
- the method for detecting image regions of signals, which are associated with the actual rail track as shown in the first embodiment of the invention only needs to be carried out, if such a signal is expected based on the geolocation method as explained above. If, such as for the position e 3 , there is no on-coming signal within the associated region E 3 , the visual search for signals is turned off in order to reduce the likelihood for false positive matches.
- the associated region E 1 contains many ground points S F , S G , S I , S J . However, none of these ground points are associated with the actual rail track t C so that there is no on-coming signal; the method for detecting image regions of signals is turned off.
- the method for detecting image regions of signals is carried out in order to find a visual representation of said signal in the image I t .
- the information relating to the map positions of signals can be used in order to further avoid false positive detections of signals with respect to both further described embodiments of the invention.
- a matching algorithm is used in order to match the rail tracks t A , ..., t G of the map to the rail tracks as contained in bird's eye view image I B . If a selected ground point G t matches the geolocation of a signal of the predefined map, which is associated with the actual path as determined by the geolocation, the overall reliability of the result will be increased.
- the image region containing an image of the identified signal it is possible to display the image region containing an image of the identified signal to the train driver.
- the procedure as described above is repeated regularly so as to provide a video in order to inform the train driver about relevant on-coming signals.
- any other event can be triggered by the information automatically retrieved from the image such as simple audible, visual, or haptic warning.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Train Traffic Observation, Control, And Security (AREA)
Claims (4)
- Verfahren zum Erfassen eines Eisenbahnsignals, das mit der Fahrbahn verknüpft ist, die von einem Zug verwendet wird,a) Aufnehmen mindestens eines zweidimensionalen Bildes (It) des Zugs mit einem Bildsensor, der sich im oder am Zug befindet, das ein Bild der entgegenkommenden Fahrbahnen und Signale erzeugt,
wobei der Bildsensor derart im oder am Zug montiert ist, dass seine y-Achse im Wesentlichen vertikal ausgerichtet ist und seine x-Achse im Wesentlichen horizontal ausgerichtet ist,b) Verwenden eines Klassifizierungsverfahrens zum Identifizieren, innerhalb des Bildes (It), von Bildbereichen (Tt), die Fahrbahnen entsprechen, und Bildbereichen (St), die Signalen entsprechen,c) aus den identifizierten Bildbereichen (Tt), die Fahrbahnen entsprechen, Auswählen des Bildbereichs (Tc), der der Fahrbahn entspricht, die von dem Zug verwendet wird, insbesondere durch Identifizieren der Fahrbahn,- die durch einen vorab definierten Bereich des Bildes führt, und/oder- die maximale Fläche oder Pixelgröße aus den in Schritt b) identifizierten Fahrbahnen aufweist,d) für jeden der Bildbereiche (St), die einem Signal (S) entsprechen:- Schätzen von projizierten Punkten der Signale und projiziertem Weg der ausgewählten Fahrbahn (Tc) in eine gemeinsame Projektionsebene, insbesondere eine Bodenebene,
wobei der projizierte Punkt des Signals als die Position eines Bodenpunkts (Gt) des entsprechenden Signals innerhalb des Bildes (It) geschätzt wird,- wobei der Bodenpunkt (Gt) der Punkt innerhalb des Bildes (It) ist, der einen Oberflächenpunkt abbildet, der direkt unterhalb des entsprechenden Signals (S) ist, und- wobei die Höhe und die Breite der Tafeln des entsprechenden Signals (S) bekannt sind oder anhand der Form und/oder des Inhalts des Bildbereichs (St) des Signals (S) geschätzt werden, wobei die Bestimmung des Bodenpunkts (Gt) des Signals (S) die folgenden Schritte umfasst:- Bestimmen einer Pixelhöhe ht und einer Pixelbreite wt des Bildbereichs (St) des Signals wie folgt:- Zählen einer Anzahl von Pixeln A, die dem Bildbereich (St) des Signals entspricht- Bestimmen der Pixelhöhe ht des Bildbereichs (St) des Signals unter Verwendung eines bekannten Verhältnisses r zwischen der Höhe und Breite der Tafel des Signals (S),- Berechnen eines y-Abstandes dt von einem unteren Rand des Bildbereichs (St) des Signals zu dem entsprechenden Bodenpunkt (Gt) von der Pixelhöhe ht, die der bekannten Höhe des Signals (S) entspricht, unter Verwendung der Beziehung:- Definieren der Koordinaten des Bodenpunkts (Gt) basierend auf dem unteren Rand des Bildbereichs (St) des Signals sowie einem horizontalen Mittelpunkt des Bildbereichs (St) des Signals als:- wobei die Position des unteren Rands yl,t des Bildbereichs (St) des Signals als die höchste oder niedrigste y-Position definiert ist, in Abhängigkeit von der Ausrichtung der y-Achse des Bildsensors, und- wobei der horizontale Mittelpunkt xm,t des Bildbereichs (St) des Signals als die x-Koordinate des Schwerpunkts des Bildbereichs (St) des Signals definiert ist,e) Schätzen einer Perspektiventransformation (R), um das Bild (It) in die gemeinsame Projektionsebene zu transformieren, vorzugsweise in eine Vogelperspektivenansicht (IB), basierend auf visuellen Merkmalen des Bildes und/oder Montagemerkmalen des Bildsensors,f) Anwenden der Perspektiventransformation- am ausgewählten Bildbereich (Tc) oder Teilen davon, insbesondere einem mittleren Weg innerhalb der Fahrbahn, und- an den projizierten Punkten, undg) Bestimmen eines oder mehrerer projizierter Punkte (Gt), die einen minimalen Abstand oder einen Abstand, der geringer als ein vorab definierter Schwellenabstand ist, und/der eine Positionierung relativ zu dem ausgewählten Bildbereich (Tc) unter der Perspektiventransformation (R) aufweisen, und Identifizieren der Signale und/oder Bildbereiche (St), die Signalen entsprechen, die mit diesen projizierten Punkten innerhalb des Bildes (It) verknüpft sind. - Verfahren nach Anspruch 1, gekennzeichnet durch die folgenden Schritte:- Bereitstellen einer Karte eines Eisenbahnnetzes, die die Positionen von Fahrbahnen und Signalen beinhaltet, wobei jedes Signal mit einer Fahrbahn verknüpft ist,- Lokalisieren der Position eines Zuges auf der Eisenbahnkarte und der Fahrbahn, die er verwendet,- Verwenden der Karte zum Bestimmen der Position des entgegenkommenden Signals, das mit der Fahrbahn verknüpft ist, die er verwendet,- nur falls das entgegenkommende Signal innerhalb eines vorab bestimmten Bereichs vor dem Zug ist, Aufnehmen eines Bildes und Ausführen des Verfahrens von Anspruch 1.
- System zum Erfassen eines Eisenbahnsignals, das mit der Fahrbahn verknüpft ist, die von einem Zug verwendet wird, umfassend- einen Bildsensor, der im oder am Zug montiert ist oder montierbar ist, der eingerichtet ist, um mindestens ein zweidimensionales Bild (It) der entgegenkommenden Fahrbahnen und Signale aufzunehmen, wobei der Bildsensor derart im oder am Zug montiert ist, dass seine y-Achse im Wesentlichen vertikal ausgerichtet ist und seine x-Achse im Wesentlichen horizontal ausgerichtet ist, und- eine Verarbeitungseinheit, die mit dem Bildsensor verbunden ist, die programmiert ist, um die folgenden Schritte auszuführen:b) Verwenden eines Klassifizierungsverfahrens zum Identifizieren, innerhalb des Bildes (It), von Bildbereichen (Tt), die Fahrbahnen entsprechen, und Bildbereichen (St), die Signalen entsprechen,c) aus den identifizierten Bildbereichen (Tt), die Fahrbahnen entsprechen, Auswählen des Bildbereichs (Tc), der der Fahrbahn entspricht, die von dem Zug verwendet wird, insbesondere durch Identifizieren der Fahrbahn,- die durch einen vorab definierten Bereich des Bildes führt, und/oder- die maximale Fläche oder Pixelgröße aus den in Schritt b) identifizierten Fahrbahnen aufweist,d) für jeden der Bildbereiche (St), die einem Signal (S) entsprechen:- Schätzen von projizierten Punkten der Signale und projiziertem Weg der ausgewählten Fahrbahn (Tc) in eine gemeinsame Projektionsebene, insbesondere eine Bodenebene, wobei der projizierte Punkt des Signals als die Position eines Bodenpunkts (Gt) des entsprechenden Signals innerhalb des Bildes (It) geschätzt wird,- wobei der Bodenpunkt (Gt) der Punkt innerhalb des Bildes (It) ist, der einen Oberflächenpunkt abbildet, der direkt unterhalb des entsprechenden Signals (S) ist, und- wobei die Höhe und die Breite der Tafeln des entsprechenden Signals (S) bekannt sind oder anhand der Form und/oder des Inhalts des Bildbereichs (St) des Signals (S) geschätzt werden,
wobei die Bestimmung des Bodenpunkts (Gt) des Signals (S) die folgenden Schritte umfasst:- Bestimmen einer Pixelhöhe ht und einer Pixelbreite wt des Bildbereichs (St) des Signals wie folgt:- Zählen einer Anzahl von Pixeln A, die dem Bildbereich (St) des Signals entspricht- Bestimmen der Pixelhöhe ht des Bildbereichs (St) des Signals unter Verwendung eines bekannten Verhältnisses r zwischen der Höhe und Breite der Tafel des Signals (S),- Berechnen eines y-Abstandes dt von einem unteren Rand des Bildbereichs (St) des Signals zu dem entsprechenden Bodenpunkt (Gt) von der Pixelhöhe ht, die der bekannten Höhe des Signals (S) entspricht, unter Verwendung der Beziehung:- Definieren der Koordinaten des Bodenpunkts (Gt) basierend auf dem unteren Rand des Bildbereichs (St) des Signals sowie einem horizontalen Mittelpunkt des Bildbereichs (St) des Signals als:- wobei die Position des unteren Rands y1,t des Bildbereichs (St) des Signals als die höchste oder niedrigste y-Position definiert ist, in Abhängigkeit von der Ausrichtung der y-Achse des Bildsensors, und- wobei der horizontale Mittelpunkt xm,t des Bildbereichs (St) des Signals als die x-Koordinate des Schwerpunkts des Bildbereichs (St) des Signals definiert ist,e) Schätzen einer Perspektiventransformation (R), um das Bild (It) in die gemeinsame Projektionsebene zu transformieren, vorzugsweise in eine Vogelperspektivenansicht (IB), basierend auf visuellen Merkmalen des Bildes und/oder Montagemerkmalen des Bildsensors,f) Anwenden der Perspektiventransformation- am ausgewählten Bildbereich (Tc) oder Teilen davon, insbesondere einem mittleren Weg innerhalb der Fahrbahn, und- an den projizierten Punkten, undg) Bestimmen eines oder mehrerer projizierter Punkte (Gt), die einen minimalen Abstand oder einen Abstand, der geringer als ein vorab definierter Schwellenabstand ist, und/der eine Positionierung relativ zu dem ausgewählten Bildbereich (Tc) unter der Perspektiventransformation (R) aufweisen, und Identifizieren der Signale und/oder Bildbereiche (St), die Signalen entsprechen, die mit diesen projizierten Punkten innerhalb des Bildes (It) verknüpft sind. - System nach Anspruch 3, weiter gekennzeichnet durch eine Geolokalisierungseinheit, die mit der Verarbeitungseinheit verbunden ist, wobei- die Verarbeitungseinheit weiter einen Speicher für eine Karte des Eisenbahnnetzes umfasst, die die Positionen von Fahrbahnen und Signalen beinhaltet, wobei jedes Signal mit einer Fahrbahn verknüpft ist, und- die Verarbeitungseinheit weiter programmiert ist, um die folgenden Schritte auszuführen:- Auffinden der Position des Zugs, die von der Geolokalisierungseinheit bereitgestellt wird, innerhalb der Eisenbahnkarte und der Fahrbahn, die er verwendet,- Verwenden der Karte zum Bestimmen der Position des entgegenkommenden Signals, das mit der Fahrbahn verknüpft ist, die er verwendet, und- nur falls das entgegenkommende Signal innerhalb eines vorab bestimmten Bereichs vor dem Zug ist, Aufnehmen eines Bildes und Ausführen der Schritte b) bis g) von Anspruch 3.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| ES19179792T ES2930674T3 (es) | 2019-06-12 | 2019-06-12 | Método y sistema para detectar una señal ferroviaria |
| EP19179792.7A EP3750776B1 (de) | 2019-06-12 | 2019-06-12 | Verfahren und system zum erfassen eines eisenbahnsignals |
| PCT/EP2020/065968 WO2020249558A1 (en) | 2019-06-12 | 2020-06-09 | Method for detecting a railroad signal |
| IL288651A IL288651B1 (en) | 2019-06-12 | 2020-06-09 | Method and system for detecting a track signal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP19179792.7A EP3750776B1 (de) | 2019-06-12 | 2019-06-12 | Verfahren und system zum erfassen eines eisenbahnsignals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP3750776A1 EP3750776A1 (de) | 2020-12-16 |
| EP3750776B1 true EP3750776B1 (de) | 2022-08-24 |
Family
ID=66857677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP19179792.7A Active EP3750776B1 (de) | 2019-06-12 | 2019-06-12 | Verfahren und system zum erfassen eines eisenbahnsignals |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP3750776B1 (de) |
| ES (1) | ES2930674T3 (de) |
| IL (1) | IL288651B1 (de) |
| WO (1) | WO2020249558A1 (de) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR3142983A1 (fr) * | 2022-12-08 | 2024-06-14 | Alstom Holdings | Procédé pour déterminer la position d’un véhicule ferroviaire |
| DE102024203289A1 (de) * | 2024-04-10 | 2025-10-16 | Siemens Mobility GmbH | Verfahren und Einrichtungen zum Betreiben eines Schienenfahrzeugs |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9796400B2 (en) * | 2013-11-27 | 2017-10-24 | Solfice Research, Inc. | Real time machine vision and point-cloud analysis for remote sensing and vehicle control |
| EP3048559A1 (de) * | 2015-01-21 | 2016-07-27 | RindInvest AB | Verfahren und System zur Erkennung eines Bahngleises |
-
2019
- 2019-06-12 ES ES19179792T patent/ES2930674T3/es active Active
- 2019-06-12 EP EP19179792.7A patent/EP3750776B1/de active Active
-
2020
- 2020-06-09 IL IL288651A patent/IL288651B1/en unknown
- 2020-06-09 WO PCT/EP2020/065968 patent/WO2020249558A1/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020249558A1 (en) | 2020-12-17 |
| IL288651B1 (en) | 2026-02-01 |
| EP3750776A1 (de) | 2020-12-16 |
| IL288651A (en) | 2022-02-01 |
| ES2930674T3 (es) | 2022-12-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2431917B1 (de) | Grenz- und Schutzgeländererkennung mithilfe einer einzigen Kamera | |
| US11024051B2 (en) | Object detection device | |
| US11280630B2 (en) | Updating map data | |
| US6819779B1 (en) | Lane detection system and apparatus | |
| JP5297078B2 (ja) | 車両の死角における移動物体を検知するための方法、および死角検知装置 | |
| Miyasaka et al. | Ego-motion estimation and moving object tracking using multi-layer lidar | |
| US11514683B2 (en) | Outside recognition apparatus for vehicle | |
| US20150073705A1 (en) | Vehicle environment recognition apparatus | |
| EP3048559A1 (de) | Verfahren und System zur Erkennung eines Bahngleises | |
| JP7675339B2 (ja) | 物体追跡装置 | |
| CN109791598A (zh) | 用于识别地面标记的图像处理方法以及地面标记检测系统 | |
| JP2008123462A (ja) | 物体検知装置 | |
| JP2005136946A (ja) | 路上走行車両用のカメラ式位置認識装置および方法 | |
| JP2016148962A (ja) | 物体検知装置 | |
| JP2014199546A (ja) | 運転支援装置及び運転支援方法 | |
| EP3223241A1 (de) | Fahrroutenerkennungsvorrichtung und fahrroutenassistenzsystem mit verwendung davon | |
| JP2021120255A (ja) | 距離推定装置及び距離推定用コンピュータプログラム | |
| EP3750776B1 (de) | Verfahren und system zum erfassen eines eisenbahnsignals | |
| Baehring et al. | Detection of close cut-in and overtaking vehicles for driver assistance based on planar parallax | |
| JP2014026519A (ja) | 車載レーンマーカ認識装置 | |
| US12498228B1 (en) | Detecting and resolving disparities between map data and environments perceived by sensor systems | |
| JP2011103058A (ja) | 誤認識防止装置 | |
| JP2002008019A (ja) | 軌道認識装置及び軌道認識装置を用いた鉄道車両 | |
| KR20060134719A (ko) | 차량의 주차 구획 인식방법 | |
| EP4579581A1 (de) | Vorrichtung zur erkennung einer externen welt und verfahren zur erkennung einer externen welt |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20210323 |
|
| RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06T 3/00 20060101ALN20220128BHEP Ipc: B61L 3/00 20060101ALN20220128BHEP Ipc: B61L 23/04 20060101AFI20220128BHEP |
|
| INTG | Intention to grant announced |
Effective date: 20220309 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1513471 Country of ref document: AT Kind code of ref document: T Effective date: 20220915 Ref country code: DE Ref legal event code: R096 Ref document number: 602019018555 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
| REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2930674 Country of ref document: ES Kind code of ref document: T3 Effective date: 20221220 |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20220824 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221226 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221124 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221224 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221125 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602019018555 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230621 |
|
| 26N | No opposition filed |
Effective date: 20230525 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20230630 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230612 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230612 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230630 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20250618 Year of fee payment: 7 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20250618 Year of fee payment: 7 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20250626 Year of fee payment: 7 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: AT Payment date: 20250627 Year of fee payment: 7 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20190612 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CZ Payment date: 20250603 Year of fee payment: 7 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IE Payment date: 20250618 Year of fee payment: 7 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20190612 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20250731 Year of fee payment: 7 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20250701 Year of fee payment: 7 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220824 |