WO2022228592A1 - Railway train equipment for the detection of objects and their subsequent classification - Google Patents
Railway train equipment for the detection of objects and their subsequent classification Download PDFInfo
- Publication number
- WO2022228592A1 WO2022228592A1 PCT/CZ2022/050044 CZ2022050044W WO2022228592A1 WO 2022228592 A1 WO2022228592 A1 WO 2022228592A1 CZ 2022050044 W CZ2022050044 W CZ 2022050044W WO 2022228592 A1 WO2022228592 A1 WO 2022228592A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- train
- computing unit
- detection
- objects
- module
- Prior art date
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 19
- 238000012544 monitoring process Methods 0.000 claims abstract description 7
- 241001465754 Metazoa Species 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000009993 protective function Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000021317 sensory perception Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L15/00—Indicators provided on the vehicle or train for signalling purposes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/041—Obstacle detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/08—Control, warning or like safety means along the route or between vehicles or trains for controlling traffic in one direction only
- B61L23/14—Control, warning or like safety means along the route or between vehicles or trains for controlling traffic in one direction only automatically operated
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L27/00—Central railway traffic control systems; Trackside control; Communication systems specially adapted therefor
- B61L27/04—Automatic systems, e.g. controlled by train; Change-over to manual control
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L15/00—Indicators provided on the vehicle or train for signalling purposes
- B61L15/0072—On-board train data handling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L2205/00—Communication or navigation systems for railway traffic
- B61L2205/04—Satellite based navigation systems, e.g. global positioning system [GPS]
Definitions
- the whole system for unmanned train operation has to be a very complex so phisticated system of cooperating subsystems.
- These subsystems include, for example, the Automatic Train Operation (ATO) system, known in the Czech Republic under the abbreviation AVV (Automatic Train Control), as well as an expert train decision making system replacing the engine driver's decision-making skills and, last but not least, a number of detectors replacing the engine driver's sensory perception.
- ATO Automatic Train Operation
- AVV Automatic Train Control
- detectors include the object detector, which is intended to replace the eyes or vision of the engine driver when monitoring the area in front of and around the railway vehicle.
- the subject of the presented technical solution is the design and technical solution of the equipment for the detection of objects and their subsequent classification which is railway train equipment for the detection of objects.
- detection sensors a group of lidars, a stereo camera, a thermal camera and a high-resolution camera
- detection sensors placed in an adaptive bracket on the front of the railway vehicle continuously monitor what is happening in the area in front of the train and in close proximity to the train. Thanks to the use of different types of sensors, a given scene can be captured in multiple parts of the elec- tromagnetic spectrum both visible and invisible to the human eye. All raw sensor data is analyzed and stored in the computing unit of the object detector. All data processing and calculations for object detection take place in this unit in real time and inde pendently of the speed of the moving vehicle.
- the data is processed using analytical al gorithms and also with the help of artificial intelligence, which is able to classify not only common objects (human, animal, vehicles) but also special railway objects (signals, their signaling signs, etc.).
- Two approaches are used to determine the clearance profile and define the safe zone. The first is to use a digital map created by scanning the track, and the second approach is to detect the track (or. rails) to refine the entire alignment.
- the output of the computing unit of the object detector is then mainly position and character information (e.g. the position of the detected object in relation to the train head or the type and properties of this object). This information is ready to be distributed to downstream train subsystems (e.g. train expert decision making system, automatic unmanned train control system or unmanned train traffic control monitoring terminal).
- train subsystems e.g. train expert decision making system, automatic unmanned train control system or unmanned train traffic control monitoring terminal.
- FIG.l represents the embodimen of the device according to this technical solution.
- the subject of the technical solution is a railway device 10 for the detection of objects and their subsequent classification, comprising detection sensors connected to a computing unit 8 with a module 7 of the Global Positioning System Global Positioning System (hereinafter also GNSS).
- GNSS Global Positioning System Global Positioning System
- the essence of the technical solution lies in the fact that in the bracket 6 located on the front of the rail vehicle, there are sensors comprising a group of lidars 1, a stereo camera 2, a thermal camera 3 and a high resolution camera 4, together powered by a power supply and control module 5, which are connected to a switchboard 9 inside the rail vehicle with a computing unit 8 and a module 7 of the global navigation satellite system GNSS.
- the computing unit 8 for detection and classification of objects is con nectable to the expert train system 11 for making decisions, to the system 12 for automatic control of the unmanned train and to the traffic controller's monitoring terminal 13 for unmanned trains.
- the computing unit 8 is adapted to provide positional and character information, including the distance of the detected object from the front of the train and the type of detected object.
- the device 10 consists of the following parts: • detection sensors in a defined configuration, which is a group of lidars 1, a stereo camera 2, a thermal camera 3 and a high resolution camera 4;
- Each sensor by its technological nature, generally perceives the environment at different distances, at different angles of view and in different parts of the electro magnetic spectrum.
- the above-mentioned sensor configuration can also capture some information beyond the current vision of the human eye or the engine driver's eye.
- the individual sensing principles are as follows:
- lidar 1 this involves accurately measuring the distance of objects and creating a 3D scene using the reflection of laser beams.
- stereo camera 2 it is about cal culating the disparity map and illustrating the 3D scene.
- thermal camera 3 it is the imaging of emitted infrared radiation
- high-resolution camera 4 it is an image in the visible spectrum of electromagnetic radiation. All raw data from sensors i.e. lidars 1, stereo cameras 2, thermal cameras 3 and camera 4, are analyzed and stored in the computing unit 8 of the object detector.
- the power supply of the individual sensors is provided by the power supply and control module 5.
- the sensors i.e. lidars 1, stereo cameras 2, thermal cameras 3 and camera 4, including the power supply and control module 5 are placed in a special bracket 6, which is located on the front of the rail vehicle.
- This bracket 6 has not only a load-bearing function, but also a protective function.
- One of the key features of this bracket 6 is that it can be installed on any standard rail vehicle thanks to its adaptable mounting. It consists of two parts: a universal fixed support and protection box for lidars 1, stereo cameras 2, thermal cameras 3 and camera 4, and a power supply module 5 and an adapter (vehicle mounted structure) corresponding to the design of the type of railway vehicle.
- a railway switchboard 9 with a computing unit 8 of the object detector and a GNSS module 7 (and a communication module).
- the computing unit 8 of the object detector performs all the computing operations necessary for object detection and classification using artificial intelligence.
- standard objects human, animal, vehicles
- it is also able to classify special railway objects (signals, their signs, etc.).
- the track (or rail) itself is also detected so that it can be determined whether or not the detected object is located in the line clearance profile.
- the output of the computing unit 8 of the object detector is then mainly position and character information (e.g. the distance of the detected object from the front of the train or the type of detected object). All operations take place in real time regardless of the speed of the moving vehicle.
- the computing unit 8 of the object detector interfaces not only with its own subsystems and modules i.e. lidars 1, stereo cameras 2, thermal cameras 3 and camera 4, power supply module 5 and modul 7, but also with related surrounding railway subsystems.
- These subsystems include in particular the expert train decision-making system 11 (and hence the downstream automatic train control system 12).
- the computing unit 8 sends status information and information about the detected objects to the expert decision-making system 11, so that it can decide to take the appropriate action.
- Fur thermore it is possible for the object detection device 10 to send visual information to downstream systems outside the train, namely with remote management and control of the train (traffic controller monitoring terminal 13 of unmanned trains).
- the device can also be used when the train is operated in lower levels of automation or in degraded states. In these cases, it will serve as an assistance system for the engine driver or other authorized persons present on the train, or for authorized persons outside the train. .
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Train Traffic Observation, Control, And Security (AREA)
- Electric Propulsion And Braking For Vehicles (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
HRP20231352AA HRP20231352A1 (en) | 2021-04-26 | 2022-04-24 | Railway train equipment for the detection of objects and their subsequent classification |
HU2300377A HUP2300377A1 (en) | 2021-04-26 | 2022-04-24 | Railway train equipment for the detection of objects and their subsequent classification |
BG113786A BG113786A (en) | 2021-04-26 | 2023-09-29 | Equipment installed onboard railway trains for detection of objects and their subsequent classification |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CZPUV2021-38758 | 2021-04-26 | ||
CZ2021-38758U CZ35674U1 (en) | 2021-04-26 | 2021-04-26 | Railway train equipment for detecting objects and then classifying them |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022228592A1 true WO2022228592A1 (en) | 2022-11-03 |
Family
ID=80038884
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CZ2022/050044 WO2022228592A1 (en) | 2021-04-26 | 2022-04-24 | Railway train equipment for the detection of objects and their subsequent classification |
Country Status (7)
Country | Link |
---|---|
BG (1) | BG113786A (en) |
CZ (1) | CZ35674U1 (en) |
HR (1) | HRP20231352A1 (en) |
HU (1) | HUP2300377A1 (en) |
RS (1) | RS20230869A1 (en) |
SK (1) | SK500692023A3 (en) |
WO (1) | WO2022228592A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CZ35674U1 (en) * | 2021-04-26 | 2021-12-21 | AŽD Praha s.r.o. | Railway train equipment for detecting objects and then classifying them |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108313088A (en) * | 2018-02-22 | 2018-07-24 | 中车长春轨道客车股份有限公司 | A kind of contactless rail vehicle obstacle detection system |
US20180339719A1 (en) * | 2017-05-24 | 2018-11-29 | William Joseph Loughlin | Locomotive decision support architecture and control system interface aggregating multiple disparate datasets |
JP2019188846A (en) * | 2018-04-18 | 2019-10-31 | 日本信号株式会社 | Object detection system |
CZ35674U1 (en) * | 2021-04-26 | 2021-12-21 | AŽD Praha s.r.o. | Railway train equipment for detecting objects and then classifying them |
-
2021
- 2021-04-26 CZ CZ2021-38758U patent/CZ35674U1/en active IP Right Grant
-
2022
- 2022-04-24 RS RS20230869A patent/RS20230869A1/en unknown
- 2022-04-24 WO PCT/CZ2022/050044 patent/WO2022228592A1/en active Application Filing
- 2022-04-24 HU HU2300377A patent/HUP2300377A1/en unknown
- 2022-04-24 SK SK50069-2023A patent/SK500692023A3/en unknown
- 2022-04-24 HR HRP20231352AA patent/HRP20231352A1/en unknown
-
2023
- 2023-09-29 BG BG113786A patent/BG113786A/en unknown
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180339719A1 (en) * | 2017-05-24 | 2018-11-29 | William Joseph Loughlin | Locomotive decision support architecture and control system interface aggregating multiple disparate datasets |
CN108313088A (en) * | 2018-02-22 | 2018-07-24 | 中车长春轨道客车股份有限公司 | A kind of contactless rail vehicle obstacle detection system |
JP2019188846A (en) * | 2018-04-18 | 2019-10-31 | 日本信号株式会社 | Object detection system |
CZ35674U1 (en) * | 2021-04-26 | 2021-12-21 | AŽD Praha s.r.o. | Railway train equipment for detecting objects and then classifying them |
Also Published As
Publication number | Publication date |
---|---|
SK500692023A3 (en) | 2024-02-28 |
BG113786A (en) | 2023-11-15 |
HRP20231352A1 (en) | 2024-03-29 |
CZ35674U1 (en) | 2021-12-21 |
HUP2300377A1 (en) | 2024-03-28 |
RS20230869A1 (en) | 2024-01-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3459812A1 (en) | Detection system for a vehicle | |
US11878725B2 (en) | Vehicle control system and method for implementing safety procedure | |
CZ271698A3 (en) | Method of warning railway vehicle controller from presence of obstacle on the track and system for making the same | |
CN105185160B (en) | The pavement detection method that distorted region mobile trend identifies in virtual grid | |
CN110217271A (en) | Fast railway based on image vision invades limit identification monitoring system and method | |
CN106864437A (en) | A kind of emergency brake of vehicle system and its control method | |
EP3718850A1 (en) | System and method for door error detection | |
CN108973861A (en) | A kind of intelligence A column driving safety system | |
BG113786A (en) | Equipment installed onboard railway trains for detection of objects and their subsequent classification | |
CN110007669A (en) | A kind of intelligent driving barrier-avoiding method for automobile | |
US11767016B2 (en) | Optical route examination system and method | |
US20200410788A1 (en) | Management apparatus, vehicle, inspection apparatus, and vehicle inspection system and inforamtion processing method therefor | |
CN114360210A (en) | Vehicle fatigue driving early warning system | |
KR100876661B1 (en) | Vision based monitoring system in railway station | |
KR20200041078A (en) | System and method for monitoring and warning railway platform | |
CN116279673A (en) | Train running line and driving state on-line monitoring system and device | |
CN114872741A (en) | Locomotive auxiliary automatic driving system and method based on safety guiding | |
CN111572540A (en) | Safety auxiliary driving system for detecting whether coming vehicle is out of sight or not and vehicle | |
KR20210072664A (en) | Real-time obstacle detection system for a railway vehicle | |
CN205003872U (en) | Pavement detection system of distorted region removal trend discernment in virtual net | |
KR20160027459A (en) | TRAM safe driving system | |
Bahloul et al. | Adding technological solutions for safety improvement at level crossings: a functional specification | |
CN117622228B (en) | Remote control method and device for unmanned automatic operation automobile in automobile | |
US20230295963A1 (en) | Door control device, storage medium storing computer program for door control, and method for door control | |
US20230391384A1 (en) | Automated operation of railroad trains |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22795061 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202350069 Country of ref document: SK |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023/012054 Country of ref document: TR |
|
WWE | Wipo information: entry into national phase |
Ref document number: P-2023/0869 Country of ref document: RS |
|
WWE | Wipo information: entry into national phase |
Ref document number: P.447633 Country of ref document: PL |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22795061 Country of ref document: EP Kind code of ref document: A1 |