KR102188462B1 - Safe driving assistant system for trains using head-up display and method thereof - Google Patents

Abstract

The present invention relates to a safe driving assistance system for a train by using a head-up display and a method thereof. According to the present invention, the safe driving assistance system for the train includes a head-up display device installed in a cab of the train to output an augmented reality content to a display unit formed on a front windshield. The safe driving assistance system for the train acquires data and information necessary for safe driving while the train is running through various electronic devices and sensors installed in the train, and the head-up display device collects, synthesizes, analyzes, classifies, and processes the data and the information necessary for the safe driving to provide the data and the information on the display unit as the augmented reality content. According to the present invention, various information necessary for the safe driving during a train operation are displayed in a gaze direction of a driver by using the head-up display device, so that the driver is able to focus on driving the train without drawing a gaze of the driver or distraction and to rapidly recognize a train travelling situation so that accidents are prevented.

Description

Safe driving assistance system for trains using head-up display and its method {SAFE DRIVING ASSISTANT SYSTEM FOR TRAINS USING HEAD-UP DISPLAY AND METHOD THEREOF}

The present invention relates to a safe driving assistance system for a train, and more specifically, it is acquired from various sensors and electronic devices provided in a train to collect, assemble, process, and control various data necessary for train driving, and the front windshield of the cab The present invention relates to a safe driving assistance system for trains and a method thereof using a head-up display that assists an engineer to drive safely by integrating and displaying contents of augmented reality on a Head-Up Display (HUD) device installed in the device.

In general, Head-Up Display (HUD) devices are being widely installed, receiving praise as the best safe driving assistance devices, mainly in luxury cars. Most of the head-up display (HUD) devices display various safety-related driving information of a navigation system equipped with a driving speed as the center, in real time, and visually parallel to a part of the front windshield of the driver's seat. Accordingly, the driver of the vehicle acquires all guidance information without a series of distracting actions that distract his eyes in order to directly check the complex instrument panel and the map guidance screen of the navigation while driving, so that the HUD device greatly helps the driver's safe driving. Are giving.

Most of these HUD devices are selectively applied to transportation means such as vehicles, aircraft, and ships, and can be expressed in various forms. The above-mentioned driving information is used as a hologram of a virtual image with light such as LCD, LED or laser. It can be projected onto the front windshield of the vehicle and displayed, or projected to a location where a separate HUD photosensitive film is attached, or separate multilayered multilayered multilayered photosensitive glass and reflectors for HUD are installed on the upper part of the dashboard. Various techniques are applied, such as mounting and projecting onto this photosensitive glass.

The method of direct projection on the windshield is the most commonly used method currently, and automakers assemble and ship directly to the vehicle at their factory, and the method using the HUD photosensitive film is mainly used for vehicles that have already shipped. It is mainly applied in the after-market for additional installation, and the method of projecting onto the photosensitive glass was developed mainly for fighters, for example, but has recently been installed on some vehicles. However, most of these HUD devices are fixed and display only information about speed and limited information linked to navigation, and it is a reality that only a few colors or a single color are displayed instead of various colors.

Unlike vehicles, in the case of trains such as trains, trains, etc., due to the nature of economic and commercial driving of trains, the number of drivers (driver's crew) installed in the cab is one, and the seats, adjustment levers required for driving, and other handling devices have a height or width. It is fixed so that it cannot be adjusted or adjusted anywhere, front, rear, left, right, but on the contrary, due to the size of the train (i.e., width and height) and the nature of the driving method, the front windshield is relatively large due to a completely different structure and design from the vehicle. none.

In addition, the driver's seat in the cab cannot be adjusted by the driver's height but the leg room, and the driver sits alone and actually drives and runs, so the front visibility is very good due to the large windshield, but various instruments and equipment or monitored Gauges, etc. cannot be checked without moving the gaze, and in order to check the situation from the side to the rear due to the structure of the train, it is impossible to check without moving the position.

In particular, when driving before and after sunrise, before and after sunset, and at night driving, we only rely on headlights to check and operate dark tracks, tunnels, and underground sections with the naked eye. The reality of the engineer, or the main problem, is that one engineer is responsible for the safety of many customers on the train, and for this, the engineer needs high concentration, quick judgment and decision, and all preemptive preparation and safety management There is an unchanging fact that is essential. Nevertheless, the reality is that, unfortunately, the digitization and monitoring of display instruments that only increase the visibility that induces the driver's gaze dispersion continue to progress, but only rely on the driver's naked eye. It is a reality that there are currently no auxiliary devices for section guidance, driving assistance and safe driving.

Augmented Reality (AR) is a technology that analyzes the current image captured by a camera and provides various information or contents together. It is mainly possible to shoot or display images such as game consoles or smartphones. It is applied to devices and is widely used in shopping malls and marketing. However, it is still in the research stage for vehicles with many variables, and there is no reality for trains, but it is possible to display not only driving information, but also various information and data detected from different types of sensors, such as display of obstacles and traffic light recognition, as dynamic images. There is a great advantage of being.

However, the HUD device and augmented reality according to the prior art as described above are configured and implemented as one device or system, and have been partially used for vehicles, mobile phones, and game consoles, but have not been applied to trains and provided to the engineer. Since there is no technology for a device or system that integrates the system, it was not possible to provide an environment for driver assistance through dynamic visualization of better virtual signs or driving information, and safe driving assistance without distraction or dispersion. .

Korean Patent Application Publication No. 10-2014-0004412 (published on January 13, 2014) Korean Patent Application Publication No. 10-2017-0004127 (published on January 11, 2017) Korean Patent Application Publication No. 10-2017-0083798 (published on July 19, 2017) Korean Registered Patent Publication No. 10-1855940 (announced May 09, 2018)

An object of the present invention is to provide a safe driving assistance system and method for a train using a head-up display that assists and supports safe driving to an engineer by displaying various information necessary for safe driving on the front windshield of a train cab using a head-up display. To provide.

Another object of the present invention is to collect and collect various information necessary for safe driving while driving a train from various sensors and electronic devices installed in the train and process it into augmented reality content, and project it on the front window of the driver's cab to view the driver's gaze. It is to provide a safe driving assistance system and a method for a train using a head-up display displayed on a position.

Another object of the present invention is to detect obstacles and dangerous objects on the driving path detected during train operation from various sensors and electronic devices installed in the train, display the driving path and direction, position and trajectory, warning of deceleration and curve sections, branch points and dangers. By collecting various data and information such as warning of local operation warning, stopping station entry, and stop line distance, and projecting and projecting it on the windshield as a dynamic graphic image, the engineer can check all the information related to train operation in daytime, nighttime, and even in bad weather conditions. Provides a safe driving assistance system and method for trains using a head-up display that assists and supports to focus on the task of safe driving and safety management without distracting the engineer's gaze or distracting attention and concentration. .

Another object of the present invention is to visually display various information necessary for safe driving while a train is operating on the front windshield during driving using augmented reality technology, and to visually warn of errors or mistakes of an engineer in advance. It is to provide a safe driving assistance system and method for trains using a head-up display that assists and supports to recognize all situations, thereby preventing human accidents and mistakes or accidents caused by an engineer's misunderstanding or misjudgment. .

Another object of the present invention is to upgrade the T2M (Train to Machine) function through maintenance and easy connection with other devices or other sensors by simply installing it between the instrument panel and the front windshield regardless of the location of the engineer in the cab. A head that provides efficiency, convenience, and economy as it is configured as a standalone type to increase the efficiency of post-management such as addition and expansion, and to facilitate movement and exchange installation to the left, right, and center according to the seat position of the engineer. It is to provide a safe driving assistance system and a method for a train using an up display.

In order to achieve the above objects, the safe driving assistance system for a train using the head-up display device of the present invention integrates and provides various information necessary for safe driving on the windshield of the driver's seat of the train by using the head-up display device. There is one characteristic. The safe driving assistance system for a train using the head-up display device of the present invention displays various information necessary for safe driving while the train is running in the driver's gaze direction using the head-up display device, thereby distracting or distracting the driver's gaze. You can focus on driving the train without it, and you can quickly grasp the driving situation of the train to prevent accidents.

In the safe driving assistance system for a train using the head-up display device of the present invention according to this feature, electronic devices having different functions are installed inside and outside the train, respectively, to obtain driving information according to the train driving in real time. Device part; A sensor unit including a plurality of sensors installed inside and outside the train to obtain sensing information detected while driving the train in real time; A train power supply for supplying power to the train; A display unit formed on a front windshield of the driver's cabin of the train to display the driving information and the sensing information in real time so that the train driver can recognize it while the train is running; And the driving information and the sensing information are collected in real time from the electronic device unit and the sensor unit, installed on the dashboard of the cab of the train, and processed into augmented reality contents to assist and support the driver's train driving. It includes a head-up display device that outputs to the display unit.

In this aspect, the head-up display device comprises: a communication interface unit connected to the electronic device unit and the sensor unit to receive the driving information and the sensing information; A data collection unit that receives the driving information and the detection information from the communication interface unit, collects, collects, and analyzes data, and classifies data according to usage; A data processing unit that batch-processes and verifies the data transmitted from the data collection unit, selects data according to a purpose, and performs primary processing; A data processing unit that processes, converts, and generates graphic data so that the data first processed by the data processing unit are displayed as contents of augmented reality through 3D modeling; An augmented reality image output unit receiving graphic data from the data processing unit and outputting the graphic data to be displayed as a visual image on the display unit; And a power control unit receiving power from the train power supply unit and controlling to supply power to the head-up display device.

In this aspect, the head-up display device comprises: an audio signal processing unit for converting data that can be expressed as audio among data processed by the data processing unit into an audio format; An audio output unit for receiving audio data from the audio signal processing unit and outputting a voice guidance and warning sound; And an emergency power supply unit receiving power from the train power supply and recharging under the control of the power control unit and supplying power to the train when the train power supply unit is cut off.

In this feature, the display unit displays the visual image as an augmented reality graphic image in the form of a moving picture by changing a shape and color.

In this feature, the display unit includes time information necessary for safe driving while the train is running, speed information, train information, warning information, traffic light information, navigation map information, obstacle detection radar state information, obstacle access information, and next arrival station information. , Distance information to the next destination station, distance information to the stop line, current operation area information, current driving route information, stop line location information, mileage information, average driving speed information, distance to the end station, warning message information, and driving hourly speed Information is integrated and displayed on at least one screen.

As described above, the safe driving assistance system for a train using the head-up display device of the present invention displays various information necessary for safe driving while the train is running in the driver's gaze direction using the head-up display device, thereby dispersing the driver's gaze. You can focus on driving the train without being distracted or distracted, and you can quickly grasp the driving situation of the train to prevent accidents.

In addition, the safe driving assistance system for trains using the head-up display device of the present invention transmits and projects information and data necessary for all driving and driving on the windshield through the HUD device to facilitate the location and status of the train by the driver or the driver. It has the effect of quickly grasping and turning or lowering the head due to the scattered devices installed on the instrument panel or bracket, and in particular, focusing and immersing only on the driving of the train without distraction or distraction.

In addition, the safe driving assistance system for trains using the head-up display device of the present invention provides safe driving and accident prevention, such as notification of driving path and signal conditions, notification of distance and approach conditions, notification of deceleration zones and danger areas, and warning of obstacles and moving objects. Virtual information and actual data directly connected to the project are projected and projected through the HUD device in the form of an augmented reality video using 3D modeling to call attention to a single engineer or a driving crew, and to promptly take measures and cope with safe driving. It has the effect of supporting and assisting safe driving by intuitively presenting it so that accident prevention is possible.

In addition, the safe driving assistance system for a train using the head-up display device of the present invention includes all driving conditions of the train even during voice communication and conversations with the control room, other trains, and ground personnel while the driver or driver is running or stopped at day or night. It has the effect of greatly improving concentration for safe driving by providing high visibility and convenience that can check data and data in real time with the naked eye.

In addition, the safe driving assistance system for trains using the head-up display device of the present invention can be easily connected and displayed to the HUD device through data processing when other external devices or sensors need to be added, so that additional devices can be upgraded. It is easy and is attached and installed as a standalone type, so it is very easy and simple to control, move, and exchange the HUD device, so it has the effect of remarkably increasing maintenance and operation convenience.

1 and 2 are views showing a partial configuration of a cab of a train in which a safe driving assistance system for a train using an augmented reality according to the present invention is installed,
3 is a block diagram showing the configuration of the safe driving assistance system for a train shown in FIGS. 1 and 2;
4 is a diagram showing a configuration of a display unit of a head-up display device according to an embodiment of the present invention;
5 illustrates screens displayed during normal train operation of the display unit shown in FIG. 4, and
6 are screens displayed when an obstacle is detected during train operation of the display unit shown in FIG. 4.

The embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be construed as being limited by the embodiments described below. This embodiment is provided to more completely explain the present invention to those of ordinary skill in the art. Therefore, the shape of the constituent elements in the drawings is exaggerated in order to emphasize a more clear description.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to FIGS. 1 to 6.

1 and 2 are views showing a partial configuration of a cab of a train in which a safe driving assistance system for a train using augmented reality according to the present invention is installed.

1 and 2, in order to assist the safe driving of an engineer or a driving crew member (hereinafter referred to as an engineer) while driving a train, the safe driving assistance system 100 for a train of the present invention Information related to train driving, such as various driving information and detection information during train driving from various electronic devices (131 to 137 in FIG. 3) and various sensors (141 to 147 in FIG. 3) installed in the train 10 such as a train And processing various information necessary for safe driving of an engineer using the head-up display device 110 into contents of Augmented Reality (AR), and display various colors and colors on the front windshield 16 of the cab 12. Integrated display in various forms.

In an embodiment of the present invention, information necessary for safe driving includes, for example, current time, current driving speed, current position, navigation display, forward obstacle detection situation, path trajectory, warning, obstacle detection, traffic light recognition, stop line Various information related to train driving, such as the distance to, driving distance, safe driving indication of the front section and stop station, the driving distance of the train, the average driving speed, the distance to the next stop, and the driving direction, are included.

To this end, the head-up display device 110 of the present invention is installed in the cab 12 in which all control and control of train operation is performed by an engineer. That is, the head-up display device 110 is installed, for example, in the cab 12 of the train 10 so that the display unit 120 is positioned on the front windshield 16 according to the position of the engineer's gaze. The cab 12 is, for example, located on a vehicle in front of the train 10, and the head-up display device 110 includes a dashboard of the cab 12 so that the display unit 120 is formed on the front windshield 16. It is installed on the top of 14). Accordingly, the display unit 120 is projected onto the front windshield 16 by the head-up display device 110 to display various information necessary for safe driving. The head-up display device 110 may be installed in the cab 12 of the train 10 having various shapes and structures according to the type of train 10 such as a train, a train, an electric train, and a high-speed train.

Therefore, the safe driving assistance system 100 for a train of the present invention integrates and displays various information in real time as augmented reality content such as a video form and a dynamic image form on the front windshield 16 so that the driver The actual driving situation is visually checked in real time, and all data and various information necessary for safe driving are checked and operated, so that the engineer can visualize all the information of the train 10 at once without distraction in any situation. As it can be quickly identified, safe driving optimized for the driving and driving characteristics of the train 10 is guaranteed, and through this, various train accidents can be drastically prevented and improved.

In addition, the safe driving assistance system 100 for a train of the present invention includes complex instruments and communication devices, various warning sounds, various noises and noises from inside and outside the train, front signal equipment and various warning lights when the train 10 is operated during the day and night. , Facilities, signs, facilities, etc., without distracting the eyes and attention of the engineer on board, it is possible to focus only on the driving and mission of the train 10, so it has excellent accident prevention and visual warning effects. 12) Easy to maintain with simple installation.

In addition, the safe driving assistance system 100 for a train of the present invention has only one engineer who plays such an enormous role in the train, and this one person performs all the driving processes from start to run, stop, etc. In the poor situation where instruments and external devices are checked and checked, and at the same time, communication with the outside has to be handled for a long time alone, numerous risk factors, anxiety factors, and unexpected factors exist. Due to the nature of the means, irreversible large-scale catastrophes occur. Various information and data are combined with AR technology through 3D modeling to enable the engineer to identify and check the naked eye in real time. By projecting and projecting dynamic shapes, virtual signs and warnings, etc., on the front windshield 16 with images optimized for display, the engineer gazes out even in bad weather conditions such as daytime and nighttime, tunnels and bridges, rainfall and snowfall, fog and smog. It is possible to support and assist the safe driving of trains by increasing driving immersion and mission concentration without decentralization.

The safe driving assistance system 100 for a train of the present invention operates the head-up display device 110 as a standalone type, so that it is easy and convenient to attach and move to the cab 12, and the engineer Even if it is arranged, it is possible to increase operational efficiency by displaying an optimal image, and it can be installed by changing and adjusting the location and the angle of expression in various ways according to the shape or structure of the cab 12 of the various trains 10.

Specifically, the configuration and operation of the safe driving assistance system for a train using augmented reality according to the present invention will be described in detail.

3 is a block diagram showing the configuration of the safe driving assistance system for a train shown in FIGS. 1 and 2.

Referring to FIG. 3, the safe driving assistance system 100 for a train of the present invention uses a head-up display device 110 to assist and support safe driving to an engineer when driving a train. Various data and information acquired through various electronic devices (131 to 137) and sensors (141 to 147) installed in the system are collected, aggregated, analyzed, and processed to provide contents of augmented reality through 3D modeling. The dynamic image and video of the driver are projected on the windshield 16 to display various information necessary for safe driving on a single screen, such as dynamic movement, flashing, and changes in various colors and shapes. It is provided in a visual form that can be clearly checked at night.

Therefore, the safe driving assistance system 100 for a train of the present invention provides a variety of driving information and driving information to the engineer, so that a single engineer in the cab 12 increases the degree of immersion without distraction, thereby perfecting the essential task of safe driving. The T2M (Train to Machine) function is combined with the augmented reality head-up display device 110 to support and assist.

To this end, the safety assistance system 100 for a train of the present invention includes an electronic device unit 130, a sensor unit 140, a train power supply unit 150, a head-up display device 110, and a display unit 120. do.

Specifically, the electronic device unit 130 includes a plurality of electronic devices 131 to 137 installed inside and outside the train 10, that is, outside the head-up display device 110 and having different functions. Each of the electronic devices 131 to 137 is installed inside and outside the train 10 according to a purpose. The electronic device unit 130 generates or acquires various data and information related to train driving, respectively, and provides them to the head-up display device 110 through a wired or wireless communication network, a mobile communication network, or the like.

The electronic device unit 130 of this embodiment includes, for example, a navigation 131, a speedometer 132, a location altimeter 133, a GPS device 134, a data providing device 135, a camera device 136, and a temperature. And a measuring device 137 and the like. The electronic device unit 130 transmits various types of data and information to the head-up display device 110 through the communication interface unit 111.

The navigation 131 is installed in the driver's room 12 of the train 10 to provide map data including railroad tracks for train operation, and display location information and geographic information according to train operation on the map data to the driver. to provide. The navigation 131 can grasp location information such as the current location, driving speed, driving direction, administrative area, and boundary, and is connected to other external navigation through a wireless communication network such as Wi-Fi and Bluetooth to collect data or independently Geographic information, location information, and map data may be transmitted to the head-up display device 110.

The speedometer 132 is installed in the train 10 to measure speed information during train driving using its own speed meter, speed sensor, or acceleration sensor, and transmits it to the head-up display device 110.

The position altimeter 133 is installed on the train 10 to measure altitude information using an altitude meter, an altitude sensor, or an atmospheric pressure sensor, and transmits the altitude information to the head-up display device 110.

The GPS device 134 is installed in the train 10 and obtains current location information of the train 10 while the train is running and transmits the information to the navigation 131 and the head-up display device 110.

The data providing device 135 includes, for example, a main control unit (MCU) of the train 10, a driving record self-diagnosis (OBD) device, and the like, and real-time train data obtained by communicating with each electronic device, for example, a train Train information related to and various data according to train operation are measured, sensed, and acquired, and transmitted to the head-up display device 110. The data providing device 135 is, for example, a mobile communication network such as 3G, 4G, LTE, 5G, a wireless communication network such as WiFi, Bluetooth, or I2C, LDI, RS232C, RS485, SPI/SPIO, GPI/GPIO, CMOS, LVDS, RGB It is connected to a wired communication network that transmits &　SYNC signals, and processes mutual data communication with various electronic devices installed inside and outside the train 10. The data providing device 135 transmits data transmitted from various electronic devices to the head-up display device 110 through the communication interface unit 111. The data providing device 135 shares various data by connecting the main control device of the train 10 and a self-diagnostic device for driving records to each other through a mutual communication network, according to the need and purpose of the train 10. And can also be collected.

A plurality of camera devices 136 are installed inside and outside the train 10, such as the front, rear, and side, and acquire and analyze high-resolution (eg, Full HD) images. The camera device 136 is installed, for example, on the upper part of the front windshield 16, around the head-up display device 110, and captures and acquires images of the railroad situation in front of the train and the railroad traffic situation. The image is analyzed and the image and the analysis information are transmitted to the head-up display device 110 through the communication interface unit 111.

The temperature measuring device 137 is provided with a temperature sensor, a light source or a photosensitive device, and measures temperature or recognizes and detects objects, obstacles, and facilities using light, and transmits the sensed temperature information and sensing information to a communication interface unit. It is transmitted to the head-up display device 110 through 111.

The sensor unit 140 includes a plurality of sensors 141 to 147 respectively installed inside and outside the train 10 to obtain various sensing information, and transmits the acquired sensing information in real time through the communication interface unit 111. It is transmitted to the head-up display device 110. The sensor unit 140 includes various sensors other than the electronic device unit 130.

The sensor unit 140 of this embodiment is, for example, a speed sensor 141, a distance sensor 142, a gravity sensor 143, a heat sensor 144, an object recognition sensor 145, a facility detection sensor 146 ) And a door sensor 147, and the like.

The speed sensor 141 detects a change in speed of the train 10 in real time while the train is running, measures speed information such as speed, sudden acceleration, and rapid deceleration, and displays the speed information through the communication interface unit 111 To the device 110.

The distance sensor 142 is installed, for example, in front of the cab 12 of the train 10, detects a front collision of the train 10 or an obstacle or object in front of the train 10 at a short distance, and measures the distance of a stop line from the train 10. It detects or interworks with the electronic device unit 130 to obtain distance information by comparing and analyzing the image data acquired from the camera device 136, and this is transferred to the head-up display device 110 through the communication interface unit 111. send.

The gravity sensor 143 detects a change in impact or gravity between stops and runs of the train 10 to display the presence or absence of an abnormality in the track or train 10, and detects a speeding or abnormal situation, and the communication interface unit 111 It is transmitted to the head-up display device 110 through.

The thermal sensor 144 includes, for example, a thermal sensor, a vibration sensor, an earthquake sensor, etc., and detects an earthquake, vibration, etc. during stop, stop, or operation of the train 10, or By sensing, sensing information on an earthquake or abnormal situation is acquired and transmitted to the head-up display device 110 through the communication interface unit 111.

The object recognition sensor 145 is provided with, for example, a radar sensor, a lidar sensor, etc., installed outside the train 10, the front or side surfaces of the windshield 16, etc., and front obstacles for distance measurement and driving analysis Or, by detecting a battlefield object such as a person, an animal, and an object, comparing and analyzing it in connection with the electronic device unit 130, information on the recognized object is transmitted to the head-up display device 110 through the communication interface unit 111 Transfer to.

The facility detection sensor 146 detects, for example, a designated object or facility located in front of a train and transmits it to the head-up display device 110 through the communication interface unit 111. Accordingly, the head-up display device 110 interlocks with the electronic device unit 130 to compare and analyze the image data of the camera device 136 based on, for example, geographic information and location information of the navigation 131, A virtual image of augmented reality is generated and detected facilities are displayed.

The door sensor 147 is installed on each of the doors of the train 10 to detect an open/closed state of each of the doors and transmits it to the head-up display device 110 through the communication interface unit 111.

The train power supply unit 150 supplies power to the train 10. The train power supply unit 150 supplies power to the head-up display device 110 through the power control unit 118. The train power supply unit 150 supplies power to the emergency power supply unit 119.

The head-up display device 110 is provided as a standalone type device to facilitate installation at various locations of the cab 12, and various data and information for assisting and supporting the safe driving of the train are stored on the front windshield 16. Process to be projected and displayed. The head-up display device 110 is provided in various forms such as, for example, an LED type, a TFT-LCD type, and a projector type, and typical components of a head-up display (HUD) include, for example, a cover glass, a mirror, and a light source. , A shutter, an application processor (AP), a laser driving chip for a projector, a display for screen enlargement, and the like. Since various technologies have already been disclosed for the general configuration of such a head-up display, a detailed description thereof will be omitted.

The head-up display device 110 of this embodiment includes a communication interface unit 111, a data collection unit 112, a data processing unit 113, a data processing unit 114, an augmented reality image output unit 115, and an audio signal processing unit. 116, an audio output unit 117, a power control unit 118, and an emergency power supply unit 119.

The communication interface unit 111 is provided as an interface module such as wired communication, wireless communication, and mobile communication, and receives various data and information transmitted from the electronic device unit 130 and the sensor unit 140 in real time. It is transmitted to the data collection unit 112.

The data collection unit 112 collects data and information transmitted from the electronic device unit 130 and the sensor unit 140, and compares and analyzes the collected data by purpose, use, function, etc. to facilitate data processing. It is collected and classified and transmitted to the data processing unit 113.

The data processing unit 113 batch-processes and verifies the data transmitted from the data collection unit 112, and performs primary processing of the data to facilitate data processing by selecting optimal data according to functions and uses.

The data processing unit 114 processes, transforms, and generates graphic data so that the data first processed by the data processing unit 113 can be expressed as augmented reality contents through 3D modeling, and the augmented reality image output unit 115 Transfer to.

The augmented reality image output unit 115 outputs the processed, transformed, and generated graphic data to the display unit 120 to be expressed as a visual image. The augmented reality image output unit 115 outputs images that are statically or dynamically graphicd by the data processing unit 114 with a light source such as LED, laser, etc. to the outside in real time, and the front windshield 16 of the cab 12 ) Projected and projected as a graphic image expressed as augmented reality content composed of a variety of high-resolution, high-quality colors. At this time, the augmented reality image output unit 115 may amplify the output so that the image is enlarged through a magnifying lens in which, for example, a mirror-shaped reflector and optical technology are grafted, and the angle of the internal reflector is manually or motorized. It can automatically adjust the projection and light projection position with functions such as vertical and horizontal direction adjustment and flip using a lamp. Accordingly, the display unit 120 displays a graphic image of an augmented reality on the front windshield 16 of the cab 120, and the display position is adjusted according to the direction of the driver's gaze according to the position of the augmented reality image output unit 116 do.

The voice signal processing unit 116 receives data that can be expressed as voice among the data processed by the data processing unit 113 and converts it into an audio format, and provides voice guidance and warning sound according to the data of the electronic device unit 130 and the sensor unit 140. Is processed to be output to the audio output unit 117.

The audio output unit 117 is provided with, for example, a speaker, and is installed in the cab 12 inside or outside the head-up display device 110. The audio output unit 117 outputs voice guidance and warning sounds from the audio signal processing unit 116 to inform the engineer.

The power control unit 118 controls power supply to the head-up display device 110. That is, the power control unit 118 receives power supplied from the train power supply unit 150 and provides power protection and control circuits such as surge protection, overcurrent prevention, and reverse polarity protection. And control to stably supply power to the head-up display device 110. The power control unit 118 controls the emergency power supply unit 119 to be charged using the power of the train power unit 150. The power control unit 118 controls to supply power to the head-up display device 110 from the emergency power supply unit 119 when power supplied from the train power supply unit 150 is cut off due to a failure or an emergency situation.

The emergency power supply unit 119 is provided with, for example, a rechargeable battery, a UPS device, etc., is supplied with power from the train power supply unit 150 and is charged under the control of the power control unit 118. When the power of the train power supply unit 150 is cut off, the emergency power supply unit 119 supplies power to the head-up display device 110 under the control of the power control unit 118.

In addition, the display unit 120 is positioned on the front windshield 16 of the cab 12 to display various data and information output from the head-up display device 110 in real time. The display unit 120 displays the augmented reality graphic image of various colors and shapes from the augmented reality image output unit 115 in real time according to the driving situation of the train or changes in real time to improve visibility.

In addition, the configuration and function of the display unit of the head-up display device according to an embodiment of the present invention will be described in detail.

4 is a diagram illustrating a configuration of a display unit of a head-up display device according to an embodiment of the present invention.

Referring to FIG. 4, the display unit 120 of the head-up display device 110 of this embodiment is formed on the front windshield 16 of the cab 12 to display contents of augmented reality output from the head-up display device 110. Indicate. In the display unit 120, various driving information necessary for safe driving are superimposed or integrated on the front window 16 according to traffic conditions and operation conditions of the front railroad, the front train, and the like, and are projected and displayed on a single screen.

The display unit 120 of this embodiment includes time information 200, speed information 202, train information 204, warning information 206, traffic light information 208, navigation map information 210, obstacle detection radar status information. (212), obstacle approach information 214, next destination station information 216, next destination station information 218, distance to stop line 220, current driving area information 222, current driving route information ( 224), stop line position information 226, travel distance information 228, average driving speed information 230, distance information to the end station 232, warning message information 234, and driving hourly speed information 236, etc. Is displayed in a single screen by changing various shapes and colors.

Specifically, the time information 220 displays the current time while the train is running. The speed information 202 displays the running speed of the current train 10. The train information 204 displays the train number of the corresponding train organized according to the train schedule. The warning information 206 flashes or displays an event situation occurring while driving a train with an image (eg, a tripod image, etc.) indicating caution, warning, stop, and the like, or by different colors. The traffic light information 208 compares and analyzes data such as the camera device 136, the GPS device 134, and the navigation 131 to recognize the traffic lights ahead, and changes the traffic lights to red, yellow, and Mark in green.

The navigation map information 210 displays the location, expected driving route, and driving direction on the map data in real time while the train is running, and checks the location even in daytime, nighttime, and in bad weather, enabling safe driving in consideration of the driving situation and driving direction. Mark to be done. The obstacle detection radar status information 212 is displayed in various colors in the form of a dynamic image of augmented reality, and an object recognition sensor 145 that detects an obstacle, an object, etc. that always operates while driving, for example, a radar sensor, a lidar sensor It displays the operation status of the light, and the status and location of obstacles and objects. The obstacle approach information 214 compares and analyzes data such as the sensor unit 140 and the camera device 136 to detect obstacles, objects, people, animals, etc., and various colors according to the access state. , Red when approaching a collision, yellow when there is no obstacle, and blue when there is no obstacle in the form of a gauge bar.

The next arrival station information 216 indicates the next stop station of the corresponding train. The distance information 218 to the next arrival station indicates the distance from the current location to the next settlement station. The distance information 220 to the stop line is displayed to inform the engineer of the exact distance to the stop line (designated stop line) upon arrival at the stop station. The current driving area information 222 displays an administrative area on a map that is currently running. The current driving route information 224 displays the predicted route and the predicted direction to which the corresponding train is currently traveling in the form of a dynamic image of an augmented reality, using various colors. At this time, the current driving route information 224 is changed to, for example, blue for normal driving, yellow for driving in a caution section, and red for speeding, turning around, and abnormal situations, and driving and entering directions and caution. It displays conditions such as driving section, danger section and speeding, and displays in a dynamic image format according to the detection status of obstacles and objects.

The stop line position information 226 visually displays the position of the stop line. The travel distance information 228 displays the total distance traveled for all sections organized in the corresponding train. The running average speed information 230 displays the average train speed per hour for all sections between train runs. The distance information 232 to the end point station displays the distance from the current location to the last settlement station excluding the distance traveled among all the sections of the train. The message information 234 expresses and displays various forms and color texts for the front section and stop station, safe driving guidance and warning, current situation and state, and caution situation, as well as explanations or instructions for caution or warning. do. Further, the driving hourly speed information 236 is linked with the speedometer 132 to display the driving hourly speed in the form of a gauge bar. The driving speed information 236 displays the driving speed in red, for example, in case of overspeed or limit speed, in yellow in case of caution, and in blue in case of specified speed, and the display color is changed in various ways. It is possible.

The configuration of the display unit 120 may be changed in various ways, such as expression form and color, depending on the selection or setting of the engineer, and may be changed in various orders and arrangements according to the expression type programmed by the supplier in advance.

5 are screens displayed during normal train operation of the display unit shown in FIG. 4.

Referring to FIG. 5, these screens show that contents of virtual augmented reality (AR) through 3D modeling are displayed on the front windshield 16 during normal driving through the head-up display device 110 during train driving. .

The display unit 120 of this embodiment repeats the dynamic image of the obstacle detection radar along the train progress direction and the driving route in the order of (a) to (d) using the contents of virtual augmented reality (AR) during normal train operation. Indicate. That is, the display unit 120 converts the contents of the augmented reality (AR) into a video format, and the current driving route information 224a to 224d of the train and the obstacle detection radar state information 212a to 212d on the navigation map information 210 Is displayed as a video graphic image.

At this time, the current driving route information 224a is displayed as a wave in the form of a guide light for landing on an aircraft runway by flashing rapidly and sequentially in a direction in which the train travels along the track as a boomerang-shaped video graphic. Obstacle detection radar state information 212a is formed in an inverted triangle shape and is displayed overlapping along the track displayed on the navigation map information 210, and it is connected by flashing and flashing rapidly in a wave shape like the current driving route information 224a. It is displayed as if spreading outward in a wide direction from the vertex of an inverted triangle in a round swell shape.

The display unit 120 expresses such a dynamic part as a graphic such as a video to inform the driver of the current driving state and the front state of the train, and is displayed to quickly detect a visual change with high visibility. In addition, the content of augmented reality (AR) is linked with various data and information of the other electronic device unit 130 to provide various processing signs such as branching section, accident-prone section, sharp curve section, deceleration section, and crossing section. It is displayed by the head-up display device 110 using warning banners, overhead lines, figures, symbols, characters, etc., so that it is possible to quickly grasp the track and traffic conditions of the engineer, thereby assisting and supporting to prevent accidents.

6 are screens displayed when an obstacle is detected during train operation of the display unit shown in FIG. 4.

Referring to FIG. 6, these screens show the contents of virtual augmented reality (AR) through 3D modeling through the head-up display device 110 in a situation in which an obstacle or object in front of the train is detected while the train is running. It shows what is displayed on the front windshield 16.

The display unit 120 of this embodiment is, for example, when an obstacle or an object is detected on a driving path on a track in which the train must proceed 500m ahead, the distance between the train 10 and the detected obstacle or object 20 Various graphic images are changed and displayed in the order of (a) to (e).

That is, the display unit 120 uses the contents of virtual augmented reality (AR) during normal train operation, along with the train traveling direction and the traveling route, the current speed information 202 of the train 10, and the current traveling route information 224. , Obstacle detection radar state information 212, obstacle access information 214, etc. are displayed (a). At this time, since normal driving is in progress, no warning message is displayed in the warning message information 234.

When an obstacle or an object is detected at a position in front of the driving path by the electronic device 130 and the sensor unit 140 while the train is running, for example, 500m in front, the display unit 120 indicates that the train 10 is The obstacle detection radar state information 212a and 212b and the obstacle approach information 214a sequentially indicate that the obstacle or object 20 is detected until the distance to the object 20 is driven 300m and 200m in front, and the engineer The colors of the current driving route information 224a and the warning information 206 are changed to yellow and displayed in order to give attention to the detection of an obstacle or an object (b, c). At this time, the speed information 202a, 202b displays the decelerated speed of the current train 10, and the warning message information 234a displays a warning message indicating caution because an obstacle or object 20 has appeared in the front.

Thereafter, when the train 10 travels 100m in front of the obstacle or object 20, the display unit 120 displays the obstacle or object 20 in each of the obstacle detection radar state information 212c and the obstacle access information 214b. ) Is displayed, and the current driving route information 224b and the warning information 206a are changed to red to give a collision warning according to detection of an obstacle or object to the engineer and displayed (d). At this time, the speed information 202c displays the decelerated speed of the current train, and the warning message information 234b displays a warning message indicating that there is a risk of collision with an obstacle or object 20 detected in front.

Subsequently, when the train stops around 10m in front of the obstacle or the object 10, the display unit 120 indicates that the obstacle or object 20 is approached in each of the obstacle detection radar state information 212d and the obstacle access information 214b. Is displayed, and the warning information 206b indicates a stop state, and the speed information 202d indicates that the current train is stopped.

As described above, the display unit 120 of the present invention detects an obstacle or object 20 on the traveling path in the direction of the train travel while the train 10 is running normally, the train 10 and the obstacle or object 20 Depending on the distance from the camera, various colors of warning and caution display, character display, and various flashing functions are displayed by the head-up display device 110 to change the contents of augmented reality (AR) in a video format to change and move variously. It is presented as a dynamic image so that the engineer can visually recognize it quickly and accurately.

In the above, the configuration and operation of the safe driving assistance system for a train using the head-up display according to the present invention has been shown according to the detailed description and drawings, but this is only described by way of example, and does not depart from the technical idea of the present invention. Various changes and changes are possible within the range.

10: train
12: cab
14: instrument panel
16: front windshield
20: obstacle or object
100: safe driving assistance system for trains
110: head-up display device
120: display
130: electronic device unit
140: sensor unit
150: train power supply

Claims (5)

In the safe driving assistance system for trains:
Electronic devices with different functions are installed inside and outside the train, respectively, to provide real-time driving information including at least the location, speed, altitude, forward and surrounding images, objects, obstacles, and the presence or absence of facilities according to the train driving. An electronic device to obtain;
Each of which is installed inside and outside the train and includes at least a change in the speed of the train detected during the running of the train, a distance from an object, a change in gravity, a heat detection, a vibration detection, an object and an obstacle, and a door opening and closing. A sensor unit including a plurality of sensors for acquiring detection information in real time;
A train power supply for supplying power to the train;
A display unit formed on a front windshield of the driver's cabin of the train to display the driving information and the sensing information in real time so that the train driver can recognize it while the train is running; And
Installed on the dashboard of the driver's cabin of the train, collects the driving information and the sensing information in real time from the electronic device unit and the sensor unit, and processes it into augmented reality contents to process the train's front track, the front train traffic situation and operation Includes; a head-up display device for outputting to the display unit to assist and support the driver's train driving according to the situation,
The head-up display device,
A communication interface unit connected to each of the electronic device units and the sensor units to receive the driving information and the sensing information;
A data collection unit that receives the driving information and the detection information from the communication interface unit, collects, collects, and analyzes data, and classifies data according to functions and uses;
A data processing unit that batch-processes and verifies the data transmitted from the data collection unit, selects data according to functions and uses, and performs primary processing;
A data processing unit that processes, converts, and generates graphic data so that the data first processed by the data processing unit are displayed as contents of augmented reality through 3D modeling;
An augmented reality image output unit receiving graphic data from the data processing unit and outputting the graphic data to be displayed as a visual image on the display unit;
A power control unit configured to receive power from the train power unit and control to supply power to the head-up display device;
An audio signal processing unit for converting data that can be expressed as audio among data processed by the data processing unit into an audio format;
An audio output unit for receiving audio data from the audio signal processing unit and outputting a voice guidance and warning sound; And
And an emergency power supply to supply power to the train when the train power supply unit receives power and is recharged under the control of the power control unit.
delete delete The method according to claim 1,
The display unit,
Displaying an augmented reality graphic image in the form of a moving image or a dynamic image in which the shape and color of the visual image is changed from the augmented reality image output unit according to the railroad ahead of the train, the traffic situation and the driving situation of the train ahead;
In response to the driving information and the detection information, time information, speed information, train information, warning information, traffic light information, navigation map information, obstacle detection radar status information, obstacle access information, next arrival station are required for safe driving while the train is running. Information, distance to the next destination station, distance to the stop line, current driving area information, current driving route information, stop line location information, mileage information, average driving speed information, distance to the end station, warning message information and driving A safe driving assistance system for trains, characterized in that the hourly speed information is changed in real time and displayed on a single screen. delete

Images