CN110544360A - train safe driving monitoring system and method - Google Patents

train safe driving monitoring system and method Download PDF

Info

Publication number
CN110544360A
CN110544360A CN201910727432.5A CN201910727432A CN110544360A CN 110544360 A CN110544360 A CN 110544360A CN 201910727432 A CN201910727432 A CN 201910727432A CN 110544360 A CN110544360 A CN 110544360A
Authority
CN
China
Prior art keywords
monitoring
dangerous
driver
driving
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910727432.5A
Other languages
Chinese (zh)
Inventor
贾云光
刘森
赵丽
于晓泉
杨光伦
孙振宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CRSC Research and Design Institute Group Co Ltd
Original Assignee
CRSC Research and Design Institute Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CRSC Research and Design Institute Group Co Ltd filed Critical CRSC Research and Design Institute Group Co Ltd
Priority to CN201910727432.5A priority Critical patent/CN110544360A/en
Publication of CN110544360A publication Critical patent/CN110544360A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00624Recognising scenes, i.e. recognition of a whole field of perception; recognising scene-specific objects
    • G06K9/00832Recognising scenes inside a vehicle, e.g. related to occupancy, driver state, inner lighting conditions
    • G06K9/00845Recognising the driver's state or behaviour, e.g. attention, drowsiness
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal operating condition and not elsewhere provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0205Specific application combined with child monitoring using a transmitter-receiver system
    • G08B21/0208Combination with audio or video communication, e.g. combination with "baby phone" function
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal operating condition and not elsewhere provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0225Monitoring making use of different thresholds, e.g. for different alarm levels
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems

Abstract

The invention provides a train safe driving monitoring system and a method, wherein the monitoring system comprises vehicle-mounted equipment, the vehicle-mounted equipment comprises an identification module and a monitoring processing module, and the identification module comprises an image identification module and a voice identification module; the image recognition module is used for recognizing driver behaviors and external personnel behaviors; the voice recognition module is used for recognizing dangerous sounds; the monitoring processing module is used for judging the driving danger condition according to the identification information of one or more identification modules. The monitoring system of the invention improves the reliability of judging the dangerous situation by comprehensively analyzing various monitoring and identifying results.

Description

Train safe driving monitoring system and method
Technical Field
the invention belongs to the field of rail transit safety, and particularly relates to a train safe driving monitoring system and method.
background
The train driving safety is the basis of normal operation of a train, and the key for monitoring and processing dangerous conditions of train driving in real time and guaranteeing the safe driving of the train is realized. In the running process of the train, the situations of dangerous driving conditions are various and complicated, and the dangerous driving conditions can be caused by the change of environmental physical parameters, dangerous driving of drivers, dangerous behaviors of external personnel and the like.
in the prior art, a method, a device and a system for identifying locomotive driver behaviors exist (a publication number CN106941602A), the technical scheme is used for collecting real-time monitoring images of a locomotive cab, automatically identifying several types of daily operations of a driver through a deep learning algorithm and giving an alarm for behaviors which do not meet driving requirements. The technical scheme provides a locomotive driver behavior identification method, namely image identification. In the prior art, a single way is often adopted to identify the driving danger condition, the driving danger condition cannot be comprehensively monitored, the alarm is given according to the information identified by the single way, and the false alarm rate is high. At the same time, there is a lack of safety protection against abnormal conditions.
therefore, how to realize comprehensive and comprehensive monitoring of safe train driving is an urgent problem to be solved in the field of rail transit safety.
Disclosure of Invention
Aiming at the problems, the invention provides a train safe driving monitoring system and a train safe driving monitoring method.
the train safe driving monitoring system includes: the vehicle-mounted equipment comprises a recognition module and a monitoring processing module, wherein the recognition module comprises an image recognition module and a voice recognition module;
the image recognition module is used for recognizing driver behaviors and external personnel behaviors;
the voice recognition module is used for recognizing dangerous sounds;
The monitoring processing module is used for judging the driving danger condition according to the identification information of one or more identification modules.
Further, the air conditioner is provided with a fan,
The image identification module is used for identifying potential hazard behaviors and hazard implementation behaviors of the foreign personnel;
The monitoring processing module is used for carrying out early warning according to the potential dangerous behaviors;
and the monitoring processing module is used for alarming according to the hazard implementation behavior.
Further, the air conditioner is provided with a fan,
and the monitoring processing module is used for judging the driving danger condition according to the behavior recognition result of the external personnel and the dangerous sound recognition result.
Further, the air conditioner is provided with a fan,
The identification module further comprises an environment monitoring module, the environment monitoring module monitors driving environment parameters through one or more sensors, and the monitoring processing module judges driving danger conditions according to the driving environment parameter information.
Further, the air conditioner is provided with a fan,
The monitoring processing module is used for judging dangerous driving behaviors of the driver according to the driving environment parameters and the driver behavior monitoring result.
further, the air conditioner is provided with a fan,
The monitoring system further comprises driver wearing equipment, and the driver wearing equipment is used for monitoring physiological parameters of a driver;
the monitoring processing module is used for judging dangerous driving behaviors of the driver according to the physiological parameters of the driver and the driving environment parameters.
further, the air conditioner is provided with a fan,
The image recognition module is also used for recognizing the appearance characteristics of the driver and authorizing the driver to drive the train according to the appearance characteristic recognition result.
Further, the air conditioner is provided with a fan,
The voice recognition module is also used for recognizing alarm voice information, and the monitoring processing module carries out automatic alarm according to the alarm voice information.
further, the air conditioner is provided with a fan,
And the monitoring processing module triggers ATP to carry out train operation safety protection when the train is in the dangerous driving condition.
The invention also provides a train safe driving monitoring method, which comprises the following steps:
acquiring dangerous behavior information through image recognition, wherein the dangerous behavior information comprises dangerous behavior of a driver and/or dangerous behavior information of external personnel;
acquiring dangerous sound information through voice recognition;
and judging the driving danger condition according to the dangerous behavior information and the dangerous sound information.
further, the air conditioner is provided with a fan,
The acquiring of the dangerous behavior information through image recognition comprises:
Acquiring potential hazard behaviors and hazard implementation behaviors of external personnel;
Carrying out early warning according to the potential dangerous behaviors;
and alarming according to the hazard implementation behavior.
Further, the method comprises:
acquiring driving environment parameters through a sensor;
Acquiring physiological parameters of a driver through driver wearing equipment;
And judging dangerous driving conditions according to the driving environment parameters and the physiological parameters.
Further, the method comprises:
Acquiring driving environment parameters through a sensor;
and judging dangerous driving conditions according to the driving environment parameters and the dangerous behavior information.
Further, the method comprises:
and acquiring the appearance characteristics of the authorized target personnel through image identification, and judging whether the authorized target personnel has the right to drive the train according to the appearance characteristics.
Further, the air conditioner is provided with a fan,
judging the danger level of the dangerous driving condition, and carrying out dangerous handling according to the danger level, wherein the dangerous handling comprises the following steps: at least one of warning, early warning, warning and ATP automatic protection.
the train safe driving monitoring system and the method can comprehensively and comprehensively monitor the dangerous condition of train driving, and can monitor the health state of a driver, the behavior of the driver, the invasion behavior of external personnel and the dangerous condition of the physical and chemical environment of a cab;
The reliability of judging the dangerous situation is improved by comprehensively analyzing various monitoring and identifying results;
By identifying that the driver authorizes driving, the possibility that external personnel operate the driving device is reduced, and the safety of the cab is improved;
The system gives out multi-level and multi-measure such as reminding, alarming, safety protection and the like to dangerous conditions, and improves the efficiency and quality of dangerous condition processing.
additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
fig. 1 shows a schematic structural diagram of a train safe driving monitoring system according to an embodiment of the invention;
FIG. 2 shows a flow chart of a method for monitoring safe driving of a train according to an embodiment of the invention;
fig. 3 is a schematic structural diagram of a train safe driving monitoring system according to an embodiment of the invention;
Fig. 4 shows a flow chart of a monitoring method for train safe driving according to an embodiment of the invention.
Detailed Description
in order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a train safe driving monitoring system, which comprises an identification module and a monitoring processing module, wherein the identification module comprises a first identification module and a second identification module; the monitoring processing module is used for judging the driving danger condition according to the first danger information identified by the first identification module and the second danger information identified by the second identification module and corresponding to the first danger information. The invention does not limit the first and the second, and improves the safety of train driving by comprehensively monitoring various types of indexes (or parameters) of the train driving environment during train driving. The first recognition module and the second recognition module are used for representing the distinction of monitoring types, such as image recognition, voice recognition, environmental parameter recognition, driver physiological parameter recognition and the like, and are not limited to comprise two recognition modules, and only represent the combination of different recognition modules, namely the combination of a plurality of modules. For example, the first recognition module may be an image recognition module, and the second recognition module may be a voice recognition module; or the first recognition module is an image recognition module, and the second recognition module is an environment monitoring module and the like. The modular combined integrated monitoring is further described in the examples below. In the embodiment of the invention, the expression "corresponding" indicates that the recognition and monitoring targets are the same, for example, the drinking behavior of the driver is monitored by the image recognition module, and the alcohol concentration is recognized by the integrated environment monitoring module to jointly recognize the drinking driving behavior of the driver. The recognition module is used for recognizing information such as images and sounds, and the monitoring processing module judges the driving danger condition according to the recognition information. The identification module is mainly arranged on the train and connected with the information acquisition equipment, and the monitoring processing module can be arranged on the train and also can be arranged on the ground as long as being in data connection with the identification module. In this embodiment, preferably, the identification module and the monitoring processing module are both arranged on the train, that is, belong to the vehicle-mounted device, so as to realize real-time and high-efficiency monitoring processing and ensure safety.
The monitoring system monitors related environment and personnel of train driving mainly through vehicle-mounted equipment, and the vehicle-mounted equipment in the embodiment of the invention is not limited to one or more computer equipment and also comprises image voice acquisition equipment, sensor equipment, loudspeaker equipment, communication equipment, charging equipment and the like.
The vehicle-mounted equipment comprises an identification module and a monitoring processing module, wherein the identification module at least comprises an image identification module and a voice identification module;
The image recognition module is used for recognizing driver behaviors and external personnel behaviors;
The voice recognition module is used for recognizing dangerous sounds;
and the monitoring processing module is used for judging the driving danger condition according to the identification information of one or more identification modules.
The monitoring system of the embodiment of the invention also comprises a ground center and driver wearing equipment which are in data connection with the vehicle-mounted equipment. The following describes the structure and function of the monitoring system according to the embodiment of the present invention in detail with reference to the accompanying drawings.
as shown in fig. 3, the monitoring system includes a vehicle-mounted device, a ground center, and a driver wearing device, and is also connected to the train ATP device. The vehicle-mounted equipment mainly comprises an identification module and a monitoring processing module. The various parts of the system and their interrelationship are described in detail below.
The ground center: the ground center mainly comprises a server and a firewall, and realizes communication with the vehicle-mounted equipment through a 2G/3G/4G/5G network interface, a radio station, special wireless communication equipment, WiFi and the like or a railway special network, pushes driving information and downloads monitoring data.
The information sent by the ground center to the vehicle-mounted equipment comprises operation plan information, work plan information and the like. Illustratively, when it is the turn of the driver A to work on duty, the vehicle-mounted system can search for corresponding driver wearing equipment on the monitoring train at a preset time according to the plan information, and send out the on duty prompt to the driver through the wearing equipment. In addition, in the driving process of the driver, the driver can be reminded to shift posts or have a rest according to the working plan information in combination with the monitoring information of the image recognition module or the monitoring information of the equipment worn by the driver.
The ground center is also used for receiving monitoring information, monitoring analysis information, alarm information, train control state change information and the like transmitted by the vehicle-mounted equipment. Illustratively, when the vehicle-mounted equipment monitors that a driver cab is in a crisis condition, real-time alarm is given, alarm information is transmitted to a ground center, and the ground center timely informs ground personnel to take measures to ensure the safety of a line. According to the nature of the transmission information, real-time transmission and periodic transmission can be adopted for different data, for example, a non-dangerous monitoring analysis information record analyzed in the real-time monitoring process of the monitoring processing module can be periodically sent to the ground center, video information of a train cab can be transmitted to the ground center in real time or in a delayed mode according to a communication environment, and the motion trail information of an on-duty driver can be periodically collected.
The driver wears the equipment: the device is used for collecting the body health information of a driver, and the driver wears the built-in photoelectric pulse sensor of the device, so that the measurement of the fatigue degree, the blood pressure, the pulse, the heart rate and the blood oxygen of the driver can be realized. The device measures the continuous blood pressure of a human body based on a pulse transmission time method, and the measurement of the continuous blood pressure value of the human body can be calculated by utilizing the pulse wave transmission speed, namely the Pulse Transmission Time (PTT) or the pulse transmission speed (PWV) is obtained by simulating the time difference between corresponding characteristic points in a mathematical model and a photoplethysmography (PPG), so that the blood pressure is calculated. The characteristic indexes reflecting the health state of the human body can be obtained through analyzing and processing the pulse information, and diagnosis and degree grading of mental fatigue are realized. The method for measuring the blood oxygen saturation by using a photoelectric technology is realized by a method for measuring the red light to green light by wearing equipment by a driver according to the Lambert-beer law. The driver-worn device detects the pulse rate by transmitting or reflecting blood flowing in the blood vessel (pulse).
The driver wears equipment and wears to locate the driver's wrist, modes such as accessible NFC, WIFI, bluetooth and mobile unit data connection. The wearing equipment can send the acquired health information of the driver to the behavior monitoring processing module. The wearing equipment can receive driving plan information and prompt information (such as post arrival prompt, rest prompt and warning prompt) pushed by the vehicle-mounted equipment. The prompting mode can be vibration or sound. Illustratively, when the monitoring system monitors that the driver sleeps during driving, the monitoring system reminds the driver of being alerted by vibration and sound. When the condition of the driver is monitored to be abnormal and the driver cannot drive adequately, the vehicle-mounted system sends a notice to the ground equipment in time, and the train is switched to enter the ATP automatic protection.
In addition, weather forecast pushing can be carried out on the wearing equipment, and a non-contact card punching function is set. Optionally, a 2G/3G/4G/5G SIM and a railway special SIM card can be arranged in the wearing equipment, and the alarm can be realized through short message transmission when necessary.
The driver wearing equipment is internally provided with a satellite positioning device, a gyroscope and an acceleration sensor device to realize the tracking of the gesture and the motion trail of the driver.
The vehicle-mounted equipment mainly comprises an identification module and a monitoring processing module.
and the monitoring processing module judges and processes the dangerous condition according to the data monitored or identified by the identification module. In the embodiment of the invention, the monitoring processing module determines the danger level according to the danger information identified by the identification module, comprises the step of determining the danger level according to one or more pieces of danger information identified by one danger module, and also comprises the step of determining the driving danger level according to the relevant danger information of a plurality of identification modules. The monitoring processing module comprises: the system comprises a danger information recording unit, a danger tracking and monitoring unit and a danger condition judging unit;
the danger information recording unit is used for recording danger information, such as information for identifying that a foreign person invades the cab, a gunshot sound and the like. Recording the danger information includes recording the first danger information, the second danger information and the like, namely recording the danger identification results of the plurality of identification submodules, and exemplarily including recording the type, source, time and the like of the identified danger information; the recorded danger information may be transmitted to the ground center at a designated period. In addition, in the embodiment, driving danger conditions are judged by adopting comprehensive dangerous information monitored in multiple types, and the dangerous information record can also be used as trigger and record data for tracking and monitoring specific dangerous conditions.
and the danger tracking and monitoring unit tracks and monitors the identification result of the corresponding identification module according to the recorded danger information. The method comprises the steps of tracking and monitoring the recognition result of a second recognition module (such as an environment monitoring module) according to first dangerous information (such as an unclean state of a driver at a driving position recognized by an image recognition module), and tracking and monitoring whether alcohol concentration is abnormal or toxic gas exists in environment parameters or not. Since the danger information identified by one identification module may be wrong or temporary, the system tracking and monitoring unit monitors the second danger information corresponding to the first danger information in a specified period. For example, a timer may be set, and if second danger information corresponding to the first danger information occurs within the time of the timer, it indicates that the tracked and monitored target danger condition is verified, so that the judgment of danger condition makes a judgment of danger level increase, and makes a corresponding treatment.
And the dangerous condition judgment unit judges the driving dangerous condition according to the recorded first dangerous information and the tracking and monitoring result. First, the dangerous situation judging unit preliminarily determines the dangerous level of the dangerous situation, such as the driver's drowsy or not wakening state, which is low, based on the first dangerous information. After the second danger information monitored in the appointed period is obtained, the danger condition judging unit redetermines the danger level, and if the alcohol concentration monitored by the environment monitoring module is higher, the driver can be considered to be drunk and driven, so that the danger level is increased.
if the danger tracking and monitoring unit does not acquire other danger information (including second danger information and other danger information identified by the first identification module subsequently) consistent with the danger condition of the monitored target in a specified period, namely the initially recorded danger information is not verified in the specified period (such as 10 minutes), the recording is not subjected to tracking and monitoring for danger level accumulation.
The monitoring processing module further comprises a danger processing unit, the danger processing unit triggers the monitoring system to perform corresponding danger handling operation according to the danger level, and the danger handling operation comprises the following steps: warning, early warning, alarming and ATP automatic protection.
The monitoring system further comprises a hazard cancellation unit. In this embodiment, the system outputs a prompt and an alarm, that is, outputs a danger signal, to the monitored dangerous situation through a display device, a speaker device, a driver wearing device, and the like. The driver can cancel the output of these danger signals, thereby stopping the danger signals after a false alarm or the danger has been eliminated, reducing unnecessary panic and impact. The risk cancellation unit may be configured to cancel the specified period of the tracking monitoring. In a designated period, the monitored danger meeting the set level is output and prompted, if the image information that the driver is not awake is detected, the driver can immediately wear the equipment to carry out vibration reminding, and meanwhile, follow-up monitoring is still carried out. The driver can cancel the danger signal by wearing the equipment, and simultaneously, the tracking monitoring is stopped.
the danger cancellation module is also used for monitoring the danger cancellation behavior, and judging whether illegal cancellation operation is performed or not according to the authenticity of the danger cancellation signal verified when the danger cancellation signal is monitored to be cancelled frequently. For example, when the driver cancels the danger signal for a plurality of times continuously and the danger signal contains the consistent danger situation, the illegal cancellation operation can be judged. Therefore, the danger signal is automatically output according to the judged danger condition, and the cancellation operation is ignored.
in the embodiment of the invention, the monitoring processing module is not limited to comprehensively judging and accumulating the danger level according to the danger information of different identification modules, and can also continuously monitor the danger information of the same identification module so as to further confirm the judgment of the danger condition. The monitoring processing module judges the driving danger condition according to the first danger information identified by the first identification module and the third danger information identified by the first identification module and corresponding to the first danger information. The embodiment of the invention limits the types of the first, second and third corresponding identification modules.
the monitoring system of the present invention will be described in detail below with reference to the comprehensive monitoring of images, voice, physical environment, and driver status in practical applications.
The identification module comprises sub-modules of a plurality of monitoring types: the device comprises an image recognition module, a voice recognition module and an environment monitoring module. In addition, the vehicle-mounted equipment further comprises a vehicle-ground communication module, a wireless charging module, a near field wireless communication module NFC, a positioning module and the like. In this embodiment, the identification module utilizes the collected data of the collecting device to complete identification of the information collected by analyzing and processing the data, the collected data can be completed through the video collecting device, the audio collecting device, the sensor, the wearing device and the like, and the collected information is generally transmitted to the computing terminal to be analyzed and processed. The calculation processing operations of the different identification modules may be performed in one or more terminals, or may be performed in a processing unit of the acquisition device. The embodiment of the invention does not limit the information processing equipment of the identification module. The following explains the respective modules of the in-vehicle apparatus.
An image recognition module: in this embodiment, the image recognition module is used for monitoring driver behaviors, monitoring external personnel behaviors, and driver identification verification authorization. The image recognition module receives data of the video acquisition equipment and analyzes and processes the data. To above-mentioned three kinds of image monitoring targets, because data acquisition pixel, position require differently, in this embodiment, adopt the multiunit camera to gather driver's action, external personnel's action, driver appearance characteristic:
(1) the group of cameras are used for monitoring the state of driver personnel, acquiring the state of a driver according to the facial behaviors and the gesture characteristics of the driver, recognizing the behaviors of the driver such as sleeping, distracting, smoking, drinking and the like, and judging and processing the recognition result through the monitoring processing module. And when the monitoring processing unit determines that the driver is in a dangerous driving state according to the image recognition result, alarming is carried out, and ATP is automatically switched to carry out safety protection. The group of cameras are high in pixels and are mainly arranged around the driving position of a driver.
(2) the other group of cameras are mainly used for monitoring external personnel, monitoring the states of the external personnel, judging potential hazard behaviors according to behavior states, actions and facial features of the external personnel, realizing an automatic alarm function through the monitoring processing module when the external personnel threatens drivers, and performing train operation safety protection through ATP.
(3) In addition, the image recognition module is also used for carrying out appearance feature recognition on the driver and determining whether the driver is authorized to request the verification personnel to drive the train according to the judgment result. In this embodiment, through one or more in driver personnel surveillance cameras, carry out facial recognition to the request verification personnel, send facial recognition result to the monitoring processing module and judge whether the request personnel have the right to operate current driver's cabin.
In the embodiment of the invention, the image recognition module recognizes various image information, and similar recognition operations, such as facial feature and expression recognition, can adopt the same recognition algorithm. Thereby improving the integration and utilization of the identification module.
a voice recognition module: in this embodiment, the speech recognition module is used to recognize natural sounds in the environment and speech content of a person. The voice recognition module receives natural sound and human voice in the train driving environment collected by the voice recording device, and respectively recognizes the two types of voice:
(1) Extracting human voice from the voice information, identifying the voice content of the voice, comparing the voice content with the preset dangerous language, if the voice content contains the preset dangerous language such as 'alarm', 'help-seeking' and the like, considering that a driver possibly sends a dangerous help-seeking signal to enter dangerous early warning, and judging whether to alarm or not by further analyzing the dangerous language or combining the image information identified by the image identification module. Through comprehensive judgment of a plurality of modules, the accuracy rate of dangerous condition judgment is improved, and the false alarm frequency is reduced. In this embodiment, the comprehensive judgment is to perform comprehensive analysis by sending the identification information of the multiple modules to the monitoring processing module. When the driving danger condition is considered to occur through further judgment, the system can automatically dial an emergency alarm call. Further determinations are illustratively: judging whether the dangerous speech is effective dangerous language, namely judging whether the speech of the dangerous language is independent (not a word carried in a sentence), loud, repeated for multiple times and the like, and determining whether the keyword of the dangerous language is true alarm speech by evaluating the characteristics.
(2) The voice behavior recognition device is used for recognizing dangerous languages in the driving environment of the driver and dangerous sounds such as: gunshot sounds, glass breaking sounds, cab breaking sounds, and the like. In the embodiment of the invention, the frequency of abnormal sound is tracked and monitored, the recognized dangerous sound is early warned, a driver can cancel the dangerous early warning by wearing the wading pen, but when the dangerous sound with certain frequency is tracked and recognized and is frequently canceled by the driver, the driver can be judged to abnormally execute, and then the system automatically triggers the warning. In this embodiment, multiple types of gunshot samples in the system can be classified and analyzed, and in the recognition process, the speech spectrum characteristics of the acquired sound are analyzed to determine whether the sound is a gunshot. The glass sound and the cab damage sound (such as the hitting sound of a hard object) are also referred to according to the sample and the characteristics, and the sound spectrum characteristics are extracted and compared for judgment.
The voice recognition module further sends the recognition result to the monitoring processing module, the monitoring processing module judges the driving danger condition according to the behavior recognition result of the external personnel and the dangerous sound recognition result, and the driver danger or the normal driving danger state is accurately judged by deep learning and matching with the image recognition device.
an environment monitoring module: the monitoring of dangerous conditions is realized through toxic gases such as temperature, humidity, smoke sensation, alcohol, chemical gas, CO and the like in the vehicle collected by the environment monitoring equipment. The environment monitoring equipment comprises a temperature and humidity sensor, an alcohol gas sensor, a toxic gas sensor and a smoke detection sensor, the sensors can be concentrated inside the environment monitoring unit and are installed at the top of the cab, or are dispersedly arranged in the cab, the equipment room, the corridor and the like, and data are sent to the environment monitoring module in a bus/network cable/wireless mode and the like. The environment monitoring unit judges whether the environment physicochemical parameter is abnormal, if the environment physicochemical parameter exceeds a threshold value, or the parameter has obvious mutation, so as to carry out early warning or alarm on dangerous conditions. The environment monitoring module also sends the environment parameters to the monitoring processing module for combining with the identification results of other modules to carry out comprehensive judgment on the dangerous conditions.
A monitoring processing module: in this embodiment, the monitoring processing module analyzes and judges the dangerous driving condition of the train according to the data information of the one or more identification sub-modules, and processes the dangerous driving condition. The dangerous condition treatment comprises prompting, warning, early warning, alarming, automatic protection of ATP and the like. The reminding and alarming comprises alarming through vehicle-mounted display equipment, sound equipment, driver wearing equipment and communication equipment of a communication module (to a ground center and a ground communication system). The monitoring processing module comprises a processor, a solid-state storage unit and other devices, CAN support comprehensive real-time analysis of various identification information, CAN also identify data to be identified sent by the sub-module according to needs, and supports connection with ATP through the secure Ethernet/MVB/CAN/IO. The following further explains several cases in which the detection processing module comprehensively judges data information of a plurality of identification modules:
In the embodiment of the invention, the monitoring processing module carries out early warning according to the potential dangerous state and carries out alarming according to the harm implementation behavior. In practical application, the train driving environment is complex, and false alarm is easily caused by monitoring and recognizing preset states (including cab environment, personnel characteristics, behaviors and the like) to give an alarm, so that unnecessary emergency and panic are caused. Therefore, in the embodiment of the present invention, not only the detection is performed in multiple ways, but also differentiated and ranked processing is performed according to the accuracy of the recognition result, including: carrying out danger early warning on the potential dangerous condition, and carrying out continuous tracking detection on the dangerous condition; and alarming for harm implementation behaviors. Illustratively, the danger identification of one identification module or a plurality of identification modules is subjected to grade evaluation, and corresponding danger treatment measures such as early warning, alarming and ATP automatic protection are carried out according to the danger grade. The danger level can be accumulated according to the continuous tracking danger information frequency, and also can be accumulated according to the danger information of a plurality of integrated modules. In this embodiment, the tracking monitoring means that when certain dangerous information is monitored, the dangerous information of the module and other related designated modules is continuously tracked, accumulated and monitored within a certain time, and in the designated time, if other dangerous signals consistent with the dangerous signals occur, the dangerous levels are accumulated. And if the designated time is over and the danger level is not further increased, clearing the tracking accumulation monitoring process, returning to a default state, and monitoring whether each module generates a new danger signal or not. After the danger signal is monitored, the danger signal is fed back to the display equipment or the driver wears the equipment through prompt, the driver can carry out danger cancellation reminding or early warning through the equipment, the tracking accumulation monitoring process is ended at the same time, the recording and the subsequent monitoring of the danger signal are not cancelled, when the driver cancels the danger early warning frequently, and the system obtains the fact (continuous occurrence or consistency) of the danger signal according to analysis, the illegal operation of the driver is judged, and the danger information is reported automatically and the like. The early warning processing does not cause a telephone alarm and an audio alarm in the present embodiment, but displays through the on-vehicle display device, reminds the driver through the wearing device, and saves the early warning condition information.
Illustratively, when the image recognition module recognizes the potential hazard row of the external person, the monitoring processing module performs early warning according to the potential hazard row, and is configured to perform early warning according to the potential hazard row. In the embodiment, the image recognition module adopts a self-learning algorithm to learn dangerous behaviors and abnormal behaviors, and before data is input, the system conducts deep self-learning according to various dangerous behaviors exercised by actual personnel to form an abnormal behavior database. In the monitoring process, the image recognition module is used for collecting that an unauthorized person stays in the cab, entering a danger early warning state and continuously tracking, and if the unauthorized person stays in the cab, the warning level is improved or early warning is continuously sent out. The driver can check the driving environment in time after receiving the early warning, and cancel the early warning for the false early warning condition. The driver is informed by wearing the equipment, and can be informed in time when the driver does not observe the driving environment (such as temporarily leaving), so that the danger early warning condition can be timely processed. And when the image identification module identifies the harm implementation behavior, the monitoring processing module gives an alarm according to the harm implementation behavior. For example, when it is monitored that a foreign person intentionally touches the driving device (for example, touches the operation interface with a hand), an alarm is given through the vehicle-mounted loudspeaker system. Further, if it is monitored that the driving equipment is violently damaged by the outside person or the driver is seized or attacked, an emergency alarm is started, and the ground center is directly informed through the communication module on the basis of the alarm. And simultaneously, triggering the train to switch to an ATP protection mode. By adopting graded danger processing and continuous tracking, the situation of false alarm causing panic is reduced, and the danger early warning can be timely found, so that the false alarm can be continuously tracked or eliminated.
In the embodiment of the invention, the monitoring processing module also judges the driving danger condition according to the behavior recognition result of the external personnel of the image recognition module and the dangerous sound recognition result of the voice recognition module. Illustratively, when the monitoring processing module receives the recognition result that a foreign person breaks into the cab and recognizes the sound that the cab is damaged by violent impact in continuous monitoring, the monitoring processing module can judge that the cab has an attack event, immediately give an alarm and trigger automatic protection of ATP (automatic train protection), wherein braking is one of ATP protection means, and when a driver loses the behavior ability, the train can be actively stopped through ATP, so that greater danger is prevented. In this embodiment, when the driver is monitored and identified to lose the behavior ability, or when functions such as early warning, warning and alarm are invalid, the ATP automatic protection is triggered. For another example, when the sound of broken glass is recognized by the voice recognition module and the behavior of the external person invading the cab is recognized by the image recognition module in the subsequent tracking monitoring, the violent invasion condition of the external person in the cab is judged, and the alarm and ATP protection are carried out.
In this embodiment, the monitoring processing module further determines dangerous driving behaviors of the driver according to the driving environment parameters identified by the environment monitoring module and the driver behaviors identified by the image identification module. In an exemplary embodiment, when the environment monitoring module monitors that the smoke concentration in the cab rises and the image recognition module monitors that the driver smokes, the monitoring processing module judges that the driver is in a dangerous driving state according to the recognition information, and warning prompt is performed through the display device and the wearing device. When the environment monitoring module monitors that the alcohol concentration rises and the image recognition module monitors that the driver drinks or recognizes that the driver is in a non-waking state through facial features, the monitoring processing module can judge that the driver is in a drinking or drunk driving state, and then prompts the driver through loud-speaking and wearing equipment vibration, and sends the dangerous driving condition to the ground center in time.
in this embodiment, the monitoring processing module further determines dangerous driving behaviors of the driver according to the physiological parameters monitored by the driver wearing equipment and the driving environment parameters identified by the environment monitoring module. Illustratively, the environment monitoring module can identify the increase of the indoor alcohol concentration, and meanwhile, the driver's driving behavior of drinking can be jointly judged by combining the abnormal pulse and blood oxygen concentration monitored by the driver wearing equipment.
The vehicle-ground communication module: the communication between the vehicle-mounted equipment and the ground equipment is realized, and in the embodiment, the vehicle-ground communication module comprises two parts:
(1) Through wireless communication: the public network communication supports 2G/3G/4G/5G network interfaces, radio stations, special wireless communication equipment, WiFi and the like, and realizes data transmission between the vehicle-mounted equipment and the ground center. The vehicle-mounted communication module sends the acquired data and the data for identification and analysis received by the vehicle-mounted equipment to the ground center; and transmitting the driving plan, the work plan and the like to the vehicle-mounted equipment.
(2) The wireless communication module is internally provided with alarm telephone information and is used for automatically dialing an alarm help-seeking telephone in emergency.
the wireless charging module: the vehicle-mounted equipment realizes the charging function of the equipment worn by the driver through the charging interface, supports wireless charging, and can be used for carrying out quick wireless charging on the equipment worn by at least two drivers simultaneously.
near field wireless communication module NFC: and finishing the information interaction function with the equipment worn by the driver.
A positioning module; the positioning device has the functions of GPS/Beidou/Glonass/Galileo positioning, gyroscope positioning or hybrid positioning.
the monitoring system can be used for monitoring, alarming and protecting the driving safety aiming at the detection of abnormal driving behaviors of a driver, the monitoring of the health state of the driver and the anti-terrorism through the modules and the equipment.
The vehicle-mounted equipment also comprises an integrated/independent display module and loudspeaker equipment, and is used for displaying relevant information in real time and carrying out relevant prompt on a driver.
according to the same inventive concept, an embodiment of the present invention further provides a train safe driving monitoring method, as shown in fig. 2, including:
(1) Monitoring first data of a train driving related environment, and identifying first danger information of train driving from the first data;
(2) Monitoring second data of a train driving related environment, and identifying second danger information corresponding to the first danger information from the second data;
(3) And judging the driving danger condition according to the first danger information and the second danger information.
Wherein, the train driving related environment includes in this embodiment: the train logistics parameter environment, the behaviors of drivers and foreign persons, the states of the drivers and the like, and the monitoring data (first data and second data) comprise: image information of the cab, sound information (including voice information), cab and surrounding physical environment parameter information, driver status information (including driver position information, motion information, physiological status information), and the like. The first and second data are not limited in the embodiments of the present invention, and are used to represent different types of monitoring data, and for example, the first data is image recognition information, and the second data is voice recognition information. The embodiment of the invention is not limited to the comprehensive analysis and judgment of two types of data, for example, whether the driver is drunk or not can be judged together according to the information (first danger information) of the state that the driver is not awake, the information (second danger information) of the abnormal alcohol concentration in the environmental parameter data and the information (third danger information) of the abnormal blood oxygen concentration in the physiological state data of the driver, which are identified by the image identification data. The integrated monitoring and analysis of the different types of data will be further described in the examples that follow. The "corresponding" representation identifies and monitors the same target, for example, driver drinking behavior, via an image recognition module.
In the embodiment of the invention, the driving danger level is determined according to a plurality of pieces of identified related danger information, including level determination according to the danger information in the same type of data, for example, the danger level can be gradually increased when the driver doze state data is continuously identified from the image identification data; and determining the grade according to the non-passing type danger information, such as confirming the driving danger condition according to the first danger information and the second danger information of different types, and determining the danger grade. Further, corresponding danger coping operations are carried out according to the danger grades, and the danger coping operations comprise: at least one of warning, early warning, warning and ATP automatic protection. In the embodiment of the invention, the response operation can be executed through the display equipment, the loudspeaker equipment, the driver wearing equipment and the like, the dangerous signal is output, so that the output information can be fed back in time, one or more different output modes can be selected according to the danger level, and the dangerous information can be effectively fed back without causing over-excited emergency reaction due to the lower level of dangerous information. Meanwhile, for emergency danger with higher grade, if a train cab is subjected to violent invasion, the train is switched to an automatic protection state except for outputting an alarm signal, so that the train can be automatically stopped, and the running fault is avoided.
further, determining a driving risk condition according to the first risk information and the second risk information includes:
(1) recording first danger information; recording the danger information includes recording the above-described first danger information, second danger information, and the like, and illustratively, includes recording the type, source, time, and the like of the identified danger information. In the embodiment, driving danger conditions are judged by adopting comprehensive dangerous information monitored in various types, and the dangerous information record can also be used as trigger and record data for tracking and monitoring specific dangerous conditions.
(2) tracking and monitoring the second data according to the recorded first danger information to identify the second danger information; since the danger information identified by one identification module may be wrong or temporary, the system tracking and monitoring unit monitors the second danger information corresponding to the first danger information in a specified period. For example, a timer may be set, and if second danger information corresponding to the first danger information occurs within the time of the timer, it indicates that the tracked and monitored target danger condition is verified, so that the judgment of danger condition makes a judgment of danger level increase (accumulation), and makes a corresponding treatment. Illustratively, in the first data of image recognition, the recognized driver has first dangerous information of an un-wakening state at the driving position, the environment monitoring second data is tracked and monitored, and whether an abnormal alcohol concentration or the presence of toxic gas and the like (namely, second dangerous information) exists in the environment parameters is tracked and monitored to further confirm the dangerous condition level.
(3) and judging the driving danger condition according to the recorded first danger information and the tracking and monitoring result. Firstly, preliminarily determining the danger level of the dangerous condition according to the first dangerous information; such as the initial recognition of a drowsy or unclean state of the driver, the risk level is low. Then, monitoring second danger information corresponding to the first danger information in a specified period; alcohol concentration in the above-described environmental monitoring data. Finally, re-determining the danger level according to second danger information monitored in the specified period; if the alcohol concentration further monitored from the environmental monitoring module is high, it can be considered that the driver is driving with alcohol, thereby increasing the risk level.
By tracking and monitoring in the appointed time, a plurality of dangerous information can be effectively associated, so that the driving safety monitoring is more comprehensive and accurate, and the misinformation of the dangerous driving condition caused by single and temporary dangerous information is avoided. The monitoring of a plurality of different types of data can avoid danger monitoring to omit simultaneously, and the danger information of discernment all can be used for arousing tracking monitoring in any one in a plurality of data, when data can not effectively be monitored and discerned, still can carry out comprehensive monitoring to the train environment to a certain extent, has improved the security.
the method further comprises the following steps: and canceling the danger signal, wherein the canceling simultaneously cancels the designated period of the tracking monitoring. In this embodiment, the monitored dangerous situation is output through a display device, a speaker device, a driver wearing device, and the like to prompt and alarm, that is, a dangerous signal is output. The driver can cancel the output of these danger signals, thereby stopping the danger signals after a false alarm or the danger has been eliminated, reducing unnecessary panic and impact. The cancellation operation may also be used to cancel the specified period of the trace monitoring described above. In a designated period, the monitored danger meeting the set level is output and prompted, if the image information that the driver is not awake is detected, the driver can immediately wear the equipment to carry out vibration reminding, and meanwhile, follow-up monitoring is still carried out. The driver can cancel the danger signal by wearing the equipment, and simultaneously, the tracking monitoring is stopped.
The method further comprises a hazard cancellation operation detection: and when the frequent cancellation of the danger signal is monitored, judging whether the illegal cancellation operation is carried out or not according to the authenticity of the verification cancellation of the danger signal. For example, when the driver cancels the danger signal for a plurality of times continuously and the danger signal contains the consistent danger situation, the illegal cancellation operation can be judged. Therefore, the danger signal is automatically output according to the judged danger condition, and the cancellation operation is ignored. By canceling the detection operation, the condition that a driver illegally cancels or the driver wears equipment or the driving equipment is maliciously utilized by people to cause that a monitoring result cannot be fed back is avoided, and the safety of train monitoring is improved.
as shown in fig. 4, in another embodiment, a train safe driving monitoring method includes:
(1) Acquiring dangerous behavior information through image recognition, wherein the dangerous behavior information comprises dangerous behavior of a driver and/or dangerous behavior information of external personnel;
(2) acquiring dangerous sound information through voice recognition;
(3) and judging the driving danger condition according to the dangerous behavior information and the dangerous sound information.
The train driving environment safety is the basis of train operation safety, and the safety of train driving can be improved by monitoring a train cab and particularly realizing the invasion of external personnel, such as terrorist attack behaviors. Illustratively, the video acquisition equipment can be adopted to acquire image information of a train cab, dangerous behaviors and abnormal behaviors are learned through a self-learning algorithm, and before data is input, the system conducts deep self-learning according to various dangerous behaviors exercised by actual personnel to form an abnormal behavior database. In the monitoring process, the collected image video information is analyzed, the behavior characteristics are extracted, and the behavior characteristics are compared with the abnormal behaviors recorded by the database to determine dangerous behavior information. The voice recognition can be carried out in the modes of feature extraction and data comparison.
the steps (1) and (2) are not distinguished in sequence.
In practical application, the train cab can be accidentally intruded by ordinary non-working personnel, but malicious destructive behaviors can not be carried out. In this embodiment, the step of obtaining the dangerous behavior information includes obtaining a potential dangerous behavior and a dangerous implementation behavior of the external person. Carrying out early warning according to the potential dangerous behaviors, for example, monitoring that non-workers enter a train cab and stay for more than 3 seconds through image recognition data, and carrying out dangerous early warning, wherein the early warning is output in a mode of prompting a driver by wearing equipment by the driver or playing voice prompt information through cab loudspeaker equipment; and alarming according to the harm implementation behavior, and if monitoring that an external person operates the driving equipment, destroys the driving equipment or invades the driver, directly alarming and triggering automatic protection of ATP. Through the monitoring of dangerous action and differentiation in the hierarchy, can accurate comprehensive monitoring high dangerous condition to make effective response, can avoid dangerous wrong report and the reaction of overexcitation that the monitoring process caused again.
In this embodiment, still carry out danger level judgement to dangerous driving condition, according to danger level carries out danger processing, danger processing includes: at least one of warning, early warning, warning and ATP automatic protection. The dangerous behavior monitoring adopts danger grade evaluation and differentiation processing.
In the embodiment of the invention, the safe driving monitoring method further comprises monitoring train environmental parameters, specifically, according to the embodiment, various sensors arranged in a train cab and around the train cab can be used for collecting physical parameters of driving environment; still include driver state parameter monitoring, according to above-mentioned embodiment, can adopt the driver to wear equipment and gather driver action state, position state and physiological parameter, include: heartbeat, blood oxygen concentration, etc. The dangerous driving condition can be judged according to the environmental parameters and the physiological parameters. And the dangerous driving condition can be judged according to the environmental parameters and the dangerous behavior information of the image identification data.
In the embodiment of the invention, the appearance characteristics of the authorized target personnel are obtained through image recognition, and whether the authorized target personnel is authorized to drive the train or not is judged according to the appearance characteristics. The safety of train driving can be further improved through train authorization control, and foreign people are prevented from entering a driving area or executing driving operation. Meanwhile, through image recognition authorization, during the period that a target person (driver) is on duty, the driver behavior can be monitored in a targeted manner, such as monitoring the face state, behavior state and physiological parameter state of the driver, and the driver behavior can also be monitored in a targeted manner so as to distinguish external persons and recognize the invasion behavior of the external persons to the driver.
The method described in this embodiment may be implemented by the safe driving monitoring system in the above embodiment, but is not limited to the above system. The train safe driving monitoring system and the method provided by the invention can comprehensively and comprehensively monitor various factors in train driving, improve the accuracy of danger judgment and avoid misinformation through comprehensive judgment of monitoring of various factors. One or more different dangerous handling operations are adopted for different dangerous conditions, so that the rationality of safety monitoring handling is improved, dangerous information can be fed back in time, and over-excited emergency reaction caused by temporary slight dangerous conditions is avoided.
Although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (15)

1. A train safe driving monitoring system is characterized in that,
The monitoring system comprises vehicle-mounted equipment, wherein the vehicle-mounted equipment comprises a recognition module and a monitoring processing module, and the recognition module comprises an image recognition module and a voice recognition module;
The image recognition module is used for recognizing driver behaviors and external personnel behaviors;
The voice recognition module is used for recognizing dangerous sounds;
The monitoring processing module is used for judging the driving danger condition according to the identification information of one or more identification modules.
2. The monitoring system of claim 1,
the image identification module is used for identifying potential hazard behaviors and hazard implementation behaviors of the foreign personnel;
The monitoring processing module is used for carrying out early warning according to the potential dangerous behaviors;
and the monitoring processing module is used for alarming according to the hazard implementation behavior.
3. The monitoring system according to claim 1 or 2,
and the monitoring processing module is used for judging the driving danger condition according to the behavior recognition result of the external personnel and the dangerous sound recognition result.
4. The monitoring system of claim 1,
The identification module further comprises an environment monitoring module, the environment monitoring module monitors driving environment parameters through one or more sensors, and the monitoring processing module judges driving danger conditions according to the driving environment parameters.
5. the monitoring system of claim 4,
The monitoring processing module is used for judging dangerous driving behaviors of the driver according to the driving environment parameters and the driver behavior monitoring result.
6. The monitoring system of claim 4,
the monitoring system further comprises driver wearing equipment, and the driver wearing equipment is used for monitoring physiological parameters of a driver;
the monitoring processing module is used for judging dangerous driving behaviors of the driver according to the physiological parameters of the driver and the driving environment parameters.
7. The monitoring system of claim 1,
The image recognition module is also used for recognizing the appearance characteristics of the driver and authorizing the driver to drive the train according to the appearance characteristic recognition result.
8. the monitoring system of claim 1,
The voice recognition module is also used for recognizing alarm voice information, and the monitoring processing module carries out automatic alarm according to the alarm voice information.
9. the monitoring system of any one of claims 1-2, 6-8,
And the monitoring processing module triggers ATP to carry out train operation safety protection when the train is in the dangerous driving condition.
10. A train safe driving monitoring method is characterized by comprising the following steps:
acquiring dangerous behavior information through image recognition, wherein the dangerous behavior information comprises dangerous behavior of a driver and/or dangerous behavior information of external personnel;
acquiring dangerous sound information through voice recognition;
and judging the driving danger condition according to the dangerous behavior information and the dangerous sound information.
11. The monitoring method according to claim 10, wherein the acquiring of the dangerous behavior information through image recognition comprises:
acquiring potential hazard behaviors and hazard implementation behaviors of external personnel;
carrying out early warning according to the potential dangerous behaviors;
and alarming according to the hazard implementation behavior.
12. The method of monitoring of claim 10, comprising:
acquiring driving environment parameters through a sensor;
Acquiring physiological parameters of a driver through driver wearing equipment;
And judging dangerous driving conditions according to the driving environment parameters and the physiological parameters.
13. The method of monitoring of claim 10, comprising:
acquiring driving environment parameters through a sensor;
And judging dangerous driving conditions according to the driving environment parameters and the dangerous behavior information.
14. The method of monitoring of claim 10, comprising:
and acquiring the appearance characteristics of the authorized target personnel through image identification, and judging whether the authorized target personnel has the right to drive the train according to the appearance characteristics.
15. the monitoring method according to any one of claims 10 to 14,
judging the danger level of the dangerous driving condition, and carrying out dangerous handling according to the danger level, wherein the dangerous handling comprises the following steps: at least one of warning, early warning, warning and ATP automatic protection.
CN201910727432.5A 2019-08-07 2019-08-07 train safe driving monitoring system and method Pending CN110544360A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910727432.5A CN110544360A (en) 2019-08-07 2019-08-07 train safe driving monitoring system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910727432.5A CN110544360A (en) 2019-08-07 2019-08-07 train safe driving monitoring system and method
PCT/CN2020/105205 WO2021023064A1 (en) 2019-08-07 2020-07-28 Safe driving monitoring system and method for train

Publications (1)

Publication Number Publication Date
CN110544360A true CN110544360A (en) 2019-12-06

Family

ID=68710527

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910727432.5A Pending CN110544360A (en) 2019-08-07 2019-08-07 train safe driving monitoring system and method

Country Status (2)

Country Link
CN (1) CN110544360A (en)
WO (1) WO2021023064A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111275943A (en) * 2020-02-27 2020-06-12 中国人民解放军陆军特色医学中心 Wearable nursing operation flow monitoring devices
WO2021023198A1 (en) * 2019-08-07 2021-02-11 北京全路通信信号研究设计院集团有限公司 Train safety driving monitoring system and method
WO2021023064A1 (en) * 2019-08-07 2021-02-11 北京全路通信信号研究设计院集团有限公司 Safe driving monitoring system and method for train
CN113256186A (en) * 2021-07-15 2021-08-13 西南交通大学 High-speed rail dispatcher comprehensive capacity evaluation method and system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102737475A (en) * 2011-04-07 2012-10-17 通用汽车环球科技运作有限责任公司 System and method for real-time detection of emergency situation occuring in vehicle
CN104537798A (en) * 2014-12-22 2015-04-22 清华大学苏州汽车研究院(吴江) Smoking, drunkenness and call prevention safety driving early warning system
CN104925113A (en) * 2015-06-08 2015-09-23 庄可军 Novel and multifunctional steering wheel
CN106781284A (en) * 2016-12-31 2017-05-31 中国铁道科学研究院电子计算技术研究所 Trainman's driver fatigue monitor system based on Multi-information acquisition
CN206224162U (en) * 2016-11-14 2017-06-06 周剑涛 A kind of on-vehicle Bluetooth speech control system
CN106941602A (en) * 2017-03-07 2017-07-11 中国铁道科学研究院 Trainman's Activity recognition method, apparatus and system
CN108022406A (en) * 2016-11-02 2018-05-11 天创科技有限公司 Vehicles monitoring system
CN108846332A (en) * 2018-05-30 2018-11-20 西南交通大学 A kind of railway drivers Activity recognition method based on CLSTA
CN108960067A (en) * 2018-06-05 2018-12-07 北京华纵科技有限公司 Real-time train driver motion recognition system and method based on deep learning

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9688271B2 (en) * 2015-03-11 2017-06-27 Elwha Llc Occupant based vehicle control
CN105292052A (en) * 2015-11-12 2016-02-03 福州大学 Automatic monitoring and alarming system for vehicle traffic safety
CN205113247U (en) * 2015-11-12 2016-03-30 福州大学 Automatic control of vehicle driving safety and alarm system
CN107757471A (en) * 2017-09-30 2018-03-06 上海爱优威软件开发有限公司 Safe driving prompting method and mobile terminal
US10864819B2 (en) * 2017-10-31 2020-12-15 Speedgauge, Inc. Driver alertness warning system and method
CN108162975A (en) * 2017-12-11 2018-06-15 厦门蓝斯通信股份有限公司 A kind of driver identity identification and monitoring and managing method and system
CN108238053A (en) * 2017-12-15 2018-07-03 北京车和家信息技术有限公司 A kind of vehicle drive monitoring method, device and vehicle
KR102302917B1 (en) * 2017-12-18 2021-09-15 현대모비스 주식회사 Apparatus and method for supporting safe driving
CN109229016A (en) * 2018-09-10 2019-01-18 深圳融易保数据运营有限公司 Vehicle-mounted voice reminding method and system
CN109910898A (en) * 2018-10-10 2019-06-21 深圳龙图腾创新设计有限公司 A kind of vehicles management method and system
CN109606386A (en) * 2018-12-12 2019-04-12 北京车联天下信息技术有限公司 Cockpit in intelligent vehicle
CN110544360A (en) * 2019-08-07 2019-12-06 北京全路通信信号研究设计院集团有限公司 train safe driving monitoring system and method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102737475A (en) * 2011-04-07 2012-10-17 通用汽车环球科技运作有限责任公司 System and method for real-time detection of emergency situation occuring in vehicle
CN104537798A (en) * 2014-12-22 2015-04-22 清华大学苏州汽车研究院(吴江) Smoking, drunkenness and call prevention safety driving early warning system
CN104925113A (en) * 2015-06-08 2015-09-23 庄可军 Novel and multifunctional steering wheel
CN108022406A (en) * 2016-11-02 2018-05-11 天创科技有限公司 Vehicles monitoring system
CN206224162U (en) * 2016-11-14 2017-06-06 周剑涛 A kind of on-vehicle Bluetooth speech control system
CN106781284A (en) * 2016-12-31 2017-05-31 中国铁道科学研究院电子计算技术研究所 Trainman's driver fatigue monitor system based on Multi-information acquisition
CN106941602A (en) * 2017-03-07 2017-07-11 中国铁道科学研究院 Trainman's Activity recognition method, apparatus and system
CN108846332A (en) * 2018-05-30 2018-11-20 西南交通大学 A kind of railway drivers Activity recognition method based on CLSTA
CN108960067A (en) * 2018-06-05 2018-12-07 北京华纵科技有限公司 Real-time train driver motion recognition system and method based on deep learning

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021023198A1 (en) * 2019-08-07 2021-02-11 北京全路通信信号研究设计院集团有限公司 Train safety driving monitoring system and method
WO2021023064A1 (en) * 2019-08-07 2021-02-11 北京全路通信信号研究设计院集团有限公司 Safe driving monitoring system and method for train
CN111275943A (en) * 2020-02-27 2020-06-12 中国人民解放军陆军特色医学中心 Wearable nursing operation flow monitoring devices
CN113256186A (en) * 2021-07-15 2021-08-13 西南交通大学 High-speed rail dispatcher comprehensive capacity evaluation method and system

Also Published As

Publication number Publication date
WO2021023064A1 (en) 2021-02-11

Similar Documents

Publication Publication Date Title
CN110544360A (en) train safe driving monitoring system and method
Chhabra et al. A survey on driver behavior detection techniques for intelligent transportation systems
CN102426776A (en) Network monitoring system and method for designated driving of automotive vehicle
US20150261769A1 (en) Local Safety Network
US10332385B2 (en) Location based support request messages responsive to alert recommendation
KR101609914B1 (en) the emergency situation sensing device responding to physical and mental shock and the emergency situation sensing method using the same
CN109383516A (en) A kind of anomaly analysis behavioral value system based on user behavior analysis
KR20160074208A (en) System and method for providing safety service using beacon signals
CN107933471A (en) The method and vehicle-mounted automatic help system of accident active call rescue
CN106448047A (en) Vehicle safety warning method and vehicle safety warning device
CN110525456B (en) Train safe driving monitoring system and method
CN109359755A (en) Event monitoring method, apparatus, equipment and storage medium
CN205722310U (en) A kind of train driver Activity recognition system based on video sequence
CN110309735A (en) Exception detecting method, device, server and storage medium
CN109451385A (en) A kind of based reminding method and device based on when using earphone
CN110379107A (en) A kind of public transport travel safety ensuring system and method
KR101437406B1 (en) an emergency management and crime prevention system for cars and the method thereof
CN109637089A (en) The method for early warning and device of user security
EP3109839A1 (en) Method of implementing gps based extended chime and special escort mode in security panel
CN112289031A (en) Method and device for detecting and alarming abnormal conditions in bus driving process
KR20150106986A (en) System for detecting drowsiness based on server and the method thereof
KR20160028542A (en) an emergency management and crime prevention system for cars and the method thereof
CN110222216A (en) Multifunctional intellectual defence system
CN110503802A (en) Driving accident judgment method and system based on automobile data recorder
AU2016205895B2 (en) Determining entry into or exit from a place while a tracking device is in the place

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination