CN107336724B - A kind of the high-speed rail anticollision gear and method of computer vision and millimeter-wave technology combination - Google Patents

A kind of the high-speed rail anticollision gear and method of computer vision and millimeter-wave technology combination Download PDF

Info

Publication number
CN107336724B
CN107336724B CN201710446437.1A CN201710446437A CN107336724B CN 107336724 B CN107336724 B CN 107336724B CN 201710446437 A CN201710446437 A CN 201710446437A CN 107336724 B CN107336724 B CN 107336724B
Authority
CN
China
Prior art keywords
target
module
radar
detection
computer vision
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710446437.1A
Other languages
Chinese (zh)
Other versions
CN107336724A (en
Inventor
叶涛
张强
周东杰
杨俊雄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Remote Sensing Equipment
Original Assignee
Beijing Institute of Remote Sensing Equipment
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Remote Sensing Equipment filed Critical Beijing Institute of Remote Sensing Equipment
Priority to CN201710446437.1A priority Critical patent/CN107336724B/en
Publication of CN107336724A publication Critical patent/CN107336724A/en
Application granted granted Critical
Publication of CN107336724B publication Critical patent/CN107336724B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning or like safety means along the route or between vehicles or trains
    • B61L23/04Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
    • B61L23/041Obstacle detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)
  • Train Traffic Observation, Control, And Security (AREA)
  • Image Processing (AREA)

Abstract

The high-speed rail anticollision gear and method combined the invention discloses a kind of computer vision and millimeter-wave technology, the trained classifier of machine learning method is directed through by high-speed rail anticollision gear, start millimetre-wave radar work, Visible Light Camera acquires video data, image preprocessing is done to the video data of acquisition, then start module of target detection, millimetre-wave radar and computer vision module start simultaneously at detection target, if radar or Computer Vision Detection within the scope of train driving rail, are alarmed to target by voice;If radar or computer vision do not detect that target, process return to Visible Light Camera acquisition video data, acquire next frame image, continue to test target within the scope of train driving rail.The present invention round-the-clock can detect the barrier in front of traveling train within the scope of rail.

Description

A kind of the high-speed rail anticollision gear and method of computer vision and millimeter-wave technology combination
Technical field
The present invention relates to a kind of high-speed rail anticollision gear and method, especially a kind of computer vision and millimeter-wave technology are combined High-speed rail anticollision gear and method.
Background technique
The high-speed rail anticollision gear that computer vision and millimeter-wave technology combine is in high-speed rail motorcoach train in the process of shunting In dedicated anticollision gear whole-process automatic early warning is carried out to route ahead state under high-speed rail EMU shunting mode.It is high Iron EMU under shunting mode, existing monitor recording device can not effective monitoring, be easy to appear Ren Gong lookout fault or not and Shi Jinhang reduction of speed, braking, lead to the accidents such as occur Vehicular impact foreign matter when line anomalies or knock into the back.
Summary of the invention
The high-speed rail anticollision gear and method combined it is an object of that present invention to provide a kind of computer vision and millimeter-wave technology, Solve high-speed rail EMU under shunting mode, existing monitor recording device can not effective monitoring, be easy to appear Ren Gong lookout fault Or reduction of speed, braking are carried out not in time, lead to the accidents the problem of such as occur Vehicular impact foreign matter when line anomalies or knock into the back.
A kind of high-speed rail anticollision gear of computer vision and millimeter-wave technology combination, comprising: Visible Light Camera, radar detection Device, processor and phonetic alarm;Further include: classifier loading module, image pre-processing module, Radar Targets'Detection module, Computer vision module.Wherein, it is seen that light camera, radar detedtor and phonetic alarm pass through cable respectively with processor into Row physical connection, classifier loading module, image pre-processing module, Radar Targets'Detection module and the operation of computer vision module In processor.It is described:
The function of Visible Light Camera are as follows: acquisition image/video data;
The function of radar detedtor are as follows: objects ahead is detected by millimeter-wave technology;
The function of processor are as follows: realize the control of each hardware module of high-speed rail anticollision gear and coordinate each software module work;
The function of phonetic alarm are as follows: pass through voice broadcast warning message;
The function of classifier loading module are as follows: the classifier that load machine learning method training obtains;
The function of image pre-processing module are as follows: edge detection is carried out to the video image of visible light collection and extracts image spy Sign;
The function of Radar Targets'Detection algoritic module are as follows: by calculating the distance and angle of target range collimation axis of radar, sentence Disconnected target realizes the function of target detection whether within the scope of the rail of train driving;
The function of computer vision module are as follows: by the classifier of load, the image extracted according to image pre-processing module The strategy of feature, binding pattern identification realizes target detection.
The course of work of high-speed rail anticollision gear are as follows: high-speed rail anticollision gear imports machine learning side by classifier loading module Then the trained classifier of method starts radar detedtor work, while Visible Light Camera module acquires video data, and image is pre- Processing module does image preprocessing to the video data of acquisition, then starts target detection, Radar Targets'Detection algoritic module and Computer vision module starts target detection.When radar detedtor detects target, Radar Targets'Detection algoritic module is calculated The distance and angle of the high collimation axis of radar of target range, by distance and angle meter target whether train driving rail range It is interior, when target is within the scope of the rail of train driving, then pass through voice broadcast: " note that front XX meters has barrier!", Middle XX indicates the distance of target range collimation axis of radar, while process returns to Visible Light Camera module, acquires next frame video image Data continue to test target.When target is not within the scope of the rail of train driving, but point that computer vision module passes through load When class device binding pattern recognition strategy detects target, then pass through voice broadcast: " note that there is barrier in front!";When target not Within the scope of the rail of train driving, and computer vision module does not have by the classifier binding pattern recognition strategy detection of load When detecting target, process returns to Visible Light Camera module, acquires next frame video image data, continues to test target.When When radar detedtor does not detect target, process returns to Visible Light Camera module, acquires next frame video image data, continues Detect target.
A kind of specific steps for the high-speed rail avoiding collision that computer vision and millimeter-wave technology combine are as follows:
The first step builds high-speed rail anti-collision system, comprising: Visible Light Camera, radar detedtor, processor and audio alert Device;Further include: classifier loading module, image pre-processing module, Radar Targets'Detection module, computer vision module;Wherein, Visible Light Camera, radar detedtor and phonetic alarm pass through cable and carry out physical connection with processor respectively;
Second step high-speed rail anti-collision system imports the trained classifier of machine learning method by classifier loading module, Then starting radar detedtor work;
Third step Visible Light Camera module acquires video image data;
4th step image pre-processing module does image preprocessing to the video data of acquisition;
5th step starts target detection, and Radar Targets'Detection algoritic module and computer vision module start target detection;
When radar detedtor detects target, Radar Targets'Detection algoritic module calculates the high collimation axis of radar of target range Distance and angle, through distance and angle meter target whether within the scope of the rail of train driving:
When target is within the scope of the rail of train driving, then pass through voice broadcast: " note that front XX meters has obstacle Object!", wherein XX indicates the distance of target range collimation axis of radar, while returning to Visible Light Camera module, acquires next frame video figure As data, target is continued to test;
When target is not within the scope of the rail of train driving, but computer vision module passes through the classifier combination mould of load When formula recognition strategy detects target, then pass through voice broadcast: " note that there is barrier in front!";When target is not in train driving Rail within the scope of, and computer vision module by load classifier binding pattern recognition strategy detection do not detect mesh When mark, Visible Light Camera module is returned to, acquires next frame video image data, continues to test target;
When radar detedtor does not detect target, Visible Light Camera module is returned to, acquires next frame video image number According to continuing to test target;So far, the high-speed rail anticollision detection combined based on computer vision and millimeter-wave technology is completed.
The present invention can whole-process automatic early warning, indirect labor judges and confirms line status, with " failure guiding peace It is entirely " design principle, is the another road safety curtain and protective net of high-speed rail EMU shunting service.
Detailed description of the invention
The work flow diagram for the high-speed rail anticollision gear that a kind of computer vision of Fig. 1 and millimeter-wave technology combine;
The composition schematic diagram for the high-speed rail anticollision gear that a kind of computer vision of Fig. 2 and millimeter-wave technology combine.
Specific embodiment
A kind of high-speed rail anticollision gear of computer vision and millimeter-wave technology combination, comprising: Visible Light Camera, radar detection Device, processor and phonetic alarm;Further include: classifier loading module, image pre-processing module, Radar Targets'Detection module, Computer vision module.Wherein, it is seen that light camera, radar detedtor and phonetic alarm pass through cable respectively with processor into Row physical connection, described:
The function of Visible Light Camera are as follows: acquisition image/video data;
The function of radar detedtor are as follows: objects ahead is detected by millimeter-wave technology;
The function of processor are as follows: realize the control of each hardware module of high-speed rail anticollision gear and coordinate each software module work;
The function of phonetic alarm are as follows: pass through voice broadcast warning message;
The function of classifier loading module are as follows: the classifier that load machine learning method training obtains;
The function of image pre-processing module are as follows: edge detection is carried out to the video image of visible light collection and extracts image spy Sign;
The function of Radar Targets'Detection algoritic module are as follows: by calculating the distance and angle of target range collimation axis of radar, sentence Disconnected target realizes the function of target detection whether within the scope of the rail of train driving;
The function of computer vision module are as follows: by the classifier of load, the image extracted according to image pre-processing module The strategy of feature, binding pattern identification realizes target detection.
The course of work of high-speed rail anticollision gear are as follows: high-speed rail anticollision gear imports machine learning side by classifier loading module Then the trained classifier of method starts radar detedtor work, while Visible Light Camera module acquires video data, and image is pre- Processing module does image preprocessing to the video data of acquisition, then starts target detection, Radar Targets'Detection algoritic module and Computer vision module starts target detection.When radar detedtor detects target, Radar Targets'Detection algoritic module is calculated The distance and angle of the high collimation axis of radar of target range, by distance and angle meter target whether train driving rail range It is interior, when target is within the scope of the rail of train driving, then pass through voice broadcast: " note that front XX meters has barrier!", Middle XX indicates the distance of target range collimation axis of radar, while process returns to Visible Light Camera module, acquires next frame video image Data continue to test target.When target is not within the scope of the rail of train driving, but point that computer vision module passes through load When class device binding pattern recognition strategy detects target, then pass through voice broadcast: " note that there is barrier in front!";When target not Within the scope of the rail of train driving, and computer vision module does not have by the classifier binding pattern recognition strategy detection of load When detecting target, process returns to Visible Light Camera module, acquires next frame video image data, continues to test target.When When radar detedtor does not detect target, process returns to Visible Light Camera module, acquires next frame video image data, continues Detect target.
A kind of specific steps for the high-speed rail avoiding collision that computer vision and millimeter-wave technology combine are as follows:
The first step builds high-speed rail anti-collision system, comprising: Visible Light Camera, radar detedtor, processor and audio alert Device;Further include: classifier loading module, image pre-processing module, Radar Targets'Detection module, computer vision module;Wherein, Visible Light Camera, radar detedtor and phonetic alarm pass through cable and carry out physical connection with processor respectively;
Second step high-speed rail anti-collision system imports the trained classifier of machine learning method by classifier loading module, Then starting radar detedtor work;
Third step Visible Light Camera module acquires video image data;
4th step image pre-processing module does image preprocessing to the video data of acquisition;
5th step starts target detection, and Radar Targets'Detection algoritic module and computer vision module start target detection;
When radar detedtor detects target, Radar Targets'Detection algoritic module calculates the high collimation axis of radar of target range Distance and angle, through distance and angle meter target whether within the scope of the rail of train driving:
When target is within the scope of the rail of train driving, then pass through voice broadcast: " note that front XX meters has obstacle Object!", wherein XX indicates the distance of target range collimation axis of radar, while returning to Visible Light Camera module, acquires next frame video figure As data, target is continued to test;
When target is not within the scope of the rail of train driving, but computer vision module passes through the classifier combination mould of load When formula recognition strategy detects target, then pass through voice broadcast: " note that there is barrier in front!";When target is not in train driving Rail within the scope of, and computer vision module by load classifier binding pattern recognition strategy detection do not detect mesh When mark, Visible Light Camera module is returned to, next frame video image data is acquired, continues to test target;
When radar detedtor does not detect target, Visible Light Camera module is returned to, acquires next frame video image number According to continuing to test target;So far, the high-speed rail anticollision detection combined based on computer vision and millimeter-wave technology is completed.

Claims (2)

1. the high-speed rail anticollision gear that a kind of computer vision and millimeter-wave technology combine, comprising: Visible Light Camera, radar detection Device, processor and phonetic alarm;Characterized by further comprising: classifier loading module, image pre-processing module, radar target Detection module, computer vision module;Wherein, it is seen that light camera, radar detedtor and phonetic alarm are distinguished by cable Physical connection is carried out with processor, described:
The function of Visible Light Camera are as follows: acquisition image/video data;
The function of radar detedtor are as follows: objects ahead is detected by millimeter-wave technology;
The function of processor are as follows: realize the control of each hardware module of high-speed rail anticollision gear and coordinate each software module work;
The function of phonetic alarm are as follows: pass through voice broadcast warning message;
The function of classifier loading module are as follows: the classifier that load machine learning method training obtains;
The function of image pre-processing module are as follows: edge detection is carried out to the video image of visible light collection and extracts characteristics of image;
The function of Radar Targets'Detection algoritic module are as follows: by calculating the distance and angle of target range collimation axis of radar, judge mesh Mark realizes the function of target detection whether within the scope of the rail of train driving;
The function of computer vision module are as follows: by the classifier of load, according to the characteristics of image that image pre-processing module extracts, The strategy of binding pattern identification realizes target detection;
The course of work of the high-speed rail anticollision gear are as follows: high-speed rail anticollision gear imports machine learning side by classifier loading module Then the trained classifier of method starts radar detedtor work, while Visible Light Camera module acquires video data, and image is pre- Processing module does image preprocessing to the video data of acquisition, then starts target detection, Radar Targets'Detection algoritic module and Computer vision module starts target detection;When radar detedtor detects target, Radar Targets'Detection algoritic module is calculated The distance and angle of the high collimation axis of radar of target range, by distance and angle meter target whether train driving rail range It is interior, when target is within the scope of the rail of train driving, then pass through voice broadcast: " note that front XX meters has barrier!", Middle XX indicates the distance of target range collimation axis of radar, while returning to Visible Light Camera module, acquires next frame video image data, Continue to test target;When target is not within the scope of the rail of train driving, but computer vision module passes through the classifier of load When binding pattern recognition strategy detects target, then pass through voice broadcast: " note that there is barrier in front!";When target is not arranging Within the scope of the rail of vehicle traveling, and computer vision module is not examined by the classifier binding pattern recognition strategy detection of load When measuring target, Visible Light Camera module is returned to, next frame video image data is acquired, continues to test target;Work as radar detection When device does not detect target, process returns to Visible Light Camera module, acquires next frame video image data, continues to test mesh Mark.
2. the high-speed rail avoiding collision that a kind of computer vision and millimeter-wave technology combine, it is characterised in that specific steps are as follows:
The first step builds high-speed rail anti-collision system, comprising: Visible Light Camera, radar detedtor, processor and phonetic alarm;Also wrap It includes: classifier loading module, image pre-processing module, Radar Targets'Detection module, computer vision module;Wherein, it is seen that light Camera, radar detedtor and phonetic alarm pass through cable and carry out physical connection with processor respectively;
Second step high-speed rail anti-collision system imports the trained classifier of machine learning method by classifier loading module, then opens Dynamic radar detedtor work;
Third step Visible Light Camera module acquires video image data;
4th step image pre-processing module does image preprocessing to the video data of acquisition;
5th step starts target detection, and Radar Targets'Detection algoritic module and computer vision module start target detection;
When radar detedtor detects target, Radar Targets'Detection algoritic module calculates the distance of the high collimation axis of radar of target range And angle, through distance and angle meter target whether within the scope of the rail of train driving:
When target is within the scope of the rail of train driving, then pass through voice broadcast: " note that front XX meters has barrier!", Middle XX indicates the distance of target range collimation axis of radar, while returning to Visible Light Camera module, acquires next frame video image data, Continue to test target;
When target is not within the scope of the rail of train driving, but computer vision module is known by the classifier binding pattern of load When strategy does not detect target, then pass through voice broadcast: " note that there is barrier in front!";When target is not in the iron of train driving In criterion is enclosed, and computer vision module does not detect target by the classifier binding pattern recognition strategy detection of load When, Visible Light Camera module is returned to, next frame video image data is acquired, continues to test target;
When radar detedtor does not detect target, Visible Light Camera module is returned to, acquires next frame video image data, after Continuous detection target;
So far, the high-speed rail anticollision detection combined based on computer vision and millimeter-wave technology is completed.
CN201710446437.1A 2017-06-14 2017-06-14 A kind of the high-speed rail anticollision gear and method of computer vision and millimeter-wave technology combination Active CN107336724B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710446437.1A CN107336724B (en) 2017-06-14 2017-06-14 A kind of the high-speed rail anticollision gear and method of computer vision and millimeter-wave technology combination

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710446437.1A CN107336724B (en) 2017-06-14 2017-06-14 A kind of the high-speed rail anticollision gear and method of computer vision and millimeter-wave technology combination

Publications (2)

Publication Number Publication Date
CN107336724A CN107336724A (en) 2017-11-10
CN107336724B true CN107336724B (en) 2019-04-12

Family

ID=60220591

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710446437.1A Active CN107336724B (en) 2017-06-14 2017-06-14 A kind of the high-speed rail anticollision gear and method of computer vision and millimeter-wave technology combination

Country Status (1)

Country Link
CN (1) CN107336724B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108313088B (en) * 2018-02-22 2020-08-25 中车长春轨道客车股份有限公司 Non-contact rail vehicle barrier detection system
CN108528478B (en) * 2018-04-02 2020-09-25 交控科技股份有限公司 Method and device for identifying rail traffic conditions
CN108583620B (en) 2018-04-02 2019-08-30 交控科技股份有限公司 The processor and early warning system of train assistance tracking early warning
CN109001743B (en) * 2018-09-06 2024-08-02 中国铁道科学研究院集团有限公司通信信号研究所 Tramcar anti-collision system
CN111688758A (en) * 2019-03-11 2020-09-22 北京华通时空通信技术有限公司 Obstacle detection system for high-speed railway track
CN112298285A (en) * 2019-07-26 2021-02-02 比亚迪股份有限公司 Train control system, train control method and train
TWI774445B (en) * 2021-06-28 2022-08-11 萬旭電業股份有限公司 Millimeter wave radar apparatus detecting obstacle on railway
CN113435404B (en) * 2021-07-14 2023-05-12 深圳市比一比网络科技有限公司 Electric bus shunting safety auxiliary driving method and system based on radar and image detection
CN115366940B (en) * 2022-08-29 2023-09-26 中南大学 Train with self-adaptive crashworthiness protection device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6944543B2 (en) * 2001-09-21 2005-09-13 Ford Global Technologies Llc Integrated collision prediction and safety systems control for improved vehicle safety
CN102303605A (en) * 2011-06-30 2012-01-04 中国汽车技术研究中心 Multi-sensor information fusion-based collision and departure pre-warning device and method
CN202272020U (en) * 2011-08-02 2012-06-13 王元知 Anticollision and rear-end collision prevention safety device of high-speed train
CN102508246B (en) * 2011-10-13 2013-04-17 吉林大学 Method for detecting and tracking obstacles in front of vehicle
CN102756748A (en) * 2012-07-31 2012-10-31 上海中科高等研究院 Train anticollision system on basis of sound wave communication and anticollision method thereof
CN104637059A (en) * 2015-02-09 2015-05-20 吉林大学 Night preceding vehicle detection method based on millimeter-wave radar and machine vision

Also Published As

Publication number Publication date
CN107336724A (en) 2017-11-10

Similar Documents

Publication Publication Date Title
CN107336724B (en) A kind of the high-speed rail anticollision gear and method of computer vision and millimeter-wave technology combination
Dagan et al. Forward collision warning with a single camera
CN100440269C (en) Intelligent detecting prewarning method for expressway automobile running and prewaring system thereof
CN107161097B (en) Vehicle running intelligent security system based on Beidou Navigation System
CN105549023B (en) Article detection device and its method of work
US9047781B2 (en) Safety zone detection, enforcement and alarm system and related methods
CN106530831A (en) System and method for monitoring and early warning of high-threat vehicles
CN102765365B (en) Pedestrian detection method based on machine vision and pedestrian anti-collision warning system based on machine vision
CN103971540B (en) A kind of prior-warning device preventing vehicle pileup from knocking into the back and method for early warning
CN102785660A (en) Vehicle collision-proof early warning device
CN111198371A (en) Forward-looking obstacle detection system
CN105844222A (en) System and method for front vehicle collision early warning based on visual sense
CN102576495B (en) Collision monitor for a motor vehicle
CN103112451A (en) Automobile automatic collision avoidance system and method
EP1375267A2 (en) Process and system for the detection of an accident risk
CN101872559A (en) Vehicle driving simulator-oriented virtual driving active safety early warning system and early warning method
CN106585670B (en) To train detection systems and method before a kind of urban track traffic based on video
CN106080482A (en) A kind of automobile deceleration safety system
CN105336217A (en) Driving safety prewarning system based on machine vision and Android platform
CN108973859A (en) A kind of terrible Preventing Traffic Accident System and method of popping one's head in
CN113657265B (en) Vehicle distance detection method, system, equipment and medium
CN207345852U (en) A kind of train Safety of Shunting Operation prevention and control system
CN111145554B (en) Scene positioning method and device based on automatic driving AEB
CN110834587A (en) Automobile longitudinal anti-collision system based on laser ranging
CN105225487A (en) The Real-Time Monitoring of a kind of crossing vehicle and discrimination system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant