CN108416257A - Merge the underground railway track obstacle detection method of vision and laser radar data feature - Google Patents

Merge the underground railway track obstacle detection method of vision and laser radar data feature Download PDF

Info

Publication number
CN108416257A
CN108416257A CN201810051704.XA CN201810051704A CN108416257A CN 108416257 A CN108416257 A CN 108416257A CN 201810051704 A CN201810051704 A CN 201810051704A CN 108416257 A CN108416257 A CN 108416257A
Authority
CN
China
Prior art keywords
laser radar
data
camera
subway
image data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810051704.XA
Other languages
Chinese (zh)
Inventor
林春雨
王保华
翟国锐
尹航
郝志强
彭少武
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jiaotong University
Original Assignee
Beijing Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jiaotong University filed Critical Beijing Jiaotong University
Priority to CN201810051704.XA priority Critical patent/CN108416257A/en
Publication of CN108416257A publication Critical patent/CN108416257A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Train Traffic Observation, Control, And Security (AREA)

Abstract

The invention discloses a kind of underground railway track obstacle detection methods of fusion vision and laser radar data feature, include the following steps:S1, laser radar and camera are assembled for subway;S2, using the subway of laser radar and camera is equipped with along vehicle line back and forth at least once, acquire camera image data and laser radar point cloud data on the way;S3, the structure that map is carried out using laser radar point cloud data;For at cross track and bend position, demarcated one by one using camera image data;S4, the road conditions that camera image data and laser radar point cloud data can not all be determined, using manually being marked manually;Form the subway maps data of the vehicle line in S2.The present invention merges the detection of obstacles that vision realizes underground railway track with laser radar data feature;Based on laser radar data, supplemented by visual signature, the two data characteristics is excavated, detects barrier.

Description

Merge the underground railway track obstacle detection method of vision and laser radar data feature
Technical field
The present invention relates to automatic Pilot technical fields, and in particular to a kind of ground of fusion vision and laser radar data feature Rail road obstacle detection method.
Background technology
Automatic driving technology development like a raging fire in recent years, be but limited to many randomnesss of urban traffic situation and repeatly Be rebuffed repeatly, although can by being equipped with laser radar, the sensors such as millimetre-wave radar enhance the feasibility of automatic Pilot, really again by It can not implement to the puzzlement of sensor high price, for example a 64 line laser radar costs reach more than 8000 dollars, close to one The price of automobile.And main public transport --- subway in city, because it is with fixed travel route and its costliness Price and subway driver training long periodicity, will be most urgent and be easiest to realize automatic Pilot.And subway is driven automatically In sailing, the main problem most paid close attention to is exactly the detection of barrier.
Invention content
Based on background above technology, the present invention provides a kind of underground railway track barrier of fusion vision and laser radar data feature Hinder object detecting method.Based on laser radar data, supplemented by visual signature, the two data characteristics is excavated, detection barrier Hinder object.
In order to achieve the goal above, the present invention uses following technical scheme:
A kind of underground railway track obstacle detection method of fusion vision and laser radar data feature, includes the following steps:
S1, laser radar and camera are assembled for subway;
S2, using the subway of laser radar and camera is equipped with along vehicle line back and forth at least once, acquisition is on the way Camera image data and laser radar point cloud data;
S3, the structure that map is carried out using laser radar point cloud data;For at cross track and bend position, using taking the photograph As head image data is demarcated one by one;
S4, the road conditions that can not be all determined for camera image data and laser radar point cloud data are carried out using artificial Mark manually;Form the subway maps data of the vehicle line in S2.
Preferably, the set of the camera image data in the subway maps data constitutes visual signature database, institute State the constantly improve that detection method further includes visual signature database.
It is highly preferred that the constantly improve detailed process of the visual signature database is:When judging rail according to laser radar When thering is barrier to occur above road, in conjunction with the camera image data in subway map datum and the barrier captured by the preceding camera Hinder object image data, judge whether final barrier causes danger to underground railway track traveling, and barrier image data is added In visual signature database.
Another aspect of the present invention also provide using the above detection method carry out underground railway track barrier detection subway from The dynamic method for driving power.
Beneficial effects of the present invention
The underground railway track obstacle detection method of fusion vision and laser radar data feature provided by the invention, fusion regard Feel the detection of obstacles that underground railway track is realized with laser radar data feature;Based on laser radar data, it is with visual signature It is auxiliary, the two data characteristics is excavated, barrier is detected.
Description of the drawings
Fig. 1 is the theoretical experimental calibration plate picture of combined calibrating of the present invention.
Fig. 2 is the theoretical experiment flow figure of combined calibrating of the present invention.
Specific implementation mode
The present invention is specifically described below by embodiment, it is necessary to which indicated herein is that the present embodiment is served only for pair The present invention is further described, and should not be understood as limiting the scope of the invention, and the person skilled in the art in the field can To make some nonessential modifications and adaptations according to the content invented above.In the absence of conflict, the reality in the present invention The feature applied in example and embodiment can be combined with each other.
The present invention demonstrates the empirical theory of video camera and laser radar combined calibrating in laboratory conditions first:
Gridiron pattern is set indoors, the gridiron pattern is shot simultaneously using laser radar and camera, obtains point cloud number respectively According to and image data.
The combined calibrating of camera and laser radar, specific demarcation flow such as Fig. 2 are carried out using scaling board as shown in Figure 1 It is shown.
Wherein black circle is round hole region, and other is solid area, and such laser radar is encountering scanning circle It when region, just will appear the jump of depth point cloud data, be convenient for the determination of coordinate.And camera data can pass through detection Each circular center determines the relationship between world coordinates and image coordinate, and then determines camera inside and outside parameter, finally realizes two The combined calibrating of person.
The present invention carries out the structure of subway maps data according further to laser radar and camera, specific as follows:
Laser radar and camera are assembled for subway;Using being equipped with the subway of laser radar and camera along driving line Road at least once, acquires camera image data and laser radar point cloud data on the way back and forth.
Since Lidar Ratios are more accurate and reliable, the structure of map will be carried out using laser radar, at cross track It with the positions such as bend, will one by one be demarcated using the image data of camera, to determine the correctness of position traveling.Camera shooting Head image data and the road conditions that can not all determine of laser radar point cloud data, will be using manually being marked manually.Thus shape At the subway maps data of specific circuit, it is ensured that subway can be without the traveling under any burst and abnormal conditions.
Further, when this method being applied in subway automatic Pilot, in the process of moving, it will appear barrier above track Hinder object, the detection of abnormal conditions can be carried out at this time, it is specific as follows:
Generally for the large-sized object that can cause rail running safety, the pedestrian of the electric pole, shuttle that such as fall and domestic animal Poultry is that can make correct judgement merely with the radar point cloud data acquired in real time in the subway maps data and traveling of structure 's.For curve data, such as close to the left and right turning at right angle, laser radar point cloud data, which may judge front by accident, barrier, But due to having had been built up subway maps data, can be happened to avoid such.
Main exception is from several points:The snowflake of snowy day sheet occurs, or is suspended in the north material on track The appearance of the objects such as bag, balloon and kite.These objects will not cause rail running danger, but laser radar but may production Raw erroneous judgement.Therefore, it needs to combine the camera image data in subway map datum at this time and works as captured by preceding camera Barrier image data, visual signature carry out auxiliary judgment.Visual signature database can also be constantly updated, such as every It when the above-mentioned barrier of secondary appearance, will constantly be added in visual signature database, and occur in this way in next time, can directly carry out It compares to make accurate judgment.Visual signature database therein is the collection of the camera image data in subway maps data It closes.
For example, the balloon to suspend above track, can utilize laser radar to detect the position of the object, including the object Height apart from track.Since laser radar belongs to discrete spot scan, possibly it can not judge whether the object connect with track, Auxiliary judgment can be carried out using camera image data at this time, usually may determine that the object is levitated object.For For the sake of safety, it will be somebody's turn to do using the visual signature of the object occurred in the track being continuously added stored in visual database The classification and identification of object judge that the object is non-hazardous levitated object, perfect with database, can determine whether out the object Body is balloon.
In subway automatic Pilot, the main problem most paid close attention to is exactly detection of obstacles, and the present invention with this end in view, is melted Close the detection of obstacles that vision realizes subway with laser radar data feature.The present invention based on laser radar point cloud data, with Supplemented by visual signature data, the two data characteristics is excavated, detects barrier.
Obviously, described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Based on this Embodiment in invention, every other reality obtained by those of ordinary skill in the art without making creative efforts Example is applied, the scope of the present invention is belonged to.

Claims (4)

1. a kind of underground railway track obstacle detection method of fusion vision and laser radar data feature, which is characterized in that including Following steps:
S1, laser radar and camera are assembled for subway;
S2, using the subway of laser radar and camera is equipped with along vehicle line back and forth at least once, acquire taking the photograph on the way As head image data and laser radar point cloud data;
S3, the structure that map is carried out using laser radar point cloud data;For at cross track and bend position, camera is utilized Image data is demarcated one by one;
S4, the road conditions that can not be all determined for camera image data and laser radar point cloud data are carried out manually using artificial Mark;Form the subway maps data of the vehicle line in S2.
2. detection method according to claim 1, which is characterized in that the camera image number in the subway maps data According to set constitute visual signature database, the detection method further includes the constantly improve of visual signature database.
3. detection method according to claim 2, which is characterized in that the constantly improve of the visual signature database is specific Process is:When judging to there is barrier to occur above track according to laser radar, in conjunction with the camera figure in subway map datum Barrier image data as data and captured by the preceding camera, judges whether final barrier causes underground railway track traveling Danger, and barrier image data is added in visual signature database.
4. a kind of method of subway automatic Pilot power, which is characterized in that using any detection methods of claim 1-3 into The detection of row underground railway track barrier.
CN201810051704.XA 2018-01-19 2018-01-19 Merge the underground railway track obstacle detection method of vision and laser radar data feature Pending CN108416257A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810051704.XA CN108416257A (en) 2018-01-19 2018-01-19 Merge the underground railway track obstacle detection method of vision and laser radar data feature

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810051704.XA CN108416257A (en) 2018-01-19 2018-01-19 Merge the underground railway track obstacle detection method of vision and laser radar data feature

Publications (1)

Publication Number Publication Date
CN108416257A true CN108416257A (en) 2018-08-17

Family

ID=63126036

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810051704.XA Pending CN108416257A (en) 2018-01-19 2018-01-19 Merge the underground railway track obstacle detection method of vision and laser radar data feature

Country Status (1)

Country Link
CN (1) CN108416257A (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109657698A (en) * 2018-11-20 2019-04-19 同济大学 A kind of magnetic-levitation obstacle detection method based on cloud
CN110018470A (en) * 2019-03-01 2019-07-16 北京纵目安驰智能科技有限公司 Based on example mask method, model, terminal and the storage medium merged before multisensor
CN110412986A (en) * 2019-08-19 2019-11-05 中车株洲电力机车有限公司 A kind of vehicle barrier detection method and system
CN110471085A (en) * 2019-09-04 2019-11-19 深圳市镭神智能系统有限公司 A kind of rail detection system
CN110550072A (en) * 2019-08-29 2019-12-10 北京博途智控科技有限公司 method, system, medium and equipment for identifying obstacle in railway shunting operation
CN110654422A (en) * 2019-11-12 2020-01-07 中科(徐州)人工智能研究院有限公司 Rail train driving assistance method, device and system
WO2020103533A1 (en) * 2018-11-20 2020-05-28 中车株洲电力机车有限公司 Track and road obstacle detecting method
CN111323027A (en) * 2018-12-17 2020-06-23 兰州大学 Method and device for manufacturing high-precision map based on fusion of laser radar and panoramic camera
CN111366912A (en) * 2020-03-10 2020-07-03 上海西井信息科技有限公司 Laser sensor and camera calibration method, system, device and storage medium
CN111688758A (en) * 2019-03-11 2020-09-22 北京华通时空通信技术有限公司 Obstacle detection system for high-speed railway track
CN111832411A (en) * 2020-06-09 2020-10-27 北京航空航天大学 Track cataract obstacle detection method based on fusion of vision and laser radar
CN112269379A (en) * 2020-10-14 2021-01-26 北京石头世纪科技股份有限公司 Obstacle identification information feedback method
CN112698352A (en) * 2020-12-23 2021-04-23 淮北祥泰科技有限责任公司 Obstacle recognition device for electric locomotive
CN113050654A (en) * 2021-03-29 2021-06-29 中车青岛四方车辆研究所有限公司 Obstacle detection method, vehicle-mounted obstacle avoidance system and method for inspection robot
CN114022760A (en) * 2021-10-14 2022-02-08 湖南北斗微芯数据科技有限公司 Railway tunnel barrier monitoring and early warning method, system, equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004092876A2 (en) * 2003-04-07 2004-10-28 Goodpointe Technology Infrastructure Management System Software And Counsulting Services Centralized facility and intelligent on-board vehicle platform for collecting, analyzing and distributing information relating to transportation infrastructure and conditions
CN101395649A (en) * 2006-03-01 2009-03-25 丰田自动车株式会社 Obstacle detection method, obstacle detection device, and standard mobile body model
CN105825173A (en) * 2016-03-11 2016-08-03 福州华鹰重工机械有限公司 Universal road and lane detection system and method
CN105928531A (en) * 2016-04-13 2016-09-07 浙江合众新能源汽车有限公司 Method for generating route accurately used for pilotless automobile
CN105955257A (en) * 2016-04-29 2016-09-21 大连楼兰科技股份有限公司 Bus automatic driving system based on fixed route and driving method thereof
CN106996793A (en) * 2015-11-04 2017-08-01 丰田自动车株式会社 Map rejuvenation decision-making system
CN107161141A (en) * 2017-03-08 2017-09-15 深圳市速腾聚创科技有限公司 Pilotless automobile system and automobile
CN107390676A (en) * 2016-05-17 2017-11-24 深圳市朗驰欣创科技股份有限公司 Tunnel crusing robot and tunnel cruising inspection system
CN107505644A (en) * 2017-07-28 2017-12-22 武汉理工大学 Three-dimensional high-precision map generation system and method based on vehicle-mounted multisensory fusion

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004092876A2 (en) * 2003-04-07 2004-10-28 Goodpointe Technology Infrastructure Management System Software And Counsulting Services Centralized facility and intelligent on-board vehicle platform for collecting, analyzing and distributing information relating to transportation infrastructure and conditions
CN101395649A (en) * 2006-03-01 2009-03-25 丰田自动车株式会社 Obstacle detection method, obstacle detection device, and standard mobile body model
CN106996793A (en) * 2015-11-04 2017-08-01 丰田自动车株式会社 Map rejuvenation decision-making system
CN105825173A (en) * 2016-03-11 2016-08-03 福州华鹰重工机械有限公司 Universal road and lane detection system and method
CN105928531A (en) * 2016-04-13 2016-09-07 浙江合众新能源汽车有限公司 Method for generating route accurately used for pilotless automobile
CN105955257A (en) * 2016-04-29 2016-09-21 大连楼兰科技股份有限公司 Bus automatic driving system based on fixed route and driving method thereof
CN107390676A (en) * 2016-05-17 2017-11-24 深圳市朗驰欣创科技股份有限公司 Tunnel crusing robot and tunnel cruising inspection system
CN107161141A (en) * 2017-03-08 2017-09-15 深圳市速腾聚创科技有限公司 Pilotless automobile system and automobile
CN107505644A (en) * 2017-07-28 2017-12-22 武汉理工大学 Three-dimensional high-precision map generation system and method based on vehicle-mounted multisensory fusion

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
康拉德•莱芙 主编: "《BOSCH车辆稳定系统和驾驶员辅助系统》", 31 January 2015 *
曲越: "城轨列车非接触式障碍物检测系统的研究", 《中国优秀硕士学位论文全文数据库工程科技Ⅱ辑》 *
王威 等: "地铁轨道障碍探测技术研究", 《工艺与技术》 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109657698B (en) * 2018-11-20 2021-09-03 同济大学 Magnetic suspension track obstacle detection method based on point cloud
CN109657698A (en) * 2018-11-20 2019-04-19 同济大学 A kind of magnetic-levitation obstacle detection method based on cloud
WO2020103533A1 (en) * 2018-11-20 2020-05-28 中车株洲电力机车有限公司 Track and road obstacle detecting method
CN111323027A (en) * 2018-12-17 2020-06-23 兰州大学 Method and device for manufacturing high-precision map based on fusion of laser radar and panoramic camera
CN110018470A (en) * 2019-03-01 2019-07-16 北京纵目安驰智能科技有限公司 Based on example mask method, model, terminal and the storage medium merged before multisensor
CN111688758A (en) * 2019-03-11 2020-09-22 北京华通时空通信技术有限公司 Obstacle detection system for high-speed railway track
CN110412986A (en) * 2019-08-19 2019-11-05 中车株洲电力机车有限公司 A kind of vehicle barrier detection method and system
CN110550072A (en) * 2019-08-29 2019-12-10 北京博途智控科技有限公司 method, system, medium and equipment for identifying obstacle in railway shunting operation
CN110550072B (en) * 2019-08-29 2022-04-29 北京博途智控科技有限公司 Method, system, medium and equipment for identifying obstacle in railway shunting operation
CN110471085A (en) * 2019-09-04 2019-11-19 深圳市镭神智能系统有限公司 A kind of rail detection system
CN110654422A (en) * 2019-11-12 2020-01-07 中科(徐州)人工智能研究院有限公司 Rail train driving assistance method, device and system
CN111366912B (en) * 2020-03-10 2021-03-16 上海西井信息科技有限公司 Laser sensor and camera calibration method, system, device and storage medium
CN111366912A (en) * 2020-03-10 2020-07-03 上海西井信息科技有限公司 Laser sensor and camera calibration method, system, device and storage medium
CN111832411A (en) * 2020-06-09 2020-10-27 北京航空航天大学 Track cataract obstacle detection method based on fusion of vision and laser radar
CN112269379A (en) * 2020-10-14 2021-01-26 北京石头世纪科技股份有限公司 Obstacle identification information feedback method
CN112269379B (en) * 2020-10-14 2024-02-27 北京石头创新科技有限公司 Obstacle identification information feedback method
CN112698352A (en) * 2020-12-23 2021-04-23 淮北祥泰科技有限责任公司 Obstacle recognition device for electric locomotive
CN112698352B (en) * 2020-12-23 2022-11-22 淮北祥泰科技有限责任公司 Obstacle recognition device for electric locomotive
CN113050654A (en) * 2021-03-29 2021-06-29 中车青岛四方车辆研究所有限公司 Obstacle detection method, vehicle-mounted obstacle avoidance system and method for inspection robot
CN114022760A (en) * 2021-10-14 2022-02-08 湖南北斗微芯数据科技有限公司 Railway tunnel barrier monitoring and early warning method, system, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN108416257A (en) Merge the underground railway track obstacle detection method of vision and laser radar data feature
US11300966B2 (en) Vehicle control method and apparatus, device, vehicle and storage medium
US9721169B2 (en) Image processing device for detecting vehicle in consideration of sun position
US9569675B2 (en) Three-dimensional object detection device, and three-dimensional object detection method
CN109556615A (en) The driving map generation method of Multi-sensor Fusion cognition based on automatic Pilot
CN110077399A (en) A kind of vehicle collision avoidance method merged based on roadmarking, wheel detection
CN101469991B (en) All-day structured road multi-lane line detection method
CN106462727A (en) Systems and methods for lane end recognition
CN106251701A (en) Based on the vehicle rearview monitor and alarm system and the method that rotate zoom multi-cam
CN105799574A (en) Intelligent night driver-assistance system
US20120314070A1 (en) Lane sensing enhancement through object vehicle information for lane centering/keeping
GB2613692A (en) Systems and methods for vehicle navigation
CN106225789A (en) A kind of onboard navigation system with high security and bootstrap technique thereof
US10369995B2 (en) Information processing device, information processing method, control device for vehicle, and control method for vehicle
CN108108750A (en) Metric space method for reconstructing based on deep learning and monocular vision
CN104842860A (en) Driving route indicating method and system applied to intelligent driving vehicles
CN108132675A (en) Unmanned plane is maked an inspection tour from main path cruise and intelligent barrier avoiding method by a kind of factory
CN110059574A (en) A kind of vehicle blind zone detection method
CN108074410A (en) Traffic cloud warns platform
CN106114357A (en) Device and method for preventing scratching during turning of vehicle
TW201144115A (en) Dual vision front vehicle safety alarm device and method thereof
CN108202669A (en) Adverse weather vision enhancement driving auxiliary system and its method based on truck traffic
CN113085896B (en) Auxiliary automatic driving system and method for modern rail cleaning vehicle
CN102275558B (en) Dual-vision preceding vehicle safety attention device and method
JPH0789059B2 (en) Visual sensor system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180817