CN107878767B - 用于向飞行员警示碰撞风险的系统和方法 - Google Patents

用于向飞行员警示碰撞风险的系统和方法 Download PDF

Info

Publication number
CN107878767B
CN107878767B CN201710665481.1A CN201710665481A CN107878767B CN 107878767 B CN107878767 B CN 107878767B CN 201710665481 A CN201710665481 A CN 201710665481A CN 107878767 B CN107878767 B CN 107878767B
Authority
CN
China
Prior art keywords
camera
image
aircraft
range
stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710665481.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN107878767A (zh
Inventor
加里·艾伦·雷
布莱恩·大卫·吉尔伯特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Boeing Co
Original Assignee
Boeing Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Boeing Co filed Critical Boeing Co
Publication of CN107878767A publication Critical patent/CN107878767A/zh
Application granted granted Critical
Publication of CN107878767B publication Critical patent/CN107878767B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/239Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D45/00Aircraft indicators or protectors not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D47/00Equipment not otherwise provided for
    • B64D47/02Arrangements or adaptations of signal or lighting devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D47/00Equipment not otherwise provided for
    • B64D47/08Arrangements of cameras
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/36Videogrammetry, i.e. electronic processing of video signals from a single source or from different sources to give parallax or range information
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/0202Control of position or course in two dimensions specially adapted to aircraft
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/174Segmentation; Edge detection involving the use of two or more images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/285Analysis of motion using a sequence of stereo image pairs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/292Multi-camera tracking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/55Depth or shape recovery from multiple images
    • G06T7/579Depth or shape recovery from multiple images from motion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0017Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information
    • G08G5/0021Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information located in the aircraft
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/04Anti-collision systems
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/04Anti-collision systems
    • G08G5/045Navigation or guidance aids, e.g. determination of anti-collision manoeuvers
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/06Traffic control systems for aircraft, e.g. air-traffic control [ATC] for control when on the ground
    • G08G5/065Navigation or guidance aids, e.g. for taxiing or rolling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/246Calibration of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • G06T2207/10021Stereoscopic video; Stereoscopic image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10032Satellite or aerial image; Remote sensing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10116X-ray image
    • G06T2207/10121Fluoroscopy
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261Obstacle
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074Stereoscopic image analysis
    • H04N2013/0085Motion estimation from stereoscopic image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Automation & Control Theory (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Closed-Circuit Television Systems (AREA)
CN201710665481.1A 2016-09-30 2017-08-07 用于向飞行员警示碰撞风险的系统和方法 Active CN107878767B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/281,189 US11094208B2 (en) 2016-09-30 2016-09-30 Stereo camera system for collision avoidance during aircraft surface operations
US15/281,189 2016-09-30

Publications (2)

Publication Number Publication Date
CN107878767A CN107878767A (zh) 2018-04-06
CN107878767B true CN107878767B (zh) 2022-06-17

Family

ID=59997048

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710665481.1A Active CN107878767B (zh) 2016-09-30 2017-08-07 用于向飞行员警示碰撞风险的系统和方法

Country Status (6)

Country Link
US (1) US11094208B2 (de)
EP (1) EP3301610B1 (de)
CN (1) CN107878767B (de)
BR (1) BR102017020283A2 (de)
CA (1) CA2975139C (de)
RU (1) RU2737562C2 (de)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3020043B1 (fr) * 2014-04-17 2016-04-22 Sagem Defense Securite Aeronef comprenant un bras escamotable muni de detecteur d'obstacles
US10515559B2 (en) * 2017-08-11 2019-12-24 The Boeing Company Automated detection and avoidance system
US11107229B2 (en) * 2018-01-10 2021-08-31 Samsung Electronics Co., Ltd. Image processing method and apparatus
CN110033481B (zh) * 2018-01-10 2024-07-02 北京三星通信技术研究有限公司 用于进行图像处理的方法和设备
US10410530B1 (en) * 2018-02-27 2019-09-10 Honeywell International Inc. Systems and methods for detecting potential surface collisions and providing warnings onboard an aircraft or airport vehicle
EP3779871A4 (de) * 2018-04-05 2021-05-19 Koito Manufacturing Co., Ltd. Arithmetische verarbeitungsvorrichtung, objektidentifikationssystem, objektidentifikationsverfahren, automobil- und fahrzeugbeleuchtungskörper
US10922986B2 (en) 2018-07-18 2021-02-16 Simmons Precision Products, Inc. Taxi strike alert system
US11181368B2 (en) 2018-08-20 2021-11-23 Simmonds Precision Products, Inc. Visibility range sensing
CA3109865C (en) * 2018-08-27 2023-10-03 Gulfstream Aerospace Corporation Time available before aircraft auto-recovery begins
US11294384B2 (en) * 2019-06-03 2022-04-05 The Boeing Company Vehicle navigation using point cloud decimation
US11594144B2 (en) * 2020-01-31 2023-02-28 Honeywell International Inc. Collision awareness using cameras mounted on a vehicle
CN112232275B (zh) * 2020-11-03 2021-12-24 上海西井信息科技有限公司 基于双目识别的障碍物检测方法、系统、设备及存储介质
CN114202967B (zh) * 2021-12-22 2023-02-24 中国商用飞机有限责任公司 适用于拥挤空域的tcas避让方法、系统及其显示和告警机制
CN114610078B (zh) * 2022-05-12 2022-08-12 四川腾盾科技有限公司 一种无人机空中航路冲突预警方法及系统
CN116935697B (zh) * 2023-07-10 2024-06-14 宁波福尔达智能科技股份有限公司 一种基于图像的车辆防追尾提醒方法、车用摄像设备及车辆

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL113496A (en) 1995-04-25 1999-09-22 Cognitens Ltd Apparatus and method for recreating and manipulating a 3d object based on a 2d projection thereof
US5629692A (en) 1995-07-20 1997-05-13 Honeywell Inc. Method and apparatus for alerting pilot to transponder antenna failure in a traffic alert and collision avoidance system
US6405975B1 (en) 1995-12-19 2002-06-18 The Boeing Company Airplane ground maneuvering camera system
DE19714898A1 (de) * 1997-04-03 1998-10-08 Petri Ag Lenkrad
US6264135B1 (en) * 2000-02-14 2001-07-24 John Dacosta Inflight aircraft visual monitoring apparatus
US6928363B2 (en) 2002-09-20 2005-08-09 The Boeing Company Autotiller control system for aircraft
FR2848661B1 (fr) 2002-12-13 2005-03-04 Thales Sa Equipement anticollision terrain embarque a bord d'aeronef avec aide au retour en vol normal
US7024309B2 (en) 2003-08-28 2006-04-04 The United States Of America As Represented By The Secretary Of The Air Force Autonomous station keeping system for formation flight
US7480587B2 (en) * 2004-06-30 2009-01-20 Intel Corporation Method for adaptive performance margining with thermal feedback
US20060151769A1 (en) * 2004-08-18 2006-07-13 Lob Charles J Arrangement for lifting and lowering objects
US7456377B2 (en) * 2004-08-31 2008-11-25 Carl Zeiss Microimaging Ais, Inc. System and method for creating magnified images of a microscope slide
US8244063B2 (en) * 2006-04-11 2012-08-14 Yeda Research & Development Co. Ltd. At The Weizmann Institute Of Science Space-time behavior based correlation
WO2009116996A1 (en) * 2008-03-19 2009-09-24 Hewlett-Packard Development Company, L.P. Computing devices having adjustable keyboard lights
RU2009113441A (ru) * 2009-04-10 2010-10-20 Учреждение Российской академии наук Центр информационных технологий в проектировании РАН (RU) Способ обнаружения препятствия перед наземным подвижным объектом по последовательности изображений
US8350894B2 (en) 2009-04-17 2013-01-08 The Boeing Company System and method for stereoscopic imaging
WO2011018999A1 (ja) 2009-08-12 2011-02-17 日本電気株式会社 障害物検知装置及び方法並びに障害物検知システム
US9083956B2 (en) * 2009-09-28 2015-07-14 Samsung Electronics Co., Ltd. System and method for creating 3D video
JP5472182B2 (ja) * 2011-03-30 2014-04-16 Toto株式会社 衛生陶器
CN102390370B (zh) * 2011-10-25 2013-07-03 河海大学 一种基于立体视觉的车辆行驶应急处理装置及方法
US9091762B2 (en) * 2011-10-27 2015-07-28 Gulfstream Aerospace Corporation Methods and systems for avoiding a collision between an aircraft on a ground surface and an obstacle
US9046593B2 (en) 2011-12-15 2015-06-02 The Boeing Company Method and apparatus for detecting and classifying signals
US9581692B2 (en) * 2012-05-30 2017-02-28 Honeywell International Inc. Collision-avoidance system for ground crew using sensors
PL3301254T3 (pl) * 2012-09-14 2020-07-13 Joy Global Underground Mining Llc Głowica wrębiarkowa do maszyny górniczej
KR102115384B1 (ko) 2012-11-16 2020-05-26 트리나프코 인크. 테트라부틸암모늄 비스(플루오로술포닐)이미드 및 관련 염의 합성
CA2833985C (en) 2012-11-19 2020-07-07 Rosemount Aerospace, Inc. Collision avoidance system for aircraft ground operations
DE102013102667A1 (de) * 2013-03-15 2014-10-02 Osram Opto Semiconductors Gmbh Anzeigevorrichtung
US20150206438A1 (en) 2014-01-20 2015-07-23 Gulfstream Aerospace Corporation Aircraft tow obstacle alerting and indication & method for recording and notification of parked aircraft damage
US9047771B1 (en) 2014-03-07 2015-06-02 The Boeing Company Systems and methods for ground collision avoidance
US20150329217A1 (en) 2014-05-19 2015-11-19 Honeywell International Inc. Aircraft strike zone display
WO2016048737A1 (en) * 2014-09-22 2016-03-31 Gulfstream Aerospace Corporation Methods and systems for collision aviodance using visual indication of wingtip path
FR3028084B1 (fr) * 2014-11-03 2020-12-25 Sagem Defense Securite Procede et dispositif de guidage d'un aeronef
GB201502526D0 (en) * 2015-02-16 2015-04-01 Nokia Technologies Oy A 3D modelling system
US9955056B2 (en) * 2015-03-16 2018-04-24 Qualcomm Incorporated Real time calibration for multi-camera wireless device
US9430688B1 (en) 2015-03-25 2016-08-30 The Boeing Company Overlapping multi-signal classification
EP3112985A1 (de) * 2015-06-30 2017-01-04 Nokia Technologies Oy Vorrichtung für video-ausgabe und zugehörige verfahren

Also Published As

Publication number Publication date
RU2017123576A (ru) 2019-01-09
EP3301610B1 (de) 2024-02-21
US20180096610A1 (en) 2018-04-05
EP3301610A1 (de) 2018-04-04
RU2017123576A3 (de) 2020-09-24
BR102017020283A2 (pt) 2018-05-15
CN107878767A (zh) 2018-04-06
CA2975139C (en) 2022-03-29
CA2975139A1 (en) 2018-03-30
RU2737562C2 (ru) 2020-12-01
US11094208B2 (en) 2021-08-17

Similar Documents

Publication Publication Date Title
CN107878767B (zh) 用于向飞行员警示碰撞风险的系统和方法
CN106485233B (zh) 可行驶区域检测方法、装置和电子设备
EP3235735B1 (de) Verfahren und system zur kollisionswarnung bei bodenbewegungen eines flugzeugs
EP3007099B1 (de) Bilderkennungssystem für ein Fahrzeug und entsprechendes Verfahren
US9196054B2 (en) Method and system for recovery of 3D scene structure and camera motion from a video sequence
US20160104048A1 (en) Fusion of far infrared and visible images in enhanced obstacle detection in automotive applications
CN108596058A (zh) 基于计算机视觉的行车障碍物测距方法
EP3392153B1 (de) Verfahren und system zur bereitstellung einer andockführung für einen piloten eines rollenden flugzeugs
US10832428B2 (en) Method and apparatus for estimating a range of a moving object
US20140085409A1 (en) Wide fov camera image calibration and de-warping
Haloi et al. A robust lane detection and departure warning system
US20170032196A1 (en) Vehicle vision system with object and lane fusion
Anitha et al. Vision based autonomous landing of an unmanned aerial vehicle
US10984264B2 (en) Detection and validation of objects from sequential images of a camera
US20190180121A1 (en) Detection of Objects from Images of a Camera
KR101531313B1 (ko) 차량 하부의 물체 탐지장치 및 방법
Doehler et al. Image-based drift and height estimation for helicopter landings in brownout
Gauci Obstacle detection in aerodrome areas through the use of computer vision
Cho et al. An image processing algorithm for detection and tracking of aerial vehicles
Shahbazi et al. Vehicle Tracking and Speed Estimation from Unmanned Aerial Videos
Gauci et al. Obstacle detection around aircraft on ramps and taxiways through the use of computer vision
CN116824458B (zh) 一种机场跑道防侵入方法及系统
US11257386B1 (en) Camera-based angle tracking of swarms for collision avoidance
US20210383562A1 (en) Off-axis Observation for Moving Target Ranging
SaiVaddi et al. Computer vision based surveillance concept for airport ramp operations

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant