EP2856455B1 - Systems and methods for enhanced awareness of obstacle proximity during taxi operations - Google Patents

Systems and methods for enhanced awareness of obstacle proximity during taxi operations Download PDF

Info

Publication number
EP2856455B1
EP2856455B1 EP13796644.6A EP13796644A EP2856455B1 EP 2856455 B1 EP2856455 B1 EP 2856455B1 EP 13796644 A EP13796644 A EP 13796644A EP 2856455 B1 EP2856455 B1 EP 2856455B1
Authority
EP
European Patent Office
Prior art keywords
aircraft
obstacle
icon
sensed
coverage area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13796644.6A
Other languages
German (de)
French (fr)
Other versions
EP2856455A1 (en
EP2856455A4 (en
Inventor
Ratan Khatwa
Pamela MANNON
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honeywell International Inc
Original Assignee
Honeywell International Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honeywell International Inc filed Critical Honeywell International Inc
Priority to EP21150078.0A priority Critical patent/EP3832348A1/en
Publication of EP2856455A1 publication Critical patent/EP2856455A1/en
Publication of EP2856455A4 publication Critical patent/EP2856455A4/en
Application granted granted Critical
Publication of EP2856455B1 publication Critical patent/EP2856455B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/66Radar-tracking systems; Analogous systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/74Systems using reradiation of radio waves, e.g. secondary radar systems; Analogous systems
    • G01S13/76Systems using reradiation of radio waves, e.g. secondary radar systems; Analogous systems wherein pulse-type signals are transmitted
    • G01S13/765Systems using reradiation of radio waves, e.g. secondary radar systems; Analogous systems wherein pulse-type signals are transmitted with exchange of information between interrogator and responder
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/008Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64CAEROPLANES; HELICOPTERS
    • B64C25/00Alighting gear
    • B64C25/32Alighting gear characterised by elements which contact the ground or similar surface 
    • B64C25/42Arrangement or adaptation of brakes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D43/00Arrangements or adaptations of instruments
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D45/00Aircraft indicators or protectors not otherwise provided for
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C23/00Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed or acceleration
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/04Display arrangements
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/04Anti-collision systems
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/04Anti-collision systems
    • G08G5/045Navigation or guidance aids, e.g. determination of anti-collision manoeuvers
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/06Traffic control systems for aircraft, e.g. air-traffic control [ATC] for control when on the ground
    • G08G5/065Navigation or guidance aids, e.g. for taxiing or rolling
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/933Radar or analogous systems specially adapted for specific applications for anti-collision purposes of aircraft or spacecraft
    • G01S13/934Radar or analogous systems specially adapted for specific applications for anti-collision purposes of aircraft or spacecraft on airport surfaces, e.g. while taxiing
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9329Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles cooperating with reflectors or transponders

Definitions

  • US 2008/0306691 describes a collision prevent device and method for a vehicle in motion on the ground.
  • US 2009/0174591 A1 discloses a system for detecting obstacles on the ground.
  • US 2008/0062011 describes a collision avoidance warning system for an aircraft.
  • the present invention provides a system according to claim 1 of the appended claims.
  • the invention further provides a method according to claim 7 of the appended claims.
  • the present invention provides systems and methods for predicting and displaying targets based on height in relation to the wing or other elements of the aircraft, such as engine nacelles.
  • the systems and methods for depicting target threat based on lateral and/or vertical proximity of targets are included.
  • the location of ground obstacles is based on radar returns (from sensors deployed on the ownship); aircraft surveillance data, such as automatic dependent surveillance-broadcast (ADS-B); and/or an airport moving map database (e.g., location of buildings, towers, etc., on the airport surface).
  • ADS-B data provides aircraft-type data and an onboard database provides a look-up table for aircraft and/or other vehicle geometry information.
  • airport ground vehicles equipped with ADS-B are detectable.
  • FIGURE 1 shows an exemplary airport surface collision-avoidance system (ASCAS) 18 that includes components on an aircraft 20 for providing enhanced awareness of proximate obstacles relative to ownship (e.g., aircraft) components (e.g., wingtip, nacelles).
  • the aircraft 20 includes sensors (e.g., active sensor (e.g., radar)) and/or passive sensor (e.g., camera) 26 included within an obstacle detection module 30, for example an aircraft light module.
  • sensors 30 also include other elements such as navigation/position lights 34, a processor 36, and a communication device 38.
  • the sensors 26 are in communication via the communication device 38 (wired or wirelessly) to a cockpit user interface (UI) device 44.
  • UI cockpit user interface
  • the UI device 44 includes a processor 50 (optional), a communication device (wired or wireless) 52, and an alerting device(s) 54.
  • the UI device 44 provides audio and/or visual cues (e.g., via headphones, PC tablets, etc.) based on sensor-derived and processed information.
  • the UI device 44 Based on information from the sensors 26, the UI device 44 provides some or all of the following functions: detect and track intruders, evaluate and prioritize threats, and declare and determine actions. Once an alert associated with a detection has been produced, then execution of a collision-avoidance action (e.g., stop the aircraft, maneuver around intruder, etc.) is manually performed by a pilot or automatically by an automated system (e.g., autobrakes).
  • a collision-avoidance action e.g., stop the aircraft, maneuver around intruder, etc.
  • an automated system e.g., autobrakes
  • processing of the sensor information is done by the processor 36 at the sensor level and/or by the processor 50 at the UI device 44.
  • situational awareness is improved by integration with automatic dependent surveillance-broadcast/traffic information service-broadcast (ADS-B/TIS-B), airport/airline information on vehicles/aircraft/obstacles (e.g., through WiMax), and with synthetic vision system/enhanced vision system/combined vision system (SVS/EVS/CVS) received by the respective devices using the communication device 38.
  • ADS-B/TIS-B automatic dependent surveillance-broadcast/traffic information service-broadcast
  • ADS-B/TIS-B airport/airline information on vehicles/aircraft/obstacles
  • SVS/EVS/CVS synthetic vision system/enhanced vision system/combined vision system
  • the present invention reduces false alarms by utilizing flight plan and taxi clearance information, and airport building/obstacle databases stored in memory 60 or received from a source via the communication devices 52.
  • the stored airport building/obstacle databases include height information for any ground obstacle.
  • the sensors 26 integrated in the wing and tail modules 30 provide near-complete sensor coverage of the aircraft 20. Full coverage can be attained by placing sensors at various locations on the aircraft 20.
  • the pilot is alerted aurally, visually, and/or tactilely.
  • aural alerting is through existing installed equipment, such as the interphone or other warning electronics (e.g. Crew Alerting System) or possibly the Enhanced Ground Proximity Warning System (EGPWS) platform.
  • the interphone or other warning electronics e.g. Crew Alerting System
  • EGPWS Enhanced Ground Proximity Warning System
  • FIGURE 2 shows a top down image 120 presented by the alerting device(s) 54.
  • the image 120 includes an ownship aircraft icon 126 located at the bottom of the image 120 with two radar beam coverage areas 124 that project forward from wingtips of the icon 126.
  • Two range rings 132, 134 are shown on the display at fixed distances in front of the wing.
  • the range rings 132, 134 are scalable, using either an interface on an electronic flight bag (EFB), or a flight deck display control panel, or a cursor control device (CCD) in the aircraft 20, when shown on a device such as a navigation display.
  • EFB electronic flight bag
  • CCD cursor control device
  • Gray (or other) colored gridlines 128, 130 are included in the areas 124.
  • the gridlines 128, 130 add perspective and situational awareness at fixed intervals on the image 120.
  • each vertical and horizontal gridline 128, 130 represents 10 feet each, when units are in English feet, and 5 meters each, when units are in metric. Other increments may be used.
  • an image 180 generated by the processor 36 or 50 allows the flightcrew to visualize the lateral path of both wingtips of their aircraft, by integrating obstacle information on the image 180.
  • Primary targets are those objects on the ground that are in a direct strike zone of the aircraft's structure, such as a wing, wingtip, or nacelle (for example, within a radar beam zone).
  • Secondary targets are those objects on the ground that are outside the direct strike zone of an aircraft wing, wingtip, or nacelle but within a predetermined distance from the aircraft in both lateral and vertical dimensions (for example, within the radar beam's zone if radar is the primary sensor).
  • a primary strike zone 190 is identified as the zone from the wingtip inward toward the aircraft (i.e., the icon 126).
  • a secondary strike zone 194 is a predetermined distance from the wingtip outward within the defined coverage area 124.
  • Primary targets are those inside the primary strike zone 190 and secondary targets are those in the secondary strike zone 194. Separation between the zones 190, 194 is shown with a dashed line 196 (e.g., white or other color).
  • primary targets are shown as a large solid circle 200 (e.g., brown or other color) and secondary targets are shown as a smaller, hollow circle 202 (e.g., brown or other color).
  • display differentiation could also be used to identify the primary and secondary targets, such as texture (patterns).
  • texture patterns
  • a different symbolic shape is used to distinguish between the primary and secondary targets.
  • the secondary targets represent targets that would not be threats if the intended trajectory of the host aircraft (vehicle) is maintained.
  • the dashed line 196 does not appear on the display image 180. However, differentiation between primary and secondary zones is shown with a thicker white or gray line in the middle of the radar beam area 124 (i.e., visual coding is used to distinguish between primary and secondary zones 190, 194). Other visual coding techniques may be used.
  • the processor 36 or 50 shows (in the image 180) those targets that are in the primary strike zone 190 but either above or below the host vehicle component (e.g., wing or nacelle area).
  • the secondary targets represent targets that would not be threats if the intended trajectory of the host aircraft (vehicle) is maintained with secondary target icons 220.
  • a clearance threshold is applied to obstacles in the primary strike zone 190. Those obstacles that are not within the clearance threshold of the aircraft's structure (e.g., 5 to 30 inches) are deemed to be secondary targets. These are depicted as the smaller, hollow circles (see target icon 224 in FIGURE 4 ).
  • a value of how far (vertically) the associated targets are from the host vehicle structure is identified (+ means above, - means below).
  • FIGURE 5 shows a top down/moving map image 230 that shows target icons 240, 242 that are parked at the end of the displayed area 124 farthest from the aircraft icon 126 when the associated targets are off the scale of the areas 124.
  • the target icon 240 indicates that there is an obstacle in the primary zone to the port side of the aircraft.
  • the target icon 242 indicates that there is an obstacle in the secondary zone outside the right wingtip.
  • the off-scale targets are shown as half-circle icons at the correct sensed bearing from the host aircraft.
  • an airport moving map display or vertical situation display (e.g., displayed below the plan view display) incorporates obstacle information from an airport database, based on received target information.
  • VSD vertical situation display
  • an ownship wing position (or other aircraft structure) is shown as a triangle icon 284, within a VSD image 280.
  • Previously identified primary targets are shown as solid diamonds 286 (e.g., brown) and secondary targets are shown as hollow, smaller diamonds 288, 290 (e.g., brown).
  • a vertical (y) scale in the VSD image 280 shows obstacle height in either meters or feet (set through either a menu or maintenance options user interface).
  • the lateral distance (feet or meters) to the target is shown along the lateral (x) scale of the VSD image 280.
  • the horizontal scale can be adjusted using a zoom knob on a cursor control device (CCD) or using a range set knob.
  • a vertical line 292 is drawn from the primary target icon 286 to the lateral scale to show how far the associated object is from the wingtip (or other aircraft structure).
  • FIGURE 7 shows a VSD image 300 that includes information that distinguishes whether targets are to the left or right of the aircraft's nose.
  • an "L” or an “R” is presented adjacent the target icons 308, 310, 312 to indicate left or right side location of the target, respectively.
  • the flightcrew is presented with the option of selecting either a "LEFT WING” or “RIGHT WING” vertical profile depiction.
  • the selection causes the processors 36, 50 to show icons for obstacles located on only the selected side of the host aircraft.
  • VSD image 340 FIGURE 8 If vertical information related to obstacles is available (i.e., received via the communication device 52, or retrieved from local memory (60) based on identifying of the associated target), the distance in feet or meters of objects below (or above) the wing or nacelle is shown adjacent the respective icon, see VSD image 340 FIGURE 8 . A negative number indicates an obstacle below the host aircraft's part; a positive number is for those obstacles above the respective part.
  • FIGURE 8 also shows a "relative altitude" vertical display.
  • the datum for the vertical scale is set to zero at the bottom of the ownship wing symbol 344 (or other reference position on the aircraft) and increase/decrease from the symbol 344.
  • the target associated with a first icon 342 in the image 340 is 9 feet below the host aircraft structure indicated by a symbol 344 on the left side of the image 340.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)
  • Radar Systems Or Details Thereof (AREA)

Description

    BACKGROUND OF THE INVENTION
  • There currently exists an expensive safety problem of aircraft wingtips clipping obstacles (e.g., 2011 Paris Air Show, an A380 accident in which a wing hit a building; 2012 Chicago O'Hare accident in which a Boeing 747 cargo aircraft's wing clipped an Embraer 140's rudder). Some solutions have radar sensors placed at the wingtips and information about these potential obstacles is presented to the pilot on a human-machine interface (e.g., head-up, head-down, or head-mounted display). Having such information available improves crewmembers' awareness of obstacles, allowing them to better adjust the current aircraft speed and direction to the detected obstacles and to evaluate if a particular obstacle is a threat. However, providing information about only the lateral location of obstacles relative to an aircraft does not explicitly address whether its height of the wing, wingtips, or nacelle will clear the obstacles, based on height of the object.
  • US 2008/0306691 describes a collision prevent device and method for a vehicle in motion on the ground. US 2009/0174591 A1 discloses a system for detecting obstacles on the ground. US 2008/0062011 describes a collision avoidance warning system for an aircraft.
  • SUMMARY OF THE INVENTION
  • The present invention provides a system according to claim 1 of the appended claims.
  • The invention further provides a method according to claim 7 of the appended claims.
  • The present invention provides systems and methods for predicting and displaying targets based on height in relation to the wing or other elements of the aircraft, such as engine nacelles. In addition, the systems and methods for depicting target threat based on lateral and/or vertical proximity of targets are included. The location of ground obstacles is based on radar returns (from sensors deployed on the ownship); aircraft surveillance data, such as automatic dependent surveillance-broadcast (ADS-B); and/or an airport moving map database (e.g., location of buildings, towers, etc., on the airport surface). The ADS-B data provides aircraft-type data and an onboard database provides a look-up table for aircraft and/or other vehicle geometry information. In addition, airport ground vehicles equipped with ADS-B are detectable.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Preferred and alternative embodiments of the present invention are described in detail below with reference to the following drawings:
    • FIGURE 1 is a diagram of an aircraft configured with an obstacle awareness system formed in accordance with an embodiment of the present invention;
    • FIGURES 2 through 5 show exemplary graphical user interfaces of sensed obstacles relative to an ownship; and
    • FIGURES 6 through 8 show exemplary vertical profile interfaces of sensed obstacles relative to an ownship.
    DETAILED DESCRIPTION OF THE INVENTION
  • FIGURE 1 shows an exemplary airport surface collision-avoidance system (ASCAS) 18 that includes components on an aircraft 20 for providing enhanced awareness of proximate obstacles relative to ownship (e.g., aircraft) components (e.g., wingtip, nacelles). The aircraft 20 includes sensors (e.g., active sensor (e.g., radar)) and/or passive sensor (e.g., camera) 26 included within an obstacle detection module 30, for example an aircraft light module. These modules 30 also include other elements such as navigation/position lights 34, a processor 36, and a communication device 38. The sensors 26 are in communication via the communication device 38 (wired or wirelessly) to a cockpit user interface (UI) device 44.
  • The UI device 44 includes a processor 50 (optional), a communication device (wired or wireless) 52, and an alerting device(s) 54. The UI device 44 provides audio and/or visual cues (e.g., via headphones, PC tablets, etc.) based on sensor-derived and processed information.
  • Based on information from the sensors 26, the UI device 44 provides some or all of the following functions: detect and track intruders, evaluate and prioritize threats, and declare and determine actions. Once an alert associated with a detection has been produced, then execution of a collision-avoidance action (e.g., stop the aircraft, maneuver around intruder, etc.) is manually performed by a pilot or automatically by an automated system (e.g., autobrakes).
  • In one embodiment, processing of the sensor information is done by the processor 36 at the sensor level and/or by the processor 50 at the UI device 44.
  • In one embodiment, situational awareness is improved by integration with automatic dependent surveillance-broadcast/traffic information service-broadcast (ADS-B/TIS-B), airport/airline information on vehicles/aircraft/obstacles (e.g., through WiMax), and with synthetic vision system/enhanced vision system/combined vision system (SVS/EVS/CVS) received by the respective devices using the communication device 38.
  • In one embodiment, the present invention reduces false alarms by utilizing flight plan and taxi clearance information, and airport building/obstacle databases stored in memory 60 or received from a source via the communication devices 52. The stored airport building/obstacle databases include height information for any ground obstacle.
  • The sensors 26 integrated in the wing and tail modules 30 provide near-complete sensor coverage of the aircraft 20. Full coverage can be attained by placing sensors at various locations on the aircraft 20.
  • The pilot is alerted aurally, visually, and/or tactilely. For example, aural alerting is through existing installed equipment, such as the interphone or other warning electronics (e.g. Crew Alerting System) or possibly the Enhanced Ground Proximity Warning System (EGPWS) platform.
  • The present invention provides systems and methods for allowing a flight crew to visualize an object's distance from the host aircraft using two scalable range rings, which can be set to either feet or meters. FIGURE 2 shows a top down image 120 presented by the alerting device(s) 54. The image 120 includes an ownship aircraft icon 126 located at the bottom of the image 120 with two radar beam coverage areas 124 that project forward from wingtips of the icon 126. Two range rings 132, 134 are shown on the display at fixed distances in front of the wing. The range rings 132, 134 are scalable, using either an interface on an electronic flight bag (EFB), or a flight deck display control panel, or a cursor control device (CCD) in the aircraft 20, when shown on a device such as a navigation display.
  • Gray (or other) colored gridlines 128, 130 are included in the areas 124. The gridlines 128, 130 add perspective and situational awareness at fixed intervals on the image 120. In one embodiment, each vertical and horizontal gridline 128, 130 represents 10 feet each, when units are in English feet, and 5 meters each, when units are in metric. Other increments may be used.
  • In one embodiment, as shown in FIGURE 3, an image 180 generated by the processor 36 or 50 allows the flightcrew to visualize the lateral path of both wingtips of their aircraft, by integrating obstacle information on the image 180. Primary targets are those objects on the ground that are in a direct strike zone of the aircraft's structure, such as a wing, wingtip, or nacelle (for example, within a radar beam zone). Secondary targets are those objects on the ground that are outside the direct strike zone of an aircraft wing, wingtip, or nacelle but within a predetermined distance from the aircraft in both lateral and vertical dimensions (for example, within the radar beam's zone if radar is the primary sensor).
  • In the image 180, a primary strike zone 190 is identified as the zone from the wingtip inward toward the aircraft (i.e., the icon 126). A secondary strike zone 194 is a predetermined distance from the wingtip outward within the defined coverage area 124. Primary targets are those inside the primary strike zone 190 and secondary targets are those in the secondary strike zone 194. Separation between the zones 190, 194 is shown with a dashed line 196 (e.g., white or other color). In one embodiment, primary targets are shown as a large solid circle 200 (e.g., brown or other color) and secondary targets are shown as a smaller, hollow circle 202 (e.g., brown or other color). Other forms of display differentiation could also be used to identify the primary and secondary targets, such as texture (patterns). In one embodiment, a different symbolic shape is used to distinguish between the primary and secondary targets. The secondary targets represent targets that would not be threats if the intended trajectory of the host aircraft (vehicle) is maintained.
  • In one embodiment, the dashed line 196 does not appear on the display image 180. However, differentiation between primary and secondary zones is shown with a thicker white or gray line in the middle of the radar beam area 124 (i.e., visual coding is used to distinguish between primary and secondary zones 190, 194). Other visual coding techniques may be used.
  • If information is available on the vertical extent of detected obstacles (targets) the processor 36 or 50 shows (in the image 180) those targets that are in the primary strike zone 190 but either above or below the host vehicle component (e.g., wing or nacelle area). The secondary targets represent targets that would not be threats if the intended trajectory of the host aircraft (vehicle) is maintained with secondary target icons 220. In one embodiment, a clearance threshold is applied to obstacles in the primary strike zone 190. Those obstacles that are not within the clearance threshold of the aircraft's structure (e.g., 5 to 30 inches) are deemed to be secondary targets. These are depicted as the smaller, hollow circles (see target icon 224 in FIGURE 4). In one embodiment, a value of how far (vertically) the associated targets are from the host vehicle structure is identified (+ means above, - means below).
  • FIGURE 5 shows a top down/moving map image 230 that shows target icons 240, 242 that are parked at the end of the displayed area 124 farthest from the aircraft icon 126 when the associated targets are off the scale of the areas 124. The target icon 240 indicates that there is an obstacle in the primary zone to the port side of the aircraft. The target icon 242 indicates that there is an obstacle in the secondary zone outside the right wingtip. The off-scale targets are shown as half-circle icons at the correct sensed bearing from the host aircraft.
  • If vertical information related to obstacles is available, an airport moving map display or vertical situation display (VSD) (e.g., displayed below the plan view display) incorporates obstacle information from an airport database, based on received target information.
  • As shown in FIGURE 6, an ownship wing position (or other aircraft structure) is shown as a triangle icon 284, within a VSD image 280. Previously identified primary targets are shown as solid diamonds 286 (e.g., brown) and secondary targets are shown as hollow, smaller diamonds 288, 290 (e.g., brown).
  • In one embodiment, a vertical (y) scale in the VSD image 280 shows obstacle height in either meters or feet (set through either a menu or maintenance options user interface). The lateral distance (feet or meters) to the target is shown along the lateral (x) scale of the VSD image 280. The horizontal scale can be adjusted using a zoom knob on a cursor control device (CCD) or using a range set knob.
  • In one embodiment, a vertical line 292 is drawn from the primary target icon 286 to the lateral scale to show how far the associated object is from the wingtip (or other aircraft structure).
  • FIGURE 7 shows a VSD image 300 that includes information that distinguishes whether targets are to the left or right of the aircraft's nose. In one embodiment, an "L" or an "R" is presented adjacent the target icons 308, 310, 312 to indicate left or right side location of the target, respectively.
  • In one embodiment, the flightcrew is presented with the option of selecting either a "LEFT WING" or "RIGHT WING" vertical profile depiction. The selection causes the processors 36, 50 to show icons for obstacles located on only the selected side of the host aircraft.
  • If vertical information related to obstacles is available (i.e., received via the communication device 52, or retrieved from local memory (60) based on identifying of the associated target), the distance in feet or meters of objects below (or above) the wing or nacelle is shown adjacent the respective icon, see VSD image 340 FIGURE 8. A negative number indicates an obstacle below the host aircraft's part; a positive number is for those obstacles above the respective part.
  • FIGURE 8 also shows a "relative altitude" vertical display. The datum for the vertical scale is set to zero at the bottom of the ownship wing symbol 344 (or other reference position on the aircraft) and increase/decrease from the symbol 344. The target associated with a first icon 342 in the image 340 is 9 feet below the host aircraft structure indicated by a symbol 344 on the left side of the image 340.

Claims (10)

  1. A system comprising:
    one or more sensors (26) configured to be positioned on an aircraft and to generate sensed obstacle information;
    a processor (36) configured to:
    receive the sensed obstacle information from the one or more sensors,
    determine locations of obstacles relative to a primary strike zone (190) and a secondary strike zone (194) based on at least one of the sensed obstacle information, previously received surveillance data or previously stored ground obstacle data, the primary strike zone being a zone from a wingtip of the aircraft inward toward the aircraft and the secondary strike zone being a predetermined distance from the wingtip outward, wherein the primary strike zone and the secondary strike zone are adjacent and are forward facing, and
    generate an image (180) comprising:
    an ownship icon (126);
    at least one first icon (200) associated with a first obstacle, if the first obstacle is located within the primary strike zone;
    at least one second icon (202) associated with a second obstacle, if the second obstacle is located within the secondary strike zone, wherein the first and second icons are visually different; and
    a sensed coverage area (124) adjacent a part of the ownship icon associated with a wing of the aircraft, wherein the sensed coverage area comprises the primary and secondary strike zones and visualizing technique that visually separates the strike zones at the wingtip; and
    a display device (54) configured to present the generated image.
  2. The system of claim 1,
    wherein the sensed coverage area comprises a first sensed coverage area,
    wherein the wing of the aircraft is a port wing,
    wherein the generated image comprises the first sensed coverage area and a second sensed coverage area,
    wherein the display device presents the first sensed coverage area adjacent a first part of the ownship icon associated with the port wing of the aircraft and the second sensed coverage area adjacent a second part of the ownship icon associated with a second wing of the aircraft, and
    wherein each of the first and second sensed coverage areas comprise respective ones of the primary and secondary strike zones and a respective indicator that visually separates the strike zones.
  3. The system of claim 2, further comprising a communication device configured to receive height information of an obstacle associated with a displayed icon,
    wherein the processor is further configured to generate a numerical value based on at least one of the received height information or height information of at least one structure of the aircraft, and
    wherein the display device is further configured to present the generated numerical value adjacent the displayed icon.
  4. The system of claim 1, further comprising:
    a communication device (38) configured to receive height information of an obstacle associated with the displayed first or second icon,
    wherein the processor is further configured to generate a numerical value based on the received height information,
    wherein the generated image is presented in a vertical situation display, the generated image comprising:
    a vertical scale that represents at least one of height above ground or distance from a predefined structure of the aircraft; and
    a horizontal scale that represents distance from the predefined structure of the aircraft,
    wherein the ownship icon is presented adjacent the vertical scale at a location on the scale equal to a predefined height of the associated predefined structure of the aircraft.
  5. The system of claim 1, wherein the generated image comprises:
    a first sensed coverage area adjacent at least one feature associated with a port wing of the aircraft; and
    a second sensed coverage area adjacent the at least one feature associated with a right wing of the aircraft,
    wherein, when the processor determines that an obstacle is beyond a range of the primary strike zone or the secondary strike zone but is within a lateral extent of the respective one of the primary strike zone and the secondary strike zone, the processor generates the image to include at least a partial icon at a limit of the respective coverage area.
  6. The system of claim 1,
    wherein the processor is further configured to determine whether the first obstacle associated with the first icon vertically clears a predefined vertical distance from structure of the aircraft,
    wherein the processor is configured to select a visual characteristic of the first icon based on whether the first obstacle is determined to vertically clear the structure of the aircraft.
  7. A method comprising:
    receiving, by a processor (36), sensed obstacle information from one or more sensors positioned on an aircraft and configured to sense obstacles within a field of view;
    determining, by the processor, location of obstacles relative to a primary strike zone (190) and a secondary strike zone (194) based on at least one of the sensed obstacle information, previously received surveillance data or previously stored ground obstacle data, the primary strike zone being a zone from a wingtip of the aircraft inward toward the aircraft and the secondary strike zone being a predetermined distance from the wingtip outward, wherein the primary strike zone and the secondary strike zone are adjacent and are forward facing; and
    generating, by the processor, an image (180) comprising:
    an ownship icon (126),
    at least one first icon (200) associated with a first obstacle, if the first obstacle is located within the primary strike zone,
    at least one second icon (202) associated with a second obstacle, if the second obstacle is located within the secondary strike zone, wherein the first and second icons are visually different, and
    a sensed coverage area (124) adjacent a part of the ownship icon associated with a wing of the aircraft, wherein the sensed coverage area comprises the primary and secondary strike zones and visualizing technique that visually separates the strike zones at the wingtip; and
    presenting, by a display device (54), the generated image.
  8. The method of claim 7, wherein the sensed coverage area comprises a first sensed coverage area adjacent a first part of the ownship icon associated with a first wing of the aircraft, the generated image further comprising a second sensed coverage area adjacent a second part of the ownship icon associated with a second wing of the aircraft, wherein each of the first and second sensed coverage areas comprise respective ones of the primary and secondary strike zones and a respective indicator that visually separates the strike zones.
  9. The method of claim 7, further comprising:
    receiving, by a communication device (38), height information of an obstacle associated with a displayed icon;
    generating, by the processor, a numerical value based on at least one of the received height information or height information of at least one structure of the aircraft;
    presenting, by the display device, the generated numerical value adjacent the displayed icon.
  10. The method of claim 7, further comprising
    receiving, by a communication device, height information of the first obstacle or the second;
    generating, by the processor, a numerical value based on the received height information;
    generating, by the processor, a vertical situation display, the generated image comprising:
    a vertical scale that represents at least one of height above ground or distance from a predefined structure of the aircraft; and
    a horizontal scale that represents distance from the predefined structure of the aircraft; and
    presenting, by the display device, the ownship icon adjacent the vertical scale at a location on the scale equal to a predefined height of the associated predefined structure of the aircraft.
EP13796644.6A 2012-05-30 2013-05-30 Systems and methods for enhanced awareness of obstacle proximity during taxi operations Active EP2856455B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP21150078.0A EP3832348A1 (en) 2012-05-30 2013-05-30 Systems and methods for enhanced awareness of obstacle proximity during taxi operations

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261653297P 2012-05-30 2012-05-30
US201261706632P 2012-09-27 2012-09-27
US13/872,889 US9223017B2 (en) 2012-05-30 2013-04-29 Systems and methods for enhanced awareness of obstacle proximity during taxi operations
PCT/US2013/043287 WO2013181351A1 (en) 2012-05-30 2013-05-30 Systems and methods for enhanced awareness of obstacle proximity during taxi operations

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP21150078.0A Division EP3832348A1 (en) 2012-05-30 2013-05-30 Systems and methods for enhanced awareness of obstacle proximity during taxi operations

Publications (3)

Publication Number Publication Date
EP2856455A1 EP2856455A1 (en) 2015-04-08
EP2856455A4 EP2856455A4 (en) 2015-12-02
EP2856455B1 true EP2856455B1 (en) 2021-01-27

Family

ID=49669535

Family Applications (2)

Application Number Title Priority Date Filing Date
EP13796644.6A Active EP2856455B1 (en) 2012-05-30 2013-05-30 Systems and methods for enhanced awareness of obstacle proximity during taxi operations
EP21150078.0A Pending EP3832348A1 (en) 2012-05-30 2013-05-30 Systems and methods for enhanced awareness of obstacle proximity during taxi operations

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP21150078.0A Pending EP3832348A1 (en) 2012-05-30 2013-05-30 Systems and methods for enhanced awareness of obstacle proximity during taxi operations

Country Status (6)

Country Link
US (4) US9223017B2 (en)
EP (2) EP2856455B1 (en)
JP (1) JP2015524111A (en)
CN (1) CN104380363A (en)
IN (1) IN2014DN09499A (en)
WO (1) WO2013181351A1 (en)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9223017B2 (en) 2012-05-30 2015-12-29 Honeywell International Inc. Systems and methods for enhanced awareness of obstacle proximity during taxi operations
WO2014052060A1 (en) 2012-09-27 2014-04-03 Honeywell International Inc. Systems and methods for using radar-adaptive beam pattern for wingtip protection
US9286794B2 (en) 2013-10-18 2016-03-15 Elwha Llc Pedestrian warning system
US20150029051A1 (en) * 2013-07-25 2015-01-29 Elwha Llc Wearable radar reflectors
US10431105B2 (en) 2014-01-07 2019-10-01 Honeywell International Inc. Enhanced awareness of obstacle proximity
US10963133B2 (en) 2014-01-07 2021-03-30 Honeywell International Inc. Enhanced awareness of obstacle proximity
US20150213721A1 (en) * 2014-01-30 2015-07-30 Honeywell International Inc. Passive aircraft wingtip strike detection system and method
RU2553270C1 (en) * 2014-04-15 2015-06-10 Федеральное государственное казенное военное образовательное учреждение высшего профессионального образования "ВОЕННАЯ АКАДЕМИЯ СВЯЗИ имени Маршала Советского Союза С.М. Буденного" Министерства обороны Российской Федерации Method and apparatus for determining angular orientation of aircraft
FR3020043B1 (en) * 2014-04-17 2016-04-22 Sagem Defense Securite AIRCRAFT COMPRISING A RETRACTABLE ARM HAVING OBSTACLE DETECTOR
US9721475B2 (en) 2014-09-05 2017-08-01 Honeywell International Inc. Systems and methods for displaying object and/or approaching vehicle data within an airport moving map
WO2016045703A1 (en) * 2014-09-23 2016-03-31 Airbus Operations (S.A.S.) Method and device for determining the ground collision risk of an aircraft
US10347142B2 (en) 2014-11-05 2019-07-09 Honeywell International Inc. Air traffic system using procedural trajectory prediction
US9536435B1 (en) 2015-07-13 2017-01-03 Double Black Aviation Technology L.L.C. System and method for optimizing an aircraft trajectory
US10156627B2 (en) 2015-10-15 2018-12-18 uAvionix Corporation Aircraft navigation light ADS-B radio
USD842718S1 (en) 2017-07-25 2019-03-12 uAvionix Corporation Position indicator
US9898934B2 (en) 2016-07-25 2018-02-20 Honeywell International Inc. Prediction of vehicle maneuvers
US9997078B2 (en) 2016-09-09 2018-06-12 Garmin International, Inc. Obstacle determination and display system
CN108154715B (en) * 2016-12-02 2022-02-25 上海航空电器有限公司 Lateral collision monitoring method
US10830873B2 (en) 2017-01-06 2020-11-10 Honeywell International Inc. Synthesizer for radar sensing
US10403158B2 (en) * 2017-04-06 2019-09-03 The Boeing Company Vertical landing vehicle, situational awareness system, and method thereof
US10453351B2 (en) * 2017-07-17 2019-10-22 Aurora Flight Sciences Corporation System and method for detecting obstacles in aerial systems
US10410530B1 (en) 2018-02-27 2019-09-10 Honeywell International Inc. Systems and methods for detecting potential surface collisions and providing warnings onboard an aircraft or airport vehicle
US10234303B1 (en) 2018-02-28 2019-03-19 Honeywell International Inc. Methods and systems for providing visually automated in-cockpit aircraft docking guidance with use of airport moving map applications
WO2020113420A1 (en) * 2018-12-04 2020-06-11 SZ DJI Technology Co., Ltd. Method and system for controlling movement of movable devices
FR3090978B1 (en) * 2018-12-19 2020-12-04 Airbus Helicopters method of detecting the proximity of a lateral arrangement of an aircraft with the ground and aircraft
US10867522B1 (en) * 2019-08-28 2020-12-15 Honeywell International Inc. Systems and methods for vehicle pushback collision notification and avoidance
JP7291232B2 (en) * 2019-09-30 2023-06-14 本田技研工業株式会社 Straddle-type vehicle, straddle-type vehicle control method and program
US11770689B2 (en) * 2020-12-16 2023-09-26 Qorvo Us, Inc. Systems and methods for communication via passive radar modulation
CN114044164B (en) * 2021-11-10 2023-06-27 北京环境特性研究所 Low-scattering carrier for RCS (wing component handling System) test of wing component

Family Cites Families (94)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1056815A (en) * 1963-07-02 1967-02-01 Bofors Ab Fire control system for weapons
US3212089A (en) * 1963-09-30 1965-10-12 Longacre Andrew Monopulse resolution improvement
US3349394A (en) * 1965-12-23 1967-10-24 Motorola Inc Radar sensing system
US3372890A (en) * 1966-02-04 1968-03-12 Martin Marietta Corp Data processor for circular scanning tracking system
US3416752A (en) * 1966-03-23 1968-12-17 Martin Marietta Corp Correlation guidance system having multiple switchable field of view
US4128837A (en) * 1968-07-22 1978-12-05 Rockwell International Corporation Prediction computation for weapon control
US4170774A (en) * 1972-01-24 1979-10-09 United Technologies Corporation Amplitude selected phase interferometer angle measuring radar
US3761927A (en) * 1972-03-20 1973-09-25 United Aircraft Corp Rf phase detected interferometer radar
US3766556A (en) * 1972-03-28 1973-10-16 United Aircraft Corp Channel switching phase interferometer radar receiver
US3841585A (en) * 1973-03-06 1974-10-15 Us Army Constant bearing course homing missile
DE2623643C2 (en) * 1976-05-26 1986-11-20 Daimler-Benz Ag, 7000 Stuttgart Method for automatically regulating the safety distance between a vehicle and vehicles in front and a device for carrying out this method
US4148029A (en) * 1976-10-13 1979-04-03 Westinghouse Electric Corp. System for estimating acceleration of maneuvering targets
US4160974A (en) * 1976-10-29 1979-07-10 The Singer Company Target sensing and homing system
FR2378318A1 (en) * 1977-01-21 1978-08-18 Thomson Csf MOBILE TARGET TRACKING SYSTEM
US4101893A (en) * 1977-08-05 1978-07-18 The United States Of America As Represented By The Secretary Of The Navy Aircraft landing aid for zero-zero visibility landings
US6297762B1 (en) * 1979-06-27 2001-10-02 Raytheon Company Electronic countermeasures system
GB2057808A (en) * 1979-08-23 1981-04-01 Marconi Co Ltd Secondary surveillance radar
US4918442A (en) * 1988-10-03 1990-04-17 Bogart Jr Donald W Airplane collision avoidance system
US5129595A (en) * 1991-07-03 1992-07-14 Alliant Techsystems Inc. Focal plane array seeker for projectiles
IT223271Z2 (en) 1991-07-31 1995-06-21 Fiat Ricerche FANTASY GROUP FOR VEHICLES INCORPORATING AN OBSTACLE RELIEF SYSTEM.
JPH07306995A (en) 1994-05-13 1995-11-21 Hitachi Ltd Traffic safety system, walker's portable device and on-vehicle device used for the system, and warning method for danger to walker
KR100270523B1 (en) * 1995-12-27 2000-11-01 정몽규 Unmanned car having control function according to the road condition
US6118401A (en) * 1996-07-01 2000-09-12 Sun Microsystems, Inc. Aircraft ground collision avoidance system and method
WO1999032899A1 (en) 1997-12-22 1999-07-01 Mitsubishi Denki Kabushiki Kaisha Radar apparatus for vehicles
JP2000019246A (en) 1998-07-03 2000-01-21 Denso Corp Obstacle detection system, radar device, and transponder
GB2342251A (en) * 1998-09-29 2000-04-05 Secr Defence Proximity measuring apparatus
US6459411B2 (en) 1998-12-30 2002-10-01 L-3 Communications Corporation Close/intra-formation positioning collision avoidance system and method
US6087995A (en) * 1999-02-17 2000-07-11 Anritsu Company Universal autoradar antenna alignment system
JP2001021644A (en) 1999-07-12 2001-01-26 Denso Corp Obstacle detecting system, on-vehicle radar apparatus, and portable radar device
US6963293B1 (en) 2000-05-11 2005-11-08 Rastar Corporation System and method of preventing aircraft wingtip ground incursion
US6486798B2 (en) 2000-05-11 2002-11-26 Rastar Corporation System and method of preventing aircraft wing damage
US7055994B2 (en) 2000-09-19 2006-06-06 L-3 Communications Corporation Light source assembly and methods for aircraft external lighting
WO2003009254A1 (en) 2001-07-16 2003-01-30 727823 Ontario Limited Method and apparatus for avoiding collisions
US7295154B2 (en) 2002-01-17 2007-11-13 The Ohio State University Vehicle obstacle warning radar
FR2837591B1 (en) * 2002-03-20 2004-07-02 Airbus France AIRPORT VISUALIZATION DEVICE
JP2004258898A (en) 2003-02-25 2004-09-16 Denso Corp On-vehicle device for detecting location of pedestrian or vehicle
US7095336B2 (en) * 2003-09-23 2006-08-22 Optimus Corporation System and method for providing pedestrian alerts
US20050107934A1 (en) 2003-11-18 2005-05-19 Caterpillar Inc. Work site tracking system and method
US7188983B2 (en) 2004-01-05 2007-03-13 Matthew Dunn Vehicle lighting apparatus and method
IL161082A (en) * 2004-03-25 2008-08-07 Rafael Advanced Defense Sys System and method for automatically acquiring a target with a narrow field-of-view gimbaled imaging sensor
US7541944B2 (en) * 2004-07-12 2009-06-02 The Boeing Company Systems and methods for collision avoidance
US7167126B2 (en) 2004-09-01 2007-01-23 The Boeing Company Radar system and method for determining the height of an object
EP1787142B1 (en) 2004-09-07 2008-11-19 William Michael Butler A collision avoidance warning and taxiing guidance device
US7379014B1 (en) * 2004-09-15 2008-05-27 Rockwell Collins, Inc. Taxi obstacle detecting radar
US7379165B2 (en) 2004-09-30 2008-05-27 The Boeing Company Ground vehicle collision prevention systems and methods
US8629800B2 (en) * 2004-09-30 2014-01-14 The Boeing Company Ground vehicle collision prevention systems and methods
FR2888955B1 (en) 2005-07-21 2007-08-24 Airbus Sas METHOD AND DEVICE FOR SECURING AUTOMATIC LOW ALTITUDE FLIGHT OF AN AIRCRAFT
JP4812080B2 (en) * 2005-10-12 2011-11-09 株式会社 日立ディスプレイズ Image display device
JP2007132768A (en) 2005-11-10 2007-05-31 Hitachi Ltd Vehicle-mounted radar system having communications function
CN1979517A (en) 2005-11-30 2007-06-13 华为技术有限公司 Radio-frequency identifying method and apparatus
CN100405775C (en) 2006-01-16 2008-07-23 北京大学 Anticollision method for reading ID information in radio frequency
DE102006007536A1 (en) 2006-02-16 2007-08-30 Aloys Wobben Wind turbine with flight lighting device
US7592929B2 (en) * 2006-04-06 2009-09-22 Honeywell International Inc. Runway and taxiway turning guidance
JP4739112B2 (en) 2006-05-17 2011-08-03 住友ナコ マテリアル ハンドリング株式会社 Industrial vehicle safety device
CA2549870A1 (en) 2006-06-06 2007-12-06 Donald Wayne Ablitt Collision avoidance and rfid system
US7783427B1 (en) * 2006-07-14 2010-08-24 Rockwell Collins, Inc. Combined runway obstacle detection system and method
FR2908218B1 (en) * 2006-11-07 2014-08-15 Thales Sa DEVICE FOR AIDING NAVIGATION OF AN AIRCRAFT IN AN AIRPORT AREA
CN100466014C (en) 2006-11-08 2009-03-04 北京航空航天大学 System for monitoring moving target on place of aerodrome
JP2008123014A (en) 2006-11-08 2008-05-29 Shinko Electric Co Ltd Contact prevention system
US7865300B2 (en) * 2006-11-15 2011-01-04 International Business Machines Corporation System and method for providing turn-by-turn directions to a moving waypoint
US7623061B2 (en) 2006-11-15 2009-11-24 Autoliv Asp Method and apparatus for discriminating with respect to low elevation target objects
FR2910681B1 (en) * 2006-12-20 2009-03-06 Thales Sa SELECTIVE DISPLAY SYSTEM FOR AIRCRAFT TRAFFIC INFORMATION
JP4920431B2 (en) 2007-01-23 2012-04-18 本田技研工業株式会社 Collision damage reduction system
FR2913775B1 (en) * 2007-03-16 2010-08-13 Thales Sa OBSTACLE DETECTION SYSTEM, IN PARTICULAR FOR ANTICOLLISION SYSTEM
WO2008134815A1 (en) 2007-05-04 2008-11-13 Teledyne Australia Pty Ltd. Collision avoidance system and method
FR2917222B1 (en) * 2007-06-05 2009-10-30 Thales Sa COLLISION PREVENTION DEVICE AND METHOD FOR A GROUND VEHICLE
FR2917223B1 (en) * 2007-06-08 2009-07-17 Thales Sa AIDING SYSTEM FOR GUIDING AN AIRCRAFT ON AN AIRPORT
CN101122957B (en) 2007-09-06 2010-11-17 复旦大学 RFID read-writing device with collision checking function and its collision checking method
US8786467B2 (en) 2007-11-14 2014-07-22 The Boeing Company Methods and systems for filtering traffic information for display
FR2925739B1 (en) 2007-12-20 2010-11-05 Airbus France METHOD AND DEVICE FOR PREVENTING GROUND COLLISIONS FOR AIRCRAFT.
US8077081B2 (en) * 2008-01-29 2011-12-13 Honeywell International Inc. Ground collision instrument for aircraft and marine vehicles
FR2932279B1 (en) * 2008-06-10 2011-08-19 Thales Sa DEVICE AND METHOD FOR MONITORING OBSTRUCTIONS IN THE ENVIRONMENT CLOSE TO AN AIRCRAFT.
US7932838B2 (en) * 2008-11-17 2011-04-26 Honeywell International, Inc. Aircraft collision avoidance system
US8264377B2 (en) 2009-03-02 2012-09-11 Griffith Gregory M Aircraft collision avoidance system
FR2947639B1 (en) * 2009-07-03 2012-01-13 Airbus Operations Sas METHOD AND DEVICE FOR DETECTING CIRCULATING AIRCRAFT IN AN AIRSPACE SURROUNDING AN AIRCRAFT
CN101593437A (en) 2009-07-10 2009-12-02 贵州盖克无人机有限责任公司 A kind of unmanned plane flight collision avoidance method and device
JP2011028579A (en) 2009-07-27 2011-02-10 Toshiba Corp Ground travel guidance support system
CN101989383A (en) 2009-08-03 2011-03-23 西安费斯达自动化工程有限公司 Miniature TCAS (Traffic Collision Avoidance System)
FR2950149B1 (en) * 2009-09-17 2012-08-17 Mbda France METHOD AND SYSTEM FOR AVOIDING AN INTERCEPTION MACHINE BY AN AIR MOBILE
US20110125349A1 (en) * 2009-11-23 2011-05-26 Danny Ace Integrated Bird-Aircraft Strike Prevention System - IBSPS
US8366054B2 (en) * 2009-12-17 2013-02-05 The United States Of America As Represented By The Secretary Of The Navy Hand launchable unmanned aerial vehicle
US8922431B2 (en) * 2010-04-13 2014-12-30 Becker Research And Development (Proprietary) Limited Apparatus, a system and a method for collission avoidance
JP4919179B2 (en) 2010-05-11 2012-04-18 独立行政法人電子航法研究所 Millimeter wave radar built-in headlamp
DE102010022282A1 (en) * 2010-05-31 2011-12-01 Andreas Lewandowski Method and radio system for warning of moving persons and objects in traffic
US8325082B2 (en) * 2010-08-31 2012-12-04 Raytheon Company Predictive and adaptive wide area surveillance
US8378881B2 (en) * 2010-10-18 2013-02-19 Raytheon Company Systems and methods for collision avoidance in unmanned aerial vehicles
CN202193050U (en) 2011-08-17 2012-04-18 胡鹏 Novel anti-collision system
US8988277B2 (en) * 2011-11-08 2015-03-24 Raytheon Company Dual monopulse/interferometer radar AESA aperture
US9575174B2 (en) 2012-05-30 2017-02-21 Honeywell International Inc. Systems and methods for filtering wingtip sensor information
US9207319B2 (en) 2012-05-30 2015-12-08 Honeywell International Inc. Collision-avoidance system for ground crew using sensors
US20130321169A1 (en) 2012-05-30 2013-12-05 Honeywell International Inc. Airport surface collision-avoidance system (ascas)
US8958942B2 (en) 2012-05-30 2015-02-17 Honeywell International Inc. Systems and methods for displaying aircraft braking distance during surface operations
US9959774B2 (en) 2012-05-30 2018-05-01 Honeywell International Inc. Systems and methods for displaying obstacle-avoidance information during surface operations
US9223017B2 (en) 2012-05-30 2015-12-29 Honeywell International Inc. Systems and methods for enhanced awareness of obstacle proximity during taxi operations

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
EP2856455A1 (en) 2015-04-08
EP3832348A1 (en) 2021-06-09
IN2014DN09499A (en) 2015-07-17
US20130321194A1 (en) 2013-12-05
US20130321177A1 (en) 2013-12-05
CN104380363A (en) 2015-02-25
US9229101B2 (en) 2016-01-05
US20130325312A1 (en) 2013-12-05
US20140085124A1 (en) 2014-03-27
US9223017B2 (en) 2015-12-29
WO2013181351A1 (en) 2013-12-05
EP2856455A4 (en) 2015-12-02
JP2015524111A (en) 2015-08-20
US10274595B2 (en) 2019-04-30

Similar Documents

Publication Publication Date Title
EP2856455B1 (en) Systems and methods for enhanced awareness of obstacle proximity during taxi operations
US10140876B2 (en) Systems and methods for enhanced awareness of obstacle proximity during taxi operations
US9959774B2 (en) Systems and methods for displaying obstacle-avoidance information during surface operations
EP2168112B1 (en) Systems and methods for providing aircraft runway guidance
US9575174B2 (en) Systems and methods for filtering wingtip sensor information
US8378852B2 (en) Aircraft-centered ground maneuvering monitoring and alerting system
US9472109B2 (en) Obstacle detection system providing context awareness
US8271186B2 (en) Viewing device for aircraft comprising means of displaying trajectories of intruders presenting a risk of collision in all the space surrounding the aircraft
EP2835795B1 (en) System and method for highlighting an area encompassing an aircraft that is free of hazards
US20180075762A1 (en) Obstacle determination and display system
US10963133B2 (en) Enhanced awareness of obstacle proximity
US10431105B2 (en) Enhanced awareness of obstacle proximity
JP2014091516A (en) Method of optically locating aircraft relative to airport
EP3309519B1 (en) Aircraft system and corresponding method for displaying wind shear
EP2056273A1 (en) Perspective view primary flight display system and method with range lines
US20100052973A1 (en) Device and Method for Monitoring the Location of Aircraft on the Ground
US20100201544A1 (en) Method for Presenting Air Traffic Information on an Aircraft Head-up Display
EP3852085A1 (en) Display systems and methods for providing ground traffic collison threat awareness

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20141105

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20151102

RIC1 Information provided on ipc code assigned before grant

Ipc: G01S 13/93 20060101ALI20151027BHEP

Ipc: G08G 5/04 20060101ALI20151027BHEP

Ipc: G08G 5/06 20060101ALI20151027BHEP

Ipc: B64C 25/42 20060101ALI20151027BHEP

Ipc: B64D 43/00 20060101ALI20151027BHEP

Ipc: G01S 7/04 20060101ALI20151027BHEP

Ipc: G01C 23/00 20060101ALI20151027BHEP

Ipc: G01S 13/76 20060101ALI20151027BHEP

Ipc: G01S 13/66 20060101AFI20151027BHEP

Ipc: B64D 45/00 20060101ALI20151027BHEP

Ipc: G08G 5/00 20060101ALI20151027BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: HONEYWELL INTERNATIONAL INC.

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180907

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602013075512

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G08G0005040000

Ipc: G01S0013660000

RIC1 Information provided on ipc code assigned before grant

Ipc: G08G 5/06 20060101ALI20200731BHEP

Ipc: G01S 13/931 20200101ALI20200731BHEP

Ipc: G01S 13/66 20060101AFI20200731BHEP

Ipc: B64D 43/00 20060101ALI20200731BHEP

Ipc: G01S 13/76 20060101ALI20200731BHEP

Ipc: G01S 13/93 20200101ALI20200731BHEP

Ipc: G08G 5/00 20060101ALI20200731BHEP

Ipc: B64C 25/42 20060101ALI20200731BHEP

Ipc: G08G 5/04 20060101ALI20200731BHEP

Ipc: G01S 7/04 20060101ALI20200731BHEP

Ipc: B64D 45/00 20060101ALI20200731BHEP

Ipc: G01C 23/00 20060101ALI20200731BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200924

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1358861

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210215

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013075512

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1358861

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210127

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210527

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210427

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210527

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013075512

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20211028

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210531

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210530

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210531

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210527

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20220526

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210531

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20220519

Year of fee payment: 10

Ref country code: GB

Payment date: 20220524

Year of fee payment: 10

Ref country code: DE

Payment date: 20220527

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230525

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230523

Year of fee payment: 11

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602013075512

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20230601

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230601

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210127

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230530

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231201

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230530