WO2021110555A1 - Procédé et dispositif d'assistance à au moins un opérateur lors de l'exécution de tâches de planification et/ou de contôle - Google Patents

Procédé et dispositif d'assistance à au moins un opérateur lors de l'exécution de tâches de planification et/ou de contôle Download PDF

Info

Publication number
WO2021110555A1
WO2021110555A1 PCT/EP2020/083657 EP2020083657W WO2021110555A1 WO 2021110555 A1 WO2021110555 A1 WO 2021110555A1 EP 2020083657 W EP2020083657 W EP 2020083657W WO 2021110555 A1 WO2021110555 A1 WO 2021110555A1
Authority
WO
WIPO (PCT)
Prior art keywords
operator
traffic
data
road users
external view
Prior art date
Application number
PCT/EP2020/083657
Other languages
German (de)
English (en)
Inventor
Hejar GÜRLÜK
Lothar CHRISTOFFELS
Original Assignee
Deutsches Zentrum für Luft- und Raumfahrt e.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Deutsches Zentrum für Luft- und Raumfahrt e.V. filed Critical Deutsches Zentrum für Luft- und Raumfahrt e.V.
Priority to EP20816455.8A priority Critical patent/EP4070302A1/fr
Publication of WO2021110555A1 publication Critical patent/WO2021110555A1/fr

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0017—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information
    • G08G5/0026—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information located on the ground
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0073—Surveillance aids
    • G08G5/0082—Surveillance aids for monitoring traffic from a ground station
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/02—Automatic approach or landing aids, i.e. systems in which flight data of incoming planes are processed to provide landing data
    • G08G5/025—Navigation or guidance aids
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/06—Traffic control systems for aircraft, e.g. air-traffic control [ATC] for control when on the ground
    • G08G5/065—Navigation or guidance aids, e.g. for taxiing or rolling

Definitions

  • the invention relates to a support system for supporting at least one operator in situation-dependent planning and / or management tasks in a traffic area with a plurality of road users.
  • the invention also relates to a method for this purpose.
  • traffic control centers colloquially often also referred to as centers or towers or control rooms
  • the human factor plays a major role here, since even today a large part of the traffic management tasks that are carried out by the traffic control center are carried out by the so-called pilot.
  • a pilot regulates the traffic within the area of operation of the traffic area entrusted to him, with direct traffic guidance usually taking place.
  • direct instructions to a vehicle in question which only affect the vehicle itself and are intended for this, actions of the vehicle driver of the relevant vehicle is initiated based on the direct instructions of the pilot, so that all traffic within the traffic area can be regulated and controlled.
  • a pilot usually has a significantly higher situational awareness with regard to the overall traffic situation in the traffic area than the individual drivers of the vehicles in the traffic area.
  • the controller is an air traffic controller who is responsible for air traffic within the area of operation entrusted to him and who has to ensure that the aircraft be guided safely and, if necessary, economically through the familiar catchment area. Landing at an airport and taking off from an airport and the subsequent guidance of the aircraft through the airspace play a particularly important role here.
  • the overall situation in a certain flight area e.g. in the approach area of an airport
  • options for action can also be generated and displayed to the controller in order to be able to support him even better in his planning and / or management tasks.
  • Such options for action are automatically generated by the system based on the state of the overall situation as it results from the state data and then presented to the controller.
  • an assistance system for supporting situation-dependent planning and / or management tasks of a controlled system is known, the state of the controlled system being sensed here as well, according to the generic type, using a status detection unit.
  • acoustic recording unit acoustic speech signals between the controller and a pilot in the airspace are recorded and analyzed, based on the content of the Speech signals between the controller and the pilot then adjust the state of the controlled system.
  • the outside view is essential, especially for the area traffic control, in order to ensure appropriate situational awareness.
  • the transition from looking outside (head-up) to the display systems (head-down) can under certain circumstances be very critical if, due to complex traffic situations, the viewing times at the display systems are greatly extended. Especially during night flights or when visibility is poor, the controllers are even more dependent on their display systems, which results in even longer head-down times.
  • An augmented reality system is known from US 2005/0231419 A1, in which traffic data that was collected by various sensors at an airport is displayed. The system also responds to physical gestures by the controller to select and communicate with specific road users.
  • Such planning data from a controller for example an air traffic controller, are still displayed today manually (for example in the form of paper strips) or by electronic assistance systems, which are then displayed on the outside must be mentally transferred to the surgeon.
  • a controller for example an air traffic controller
  • electronic assistance systems which are then displayed on the outside must be mentally transferred to the surgeon.
  • this ties up the surgeon's mental capacities and thus prevents attention to correspondingly other, more important elements.
  • a support system is proposed to support at least one operator (for example controllers, in particular air traffic controllers) in situation-dependent planning and / or management tasks of a traffic area with a plurality of road users, the support system having a first data interface, a second data interface and a projection has direction.
  • operator for example controllers, in particular air traffic controllers
  • the support system Via the first data interface, the support system receives corresponding position information relating to the road users in the respective traffic area that is assigned to the operator.
  • a traffic area within the meaning of the present invention is understood to mean a demarcated area or a demarcated area within which the at least one operator is responsible for the safe guidance of the road users located in the traffic area.
  • the area or the area can be territorially limited.
  • the traffic space can be an air space for aircraft approaching and / or departing.
  • the traffic area can also be a ground-related area, for example the apron of an airport.
  • a situation to be assisted is understood to mean the implementation of planning and / or management tasks within an area (traffic area) or an area, such as the control of aircraft within an airspace or ground area by one or more air traffic controllers or that Controlling ships within a port area by one or more port pilots.
  • the position information that is fed to the support system via the first data interface contains the position of one, several or all road users within the traffic area in relation to a specified reference system or reference point. With the help of the position information, all road users can be localized within the traffic area.
  • the second data interface is set up to provide the operator's planning data assigned to the traffic participants concerned for guiding the traffic participants within the traffic area concerned to the support system.
  • an augmented exterior view for the surgeon is now generated in the natural exterior view of at least part of the traffic area, the augmented exterior view taking place as a function of the position information of the traffic participants and the planning data of the traffic participants.
  • the planning data of the respective road users are indexed with the aid of the projection device for local perception by the operator in the natural external view of the operator.
  • a coupling of the conventional systems with the augmented exterior view can be provided, thereby ensuring that the controller can always go back to the conventional working mode in the event of failure of the support system according to the invention and the associated lack of functionality. Since the coupling entails data synchronization, the data entries made in the augmented exterior view are always updated or synchronized in the conventional displays / systems. For this purpose, it is particularly advantageous if the data generated by the support system are transmitted and exchanged to other assistance systems coupled to the support system via a further, third data interface.
  • a localized representation of planning data to the road users is understood to mean that the planning data can be visually perceived in a radius around the respective road user, so that the planning data projected in this way is recognized as being assigned to the respective road user.
  • the immediate proximity of the presentation of the planning data to the respective road users ensures that the operator perceives the displayed planning data as being assigned to the corresponding road user and thus visually recognizes the assignment of the presented planning data to the respective road user.
  • the traffic area can be a part of an airport (for example a runway or apron) and / or an air space, for example the air space when the aircraft are starting or when the aircraft are landing.
  • an airport for example a runway or apron
  • an air space for example the air space when the aircraft are starting or when the aircraft are landing.
  • the planning data assigned to the road users are a sequence position within a departure sequence and / or a landing sequence, the projection device being set up to display the sequence positions assigned to the road users at the respective To project road users into the surgeon's natural external view for local perception by the surgeon.
  • Such planning data in the sense of the present invention can alternatively or additionally also contain identity information such as LFZ type and characteristics such as weight classes (light / medium / heavy)
  • the projection device is designed to project infrastructure elements of the traffic area into the natural external view of the operator for local perception by the operator. This is particularly advantageous when the natural external view is impaired (for example in the Night or in bad weather) and / or if the infrastructure elements of the traffic area are not recognizable due to the distance to the operator or because they are only available virtually and are used to control the traffic (e.g. stop bars).
  • the projection device can be set up to project the stopping points in the apron of an airport or other control elements for controlling the aircraft at the airport in the form of an augmented representation into the natural external view of the operator so that they are visually in the natural external view for the operator become perceptible. This allows head-down times or cross-checks to be reduced.
  • the operational context is determined based on status data of the traffic area and / or the road users and, depending on the determined operational context, traffic data relating to the respective road user is selected, wherein the projection unit is further set up to project the traffic data selected based on the operational context to the respective road user for local perception by the operator in the natural external view of the operator.
  • the status data of the traffic area and / or the traffic participants can be provided to the support system via the first data interface.
  • This advantageous embodiment makes it possible to counteract information overload caused by too much unnecessary information. This can increase situational awareness by displaying the most relevant information for the current operational context.
  • the operational context is determined based on status data of the traffic area and / or the traffic participants and depending on the determined operational context for the respective traffic participant at least one corresponding Interaction possibility with the road user and / or an infrastructure element of the traffic area is selected, wherein the projection unit is also set up to use the interaction options selected based on the operational context as an interaction element on the respective traffic part.
  • the status data of the traffic area and / or that of the traffic participants can be made available to the support system via the first data interface.
  • Such an interaction option can be implemented, for example, by means of a context menu with one or more menu entries.
  • This advantageous embodiment makes it possible to counteract information overload caused by too many unnecessary interaction options.
  • situational awareness can be increased by limiting the most relevant options for action based on the operational context.
  • route or runway segments can be blocked or released by switching infrastructure elements at an airport.
  • stop bars for example, to be switched and a corresponding roll release to be initiated and documented interactively.
  • the possible interaction variants are only displayed to the respective infrastructure elements or the road users if they are possible at all based on the operational context.
  • the operational context is understood to mean that part of the process sequence for controlling and guiding the road users within which the respective road user is located. Control and / or guidance commands that make no sense or are irrelevant or not useful in relation to the operational context are consequently also not shown in the augmented external view.
  • the task is also achieved with the method according to claim 7 for supporting at least one operator in situation-dependent planning and / or management tasks of a traffic area with a plurality of road users, the method having the following steps:
  • Figure 1 Schematic representation of the support system according to the invention in an airport environment.
  • FIG. 1 shows, in a greatly simplified schematic representation, the support system 10 with which an operator 100 is to be supported in situation-dependent planning and / or management tasks of a traffic area 200 with a plurality of traffic participants 210.
  • the operator 100 is an air traffic controller located in a control tower or control room, from where he has a direct visual view of the traffic area 200 for which he is responsible through a corresponding window pane.
  • the view out of the control room is therefore the natural external view or external view 12 for the operator 100 in order to be able to directly perceive the traffic area 200 and the traffic participants 210 located therein.
  • This natural exterior view 12 is now to be replaced by an augmented exterior view, in which the natural exterior view 12 has additional information relating to the traffic area 200 and the traffic participants 210 contained therein artificially added.
  • the support system 10 has a projection device 14 which has a first data interface 16 and a second data interface 18.
  • the projection device 14 is connected to an information management system 20, which is usually part of the conventional pilot workstation.
  • This information management 20 not only provides the projection device 14 with the position data or position information (location data from ground position and / or air position radar) of the individual traffic participants 210, but also other status data of the traffic area 200 or the traffic participants 210 For example, environmental data such as weather data, visibility data (transmission meter), various sensor data from existing air traffic control systems (e.g. stop-bar circuits) as well as user inputs in existing conventional human-machine interfaces.
  • the projection device 14 is also provided with planning data from the operator 100 for guiding the road users 210 within the relevant traffic area 200, which data comes from a TFDPS 22 (Tower Flight Data Processing System). From the TFDPS 22, in particular, the departure sequence of road users 210 in traffic area 200 is known, in that each road user 210 is assigned a position or point within the departure sequence. The sequence of the departure sequence is part of the flight plan data or planning data of the operator 100.
  • TFDPS 22 Tower Flight Data Processing System
  • the first data interface 16 and the second data interface 18 can also be designed as a common data interface, in this case the information management 20 and the TFDPS 22 are connected to the projection device 14 via this common data interface.
  • the information management 20 and the TFDPS 22 can arise from the same system.
  • the support system 10 also has a detection device 24 which is provided to determine the position of the surgeon 100 in relation to the natural external view 12.
  • planning data 220 augmented by the projection device 14 are now projected into the natural external view 12 for local perception by the operator 100 to the respective road users 210.
  • these augmented planning data 220 relate to the order of the sequence, here the departure sequence, of the aircraft 210.
  • the operator 100 can immediately recognize the order in which the individual traffic participants are planned in his departure sequence. This is particularly of great interest if the airport topology is such that the aircraft must be threaded onto the runway from several directions. Because here it is not immediately recognizable in which order the aircraft are to take off.
  • an augmented label 230 is projected for each aircraft 210, which can be perceived by the surgeon, the position of the individual labels 230 being projected into the natural external view 12 in such a way that the surgeon 100 uses the respective label 230 as a recognizes corresponding aircraft belonging to it. Accordingly, the labels 230 are projected so close to the aircraft that it is possible to clearly identify which label 230 belongs to which aircraft. In these labels 230, the position within the departure sequence is then indicated by a sequence number in order to make the sequence of the departure sequence recognizable over the entire natural exterior view.
  • Further data can be displayed in these labels 230, such as flight number, identifier and other status data of the aircraft and / or the traffic area (not shown). These additional data are used in particular to quickly identify the respective road user in the augmented exterior view and, if necessary, to establish / generate a sequence without having to resort to other systems.
  • interaction options in the form of selectable menu items (context menus) 240 can also be displayed in the augmented external view (for example on the labels), which are generated depending on the context in order to prevent information overload.
  • Such interaction possibilities 240 offer the operator 100 the possibility of communicating directly with infrastructure elements 250 of the airport and / or the road users 210 and of controlling them. In this way, you can use augmented menus 240 in the natural outside view 12, for example, switch stop bars 250 or transmit instructions to road users 210 digitally or by radio.
  • first data interface 18 second data interface 20 information management 22 TFDPS 24 recognition device

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)

Abstract

L'invention concerne un système d'assistance permettant d'assister au moins un opérateur lors de l'exécution de tâches de planification et/ou de contrôle dépendantes de la situation d'un espace de circulation comprenant une pluralité d'usagers de la route, le système d'assistance comprenant : - une première interface de données qui est configurée pour recevoir des informations de position relatives aux usagers de la route de l'espace de circulation ; - une seconde interface de données qui est configurée pour recevoir des données de planification, attribuées aux usagers de la route respectifs, en provenance de l'opérateur afin de contrôler les usagers de la route dans l'espace de circulation respectif ; et - un dispositif de projection qui, afin de générer une vue externe augmentée destinée à l'opérateur dans la vue externe naturelle d'au moins une partie de l'espace de circulation, est conçu de telle sorte que les données de planification associées aux usagers de la route individuels sont projetées dans la vue extérieure naturelle de l'opérateur des usagers de la route respectifs en fonction des informations de position des usagers de la route, de sorte que lesdites données soient perçues par l'opérateur de manière précise en termes de position.
PCT/EP2020/083657 2019-12-06 2020-11-27 Procédé et dispositif d'assistance à au moins un opérateur lors de l'exécution de tâches de planification et/ou de contôle WO2021110555A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP20816455.8A EP4070302A1 (fr) 2019-12-06 2020-11-27 Procédé et dispositif d'assistance à au moins un opérateur lors de l'exécution de tâches de planification et/ou de contôle

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102019133410.1A DE102019133410A1 (de) 2019-12-06 2019-12-06 Verfahren und Vorrichtung zur Unterstützung mindestens eines Operateurs bei Planungs- und/oder Führungsaufgaben
DE102019133410.1 2019-12-06

Publications (1)

Publication Number Publication Date
WO2021110555A1 true WO2021110555A1 (fr) 2021-06-10

Family

ID=73646330

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2020/083657 WO2021110555A1 (fr) 2019-12-06 2020-11-27 Procédé et dispositif d'assistance à au moins un opérateur lors de l'exécution de tâches de planification et/ou de contôle

Country Status (3)

Country Link
EP (1) EP4070302A1 (fr)
DE (1) DE102019133410A1 (fr)
WO (1) WO2021110555A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050231419A1 (en) 2004-04-15 2005-10-20 Lockheed Martin Ms2 Augmented reality traffic control center
DE102011107934A1 (de) 2011-07-19 2013-01-24 Deutsches Zentrum für Luft- und Raumfahrt e.V. Assistenzsystem

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8922589B2 (en) * 2013-04-07 2014-12-30 Laor Consulting Llc Augmented reality apparatus

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050231419A1 (en) 2004-04-15 2005-10-20 Lockheed Martin Ms2 Augmented reality traffic control center
DE102011107934A1 (de) 2011-07-19 2013-01-24 Deutsches Zentrum für Luft- und Raumfahrt e.V. Assistenzsystem

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
GUERLUEK ET AL: "Flight Data Handling with Augmented Reality - From a display system to an interactive operating system for Aerodrome Control Towers", 26 June 2018 (2018-06-26), pages 1 - 4, XP009525563, Retrieved from the Internet <URL:http://www.icrat.org/ICRAT/seminarContent/2018/papers/ICRAT_2018_paper_78.pdf> [retrieved on 20210211] *
GURLUK HEJAR ET AL: "Assessment of Risks and Benefits of Context-Adaptive Augmented Reality for Aerodrome Control Towers", 2018 IEEE/AIAA 37TH DIGITAL AVIONICS SYSTEMS CONFERENCE (DASC), IEEE, 23 September 2018 (2018-09-23), pages 1 - 10, XP033469448, DOI: 10.1109/DASC.2018.8569859 *

Also Published As

Publication number Publication date
DE102019133410A1 (de) 2021-06-10
EP4070302A1 (fr) 2022-10-12

Similar Documents

Publication Publication Date Title
EP0883873B1 (fr) Systeme de guidage d&#39;aeroport, en particulier systeme de guidage et de controle de la circulation de surface pour aeroport
EP3052363B1 (fr) Dispositif pour la conduite automatique d&#39;un véhicule
EP2944532B1 (fr) Système d&#39;assistance de feu de circulation pour un véhicule doté d&#39;un dispositif d&#39;affichage
EP3052353B1 (fr) Procédé afférent à un système d&#39;aide à la conduite d&#39;un véhicule
EP3052354B1 (fr) Procédé pour un système d&#39;aide à la conduite d&#39;un véhicule
EP1610971B1 (fr) Procede de reglage de la vitesse d&#39;un vehicule automobile en fonction des risques et equipement correspondant
DE102009042557A1 (de) Um Flugzeug zentriertes Überwachungs- und Alarmsystem für Bodenmanöver
EP2956833B1 (fr) Procédé et dispositif pour représenter des informations d&#39;un système
DE102014203138A1 (de) Fahrerassistenzsystem für ein Kraftfahrzeug und Verfahren zur Assistenz eines Kraftfahrzeug-Fahrers
DE102013001326A1 (de) Kraftwagen mit Car-to-X-Funktionalität
DE102018210226A1 (de) Verfahrung und vorrichtung für die verwendung mit fahrzeugen mit autonomem fahrmodus
EP3176047A1 (fr) Système de commande pour la conduite d&#39;un véhicule, en particulier d&#39;un véhicule utilitaire
WO2022002901A1 (fr) Procédé de détection d&#39;environnement au moyen d&#39;au moins deux capteurs de détection d&#39;environnement indépendants à formation d&#39;image, dispositif pour la mise en œuvre de ce procédé, véhicule et programme informatique conçu de manière correspondante
DE102014202509A1 (de) Steuerung einer hoch- oder vollautomatischen Fahrfunktion
WO2012110046A1 (fr) Dispositif et procédé pour surveiller et commander le guidage du trafic sur un aéroport
DE102017107484A1 (de) Verfahren zum Bereitstellen einer einen Fahrer eines Kraftfahrzeugs unterstützenden Anzeige, Fahrerassistenzsystem und Kraftfahrzeug
EP3566925A1 (fr) Véhicule automobile (partiellement) autonome et procédé de fonctionnement d&#39;un tel véhicule automobile
EP4070302A1 (fr) Procédé et dispositif d&#39;assistance à au moins un opérateur lors de l&#39;exécution de tâches de planification et/ou de contôle
WO2014135500A1 (fr) Procédé et système de dispositif pour le guidage automatisé individuel d&#39;usagers des voies de circulation sur un aéroport
EP3847050B1 (fr) Procédé et dispositif de commande pour faire fonctionner un dispositif d&#39;affichage portable sur la tête dans un véhicule automobile
DE102013008356B4 (de) Verfahren und Vorrichtung zum Anzeigen von Regelobjekten eines Regelungssystems
DE102010004653A1 (de) Steuerungsverfahren und -anordnung für ein Schienenfahrzeug
EP3217378B1 (fr) Procédé et dispositif de gestion du trafic de véhicules, en particulier d&#39;aéronefs
DE102018222666A1 (de) Autonom fahrendes Taxi
DE19956455A1 (de) Verfahren und Einrichtung zum geschwindigkeits- und/oder abstandsgeregelten Fahrbetrieb

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20816455

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020816455

Country of ref document: EP

Effective date: 20220706