EP4105914A1 - Verfahren und systeme zur kontextuellen transkriptionserweiterung - Google Patents

Verfahren und systeme zur kontextuellen transkriptionserweiterung Download PDF

Info

Publication number
EP4105914A1
EP4105914A1 EP22178408.5A EP22178408A EP4105914A1 EP 4105914 A1 EP4105914 A1 EP 4105914A1 EP 22178408 A EP22178408 A EP 22178408A EP 4105914 A1 EP4105914 A1 EP 4105914A1
Authority
EP
European Patent Office
Prior art keywords
transcription
communication
clearance
aircraft
audio communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP22178408.5A
Other languages
English (en)
French (fr)
Inventor
Hariharan SAPTHARISHI
Gobinathan BALADHANDAPANI
Raghupathy P
Sivakumar KANAGARAJAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honeywell International Inc
Original Assignee
Honeywell International Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/412,012 external-priority patent/US20220406194A1/en
Application filed by Honeywell International Inc filed Critical Honeywell International Inc
Publication of EP4105914A1 publication Critical patent/EP4105914A1/de
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0004—Transmission of traffic-related information to or from an aircraft
    • G08G5/0013—Transmission of traffic-related information to or from an aircraft with a ground station
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0017—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information
    • G08G5/0021—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information located in the aircraft
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0047—Navigation or guidance aids for a single aircraft
    • G08G5/0052—Navigation or guidance aids for a single aircraft for cruising
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/06—Traffic control systems for aircraft, e.g. air-traffic control [ATC] for control when on the ground
    • G08G5/065—Navigation or guidance aids, e.g. for taxiing or rolling
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0073—Surveillance aids
    • G08G5/0082—Surveillance aids for monitoring traffic from a ground station

Definitions

  • the subject matter described herein relates generally to vehicle systems, and more particularly, embodiments of the subject matter relate to avionics systems and methods for mitigating potential ambiguities or uncertainties in air traffic control clearance communications.
  • Air traffic control typically involves voice communications between air traffic control and a pilot or crewmember onboard the various aircrafts within a controlled airspace.
  • an air traffic controller may communicate an instruction or a request for pilot action by a particular aircraft using a call sign assigned to that aircraft, with a pilot or crewmember onboard that aircraft acknowledging the request (e.g., by reading back the received information) in a separate communication that also includes the call sign.
  • the ATC can determine that the correct aircraft has acknowledged the request, that the request was correctly understood, what the pilot intends to do, etc.
  • One method involves identifying an operational objective for an audio communication with respect to the vehicle, determining an expected clearance communication for the vehicle based at least in part on the operational objective, identifying a discrepancy between a transcription of the audio communication and the expected clearance communication, augmenting the transcription of the audio communication using a current operational context to reduce the discrepancy, resulting in an augmented transcription of the audio communication, and providing a graphical indication influenced by the augmented transcription of the audio communication.
  • a computer-readable medium having computer-executable instructions stored thereon.
  • the computer-executable instructions when executed by a processing system, cause the processing system to identify an operational objective for an audio communication with respect to a vehicle, determine an expected clearance communication for the vehicle based at least in part on the operational objective, identify a discrepancy between a transcription of the audio communication and the expected clearance communication, augment the transcription of the audio communication using a current operational context to reduce the discrepancy, resulting in an augmented transcription of the audio communication, and provide a graphical indication influenced by the augmented transcription of the audio communication.
  • a system in another embodiment, includes a communications system to receive an audio communication with respect to a vehicle, a data storage element to maintain information pertaining to a phraseology standard, and a processing system coupled to the communications system and the data storage element.
  • the processing system is configurable to identify an operational objective for the audio communication, determine an expected clearance communication for the vehicle based at least in part on the operational objective using the information pertaining to the phraseology standard, identify a discrepancy between a transcription of the audio communication and the expected clearance communication, augment the transcription of the audio communication using a current operational context to reduce the discrepancy, resulting in an augmented transcription of the audio communication, and output an indication influenced by the augmented transcription of the audio communication.
  • Embodiments of the subject matter described herein generally relate to systems and methods for detecting and mitigating potential ambiguities or uncertainties in clearance communications associated with different vehicles operating within a commonly controlled area by augmenting transcriptions of clearance communications using the current operational context to reduce or otherwise mitigate discrepancies between the received clearance communications and the expected clearance communications.
  • the subject matter is primarily described herein in the context of aircraft operating in a controlled airspace; however, the subject matter described herein is not necessarily limited to aircraft or avionic environments, and in alternative embodiments, may be implemented in an equivalent manner for ground operations, marine operations, or otherwise in the context of other types of vehicles and travel spaces.
  • audio communications received at the aircraft are parsed and analyzed to automatically identify an operational objective for an audio communication with respect to the aircraft.
  • natural language processing or similar artificial intelligence (AI) techniques may be applied to the audio communications (or transcriptions thereof) to ascertain the intent of a respective audio communication and identify the operational subjects or entities to which the respective audio communication pertains, such as, a particular aircraft or flight identifier, a runway, a taxiway, a waypoint, a heading, an altitude, a flight level, a communications radio or another avionics system or setting, an aircraft action (e.g., landing, takeoff, pushback, hold, or the like) and/or the like.
  • AI artificial intelligence
  • an expected clearance communication for the aircraft is determined based on the applicable phraseology standards, such as the international standards of phraseology set forth in the International Civil Aviation Organization (ICAO) Annex 10 Volume II Chapter 5 , ICAO Doc 4444 Chapter 12 and in ICAO Doc 9432 - Manual of Radiotelephony or another applicable phraseology standard for the particular geographic region or airspace (e.g., modified ICAO standards for improved suitability with a particular locality).
  • the expected clearance communication reflects the standard phraseology to be used for an audio clearance communication intending or attempting to achieve the identified operational objective.
  • the transcription of the received audio clearance communication exists is automatically augmented using the current operational context to reduce or otherwise mitigate the discrepancy and better comport with the applicable phraseology standards utilized to derive the expected clearance communication.
  • transcription of the received audio clearance communication may be modified to include an operational subject or operational parameter that was otherwise absent from the received audio clearance communication to obtain an augmented transcription that matches the expected clearance communication, or the expression of the operational subject or operational parameter within the transcription of the received audio clearance communication may be modified to comport with the applicable standard phraseology.
  • one or more graphical indicia may be provided to notify or otherwise indicate, to the pilot or other aircraft operator, that a discrepancy was identified with respect to a clearance communication received from the ATC or a clearance communicated by the pilot or other aircraft concurrently operating within the airspace.
  • graphical indicia or representations of the augmented transcription of the audio clearance communication may be provided in lieu of the original, "as received" transcription of the audio clearance communication to mitigate any potential ambiguities, uncertainties or other misunderstandings that could arise due to noncompliance with applicable phraseology standards.
  • the likelihood of miscommunication, misunderstandings, or other issues arising out of casual, incomplete, or noncompliant communications can be reduced.
  • ATC issuing informal clearance communications, such as "go to the right side," without specifying a runway, taxiway, or other operational subject, resulting in pilots misinterpreting the clearance communications and taxiing into the path of another aircraft.
  • a received audio ATC clearance communication of "go to the right side” would be syntactically and semantically analyzed to identify an operational objective of the ATC clearance communication and determine an expected ATC clearance communication for that operational objective in accordance with the applicable phraseology standard(s).
  • a discrepancy is detected when the expected ATC clearance communication includes an operational subject associated with the command ("go to") and/or the modifier ("right") contained in the received audio ATC clearance communication, and a graphical indication of the discrepancy may be rendered or otherwise provided on a display device onboard the aircraft to notify the pilot or other aircraft operator that the received ATC clearance communication utilized non-standard phraseology or is otherwise noncompliant with the applicable phraseology standard(s).
  • the current operational context of the aircraft may be utilized to augment the transcription of the received ATC clearance communication to reduce the discrepancy and attempt to correct the use of nonstandard phraseology.
  • the current location of the aircraft with respect to a taxi clearance, a flight plan, or other defined route or manner of operation of the aircraft may be utilized to identify the expected operational subject for the received ATC clearance communication (e.g., the next taxiway of the taxi clearance, the runway specified by the taxi clearance or the flight plan, the assigned gate for the aircraft, and/or the like) before augmenting the transcription of the received ATC clearance communication to include the expected operational subject in a manner that is syntactically and semantically consistent with applicable phraseology standard(s).
  • the current operational status associated with the taxiways, runways, gates and/or the like may be utilized to intelligently augment the transcription by excluding from consideration taxiways, runways, gates and/or the like that are not operational or currently in use.
  • the augmented content may be determined or otherwise derived from analysis of the current conversational context and/or preceding clearance communications, by querying a database or other data storage element for information relevant to the current operational context, or by predicting the content of the expected ATC clearance communication using the current operational context and/or other real-time data (e.g., data derived from current or recent flight traffic and/or the flight paths associated therewith).
  • a graphical representation of the augmented transcription of the ATC clearance communication is rendered or otherwise provided on the display device onboard the aircraft to help mitigate the discrepancy in concert with providing a graphical indication of the existence of the discrepancy (e.g., by rendering augmented portions of the transcription using a visually distinguishable characteristic), thereby conveying the potential uncertainty associated with the displayed ATC clearance communication to the pilot or other aircraft operator.
  • the subject matter described herein may also be utilized to correct or otherwise augment clearance communications that are incomplete or otherwise include indirect reference to a particular operational subject, a particular operational parameter and/or the like.
  • natural language processing or similar artificial intelligence (AI) techniques for syntactical and semantical analysis may be performed on the transcribed textual content of the received audio ATC clearance communication to identify keywords or placeholder terms that refer to a particular operational subject or operational parameter that is relevant to the clearance communication (e.g., a waypoint, runway, taxiway, airway, aircraft or call sign, frequency, altitude, aircraft action, and/or the like).
  • AI artificial intelligence
  • the transcription of the received ATC clearance communication is augmented or otherwise modified to include the relevant names, identifiers, values, and/or the like for the operational subject(s) and/or operational parameter(s) identified within the received ATC clearance communication.
  • an incomplete ATC clearance communication that includes an indirect reference to the departure tower frequency may be analyzed to identify the operational objective as the ground controller initiating a handoff to the departure controller, and based on the applicable phraseology standard(s), an expected ATC clearance communication for initiating the handoff may be identified that includes a particular frequency channel value to which the pilot is expected to tune a communications radio to before contacting the departure tower.
  • the transcription of the received ATC clearance communication may be automatically augmented to include the current radio frequency channel value associated with the departure tower and thereby conform to the expected ATC clearance communication in a manner that is syntactically and semantically consistent with applicable phraseology standard(s).
  • the radio frequency channel value for the augmented content may be determined or otherwise derived from analysis of the current conversational context and/or preceding clearance communications (e.g., by identifying a preceding ATC clearance communication that specifies the tower frequency) or by querying a database or other data storage element for information identifying the departure tower radio frequency channel for the airport where the aircraft is currently located.
  • a graphical representation of the augmented transcription of the ATC clearance may be rendered or otherwise displayed on a display device onboard the aircraft with the augmented content (e.g., the radio frequency channel "121.49”) being rendered using a visually distinguishable characteristic that indicates the augmented content was not part of the originally-received ATC clearance communication.
  • the subject matter described herein may also be utilized to detect and correct indirect call sign references within clearance communications, which may otherwise result in confusion among pilots of different aircraft and/or by the ATC.
  • the controller may initiate or otherwise indicate an abbreviated call sign, such as, for example, a prefix and the last three digits or letters of the aircraft's registration number, or some combination or amalgamation of the aircraft's type, manufacturer name, model name and/or registration number.
  • a table or similar data structure may be created in a database or other data storage element that maintains, for each clearance communication, a call sign for the aircraft associated with the clearance communication, the aircraft model for the aircraft associated with the clearance communication (if available), and one or more tags which may be utilized to identify the next expected clearance for that aircraft (e.g., indicia of the potential operational objective(s) expected for that aircraft).
  • the entries associated with preceding clearance communications are analyzed to identify whether the newly received clearance communication corresponds to the next expected clearance communication associated with a preceding clearance communication entry, for example, by identifying whether the more recent clearance communication is a response to a preceding request clearance communication, whether the more recent clearance communication is a readback, a call back, or other acknowledgment of a preceding clearance communication, whether the more recent clearance communication includes common values for the aircraft model, registration number, or other operational subjects or parameters within the clearance communication, and/or the like.
  • the transcription of the more recently received clearance communication is augmented or otherwise modified to include or otherwise incorporate the full call sign established for that aircraft in a manner that is syntactically and semantically consistent with applicable phraseology standard(s).
  • the database entry associated with the more recently received clearance communication is also updated to maintain an association with the full call sign established for that aircraft.
  • graphical representations of the transcribed clearance communication may include the full sign to reduce the likelihood of any call sign confusion.
  • FIG. 1 depicts an exemplary embodiment of a system 100 which may be utilized with a vehicle, such as an aircraft 120.
  • the system 100 includes, without limitation, a display device 102, one or more user input devices 104, a processing system 106, a display system 108, a communications system 110, a navigation system 112, a flight management system (FMS) 114, one or more avionics systems 116, and a data storage element 118 suitably configured to support operation of the system 100, as described in greater detail below.
  • FMS flight management system
  • the display device 102 is realized as an electronic display capable of graphically displaying flight information or other data associated with operation of the aircraft 120 under control of the display system 108 and/or processing system 106.
  • the display device 102 is coupled to the display system 108 and the processing system 106, and the processing system 106 and the display system 108 are cooperatively configured to display, render, or otherwise convey one or more graphical representations or images associated with operation of the aircraft 120 on the display device 102.
  • the user input device 104 is coupled to the processing system 106, and the user input device 104 and the processing system 106 are cooperatively configured to allow a user (e.g., a pilot, co-pilot, or crew member) to interact with the display device 102 and/or other elements of the system 100, as described in greater detail below.
  • a user e.g., a pilot, co-pilot, or crew member
  • the user input device(s) 104 may be realized as a keypad, touchpad, keyboard, mouse, touch panel (or touchscreen), joystick, knob, line select key or another suitable device adapted to receive input from a user.
  • the user input device 104 includes or is realized as an audio input device, such as a microphone, audio transducer, audio sensor, or the like, that is adapted to allow a user to provide audio input to the system 100 in a "hands free” manner using speech recognition.
  • an audio input device such as a microphone, audio transducer, audio sensor, or the like
  • the processing system 106 generally represents the hardware, software, and/or firmware components configured to facilitate communications and/or interaction between the elements of the system 100 and perform additional tasks and/or functions to support operation of the system 100, as described in greater detail below.
  • the processing system 106 may be implemented or realized with a general purpose processor, a content addressable memory, a digital signal processor, an application specific integrated circuit, a field programmable gate array, any suitable programmable logic device, discrete gate or transistor logic, processing core, discrete hardware components, or any combination thereof, designed to perform the functions described herein.
  • the processing system 106 may also be implemented as a combination of computing devices, e.g., a plurality of processing cores, a combination of a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other such configuration.
  • the processing system 106 includes processing logic that may be configured to carry out the functions, techniques, and processing tasks associated with the operation of the system 100, as described in greater detail below.
  • the steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in firmware, in a software module executed by the processing system 106, or in any practical combination thereof.
  • the processing system 106 includes or otherwise accesses a data storage element (or memory), which may be realized as any sort of non-transitory short or long term storage media capable of storing programming instructions for execution by the processing system 106.
  • the code or other computer-executable programming instructions when read and executed by the processing system 106, cause the processing system 106 to support or otherwise perform certain tasks, operations, functions, and/or processes described herein.
  • the display system 108 generally represents the hardware, software, and/or firmware components configured to control the display and/or rendering of one or more navigational maps and/or other displays pertaining to operation of the aircraft 120 and/or onboard systems 110, 112, 114, 116 on the display device 102.
  • the display system 108 may access or include one or more databases suitably configured to support operations of the display system 108, such as, for example, a terrain database, an obstacle database, a navigational database, a geopolitical database, a terminal airspace database, a special use airspace database, or other information for rendering and/or displaying navigational maps and/or other content on the display device 102.
  • the aircraft system 100 includes a data storage element 118, which contains aircraft procedure information (or instrument procedure information) for a plurality of airports and maintains association between the aircraft procedure information and the corresponding airports.
  • the data storage element 118 may be physically realized using RAM memory, ROM memory, flash memory, registers, a hard disk, or another suitable data storage medium known in the art or any suitable combination thereof.
  • aircraft procedure information should be understood as a set of operating parameters, constraints, or instructions associated with a particular aircraft action (e.g., approach, departure, arrival, climbing, and the like) that may be undertaken by the aircraft 120 at or in the vicinity of a particular airport.
  • An airport should be understood as referring to any sort of location suitable for landing (or arrival) and/or takeoff (or departure) of an aircraft, such as, for example, airports, runways, landing strips, and other suitable landing and/or departure locations, and an aircraft action should be understood as referring to an approach (or landing), an arrival, a departure (or takeoff), an ascent, taxiing, or another aircraft action having associated aircraft procedure information.
  • An airport may have one or more predefined aircraft procedures associated therewith, wherein the aircraft procedure information for each aircraft procedure at each respective airport are maintained by the data storage element 118 in association with one another.
  • the aircraft procedure information may be provided by or otherwise obtained from a governmental or regulatory organization, such as, for example, the Federal Aviation Administration in the United States.
  • the aircraft procedure information comprises instrument procedure information, such as instrument approach procedures, standard terminal arrival routes, instrument departure procedures, standard instrument departure routes, obstacle departure procedures, or the like, traditionally displayed on a published charts, such as Instrument Approach Procedure (IAP) charts, Standard Terminal Arrival (STAR) charts or Terminal Arrival Area (TAA) charts, Standard Instrument Departure (SID) routes, Departure Procedures (DP), terminal procedures, approach plates, and the like.
  • IAP Instrument Approach Procedure
  • STAR Standard Terminal Arrival
  • TAA Terminal Arrival Area
  • SID Standard Instrument Departure
  • DP Departure Procedures
  • the data storage element 118 maintains associations between prescribed operating parameters, constraints, and the like and respective navigational reference points (e.g., waypoints, positional fixes, radio ground stations (VORs, VORTACs, TACANs, and the like), distance measuring equipment, non-directional beacons, or the like) defining the aircraft procedure, such as, for example, altitude minima or maxima, minimum and/or maximum speed constraints, RTA constraints, and the like.
  • navigational reference points e.g., waypoints, positional fixes, radio ground stations (VORs, VORTACs, TACANs, and the like), distance measuring equipment, non-directional beacons, or the like
  • the aircraft procedure such as, for example, altitude minima or maxima, minimum and/or maximum speed constraints, RTA constraints, and the like.
  • the processing system 106 is coupled to the navigation system 112, which is configured to provide real-time navigational data and/or information regarding operation of the aircraft 120.
  • the navigation system 112 may be realized as a global positioning system (GPS), inertial reference system (IRS), or a radio-based navigation system (e.g., VHF omni-directional radio range (VOR) or long range aid to navigation (LORAN)), and may include one or more navigational radios or other sensors suitably configured to support operation of the navigation system 112, as will be appreciated in the art.
  • GPS global positioning system
  • IRS inertial reference system
  • LORAN long range aid to navigation
  • the navigation system 112 is capable of obtaining and/or determining the instantaneous position of the aircraft 120, that is, the current (or instantaneous) location of the aircraft 120 (e.g., the current latitude and longitude) and the current (or instantaneous) altitude or above ground level for the aircraft 120.
  • the navigation system 112 is also capable of obtaining or otherwise determining the heading of the aircraft 120 (i.e., the direction the aircraft is traveling in relative to some reference).
  • the processing system 106 is also coupled to the communications system 110, which is configured to support communications to and/or from the aircraft 120.
  • the communications system 110 may support communications between the aircraft 120 and air traffic control or another suitable command center or ground location.
  • the communications system 110 may be realized using a radio communication system and/or another suitable data link system.
  • the processing system 106 is also coupled to the FMS 114, which is coupled to the navigation system 112, the communications system 110, and one or more additional avionics systems 116 to support navigation, flight planning, and other aircraft control functions in a conventional manner, as well as to provide real-time data and/or information regarding the operational status of the aircraft 120 to the processing system 106.
  • FIG. 1 depicts a single avionics system 116, in practice, the system 100 and/or aircraft 120 will likely include numerous avionics systems for obtaining and/or providing real-time flight-related information that may be displayed on the display device 102 or otherwise provided to a user (e.g., a pilot, a co-pilot, or crew member).
  • avionics systems suitably configured to support operation of the aircraft 120: a weather system, an air traffic management system, a radar system, a traffic avoidance system, an autopilot system, an autothrust system, a flight control system, hydraulics systems, pneumatics systems, environmental systems, electrical systems, engine systems, trim systems, lighting systems, crew alerting systems, electronic checklist systems, an electronic flight bag and/or another suitable avionics system.
  • FIG. 1 is a simplified representation of the system 100 for purposes of explanation and ease of description, and FIG. 1 is not intended to limit the application or scope of the subject matter described herein in any way.
  • FIG. 1 shows the display device 102, the user input device 104, and the processing system 106 as being located onboard the aircraft 120 (e.g., in the cockpit), in practice, one or more of the display device 102, the user input device 104, and/or the processing system 106 may be located outside the aircraft 120 (e.g., on the ground as part of an air traffic control center or another command center) and communicatively coupled to the remaining elements of the system 100 (e.g., via a data link and/or communications system 110).
  • the data storage element 118 may be located outside the aircraft 120 and communicatively coupled to the processing system 106 via a data link and/or communications system 110.
  • practical embodiments of the system 100 and/or aircraft 120 will include numerous other devices and components for providing additional functions and features, as will be appreciated in the art.
  • FIG. 1 shows a single display device 102, in practice, additional display devices may be present onboard the aircraft 120.
  • features and/or functionality of processing system 106 described herein can be implemented by or otherwise integrated with the features and/or functionality provided by the FMS 114. In other words, some embodiments may integrate the processing system 106 with the FMS 114.
  • various aspects of the subject matter described herein may be implemented by or at an electronic flight bag (EFB) or similar electronic device that is communicatively coupled to the processing system 106 and/or the FMS 114.
  • EFB electronic flight bag
  • FIG. 2 depicts an exemplary embodiment of a speech recognition system 200 for transcribing speech, voice commands or any other received audio communications (e.g., broadcasts received from the automatic terminal information service (ATIS)).
  • the speech recognition system 200 is implemented or otherwise provided onboard a vehicle, such as aircraft 120; however, in alternative embodiments, the speech recognition system 200 may be implemented independent of any aircraft or vehicle, for example, at a ground location such as an air traffic control facility. That said, for purposes of explanation, the speech recognition system 200 may be primarily described herein in the context of an implementation onboard an aircraft.
  • the illustrated speech recognition system 200 includes a transcription system 202, an audio input device 204 (or microphone) and one or more communications systems 206 (e.g., communications system 110).
  • the transcription system 202 is also coupled to one or more onboard systems 208 (e.g., one or more avionics systems 108, 110, 112, 114, 116) to provide output signals or other indicia to a desired destination onboard system 208 (e.g., via an avionics bus or other communications medium).
  • onboard systems 208 e.g., one or more avionics systems 108, 110, 112, 114, 116
  • FIG. 2 is a simplified representation of the speech recognition system 200 for purposes of explanation and ease of description, and FIG. 2 is not intended to limit the application or scope of the subject matter described herein in any way.
  • the transcription system 202 generally represents the processing system or component of the speech recognition system 200 that is coupled to the microphone 204 and communications system(s) 206 to receive or otherwise obtain audio clearance communications and other audio communications, analyze the audio content of the clearance communications, and transcribe the audio content of the clearance communications, as described in greater detail below.
  • the transcription system 202 may be implemented as a separate standalone hardware component, while in other embodiments, the features and/or functionality of the transcription system 202 may be integrated with and/or implemented using another processing system (e.g., processing system 106). In this regard, the transcription system 202 may be implemented using any sort of hardware, firmware, circuitry and/or logic components or combination thereof.
  • the transcription system 202 may be realized as a general purpose processor, a content addressable memory, a digital signal processor, an application specific integrated circuit, a field programmable gate array, any suitable programmable logic device, discrete gate or transistor logic, processing core, a combination of computing devices (e.g., a plurality of processing cores, a combination of a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other such configuration), discrete hardware components, or any combination thereof, designed to perform the functions described herein.
  • a combination of computing devices e.g., a plurality of processing cores, a combination of a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other such configuration
  • discrete hardware components or any combination thereof, designed to perform the functions described herein.
  • the audio input device 204 generally represents any sort of microphone, audio transducer, audio sensor, or the like capable of receiving voice or speech input.
  • the audio input device 204 is realized as a microphone (e.g., user input device 104) onboard the aircraft 120 to receive voice or speech annunciated by a pilot or other crewmember onboard the aircraft 120 inside the cockpit of the aircraft 120.
  • the communications system(s) 206 e.g., communications system 110
  • the communications system(s) 206 generally represent the avionics systems capable of receiving clearance communications from other external sources, such as, for example, other aircraft, an air traffic controller, or the like.
  • the communications system(s) 206 could include one or more of a very high frequency (VHF) radio communications system, a controller-pilot data link communications (CPDLC) system, an aeronautical operational control (AOC) communications system, an aircraft communications addressing and reporting system (ACARS), and/or the like.
  • VHF very high frequency
  • CPDLC controller-pilot data link communications
  • AOC aeronautical operational control
  • ACARS aircraft communications addressing and reporting system
  • computer-executable programming instructions are executed by the processor, control module, or other hardware associated with the transcription system 202 and cause the transcription system 202 to generate, execute, or otherwise implement a clearance transcription application 220 capable of analyzing, parsing, or otherwise processing voice, speech, or other audio input received by the transcription system 202 to convert the received audio content into a corresponding textual representation.
  • the clearance transcription application 220 may implement or otherwise support a speech recognition engine (or voice recognition engine) or other speech-to-text system.
  • the transcription system 202 may also include various filters, analog-to-digital converters (ADCs), or the like, and the transcription system 202 may include or otherwise access a data storage element 210 (or memory) that stores a speech recognition vocabulary for use by the clearance transcription application 220 in converting audio inputs into transcribed textual representations.
  • the clearance transcription application 220 may also mark, tag, or otherwise associate a transcribed textual representation of a clearance communication with an identifier or other indicia of the source of the clearance communication (e.g., the onboard microphone 204, a radio communications system 206, or the like).
  • the computer-executable programming instructions executed by the transcription system 202 also cause the transcription system 202 to generate, execute, or otherwise implement a clearance table generation application 222 (or clearance table generator) that receives the transcribed textual clearance communications from the clearance transcription application 220 or receives clearance communications in textual form directly from a communications system 206 (e.g., a CPDLC system).
  • the clearance table generator 222 parses or otherwise analyzes the textual representation of the received clearance communications and generates corresponding clearance communication entries in a table 224 in the memory 210.
  • the clearance table 224 maintains all of the clearance communications received by the transcription system 202 from either the onboard microphone 204 or an onboard communications system 206.
  • the clearance table generator 222 parses or otherwise analyzes the textual content of the clearance communication using natural language processing and attempts to extract or otherwise identify, if present, one or more of an identifier contained within the clearance communication (e.g., a flight identifier, call sign, or the like), an operational subject of the clearance communication (e.g., a runway, a taxiway, a waypoint, a heading, an altitude, a flight level, or the like), an operational parameter value associated with the operational subject in the clearance communication (e.g., the runway identifier, taxiway identifier, waypoint identifier, heading angle, altitude value, or the like), and/or an action associated with the clearance communication (e.g., landing, takeoff, pushback, hold, or the like).
  • an identifier contained within the clearance communication e.g., a flight identifier, call sign, or the like
  • an operational subject of the clearance communication e.g., a runway, a taxiway, a waypoint, a heading,
  • the clearance table generator 222 also identifies the radio frequency or communications channel associated with the clearance communication and attempts to identify or otherwise determine the source of the clearance communication. The clearance table generator 222 then creates or otherwise generates an entry in the clearance table 224 that maintains an association between the textual content of the clearance communication and the identified fields associated with the clearance communication. Additionally, the clearance table generator 222 may analyze the new clearance communication entry relative to existing clearance communication entries in the clearance table 224 to identify or otherwise determine a conversational context to be assigned to the new clearance communication entry (e.g., whether a given communication corresponds to a request, a response, an acknowledgment, and/or the like).
  • the processor, control module, or other hardware associated with the transcription system 202 executes computer-executable programming instructions that cause the transcription system 202 to generate, execute, or otherwise implement a transcription analysis application 230 (or transcription analyzer) capable of analyzing, parsing, or otherwise processing transcriptions of received audio communications along with their associated fields of data maintained in the clearance table 224 to detect or otherwise identify when a respective received audio communication does not comply with phraseology standards information 226 maintained in the data storage element 210.
  • a transcription analysis application 230 or transcription analyzer
  • the phraseology standards information 226 may include reference phraseologies, verbiage, syntactical rules and/or other syntactical information that define or otherwise delineate the applicable phraseology standard(s) for the aircraft at the current geographic location of the aircraft, which may be set forth by the ICAO, the FAA, or another regulatory body or organization.
  • the phraseology standards 226 may be maintained as a syntactic semantic mapping in a set of templates and/or rules that are saved or otherwise stored as a configuration file associated with the transcription analysis application 230.
  • the data storage element 210 may maintain a clearance vocabulary 228 that includes the potential words, alphanumeric values, terms and/or phrases that are likely to be utilized in the context of ATC clearance communications.
  • the transcription analyzer 230 utilizes the applicable phraseology standard(s) 226 in concert with the clearance vocabulary 228 to perform semantical and syntactical analysis, automatically identify discrepancies between a transcribed clearance communication and an expected clearance communication according to the phraseology standard(s) 226, and automatically augment the transcribed clearance communication to mitigate the potential discrepancies with respect to the expected clearance communication.
  • the transcription analyzer 230 generates an augmented transcription of a received audio clearance communication that corrects for usage of nonstandard (or noncompliant) phraseology and/or indirect or incomplete information within the received audio clearance communication.
  • the transcription analyzer 230 may automatically generate, transmit, or otherwise provide output signals indicative of a detected discrepancy to a display system 108, 208 or another onboard system 208 to notify the pilot or initiate other remedial action when a received audio clearance communication includes nonstandard phraseology or incomplete information. Additionally, when the pilot or other operator attempts to review the received audio clearance communication, the transcription analyzer 230 may output or otherwise provide the augmented transcription of a received audio clearance communication that includes augmented content that corrects for nonstandard phraseology and/or incomplete information to a display system 108, 208 or another onboard system 208 to provide a graphical representation of the augmented transcription including the augmented content in lieu of the transcription of the originally received audio clearance communication. In this manner, the augmented transcription generated by the transcription analyzer 230 reduces the likelihood of confusion or other miscommunication during operation of the aircraft.
  • FIG. 3 depicts an exemplary embodiment of a transcription augmentation process 300 suitable for implementation by an aircraft system to augment or otherwise modify transcribed audio communications to comport with applicable phraseology standards.
  • the various tasks performed in connection with the illustrated process may be implemented using hardware, firmware, software executed by processing circuitry, or any combination thereof.
  • the following description may refer to elements mentioned above in connection with FIGS. 1-2 .
  • portions of the transcription augmentation process 300 may be performed by different elements of the aircraft system 100. That said, exemplary embodiments are described herein in the context of the transcription augmentation process 300 being primarily performed by the transcription analyzer 230 at the transcription system 202 and/or the processing system 106.
  • the transcription augmentation process 300 may include any number of additional or alternative tasks, the tasks need not be performed in the illustrated order and/or the tasks may be performed concurrently, and/or the transcription augmentation process 300 may be incorporated into a more comprehensive procedure or process having additional functionality not described in detail herein. Moreover, one or more of the tasks shown and described in the context of FIG. 3 could be omitted from a practical embodiment of the transcription augmentation process 300 as long as the intended overall functionality remains intact.
  • the transcription augmentation process 300 continually monitors and analyzes received audio communications to automatically identify an operational objective for each received audio communication (task 302).
  • the audio content of clearance communications received at the aircraft are continually transcribed into corresponding textual representations (e.g., by the clearance transcription application 220), which, in turn, are then parsed and analyzed to identify the operational subjects and parameters specified within the received sequence of clearance communications pertaining to the aircraft (e.g., by the clearance table generator 222).
  • natural language processing may be applied to the textual representations of the clearance communications directed to the ownship aircraft by ATC, provided by the ownship aircraft to ATC, or received from ATIS to identify the operational subject(s) of the clearance communications and any operational parameter value(s) and/or aircraft action(s) associated with the clearance communications, which are then stored or otherwise maintained in association with the transcribed audio content of the received audio communication in the clearance table 224.
  • the transcription analyzer 230 utilizes natural language processing, machine learning or artificial intelligence (AI) techniques to perform semantic analysis (e.g., parts of speech tagging, position tagging, and/or the like) on the transcribed audio communication to identify the operational objective of the communication.
  • AI artificial intelligence
  • the audio communication is classified into a particular operational objective that indicates what the communication is intended to convey with respect to operation of the aircraft based on the syntax of the operational subject(s), operational parameter(s) and/or action(s) contained within the communication.
  • a particular operational objective that indicates what the communication is intended to convey with respect to operation of the aircraft based on the syntax of the operational subject(s), operational parameter(s) and/or action(s) contained within the communication.
  • an ATC clearance communication of "CLEARED RUNWAY 27L" corresponding to an instruction to takeoff from a particular runway may be classified or otherwise categorized into a takeoff operational objective.
  • the transcription analyzer 230 may utilize the current conversational context and/or transcriptions of preceding audio communications maintained in the clearance table 224 to intelligently determine the most likely operational objective in the context of the preceding communications to/from the aircraft. For example, if a preceding audio communication includes a request by the pilot of the ownship aircraft having a particular operational objective, the transcription analyzer 230 may ascertain a subsequent audio clearance communication received from ATC as a response pertaining to that same operational objective.
  • some embodiments of the transcription analyzer 230 may utilize the current operational context of the aircraft at the time of receipt of the respective audio communication (e.g., the current flight phase, the current airspace or geographic region of operation, the current aircraft configuration, the current aircraft altitude, and/or the like) to identify the most likely or probable operational objective given the current operating context indicated by the onboard systems 208.
  • the current operational context of the aircraft e.g., the current flight phase, the current airspace or geographic region of operation, the current aircraft configuration, the current aircraft altitude, and/or the like
  • the transcription augmentation process 300 automatically generates or otherwise determines an expected reference communication for the identified operational objective using the applicable phraseology standard(s) (task 304).
  • the transcription analyzer 230 utilizes phraseology standard information 226 to identify or otherwise determine the expected syntax for a clearance communication corresponding to the identified operational objective and the particular operational subject(s), operational parameter(s) and/or action(s) that are required or otherwise expected to be specified or declared within the clearance communication.
  • the transcription analyzer 230 may determine the expected ATC clearance communication to include a runway identifier and the call sign for the intended recipient aircraft based on the standard phraseology (e.g., "CLEARED RUNWAY [RUNWAY IDENTIFIER] [AIRCRAFT TAIL NUMBER]").
  • the transcription augmentation process 300 compares the transcription of the received audio communication to the expected clearance communication to detect or otherwise identify whether one or more discrepancies exist (task 306).
  • the transcription analyzer 230 attempts to verify or otherwise confirm that the transcription of the received audio communication includes the required operational subject(s), operational parameter(s) and/or action(s) specified by the phraseology standard(s) for the identified operational objective with the required order or syntax.
  • the transcription augmentation process 300 does not modify or augment the transcribed audio communication and exits or waits for the next subsequent audio communication to be received.
  • the transcription augmentation process 300 When the transcription augmentation process 300 identifies a discrepancy between the transcription of the received audio communication and the expected clearance communication, the transcription augmentation process 300 automatically identifies or otherwise determines the expected or probable content missing from the received audio communication to be utilized when augmenting the transcription of the received audio communication using the current operational context of the aircraft and then automatically augments or otherwise modifies the transcription of the received audio communication to include or otherwise incorporate the expected content and thereby reduce the discrepancy (tasks 308, 310). In this regard, the transcription augmentation process 300 attempts to complete or otherwise correct the transcription of the received audio communication to conform with the applicable phraseology standard(s).
  • the transcription analyzer 230 utilizes the current operational context (e.g., the current flight phase, the current airspace or geographic region of operation, the current aircraft configuration, the current aircraft altitude, and/or the like) to identify the most probable or likely value for that operational subject or parameter based on the current operating state.
  • the transcription analyzer 230 may identify the most probable or likely action given the current operating state.
  • the transcription analyzer 230 may also utilize the current and/or preceding conversational context using the clearance table 224 to determine the probable or expected content for the audio communication.
  • the transcription analyzer 230 may automatically update the transcription of the clearance communication in the entry in the clearance table 224 associated with the respective audio communication to an augmented transcription that includes or otherwise incorporates the probable or expected content with respect to the originally transcribed audio content using a syntax that comports with the applicable phraseology standard(s). Additionally, the transcription analyzer 230 may tag or otherwise mark the entry associated with the respective audio communication in the clearance table 224 to indicate or otherwise delineate the augmented portions of the transcription relative to the portions of originally transcribed audio content.
  • parts of speech tagging and analysis may be performed on the transcription of a received ATC clearance communication "CLEARED RUNWAY 27L” to attempt to match the ATC clearance communication to a reference clearance communication for a takeoff instruction ("CLEARED RUNWAY [RUNWAY IDENTIFIER] [AIRCRAFT TAIL NUMBER]").
  • the transcription augmentation process 300 attempts to complete or otherwise correct the transcription of the received audio communication to include the aircraft identifier for the most likely intended recipient aircraft to conform with the applicable phraseology standard(s).
  • the transcription augmentation process 300 may identify an aircraft on the ground that previously received a taxi clearance to the identified runway as the likely intended recipient of the takeoff instruction. Additionally, or alternatively, the transcription augmentation process 300 may analyze the various locations of aircraft on the ground at the airport to identify the likely intended recipient aircraft of the takeoff instruction based on the relative positions of the aircraft relative to the identified runway.
  • the transcription analyzer 230 may query an airport database or other data storage element (e.g., data storage element 118) to obtain the appropriate identifiers or values to be utilized for a particular operational subject or parameter of interest given the current geographic location and operational state of the aircraft.
  • data storage element e.g., data storage element 118
  • the transcription analyzer 230 may query an airport database to identify the appropriate radio frequency communications channel for the current airport or airspace and then augment the transcription of the received audio communication to include the obtained radio frequency communications channel value in a manner that is syntactically and semantically consistent with the phraseology standard(s).
  • the transcription analyzer 230 may analyze one or more preceding clearance communications in the clearance table 224 to identify a previously communicated identifier or value for a particular operational subject or parameter. For example, when the operational objective corresponds to an ATC assignment for a particular operational subject or parameter and the expected reference clearance communication is required to include an assigned value for that particular subject or parameter which is absent from the received audio communication, the transcription analyzer 230 may analyze one or more preceding clearance communications in the clearance table 224 to identify a preceding ATC assignment issued to another aircraft for that particular operational subject or parameter and utilize the value from that preceding ATC assignment to augment the more recently received audio communication of interest.
  • the transcription analyzer 230 may analyze one or more preceding clearance communications in the clearance table 224 to identify a previously communicated full call sign or identifier associated with that recipient aircraft and then augment or otherwise modify the transcription of the received audio communication to include the full call sign for the intended recipient aircraft in place of the partial, incomplete, or indirect identifier for the intended recipient aircraft.
  • some embodiments of the clearance table 224 may include additional columns or tables that are utilized to track or otherwise maintain call signs and other aircraft information (e.g., type, manufacturer, model, registration number and/or the like) associated with each respective clearance communication. Based on the preceding clearance communications with respect to a particular aircraft, the next expected clearance communication in the sequence of clearance communications with respect to that particular aircraft may be identified and utilized to correlate the received audio communication with that particular aircraft, and thereby identify or derive the full call sign for the intended recipient aircraft to be included in the received audio communication as the full call sign that was previously established for that particular aircraft.
  • aircraft information e.g., type, manufacturer, model, registration number and/or the like
  • the transcription analyzer 230 may utilize the current operational context to predict identifiers or values to be utilized for a particular operational subject or parameter of interest based on the current state of the aircraft and other data and/or information pertaining to the current environment, airspace or geographic region where the aircraft is operating. In this regard, when the expected reference clearance communication is missing a value defining a condition of performing a particular action according to the phraseology standard(s), transcription analyzer 230 may predict or otherwise determine the probable value for that condition.
  • the transcription analyzer 230 may predict or otherwise determine the probable value(s) for augmenting the transcription of the ATC clearance command based on the current operational context. If the aircraft is currently taxiing on a taxiway that intersects a runway ahead of the aircraft's current location on the taxiway, the transcription analyzer 230 predict the ATC likely intended to specify the next runway the aircraft is likely to encounter and augment the transcription of the ATC clearance command to append the runway identifier for the probable runway to the hold short command (e.g., "Hold Short of R25").
  • ATC clearance command indicates a temporal conditional dependency (e.g., "Hold for,” “Wait for,” etc.)
  • the transcription analyzer 230 may calculate or otherwise predict the values for that temporary conditional dependency based on data and/or information pertaining to the current or recent air traffic in the vicinity of the current geographic location and/or within the current airspace, such as, for example, automatic dependent surveillance - broadcast (ADS-B) data obtained via an onboard system 208.
  • ADS-B automatic dependent surveillance - broadcast
  • the transcription analyzer 230 may identify or otherwise determine the other aircraft that was likely intended to be specified by the ATC and augment the transcription of the ATC clearance command to include the full call sign associated with the identified aircraft in connection with the conditional command (e.g., "Wait for Traffic BA1752").
  • the transcription analyzer 230 may calculate or otherwise predict a duration for the conditional dependency based on the flight paths, taxi clearances, preceding clearance communications and/or the like and augment the transcription of the ATC clearance command to include the predicted duration (e.g., "Wait for 2 minutes").
  • the transcription augmentation process 300 transmits, outputs, or otherwise provides one or more notifications of the detected discrepancy associated with the received audio communication (task 312).
  • the transcription system 202 and/or the transcription analyzer 230 may provide a command, signal or other instruction to a display system (e.g., display system 108) or another onboard system 208 that causes the destination onboard system 208 to provide one or more graphical indicia on a display device (e.g., display device 102) that includes text that notifies the pilot or other aircraft operator that the received audio communication did not comply with the applicable phraseology standard(s) or otherwise deviated from what was expected to be received.
  • the transcription system 202 and/or the transcription analyzer 230 may provide notification or indication of the discrepancy by rendering the augmented portion of the augmented transcription of the received audio communication using a visually distinguishable characteristic (e.g., a color, font weight, underlining, or the like) to provide a visual cue that a depicted audio communication transcription did not comply with the applicable phraseology standard(s) or otherwise deviated from the expected communication.
  • a pilot may exercise increased caution and/or initiate one or more remedial actions with respect to the received audio communication (e.g., by requesting clarification or confirmation of the received audio communication).
  • the transcription augmentation process 300 also outputs, generates or otherwise provides commands or signals corresponding to the augmented transcription of the received audio communication to one or more onboard systems (task 314).
  • the transcription system 202 and/or the transcription analyzer 230 may provide a command, signal or other instruction that includes the augmented content to the onboard system 208 for implementation and/or execution.
  • the transcription system 202 and/or the transcription analyzer 230 may transmit or otherwise provide the augmented transcription of the received clearance communication to a display system 108, 208 to render or otherwise depict a graphical represented of the augmented transcription of the received audio clearance communication that includes the augmented content identified by transcription analyzer 230.
  • the transcription system 202 and/or the transcription analyzer 230 may transmit or otherwise provide commands, signals or instructions corresponding to the augmented transcription of the received clearance communication to another onboard system 208 to effectuate the augmented content identified by transcription analyzer 230 at that destination onboard system 208.
  • the transcription system 202 and/or the transcription analyzer 230 may transmit or otherwise provide commands, signals or instructions indicative of the probable radio frequency channel identified by the transcription analyzer 230 to a communication system 110, 208 facilitate utilization of the augmented radio frequency channel at the communication system 110, 208.
  • the transcription system 202 and/or the transcription analyzer 230 may transmit or otherwise provide commands, signals or instructions indicative of the augmented values identified by the transcription analyzer 230 to the FMS 114, 208 facilitate utilization of the augmented values at the FMS 114, 208 (e.g., to update a flight plan, a taxi clearance, and/or the like).
  • FIG. 4 depicts an exemplary navigational map graphical user interface (GUI) displays that may be displayed, rendered, or otherwise presented by a display system 108 and/or a processing system 106 on a display device 102 onboard an aircraft 120 in connection with the transcription augmentation process 300 of FIG. 3 .
  • GUI navigational map graphical user interface
  • FIG. 4 depicts a three-dimensional forward-looking perspective view navigational map GUI display 400 (e.g., a synthetic vision display, a primary flight display, or the like); however, it should be appreciated the subject matter described herein is not limited to any particular type or configuration of GUI displays and may be implemented in an equivalent manner in the context of two-dimensional lateral map displays, vertical profile displays or vertical situation displays, or any other sort of GUI display that may be presented in connection with operation of an aircraft or other vehicle.
  • GUI navigational map graphical user interface
  • the navigational map GUI display 400 includes a graphical representation 402 of the aircraft overlaid or rendered on top of a background 404, which generally includes a graphical representation of the terrain, topology, navigational reference points, airspace designations and/or restrictions, or other suitable items or points of interest corresponding to the currently displayed area of the map 400, which may be maintained in a terrain database, a navigational database, a geopolitical database, or another suitable database (e.g., database 118).
  • the geographic location of the map 400 corresponding to the middle or center of the map 400 corresponds to the current geographic location of the aircraft to maintain the displayed area of the map 400 centered on the aircraft symbology 402.
  • the map 400 may be associated with the movement of the aircraft, and the aircraft symbology 402 and/or background 404 refreshes or otherwise updates as the aircraft travels, such that the graphical representation of the aircraft 402 is positioned over the terrain background 404 in a manner that accurately reflects the current (e.g., instantaneous or substantially real-time) real-world positioning of the aircraft relative to the Earth.
  • the navigational map display 400 includes a graphical representation 406 of an augmented transcription of the received audio of an original ATC clearance communication consisting of the words "Contact Departure” in connection with the transcription augmentation process 300.
  • the transcription analyzer 230 and/or the transcription augmentation process 300 may automatically determine the operational objective associated with the ATC clearance communication was to initiate a handoff to the departure controller (task 302).
  • the transcription analyzer 230 and/or the transcription augmentation process 300 utilizes the applicable phraseology standard(s) 226 and clearance vocabulary 228 to determine an expected reference ATC clearance communication that includes a specified radio frequency channel value for the destination controller that the aircraft is being handed off to (e.g., "Contact Departure [assigned frequency placeholder]") (task 304).
  • the transcription analyzer 230 and/or the transcription augmentation process 300 Based on the absence of a specified value for the assigned frequency operational parameter within the originally received ATC clearance communication at the syntactical position of the assigned frequency operational parameter value placeholder within the expected reference ATC clearance communication, the transcription analyzer 230 and/or the transcription augmentation process 300 automatically detects or otherwise identifies a discrepancy associated with the received ATC clearance communication (e.g., task 306).
  • the transcription analyzer 230 and/or the transcription augmentation process 300 automatically identifies the departure tower radio frequency channel value associated with the current airport and/or airspace, for example, by querying a database and/or analyzing preceding clearance communications including ATC commands for handoffs to the departure tower (task 308).
  • the transcription analyzer 230 and/or the transcription augmentation process 300 automatically augments the transcription of the received ATC clearance communication to append the identified value for the assigned frequency operational parameter value placeholder of the expected ATC clearance communication to the originally transcribed content of the received ATC clearance communication (e.g., "Contact Departure 121.49") (task 310). Thereafter, when the pilot attempts to review the received ATC clearance communication on the display device 102, the transcription analyzer 230 and/or the transcription augmentation process 300 may provide the augmented transcription of the ATC clearance communication to the display system 108, 208, which, in turn renders the graphical representation 406 of the augmented transcription overlying the navigational map 400 (task 312).
  • the identified value for the assigned frequency operational parameter value placeholder of the expected ATC clearance communication e.g., "Contact Departure 121.49”
  • the transcription analyzer 230 and/or the transcription augmentation process 300 may provide the augmented transcription of the ATC clearance communication to the display system 108, 208, which, in turn renders the
  • the transcription analyzer 230 and/or the transcription augmentation process 300 may tag or otherwise indicate the augmented portion of the augmented transcription, such that the graphical representation of the augmented portion 408 (e.g., the radio frequency channel value 121.49) is rendered using one or more different visually distinguishable characteristics relative to the rendering of the remaining original portion of the transcription (task 310), thereby conveying to the pilot that the received ATC clearance communication did not comport with the applicable phraseology standard(s) or otherwise deviated from the syntax of the expected handoff instruction.
  • the graphical representation of the augmented portion 408 e.g., the radio frequency channel value 121.49
  • the augmented portion 408 may be rendered using yellow, red, or another color intended to convey a higher level of caution to the pilot while rendering the remaining portion of the graphical representation of the transcribed ATC clearance communication using a normal color (e.g., black).
  • a normal color e.g., black
  • FIG. 5 depicts another exemplary embodiment of a navigational map GUI display 500 that may be displayed, rendered, or otherwise presented by a display system 108 and/or a processing system 106 on a display device 102 onboard an aircraft 120 in connection with the transcription augmentation process 300 of FIG. 3 .
  • the navigational map display 500 includes a graphical representation 506 of an augmented transcription of the received audio of an original ATC clearance communication consisting of the words "Follow Traffic on the Runway" in connection with the transcription augmentation process 300.
  • the transcription analyzer 230 and/or the transcription augmentation process 300 may automatically determine the operational objective associated with the ATC clearance communication was to follow a particular aircraft on a particular runway or taxiway. Based on the operational objective, the transcription analyzer 230 and/or the transcription augmentation process 300 utilizes the applicable phraseology standard(s) 226 and clearance vocabulary 228 to determine an expected reference ATC clearance communication that includes a call sign for the aircraft to be followed (e.g., "Follow Traffic [call sign]”) and a valid runway or taxiway identifier.
  • a call sign for the aircraft to be followed e.g., "Follow Traffic [call sign]
  • the transcription analyzer 230 and/or the transcription augmentation process 300 automatically detects or otherwise identifies a discrepancy associated with the received ATC clearance communication.
  • the transcription analyzer 230 and/or the transcription augmentation process 300 Based on the current location of the ownship aircraft and other aircraft in the vicinity of the aircraft, the transcription analyzer 230 and/or the transcription augmentation process 300 automatically identifies the probable or predicted aircraft to be followed by the ownship aircraft that is ahead of the ownship aircraft (e.g., by using the taxi clearance for the ownship aircraft) and then automatically augments the transcription of the received ATC clearance communication to append the full call sign for the identified aircraft value for the call sign placeholder of the expected ATC clearance communication to the originally transcribed content of the received ATC clearance communication (e.g., "Follow Traffic BA1752").
  • the transcription analyzer 230 and/or the transcription augmentation process 300 automatically identifies the probable or predicted aircraft to be followed by the ownship aircraft that is ahead of the ownship aircraft (e.g., by using the taxi clearance for the ownship aircraft) and then automatically augments the transcription of the received ATC clearance communication to append the full call sign for the identified aircraft value for the call sign placeholder of the expected
  • the transcription analyzer 230 and/or the transcription augmentation process 300 automatically determines the runway identifier that was expected to be provided in the received ATC clearance communication (e.g., based on the runway the identified aircraft BA1752 is currently on or taxing towards) and augments the transcription of the received ATC clearance communication to include the runway identifier in addition to the traffic call sign (e.g., "Follow Traffic BA1752 on Runway 28").
  • the traffic call sign e.g., "Follow Traffic BA1752 on Runway 28"
  • the transcription analyzer 230 and/or the transcription augmentation process 300 provides the augmented transcription of the ATC clearance communication to the display system 108, 208, which, in turn renders the graphical representation 506 of the augmented transcription overlying the navigational map 400, with the graphical representations of the augmented portions 508, 510 being rendered using one or more different visually distinguishable characteristics relative to the rendering of the remaining original portion of the transcription to convey that the identified aircraft and runway were not part of the originally received ATC clearance communication.
  • a pilot may exercise increased caution and/or initiate one or more remedial actions with respect to the received audio communication (e.g., by requesting clarification or confirmation of the runway, etc.).
  • FIG. 6 depicts another exemplary embodiment of a navigational map GUI display 600 that may be displayed, rendered, or otherwise presented by a display system 108 and/or a processing system 106 on a display device 102 onboard an aircraft 120 in connection with the transcription augmentation process 300 of FIG. 3 .
  • the navigational map display 600 includes a graphical representation 606 of an augmented transcription of the received audio of an original ATC clearance communication consisting of the words "Hold Short of Runway 25" in connection with the transcription augmentation process 300.
  • FIG. 6 depicts another exemplary embodiment of a navigational map GUI display 600 that may be displayed, rendered, or otherwise presented by a display system 108 and/or a processing system 106 on a display device 102 onboard an aircraft 120 in connection with the transcription augmentation process 300 of FIG. 3 .
  • the navigational map display 600 includes a graphical representation 606 of an augmented transcription of the received audio of an original ATC clearance communication consisting of the words "Hold Short of Runway 25" in connection with the transcription augmentation process
  • the transcription analyzer 230 and/or the transcription augmentation process 300 automatically calculates or otherwise determines a predicted duration for the hold short instruction based on the current operational context.
  • the transcription analyzer 230 may calculate or otherwise predict a value for the hold short duration based on one of more of the current geographic location of other nearby aircraft, the flight paths, taxi clearances, or the like associated with other aircraft in the vicinity of the ownship aircraft and/or the current conversational context and sequence of preceding clearance communications, and/or the like.
  • the transcription analyzer 230 and/or the transcription augmentation process 300 automatically augments the transcription of the received ATC clearance communication to append the predicted hold short duration to the originally transcribed content of the received ATC clearance communication (e.g., "Hold Short of Runway 25 for 2 minutes").
  • the augmented transcription of the ATC clearance communication is provided to the display system 108, 208, which, in turn renders the graphical representation 606 of the augmented transcription overlying the navigational map 600, with the graphical representations of the augmented portion 608 being rendered using one or more different visually distinguishable characteristics relative to the rendering of the remaining original portion of the transcription.
  • FIG. 7 depicts another exemplary embodiment of a navigational map GUI display 600 that may be displayed, rendered, or otherwise presented by a display system 108 and/or a processing system 106 on a display device 102 onboard an aircraft 120 in connection with the transcription augmentation process 300 of FIG. 3 .
  • FIG. 7 depicts a scenario where the transcription analyzer 230 and/or the transcription augmentation process 300 is unable to identify or otherwise determine content for augmenting the received audio communication.
  • the transcription analyzer 230 and/or the transcription augmentation process 300 presents or otherwise provides a notification 706 that the received audio communication did not comply with the applicable phraseology standard(s) 226 and/or deviates from the expected clearance communication in concert with providing a graphical representation of the transcription of the received audio communication.
  • the notification 706 may include explanatory information that explains or otherwise indicates the discrepancies associated with the received audio communication or how or why the current operational context was unable to be utilized to augment or resolve the discrepancies.
  • the pilot or other aircraft operator may be apprised of the potential issues associated with the received audio communication, thereby allowing the pilot to request clarification or confirmation of the received audio communication or otherwise initiate one or more remedial actions rather than acting on the received audio communication without awareness of the discrepancy.
  • embodiments of the subject matter described herein can be stored on, encoded on, or otherwise embodied by any suitable non-transitory computer-readable medium as computer-executable instructions or data stored thereon that, when executed (e.g., by a processing system), facilitate the processes described above.
  • Coupled means that one element/node/feature is directly or indirectly joined to (or directly or indirectly communicates with) another element/node/feature, and not necessarily mechanically.
  • drawings may depict one exemplary arrangement of elements directly connected to one another, additional intervening elements, devices, features, or components may be present in an embodiment of the depicted subject matter.
  • certain terminology may also be used herein for the purpose of reference only, and thus are not intended to be limiting.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Traffic Control Systems (AREA)
EP22178408.5A 2021-06-16 2022-06-10 Verfahren und systeme zur kontextuellen transkriptionserweiterung Pending EP4105914A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN202111026764 2021-06-16
US17/412,012 US20220406194A1 (en) 2021-06-16 2021-08-25 Contextual transcription augmentation methods and systems

Publications (1)

Publication Number Publication Date
EP4105914A1 true EP4105914A1 (de) 2022-12-21

Family

ID=82020018

Family Applications (1)

Application Number Title Priority Date Filing Date
EP22178408.5A Pending EP4105914A1 (de) 2021-06-16 2022-06-10 Verfahren und systeme zur kontextuellen transkriptionserweiterung

Country Status (1)

Country Link
EP (1) EP4105914A1 (de)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3009759A1 (fr) * 2013-08-13 2015-02-20 Airbus Operations Sas Procede et dispositif de gestion automatique de messages atis
US20160155435A1 (en) * 2013-11-14 2016-06-02 Honeywell International Inc. Aircraft systems and methods for reducing and detecting read-back and hear-back errors
KR102003321B1 (ko) * 2018-05-03 2019-07-24 아시아나아이디티 주식회사 항공 정보 메시지 분석 방법 및 장치
US20190244528A1 (en) * 2018-02-08 2019-08-08 Honeywell International Inc. Methods and systems for mitigating clearance ambiguities

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3009759A1 (fr) * 2013-08-13 2015-02-20 Airbus Operations Sas Procede et dispositif de gestion automatique de messages atis
US20160155435A1 (en) * 2013-11-14 2016-06-02 Honeywell International Inc. Aircraft systems and methods for reducing and detecting read-back and hear-back errors
US20190244528A1 (en) * 2018-02-08 2019-08-08 Honeywell International Inc. Methods and systems for mitigating clearance ambiguities
KR102003321B1 (ko) * 2018-05-03 2019-07-24 아시아나아이디티 주식회사 항공 정보 메시지 분석 방법 및 장치

Similar Documents

Publication Publication Date Title
US11238742B2 (en) Methods and systems for mitigating clearance ambiguities
EP3321916A2 (de) Systeme und verfahren zur kontextuellen markierung von daten auf einer fahrzeuganzeige
US10543931B2 (en) Method and system for contextually concatenating display, aural, and voice alerts
CN108630019B (zh) 用于渲染供atc条件许可指令使用的飞机驾驶舱显示的系统和方法
US20220343897A1 (en) Adaptive speech recognition methods and systems
US11973570B2 (en) Methods and systems for assisting radio frequency selection
US20220406194A1 (en) Contextual transcription augmentation methods and systems
EP3889947A1 (de) System und verfahren zur unterstützung des piloten durch clearance-wiedergabe
US20230392954A1 (en) Vehicle systems and related message prioritization methods
EP4095853B1 (de) Dynamische spracherkennungsverfahren und systeme mit benutzerkonfigurierbarer leistung
EP4105914A1 (de) Verfahren und systeme zur kontextuellen transkriptionserweiterung
US11688390B2 (en) Dynamic speech recognition methods and systems with user-configurable performance
US20240143937A1 (en) Transcription systems and methods for challenging clearances
EP4372721A1 (de) Transkriptionssysteme und verfahren für schwierige spalten
US11967306B2 (en) Contextual speech recognition methods and systems
EP4276794A1 (de) Transkriptionssysteme und damit zusammenhängende ergänzungsverfahren
US20230368682A1 (en) Transcription systems and related supplementation methods
US20220388630A1 (en) Speech recognition methods and systems with contextual keyword mapping
EP4210047A1 (de) Kontextabhängige, bearbeitbare spracherkennungsverfahren und -systeme
US11955012B2 (en) Transcription systems and message fusion methods
EP4120222A1 (de) Transkriptionssysteme und nachrichtenfusionsverfahren
US20230215431A1 (en) Contextual editable speech recognition methods and systems
EP4290498A1 (de) Fahrzeugsysteme und zugehörige nachrichtenpriorisierungsverfahren
EP4210021A1 (de) Systeme und verfahren zum hinzufügen relevanter daten zu atc-transkriptionsnachrichten
US12020578B2 (en) Systems and methods for adding relevant data to ATC transcription messages

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230421

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230609

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR