CN111210825A - Method and device for enhancing situational awareness perception of ground-air communication controller - Google Patents
Method and device for enhancing situational awareness perception of ground-air communication controller Download PDFInfo
- Publication number
- CN111210825A CN111210825A CN201911296392.XA CN201911296392A CN111210825A CN 111210825 A CN111210825 A CN 111210825A CN 201911296392 A CN201911296392 A CN 201911296392A CN 111210825 A CN111210825 A CN 111210825A
- Authority
- CN
- China
- Prior art keywords
- flight
- call
- voice
- communication
- air
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 113
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000002708 enhancing effect Effects 0.000 title claims abstract description 23
- 230000008447 perception Effects 0.000 title claims abstract description 18
- 238000012545 processing Methods 0.000 claims abstract description 52
- 238000004458 analytical method Methods 0.000 claims abstract description 20
- 238000004364 calculation method Methods 0.000 claims abstract description 14
- 238000012544 monitoring process Methods 0.000 claims description 17
- 230000010006 flight Effects 0.000 claims description 10
- 238000007726 management method Methods 0.000 claims description 7
- 239000000284 extract Substances 0.000 claims description 5
- 230000001105 regulatory effect Effects 0.000 claims description 5
- 230000001174 ascending effect Effects 0.000 claims description 3
- 230000003044 adaptive effect Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000009825 accumulation Methods 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 230000004083 survival effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0043—Traffic management of multiple aircrafts from the ground
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a method and a device for enhancing situational awareness of an air-ground communication controller in the field of air traffic control, wherein the method comprises the following steps: obtaining a managed flight list; when a controller calls up or a pilot calls down, collecting call voice according to a calculation period, and accumulating the collected call voice into voice flow; converting the voice stream into text information according to a calculation period; extracting a digital text in the text information, and converting the digital text into a real-time communication flight number; and outputting reminding information comprising the real-time communication flight number. The device comprises: the system comprises a ground-air communication voice and control signal access module, an air traffic control voice recognition module, an air traffic control data processing module, a flight number analysis module and a communication flight target display module. The invention enhances the air situation perception for the ground-air communication when the controller commands the airplane, can effectively prevent the controller from sending instructions by mistake, finds the mislistening and misanswering condition of the pilot in time and improves the control safety level.
Description
Technical Field
The invention relates to the field of air traffic control, in particular to a method and a device for enhancing situational awareness perception of an air-ground communication controller.
Background
The existing air traffic control command mode is a human-in-loop mode, namely, a controller carries out command control in a voice conversation mode by depending on a ground-air VHF radio station according to the real-time air situation of fusion monitoring information, flight plan, meteorological information and the like provided by an air traffic control automation system (ATC).
The air situation provided by the air traffic control automation system is displayed in a two-dimensional mode, the position of a flight is displayed on an airway/chart, and the character information such as the number, the height, the speed and the like of the flight is displayed in a data label mode. This requires the controller to develop four-dimensional (three-dimensional position + time) aircraft dynamics in the brain to determine if the safety interval is controllable and various regulatory commands that need to be issued to maintain the safety interval, issue control commands in the form of ground-to-air VHF radio calls, and confirm if the pilot understands the commands without error by monitoring the pilot's repeat.
In the prior art, Rodgersi Watts corporation produced a digital direction finder for air traffic control
DDF04E, when the controller communicates with the pilot, the direction of the radio is monitored by the digital direction-finding machine of the air traffic control, so as to detect which flight the controller communicates with the pilot, and the detected flight number in the communication is highlighted on the radar display to remind the pilot of the flight in the communication, thereby enhancing the ground-air communication scene perception of the controller.
However, the flight information in conversation is acquired by adopting a radio direction finding mode, more than three digital direction finding machines are required to be arranged to locate the direction of the radio, and a matched server, a display unit and a local area network are required to purchase and maintain the system, so that the price is high, and the cost is high. In addition, in a high-altitude airspace, the distance between flights is more than 20 kilometers, the system is more accurate in positioning, but in a low-altitude airspace, the distances between flights are short, and the existing digital direction finder has errors and low reliability in accurate orientation of the flights.
Disclosure of Invention
In order to enhance the situation and scene perception capability of a controller during ground-air communication, provide a reminder of a flight in communication for the controller in real time and overcome the defects in the technology, the invention designs a method and a device for enhancing the situation and scene awareness perception of the ground-air communication controller based on air-traffic control voice recognition, which fully utilize the existing ground-air communication facilities, reduce the construction cost and improve the air-traffic control safety level and the control efficiency.
In order to achieve the above purpose, the invention provides the following technical scheme:
a method for enhancing situational awareness perception of an air-ground call controller comprises the following steps:
obtaining a managed flight list, wherein the managed flight list comprises flight numbers of managed aircrafts in a managed sector;
when a controller calls up or a pilot calls down, collecting call voice according to a calculation period, and accumulating the collected call voice into voice flow;
converting the voice stream into text information according to a calculation period;
extracting a digital text in the text information, and converting the digital text into a real-time communication flight number;
and when the real-time communication flight number exists in the managed flight list, outputting reminding information comprising the real-time communication flight number.
The method of the invention also comprises the following steps:
when the ascending communication of a controller is finished or the descending communication of a pilot is finished, the whole voice is converted into the whole text information;
extracting the numbers in the whole text information and converting the numbers into communication flight numbers;
and when the communication flight number exists in the managed flight list, outputting reminding information comprising the communication flight number.
As a preferred scheme, the step of extracting the digital text in the text message and converting the digital text into the real-time communication flight number comprises the following steps:
extracting characters before the digital text, and searching an airline call sign corresponding to the characters before the digital text in a preset airline call sign corresponding table;
converting the digital text into a flight number according to a corresponding table of numbers in the preset flight number and calling numbers;
and combining the searched airline call number and the flight number into a real-time communication flight number.
Preferably, the list of controlled flights is generated from flight data including monitoring track data, control sector configuration data, and flight plans.
As a preferred scheme, the value range of the calculation period is more than or equal to 20ms and less than or equal to 60 ms.
Based on the same conception, the invention also provides a device for enhancing situational awareness perception of the ground-air communication controller, which comprises the following components: ground-to-air communication voice and control signal access module, air traffic control voice recognition module, air traffic control data processing module, flight number analysis module and communication flight target display module, wherein:
the ground-air communication voice and control signal access module receives uplink communication voice or downlink communication voice between a controller and a pilot in real time through an air pipe voice system, and outputs the uplink communication voice or the downlink communication voice to the air pipe voice recognition module in real time; the ground-to-air communication voice and control signal access module also receives PTT key state information, and judges whether the communication voice between the controller and the pilot is the controller uplink communication or the pilot downlink communication according to the PTT key state information;
the air traffic control data processing module receives flight data through the air traffic control system, generates a controlled flight list of a controlled sector according to the flight data, and outputs the controlled flight list of the controlled sector to the communication flight target display module, wherein the flight data comprises monitoring track data, controlled sector configuration data and a flight plan;
the air traffic control voice recognition module receives the ground-air communication voice and the uplink communication voice or the downlink communication voice output by the control signal access module in real time, collects the communication voice according to the calculation period, accumulates the collected communication voice into a voice stream, converts the voice stream into text information according to the calculation period, and outputs the text information to the flight number analysis module;
the flight number analyzing module receives the text information output by the air traffic control voice recognition module, extracts a flight number from the text information, and outputs the flight number to the communication flight destination display module, wherein the flight number comprises an airline calling number and a flight number;
the communication flight target display module receives the flight number output by the flight number analysis module, receives the managed sector controlled flight list output by the air traffic control data processing module, is used for searching whether a flight number exists in the managed sector controlled flight list, and outputs reminding information comprising the flight number when the flight number is searched.
As a preferred scheme, the ground-to-air communication voice and control signal access module also receives PTT key state information, and judges whether the communication voice between the controller and the pilot is the controller uplink communication or the pilot downlink communication according to the PTT key state information.
As a preferred solution, the step of generating the list of the managed flights of the managed sector by the air traffic data processing module includes:
decoding the flight data, and extracting a track number, a flight number and position information to form a track list;
receiving the configuration information of a control sector of the existing air traffic control system in real time;
and selecting the controlled flight from the flight path list according to the physical geometry of the control sector in the control sector configuration information to generate a controlled flight path list of the control sector.
As a preferred scheme, the flight number analyzing module extracts the flight number from the text information according to a prestored airline calling number corresponding table, a prestored correspondence table of numbers and calling numbers in flight numbers, a correspondence table of letters and calling words in the flight number and a correspondence table of the management unit name and calling number abbreviation, and the steps comprise:
using the airline call signs in the airline call sign correspondence table as keywords, sequentially searching whether the text information has matched airline call signs, and storing the matched airline call signs when the text information has the matched airline call signs;
extracting the numbers behind the matched airline call signs in the text information, and storing the numbers behind the matched airline call signs;
the numbers following the matched airline call sign and the matched airline call sign are converted to the form of the flight number in the flight plan.
The invention also provides electronic equipment for enhancing situational awareness perception of an air-ground call controller, which comprises: a power supply, a processor, a memory, a built-in display, a sound acquisition card and an external interface, wherein,
the power supply is used for supplying power to the electronic equipment;
the processor executes any one of the methods;
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform any of the methods described above;
the built-in display is used for displaying a map, a track target and reminding information of the real-time communication flight number;
the sound acquisition card is used for acquiring the input ground-to-air conversation voice;
the external interface is connected with the air traffic control system and is used for acquiring the controlled flight list.
Compared with the prior art, the invention has the beneficial effects that:
(1) the method has the advantages that the empty situation perception is enhanced for the ground-air communication when the controller commands the airplane, the controller can be effectively prevented from issuing instructions by mistake, the situations that the pilot listens to the wrong answer and the like in time are found, and the control safety level is improved.
(2) The invention can achieve the effect of reminding the flight number in a radio direction finding mode by accessing a device for enhancing situational awareness perception of the ground-air communication controller into the existing system, does not need to additionally increase expensive communication equipment, does not need to greatly modify the existing communication system and the air traffic control system, and has low cost.
(3) The method and the device can still accurately remind the flight number in the conversation in a striking way in the low-altitude airspace, and are superior to the prior technical scheme in the low-altitude airspace.
Drawings
Fig. 1 is a flowchart of a method for enhancing situational awareness of an air-ground call controller in embodiment 1 of the present invention;
fig. 2 is a logic processing flow chart of a method for enhancing situational awareness of an air-ground traffic controller in embodiment 1 of the present invention;
FIG. 3 is a schematic diagram showing the functional modules of the apparatus in embodiment 1 of the present invention;
FIG. 4 is a schematic view of the structure of an apparatus in example 1 of the present invention;
FIG. 5 is a schematic diagram of a display for enhancing situational awareness in example 1 of the present invention;
FIG. 6 is a schematic diagram of the composition of a managed flight list according to embodiment 1 of the present invention;
fig. 7 is a table of replacing last-digit numbers of shifts in embodiment 1 of the present invention.
Detailed Description
The present invention will be described in further detail with reference to test examples and specific embodiments. It should be understood that the scope of the above-described subject matter is not limited to the following examples, and any techniques implemented based on the disclosure of the present invention are within the scope of the present invention.
Example 1
The invention aims to design a method for enhancing situational awareness perception of a ground-air communication controller based on air traffic control voice recognition, which adopts the air traffic control voice recognition technology to continuously recognize flight numbers corresponding to an uplink communication of the controller and a downlink communication of a pilot, and displays the flight numbers in a striking way to remind the controller of the current flight in communication as long as the corresponding flight numbers are recognized without waiting for the completion of the communication, so as to avoid the situations of mistaken listening and answering of the communication and the like, wherein the flow of the method is shown in figure 1. In this embodiment, a logic processing flowchart of a detailed flowchart of a method for enhancing situational awareness perception of an air-ground call controller is shown in fig. 2, and the main processes are as follows:
And 4, step 4: and (3) controlling uplink call voice recognition processing: performing voice recognition on the voice accumulation of the continuously received controller calls, and turning to the step 6 for processing as long as the text is recognized to contain the flight number; and if the controller call is detected to be finished, carrying out voice recognition on the whole-sentence controller call, if the recognized text comprises the flight number, turning to the step 6 for processing, and otherwise, turning to the step 1.
And 5, pilot downlink call voice recognition processing: performing voice recognition on the accumulated voice of the continuously received pilot calls, and turning to the step 6 for processing as long as the recognized text contains the flight number; and if the pilot communication is detected to be finished, performing voice recognition on the whole pilot communication, if the recognized text comprises the flight number, turning to the step 6 for processing, and otherwise, turning to the step 1.
And 6, displaying the current communication flight: and searching the identified flight number in the managed track list of the management sector, and if the flight number exists, displaying the flight number in a striking mode to remind a controller to pay attention. Turning to the step 1.
The functional module composition of the system of the invention is shown in fig. 3. The module composition and detailed processing mode are as follows:
1. the ground-to-air communication voice and control signal access module 101: the method comprises the steps of accessing uplink and downlink call voices between a controller and a pilot in real time through an air pipe call system, and receiving a call handle PTT (push To talk) key on-off state signal for distinguishing the start-stop time of the uplink and downlink voices. The method comprises the following processing procedures:
1.1 voice data recording: the air traffic control voice data is analog audio signals, recorded by adopting a self-contained sound card Line-In or external sound card mode of a computer, set to be 16000bps (adaptive parameter) sampling rate and 16-bit (adaptive parameter) quantized audio signals.
1.2 receiving a ground-to-air call control signal: the ground-air communication generally adopts a Very High Frequency (VHF) radio station, is a half-duplex communication mode, controls uplink and downlink communication by adopting E & M5 type control signaling, and a controller in an air traffic control system utilizes an air traffic control internal telephone terminal to communicate with an external radio station through an internal telephone server. As shown in fig. 3, when the controller needs to talk, the PTT button of the floor-to-floor talk handle is pressed, and the button is released after the talk is over. The PTT key signal line is a physical switch, is short-circuited with the signal ground when being pressed, is open-circuited with the signal ground when being released, and maintains 3V-5V level when the PTT key signal line is open-circuited. In order to avoid influencing normal communication control, the scheme adopts a photoelectric coupling mode to acquire the on-off signal, if the on-off signal is at a low level (pressed), the communication of the controller is judged, if the on-off signal is at a high level (released), the communication of the controller is ended (no communication), and if the on-off signal is at a high level (released), the communication of the pilot is the other condition.
1.3 voice data output: when the recorded voice data reaches the set buffer length (10-40 milliseconds, namely 160-640 sampling values, adaptive parameters), the data is sent to the air traffic control voice recognition module 103 and the air traffic control data processing module 102 for processing through a network or a shared memory.
2. The empty pipe data processing module 102: and receiving monitoring track data and control sector configuration data output by the existing air traffic control system and air traffic control voice data output by the ground-air communication voice and control signal access module 101, and performing comprehensive processing to form a controlled flight list of the control sector for subsequent processing. The method comprises the following steps:
2.1 monitoring track data processing: receiving the comprehensive track output (generally an update period of 4-12 seconds) of the existing air traffic control system in real time, decoding according to an ASTERIX Cat62 format, extracting information such as a track number, a flight number and a position, forming a track list and updating in real time.
2.2 management sector configuration information processing: and receiving the configuration information of the managed sector of the existing air traffic control system in real time through the network for subsequent processing.
2.3 managed flight list generation: and (3) screening the flight tracks belonging to the managed sector in the flight track list of the 2.1 according to the physical geometry (formed by adding a polygon on the horizontal position and upper and lower height limits) of the current managed sector in the configuration information of the managed sector of the 2.2 to form a managed flight list, and storing the flight tracks in a data list form shown in fig. 7.
2.4 managed flight list update and maintenance: when new monitoring track data is received or the regulatory sector configuration information changes, the regulatory flight list is updated. And periodically (1 second, adaptive parameter) checking whether the data in the managed flight list exceeds the data survival time set by the system (2-3 monitoring track updating periods, adaptive parameter), and if so, removing the data from the list.
3. The empty pipe speech recognition module 103: and performing air traffic control voice recognition on the continuously received controller uplink call voice and pilot downlink call voice accumulation, and immediately sending the recognized three-digit or four-digit number to a flight number analysis module for flight number analysis processing when the three-digit or four-digit number is recognized. When the call voice ending mark is received, the empty management voice recognition module carries out empty management voice recognition on the whole sentence of the call again, extracts digital information and sends the digital information to the flight number analysis module for flight number analysis processing, and relevant results are sent to other modules for processing. According to the received ground-air communication control signal, the two situations of the sub-controller uplink communication and the pilot downlink communication are respectively processed. The specific description is as follows:
3.1 controller uplink call processing: determining To be a controller call according To a PTT (push To talk) key state, receiving a recorded ground-air call voice stream in real time, and incrementally sending recorded voice data To an air traffic control voice recognition engine for ensuring the real-time performance of processing, and processing according To the following two conditions:
3.1.1 in continuous call: the PTT key of the controller end is kept pressed, the air traffic control speech recognition engine receives speech information according to a set calculation period (preferably 30ms frame, the value range of the calculation period is more than or equal to 20ms and less than or equal to T and less than or equal to 60ms) from the time when the PTT is pressed, the speech information is accumulated and accumulated to form an audio stream, the air traffic control speech recognition engine performs speech recognition on the audio stream in real time, and the recognized text is sent to the flight number analysis module 104 for processing. Specifically, when the empty pipe speech recognition engine performs speech-to-text recognition on the accumulated audio stream, and when the recognized text is the last three-digit or four-digit number, the text including the number is immediately sent to the flight number parsing module 104 for flight number parsing processing. Due to the particularity of the field of empty pipe, the numbers recognized by the speech recognition module in the empty pipe are shown in table 1.
TABLE 1 number of empty pipe speech recognition
3.1.2 end of call: when the controller releases the PTT button to end the call, the recorded whole voice is sent to the air traffic control voice recognition engine, the air traffic control voice recognition engine carries out voice recognition on the voice accumulated from the time when the PTT is pressed to the release, the final call content is obtained, and the finally recognized text is sent to the flight number analysis module for processing 104. And simultaneously emptying the uplink call voice buffer area of the local controller.
3.2 pilot downlink call processing: if the controller does not press the PTT key, detecting the start time and the end time of the call by adopting a volume threshold (adaptive parameter, which can be set) and a mute duration (adaptive parameter, which can be set), recording the ground-air call voice stream in real time, incrementally sending the received voice data to an air traffic control voice recognition engine in order to ensure the real-time performance of the display, and processing according to the following two conditions:
3.2.1 in continuous call: and performing voice recognition on the received downlink pilot call voice stream accumulation, and sending the recognized text to the flight number analysis module 104, and particularly, when the empty pipe voice recognition engine performs voice-to-character recognition on the accumulated audio stream, and when the recognized text is finally a three-digit or four-digit number, immediately sending the text including the number to the flight number analysis module 104 for flight number analysis processing.
3.2.2 end of call: when the mute time in the recorded voice stream reaches the set threshold or the PTT button of the controller is pressed again, the end of the downlink call voice of the pilot is determined, the recorded whole voice is sent to the air traffic voice recognition engine, the final call content is recognized, and the final recognition text is sent to the flight number analysis module 104 for processing. And meanwhile, emptying a local pilot downlink call voice buffer area.
4. Flight number resolution module 104: the continuously received identification text is matched according to the flight call number keyword, and corresponding flight number is extracted and converted into an effective flight number (English text or Chinese character text number is converted into Arabic number), and after the number is compared with the flight number in the controlled flight list output by the air traffic control data processing module 102, the result is sent to the communication flight target display module 105 and the air traffic control data processing module 102. The flight number in the flight plan is composed of two parts, the first part is a unique three-character code which is uniformly coded by International Civil Aviation Organization (ICAO) for each airline company, for example, Chinese aviation is CCA, Sichuan aviation is CSC, and the second part is a flight number and generally consists of 4 digits (domestic flights) or 3 digits (international flights). Meanwhile, according to relevant specifications of air traffic control ground-air communication, in order to avoid ambiguity caused in ground-air communication, a special provision is made for voice conversation in the calling process of the airline class number, firstly, the airline call number is used as the calling name of the ground-air communication, for example, the Chinese call number of Chinese national aviation is 'national aviation', the English call number is 'air china', the Chinese call number of Chengdu aviation is 'beautiful', and the English call number is 'unused eagle', and has a one-to-one correspondence with ICAO three-character codes. In the chinese call of flight number, four numbers are specially corresponding, for example, 0 is "hole", 1 is "unit", 2 is "two", 7 is "crutch", three numbers are specially corresponding in the english call, three (3) is "tree", five (5) is "fire", and nine (9) is "ner". The specific functions are described as follows:
4.1 initialization: the following 4 basic data tables are established:
(1) establishing an airline call sign correspondence table: the system comprises data items such as an airline company name, an ICAO three-character code, a Chinese calling number, an English calling number and the like;
(2) establishing a corresponding table of numbers in flight numbers and calling numbers: the Chinese number corresponding relation is: hole is 0, two is 2, three is 3, four is 4, five is 5, six is 6, corner is 7, eight is 8, nine is 9; the English correspondence is: zero is 0, one is 1, two is 2, tree is 3, four is 4, fire is 5, six is 6, seven is 7, eight is 8, and nine is 9;
(3) establishing a correspondence table of letters in flight numbers and calling words: according to the relevant regulations of civil aviation, the last digit of the flight number needing to be overtaken next day due to flight cancellation and the like is replaced by a letter, namely the last digit (0-9) of the flight number is replaced by a letter according to the Z-Q sequence, and the letter is represented by a corresponding word when calling. The correspondence table includes three data items of word, letter and number. The last correspondence of flight numbers is shown in fig. 7.
(4) Establishing a corresponding table of the name of the control unit and the abbreviation of the call sign, which comprises three items of data of the name of the control unit, the abbreviation of Chinese call sign and the abbreviation of English call sign. For example, the Chengdu area control center is abbreviated as "Chengdu" and "chengdu", the Chengdu access control center is abbreviated as "access" and "propaach", the Chengdu double-flow airport tower control center is abbreviated as "tower" and "tower", and the like.
4.2, analyzing the number of the communication flight ascending by the controller: the call format of the controller uplink call is as follows: "airline call number flight number command type command parameter" such as "height 4200 hold under national aviation 1408".
The analysis method is as follows:
4.2.1 pretreatment: judging whether the received text of the blank management speech recognition part is a Chinese text or an English text, wherein the judgment rule is that if the characters in the text only consist of a-z, spaces and the like, the text is English, and otherwise, the text is Chinese.
4.2.2 flight call number matching: and (3) scanning the received text from left to right by using the Chinese call sign or English call sign of the airline company established in the 4.1(1) (according to the judgment result of 4.2.1) as a keyword, if the matched airline call sign exists, turning to 4.2.3 for processing, and if the matched airline call sign does not exist, returning the result to be null.
4.2.3 flight number match: and scanning the received text by using the flight calling number established by 4.1(2) and the flight overtime calling word established by 4.1(3) as keywords from the next character of the airline calling number matched with 4.2.2, accumulating and temporarily storing the text meeting the conditions in sequence, terminating the scanning if the scanned text is not the keyword or text end in 4.1(2) and 4.1(3), and sending the result to 4.2.4 for processing.
4.2.4 flight number translation: the text in the form of the output 'flight call number + flight number call' of the above steps is converted into the form of the flight number in the flight plan, for example, the 'national aviation unitary four-hole eight' is converted into 'CCA 1408'.
4.3 pilot downlink communication flight number analysis: the calling format of the pilot downlink call is mainly divided into two types, one is to repeat the instructions of the controller, and the format is as follows: "Command type Command parameter airline call number flight number", such as "lower altitude 4200 holds State aviation 1408"; secondly, report to the controller voluntarily, the format is: the "control unit is called airline call number flight number status report for short", for example, "Chengdu national aviation 1408 altitude 4800 answering machine 1011 listens to your command". The specific conversion method is the same as 4.2.
4.4 identifying that the flight number matches the list of managed flights: the identified flight number is compared with the flight number in the managed flight list output by the air traffic control data processing module 102, and the result is sent to the communication flight destination display module 105 and the air traffic control data processing module 102.
5. The talking flight destination display module 105: receiving the flight number in the call or just ending the call output by the flight number analysis module 104 and the real-time track data output by the air traffic control data processing module 102, displaying the current controlled flight list track in a situation map mode, displaying the current calling flight and the text of the current call identification in a striking mode, keeping displaying for a period of time (adaptive parameters), and providing a call flight number data output interface for being integrated into other systems. The display schematic diagram is shown in fig. 5, and the specific functions are described as follows:
5.1 empty situation map display: the empty situation display accords with the working requirements of the control seats, and displays maps, flight plans, flight paths and the like, and the flight path display comprises elements such as flight path symbols, flight path labels, lead wires, tail paths, historical tracks, speed vector lines, flight path circles and the like.
5.2 controller up-call flight number display: the up arrow of the track symbol indicates up-call and "C" indicates controller. The track symbol of the currently talking flight is displayed in a flashing manner and kept for an adaptive time (default 3 seconds) after the end of the conversation, such as the "CCA 1408" flight shown in fig. 5.
5.3 Pilot downlink call flight number display: the arrow with the track symbol down indicates a down call and "P" indicates the pilot. The track symbol of the currently talking flight is flashed and held until an adaptive time (default 3 seconds) after the end of the call, as shown in fig. 5 for a "CSC 8888" flight.
5.4 displaying the uplink and downlink communication flight number simultaneously: if the adaptation time of the 5.2 and 5.3 displays is within, the displays are superimposed at the same time, as shown in "CES 2826" in FIG. 5.
5.4 displaying the text of the ground-to-air conversation: and displaying the control area, the sector, the text corresponding to the current ground-to-air conversation voice and the current time under the empty situation map. As in fig. 5, the call text is "elevation 8100 hold below CCA1408," indicating that the current controller is talking up the flight CCA1408 with the instruction intended to let the flight drop to 8100 meters.
5.5 the update and maintenance of the ground-to-air call list in the controlled flight list: storing all the upstream voices and voice recognition texts of the controllers which are received and processed into controller communication items of the controlled flight list according to flight numbers; and storing all pilot downlink voice and voice recognition texts which are received and processed into pilot communication items of the controlled flight list according to flight numbers.
Fig. 4 is a schematic diagram of a component structure of the apparatus of the present invention, namely, an electronic device 301 (for example, a computer with a program execution function and related accessories), the hardware components of which include:
(1) at least one power supply 302, a processor 303, a memory 304, a built-in display 305, a sound acquisition card 306 and an external interface 307;
(2) the power supply 302 adopts a built-in storage battery or an alternating current power adapter and is used for providing electric energy for the electronic equipment 301;
(3) the processor 303 performs relevant application processing functions such as empty pipe voice recognition and display;
(4) the memory 304 stores instructions executable by the at least one processor 302 to enable the at least one processor 302 to perform the aforementioned methods;
(5) the built-in display 305 is used for displaying a map, a track target and a result and prompt related to air traffic control voice recognition, adopts an 8-10-inch liquid crystal display, and can also be integrated with a USB interface of the external interface 307 to use a touch liquid crystal display;
(6) the sound acquisition card 306 is used for acquiring the input ground-to-air conversation voice and the release/press state (high-low level judgment) of the PTT button;
(7) the external interface 307 provides other input and output interfaces for the apparatus, including a USB interface for connecting a mouse/keyboard and other general-purpose devices; a network interface, in the form of an RJ45 physical interface, for input of data such as monitoring data and flight plans; the external display interface supports VGA/HDMI interface forms and the like and is used for an external display.
Fig. 4 is a schematic diagram of a basic component of the device, which can increase the number of components or interfaces and the corresponding processing performance according to the number of channels supporting air traffic control voice recognition and the number of monitoring tracks and flight plans.
The device provided by the embodiment of the invention is software or firmware installed on equipment. The device provided by the embodiment of the present invention has the same implementation principle and technical effect as the method embodiments, and for the sake of brief description, reference may be made to the corresponding contents in the method embodiments without reference to the device embodiments. It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the foregoing systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Claims (10)
1. A method for enhancing situational awareness perception of an air-ground call controller is characterized by comprising the following steps:
obtaining a managed flight list, the managed flight list including flight numbers of managed aircraft within a managed sector;
when a controller calls up or a pilot calls down, collecting call voice according to a calculation period, and accumulating the collected call voice into voice flow;
converting the voice stream into text information according to the calculation period;
extracting a digital text in the text information, and converting the digital text into a real-time communication flight number;
and when the real-time communication flight number exists in the managed flight list, outputting reminding information comprising the real-time communication flight number.
2. The method for enhancing situational awareness of an air-ground call controller as claimed in claim 1, wherein the steps further comprise:
when the ascending communication of a controller is finished or the descending communication of a pilot is finished, the whole voice is converted into the whole text information;
extracting the numbers in the whole text information and converting the numbers into communication flight numbers;
and when the communication flight number exists in the managed flight list, outputting reminding information comprising the communication flight number.
3. The method for enhancing situational awareness of an air-ground call controller as claimed in claim 1, wherein the step of extracting digital text from the text message and converting the digital text into a real-time call flight number comprises:
extracting characters in front of the digital text, and searching for an airline call sign corresponding to the characters in front of the digital text in a preset airline call sign corresponding table;
converting the digital text into a flight number according to a corresponding table of numbers in a preset flight number and calling numbers;
and combining the searched airline call number and the flight number into a real-time communication flight number.
4. A method for enhancing situational awareness of an air-ground call controller according to any one of claims 1-3 wherein said obtaining a list of controlled flights is generated from flight data including surveillance track data, control sector configuration data, flight plans.
5. The method for enhancing situational awareness of an air-ground call controller according to any one of claims 1 to 3, wherein the value range of the calculation period is 20ms ≤ T ≤ 60 ms.
6. An apparatus for enhancing situational awareness perception of an air-ground traffic controller, comprising: ground-to-air communication voice and control signal access module, air traffic control voice recognition module, air traffic control data processing module, flight number analysis module and communication flight target display module, wherein:
the ground-air communication voice and control signal access module receives uplink communication voice or downlink communication voice between a controller and a pilot in real time through an air pipe voice system, and outputs the uplink communication voice or the downlink communication voice to the air pipe voice recognition module in real time; the ground-to-air communication voice and control signal access module also receives PTT key state information, and judges whether the communication voice between the controller and the pilot is the controller uplink communication or the pilot downlink communication according to the PTT key state information;
the air traffic control data processing module receives flight data through an air traffic control system, generates a controlled flight list of a controlled sector according to the flight data, and outputs the controlled flight list of the controlled sector to the communication flight target display module, wherein the flight data comprises monitoring track data, controlled sector configuration data and a flight plan;
the air traffic control voice recognition module receives uplink call voice or downlink call voice output by the ground-air call voice and control signal access module in real time, collects the call voice according to a calculation period, accumulates the collected call voice into a voice stream, converts the voice stream into text information according to the calculation period, and outputs the text information to the flight number analysis module;
the flight number analyzing module receives the text information output by the air traffic control voice recognition module, extracts a flight number from the text information, and outputs the flight number to a communication flight destination display module, wherein the flight number comprises an airline call number and a flight number;
the communication flight destination display module receives the flight number output by the flight number analysis module, receives the managed flight list of the managed sector output by the air traffic control data processing module, is used for searching whether the flight number exists in the managed flight list of the managed sector, and outputs reminding information including the flight number when the flight number is searched.
7. The apparatus as claimed in claim 6, wherein the ground-to-air communication controller situational awareness perception module further receives PTT button state information, and determines whether the communication voice between the controller and the pilot is a controller up-call or a pilot down-call according to the PTT button state information.
8. The apparatus for enhancing situational awareness of an air-ground call controller of claim 6, wherein the step of the air traffic data processing module generating the list of regulated sectors of regulated flights comprises:
decoding the flight data, and extracting a track number, a flight number and position information to form a track list;
receiving the configuration information of a control sector of the existing air traffic control system in real time;
and selecting a controlled flight from the flight path list according to the physical geometry of the control sector in the control sector configuration information, and generating a controlled flight list of the control sector.
9. The apparatus as claimed in claim 6, wherein the flight number analyzing module extracts the flight number from the text information according to a pre-stored correspondence table of airline call numbers, a correspondence table of numbers and call numbers in flight numbers, a correspondence table of letters and call words in flight numbers, and a correspondence table of the management unit names and call numbers, and comprises:
using the airline company call signs in the airline company call sign correspondence table as keywords, sequentially searching whether the text information has matched airline company call signs, and storing the matched airline company call signs when the text information has the matched airline company call signs;
extracting the numbers behind the matched airline call signs in the text information, and storing the numbers behind the matched airline call signs;
converting the matched airline call sign and the number following the matched airline call sign to a flight number form in the flight plan.
10. An electronic device for enhancing situational awareness perception of an air-ground call controller, comprising: a power supply, a processor, a memory, a built-in display, a sound acquisition card and an external interface, wherein,
the power supply is used for supplying power to the electronic equipment;
the processor performing the method of any one of claims 1-5;
the memory storing instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5;
the built-in display is used for displaying a map, a track target and reminding information of the real-time communication flight number;
the sound acquisition card is used for acquiring the input ground-to-air conversation voice;
the external interface is connected with the air traffic control internal conversation system and is used for obtaining the controlled flight list.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911296392.XA CN111210825A (en) | 2019-12-16 | 2019-12-16 | Method and device for enhancing situational awareness perception of ground-air communication controller |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911296392.XA CN111210825A (en) | 2019-12-16 | 2019-12-16 | Method and device for enhancing situational awareness perception of ground-air communication controller |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111210825A true CN111210825A (en) | 2020-05-29 |
Family
ID=70788051
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911296392.XA Pending CN111210825A (en) | 2019-12-16 | 2019-12-16 | Method and device for enhancing situational awareness perception of ground-air communication controller |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111210825A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112185390A (en) * | 2020-09-27 | 2021-01-05 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | Onboard information assisting method and device |
| CN113327607A (en) * | 2021-05-28 | 2021-08-31 | 北京航空航天大学 | Cabin voice command handshake detection system and device |
| CN114155861A (en) * | 2021-11-23 | 2022-03-08 | 首都机场集团有限公司 | Empty pipe voice intelligent monitoring system |
| WO2022063288A1 (en) * | 2020-09-27 | 2022-03-31 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | On-board information assisting system and method |
| CN115440191A (en) * | 2022-11-09 | 2022-12-06 | 四川大学 | Airplane cockpit safety auxiliary method based on deep learning and electronic equipment |
| CN116092342A (en) * | 2022-11-18 | 2023-05-09 | 四川大学 | Automatic response and quality assessment method and system for controller simulation training |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101916565A (en) * | 2010-06-24 | 2010-12-15 | 北京华安天诚科技有限公司 | Voice recognition method and voice recognition device in air traffic control system |
| CN106875948A (en) * | 2017-02-22 | 2017-06-20 | 中国电子科技集团公司第二十八研究所 | A kind of collision alert method based on control voice |
| CN109448493A (en) * | 2018-12-27 | 2019-03-08 | 中国电子科技集团公司第十五研究所 | Tower control simulated training system, voice control order identify and enter for method |
| CN110335609A (en) * | 2019-06-26 | 2019-10-15 | 四川大学 | A kind of air-ground communicating data analysis method and system based on speech recognition |
-
2019
- 2019-12-16 CN CN201911296392.XA patent/CN111210825A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101916565A (en) * | 2010-06-24 | 2010-12-15 | 北京华安天诚科技有限公司 | Voice recognition method and voice recognition device in air traffic control system |
| CN106875948A (en) * | 2017-02-22 | 2017-06-20 | 中国电子科技集团公司第二十八研究所 | A kind of collision alert method based on control voice |
| CN109448493A (en) * | 2018-12-27 | 2019-03-08 | 中国电子科技集团公司第十五研究所 | Tower control simulated training system, voice control order identify and enter for method |
| CN110335609A (en) * | 2019-06-26 | 2019-10-15 | 四川大学 | A kind of air-ground communicating data analysis method and system based on speech recognition |
Non-Patent Citations (3)
| Title |
|---|
| BO YANG，等: "ATC Speech: a multilingual pilot-controller speech corpus from real Air Traffic Control environment" * |
| 杨波，等: "基于深度学习的空管指挥安全监控技术研究" * |
| 王佳文: "面向民航陆空通话的语音识别技术研究" * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112185390A (en) * | 2020-09-27 | 2021-01-05 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | Onboard information assisting method and device |
| WO2022062195A1 (en) * | 2020-09-27 | 2022-03-31 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | In-flight information assistance method and apparatus |
| WO2022063288A1 (en) * | 2020-09-27 | 2022-03-31 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | On-board information assisting system and method |
| CN112185390B (en) * | 2020-09-27 | 2023-10-03 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | On-board information auxiliary method and device |
| CN113327607A (en) * | 2021-05-28 | 2021-08-31 | 北京航空航天大学 | Cabin voice command handshake detection system and device |
| CN114155861A (en) * | 2021-11-23 | 2022-03-08 | 首都机场集团有限公司 | Empty pipe voice intelligent monitoring system |
| CN115440191A (en) * | 2022-11-09 | 2022-12-06 | 四川大学 | Airplane cockpit safety auxiliary method based on deep learning and electronic equipment |
| CN115440191B (en) * | 2022-11-09 | 2023-01-24 | 四川大学 | Airplane cockpit safety auxiliary method based on deep learning and electronic equipment |
| CN116092342A (en) * | 2022-11-18 | 2023-05-09 | 四川大学 | Automatic response and quality assessment method and system for controller simulation training |
| CN116092342B (en) * | 2022-11-18 | 2024-08-13 | 四川大学 | Automatic response and quality assessment method and system for controller simulation training |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111210825A (en) | Method and device for enhancing situational awareness perception of ground-air communication controller | |
| CN111105647B (en) | Control instruction issuing system and method based on air traffic control voice recognition and synthesis | |
| CN106910376B (en) | Air traffic operation control instruction monitoring method and system | |
| US9666178B2 (en) | Device for aiding communication in the aeronautical domain | |
| US20230177969A1 (en) | Airport control decision support system and method based on semantic recognition of controller instruction | |
| US9262927B2 (en) | Method and device for automatically managing audio air control messages on an aircraft | |
| KR101922379B1 (en) | Method for providing real-time air traffic control monitoring service | |
| CN101916565A (en) | Voice recognition method and voice recognition device in air traffic control system | |
| CN108630019B (en) | System and method for rendering aircraft cockpit displays for use by ATC conditional approval instructions | |
| CN107808551A (en) | A kind of General Aviation operation monitoring system and its monitoring method based on the Big Dipper | |
| CN107464452A (en) | One kind misexplains control and is intended to warning system and method | |
| CN114155861A (en) | Empty pipe voice intelligent monitoring system | |
| CN110428830B (en) | Regular expression-based empty pipe instruction intention identification method | |
| US10490085B2 (en) | Method and device for identification of a recipient aircraft of an audio communication | |
| CN112634663B (en) | General aviation flight plan and monitoring target association method | |
| US7089108B2 (en) | Method and apparatus for entering a flight plan into an aircraft navigation system | |
| CN114187893B (en) | Intelligent air traffic control voice monitoring method and system | |
| CN113112877A (en) | Runway intrusion early warning method, terminal and device | |
| CN111091838A (en) | Open voice interaction platform for aircraft control | |
| CN110600007B (en) | Ship recognition and positioning system and method based on voice | |
| CN109309759A (en) | Offline mode autocontrol method and system | |
| US11621002B2 (en) | Method and device for automatically managing audio air traffic control messages on board an aircraft | |
| CN114121017B (en) | Multi-safety-level air-traffic-control voice intelligent monitoring system | |
| CN112185390A (en) | Onboard information assisting method and device | |
| WO2022063288A1 (en) | On-board information assisting system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200529 |