CN114664301A - Interactive control method, device and system for simulation training equipment - Google Patents
Interactive control method, device and system for simulation training equipment Download PDFInfo
- Publication number
- CN114664301A CN114664301A CN202210313940.0A CN202210313940A CN114664301A CN 114664301 A CN114664301 A CN 114664301A CN 202210313940 A CN202210313940 A CN 202210313940A CN 114664301 A CN114664301 A CN 114664301A
- Authority
- CN
- China
- Prior art keywords
- information
- training instruction
- simulated training
- voice
- simulated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/16—Speech classification or search using artificial neural networks
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The invention discloses a method, a device and a system for interactive control of simulation training equipment. The interactive control method of the simulated training equipment comprises the following steps: receiving voice information, judging whether a connection word, a verb and a noun exist in the voice information, and if the connection word exists in the voice information, removing the connection word; if the voice information comprises verbs and nouns, inquiring simulated training instruction information matched with the verbs and the nouns; if the voice information comprises nouns, inquiring at least one piece of simulated training instruction information matched with the nouns; generating at least one piece of simulated training instruction execution inquiry information according to the simulated training instruction information; and receiving simulation training instruction execution inquiry feedback information, and generating a simulation training instruction according to the simulation training instruction execution inquiry feedback information.
Description
Technical Field
The embodiment of the invention relates to a simulator technology, in particular to a method, a device and a system for interactive control of simulation training equipment.
Background
According to Chinese flight simulator market research and investment prospect report (2018), which is published by standing tree information consultation, the method comprises the following steps: the civil aviation administration forecasts and shows that the number of air route transportation airplanes in China rapidly increases from 2020 to 2030, the number of the air route transportation airplanes respectively reaches 3140 and 5200, the total capacity of the market of the Chinese flight simulator exceeds 500 billion yuan, and the newly added market scale exceeds billion.
The China civil aviation administration clearly specifies the real machine training hours which can be withheld by the high-grade analog machine in different courses of each machine type (for example, an instrument-grade course and a commercial driver training course, the training time is 30 hours and 120 hours respectively, and the withholding proportion of the analog machine is 50 percent and 30 percent respectively). In addition, the flight simulator also needs to bear the whole hours of pilot transfer training and part of the hours of pilot retraining, so the flight simulator plays an important role in reducing risks and costs in the pilot training industry.
Although the market demand is huge, the cost of pilot training is very high, for example, the cost is from 3000 to ten thousand yuan when a high-grade simulation machine of Tianjin Feian aviation training company is used for training for one hour, so that the flight training cost can be further reduced by controlling the time in the training.
At present, the instructor platform system that flight analog machine contains, it is the instruction center of whole flight analog machine, and the teaching personnel need sit in the instructor table front when using the instructor platform, triggers the action through clicking the corresponding function button in instructor platform interface, and then realizes setting up corresponding flight training subject, and the main disadvantage of this kind of operation lies in: because the function buttons of the instructor station are numerous, a lot of time is needed for teaching personnel to find the desired operation function buttons in the interface of the instructor station, and a lot of unnecessary flight training cost is caused.
Disclosure of Invention
The invention provides a method, a device and a system for interactive control of simulated training equipment, which aim to achieve the aim of controlling the simulated training equipment through voice.
In a first aspect, an embodiment of the present invention provides a method for controlling interaction of a simulated training device, including:
receiving voice information, judging whether a connection word, a verb and a noun exist in the voice information, and if the connection word exists in the voice information, removing the connection word;
if the voice information comprises the verb and the noun, inquiring a piece of simulated training instruction information matched with the verb and the noun;
if the voice information comprises the noun, inquiring at least one piece of simulated training instruction information matched with the noun;
generating at least one piece of simulated training instruction execution inquiry information according to the simulated training instruction information;
receiving simulation training instruction execution inquiry feedback information, and generating a simulation training instruction according to the simulation training instruction execution inquiry feedback information.
Optionally, after the query feedback information is executed according to the simulated training instruction to generate the simulated training instruction, the method further includes:
generating a simulated training instruction and sending inquiry information;
receiving a simulated training instruction and sending inquiry feedback information, and sending the inquiry feedback information according to the simulated training instruction and sending the simulated training instruction.
Optionally, sending query feedback information according to the simulated training instruction and sending the simulated training instruction includes:
if the inquiry feedback information sent by the simulated training instruction is negative information, regenerating the inquiry information sent by the simulated training instruction;
and if the inquiry feedback information sent by the second received simulated training instruction is negative information, stopping sending the simulated training instruction.
Optionally, the querying the simulated training instruction information matched with the verb and the noun includes:
determining a synonymous aviation term verb corresponding to the verb, determining a synonymous aviation term noun corresponding to the noun, and querying simulated training instruction information including the synonymous aviation term verb and the synonymous aviation term noun.
Optionally, the simulating training instruction executing the query information includes: the voice simulation training instruction executes the inquiry information, or the character simulation training instruction executes the inquiry information;
the simulation training instruction execution inquiry feedback information comprises: the voice simulation training instruction executes the inquiry feedback information, or the text simulation training instruction executes the inquiry feedback information.
Optionally, if the query information executed by the simulated training instruction adopts a voice simulated training instruction to execute the query information, and the query feedback information executed by the simulated training instruction adopts a voice simulated training instruction to execute the query feedback information, then:
and when a plurality of pieces of voice simulation training execution inquiry information are generated, if the voice simulation training execution inquiry feedback information corresponding to the current voice simulation training execution inquiry information is negative information, sequentially outputting the next voice simulation training execution inquiry information.
Optionally, the voice information includes chinese voice information and foreign language voice information.
Optionally, if the voice information contains both chinese and foreign language, then:
and unifying the voice information into Chinese voice information or foreign language voice information.
In a second aspect, an embodiment of the present invention further provides an interactive control device for a simulation training device, including an interactive control unit, where the interactive control unit is configured to:
receiving voice information, judging whether a connection word, a verb and a noun exist in the voice information, and if the connection word exists in the voice information, removing the connection word;
if the voice information comprises the verb and the noun, inquiring a piece of simulated training instruction information matched with the verb and the noun;
if the voice information comprises the noun, inquiring at least one piece of simulated training instruction information matched with the noun;
generating at least one piece of simulated training instruction execution inquiry information according to the simulated training instruction information;
receiving simulation training instruction execution inquiry feedback information, and generating a simulation training instruction according to the simulation training instruction execution inquiry feedback information.
In a third aspect, an embodiment of the present invention further provides a system for controlling interaction of a simulated training device, where the system includes a controller, where the controller is configured with an executable program, and the executable program implements, when running, the method for controlling interaction of the simulated training device described in the embodiment of the present invention.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the method, the simulation training instruction information is generated through the voice information, and the simulation training instruction is generated based on the simulation training instruction information, wherein the simulation training instruction can control the simulation training equipment to execute a certain simulation training function;
2. the method provided by the invention determines the simulated training instruction information matched with the voice information according to the name and verb included in the voice information, so that the teaching personnel do not need precise professional wording when issuing the instruction, and the use difficulty of the simulated training equipment is reduced.
Drawings
FIG. 1 is a flowchart of a method for controlling interaction of a simulated training apparatus in an embodiment;
FIG. 2 is a flow chart of another method for controlling interaction of a simulated training apparatus in an embodiment;
FIG. 3 is a flow chart of another method for controlling interaction of a simulated training apparatus in an embodiment;
FIG. 4 is a flow chart of another method for controlling interaction of a simulated training apparatus in an embodiment;
FIG. 5 is a block diagram of a simulated training apparatus in the embodiment.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
In this embodiment, a method for controlling interaction of a simulation training device is provided, which is suitable for a scenario of controlling the simulation training device, where a typical simulation training device includes a flight driving simulation training device, a vehicle driving simulation training device, and the like, and the method may be implemented in a software manner and executed by a simulation training device interaction control apparatus, and the apparatus may be configured in a simulation training device interaction control system, where fig. 1 is a flowchart of a method for controlling interaction of a simulation training device in an embodiment, and with reference to fig. 1, the method includes:
s101, receiving voice information, judging whether a connection word, a verb and a noun exist in the voice information, and if the connection word exists in the voice information, removing the connection word.
For example, in the embodiment, the language control instruction spoken by the teaching person is referred to as the language control instruction converted into the text by using the voice information.
For example, in this embodiment, the voice information may correspond to chinese voice information or foreign language voice information.
Illustratively, a language control instruction is used to indicate that the instructor desires to simulate a certain simulated training function performed by the training apparatus. For example, if the simulation training device may simulate an aircraft landing gear fault scene, the language control instruction corresponding to the simulated aircraft landing gear fault scene may be "activate landing gear fault", and when the teaching person says "activate landing gear fault", it indicates that the teaching person expects the simulation training device to simulate the aircraft landing gear fault scene.
For example, in this embodiment, when the voice message is received, it is determined whether a connection word exists in the voice message, and if the connection word exists in the voice message, the connection word is removed.
For example, if the speech message is "activate left and right engine stall failure", the conjunction word is "and", and the speech message becomes "activate left and right engine stall failure" after the conjunction word is removed.
For example, in this embodiment, any keyword extraction method may be used to determine a conjunction word in the voice information, and the specific implementation manner is not described again.
S102, if the voice information comprises verbs and nouns, inquiring simulated training instruction information matched with the verbs and the nouns.
For example, in this embodiment, it is determined whether the speech information without the conjuncts includes verbs and nouns.
When judging whether the voice information comprises verbs and nouns, firstly, word division is carried out on the voice information, each word in the voice information is determined, and then whether each word is a verb or a noun is determined respectively.
For example, in this embodiment, the word division method is not specifically limited, and any automatic word segmentation method may be adopted to implement word division.
For example, in this embodiment, whether a word is a noun or a verb may be determined by machine learning, neural network, or the like.
In the present embodiment, when the speech information includes both nouns and verbs, a piece of simulated training instruction information matching the speech information is queried.
In the present embodiment, as an example, simulated training instruction information is used to represent standard instruction phrases uniformly used in a specified field; or instruction phrases specified by a design manufacturer of the simulated training apparatus for a certain simulated training apparatus for causing the simulated training apparatus to perform the simulated training function.
For example, in this embodiment, the simulated training execution information may be stored in the simulated training execution information database.
Illustratively, as an implementable manner, a piece of simulated training instruction information matched with the voice information may be determined by:
and inquiring a piece of simulated training instruction information with the highest matching degree with the voice information from the simulated training execution information database, and taking the simulated training instruction information as the simulated training instruction information matched with the voice information.
For example, in the above scheme, the matching degree of the voice information and the simulated training instruction information may be determined through a deep learning model based on semantics or a neural network.
As an exemplary implementation, a piece of simulated training instruction information matched with the voice information may also be determined as follows:
replacing verbs in the voice information with preset synonyms, and replacing nouns in the voice information with preset synonyms;
and inquiring simulated training instruction information which is the same as the replaced voice information from the simulated training execution information database, and taking the simulated training instruction information as simulated training instruction information matched with the voice information.
For example, in this scheme, the interaction control method for the simulated training device may apply interaction control with the flight simulated training device, and in this scenario, a piece of simulated training instruction information matched with the voice information may be specifically determined in the following manner:
determining a synonymous aviation term verb corresponding to the verb, and determining a synonymous aviation term noun corresponding to the noun;
the query contains simulated training instruction information of the synonymous aviation term verb and the synonymous aviation term noun.
For example, if the voice message is "wheel lifting," the voice message after replacement may be "landing gear retraction," and at this time, the simulated training instruction message including "landing gear retraction" is queried.
S103, if the voice information comprises nouns, inquiring at least one piece of simulated training instruction information matched with the nouns.
For example, if it is determined that only the noun is included in the speech information based on the contents recorded in step S102, one or more pieces of simulated training instruction information matching the speech information are searched.
Illustratively, as an implementable manner, the at least one piece of simulated training instruction information matched with the voice information may be determined by:
and inquiring a plurality of pieces of simulated training instruction information with the matching degree not equal to zero with the voice information from the simulated training execution information database.
As an exemplary implementation, the at least one piece of simulated training instruction information matched with the voice information may also be determined by:
replacing nouns in the voice information with preset synonyms;
and inquiring all simulated training instruction information containing the replaced voice information from the simulated training execution information database.
And S104, generating at least one piece of simulated training instruction execution inquiry information according to the simulated training instruction information.
For example, in this embodiment, the query information executed by the simulated training instruction represents text query information or voice query information that can be output by the simulated training device and acquired by the teaching staff.
Illustratively, in this embodiment, the simulated training instruction execution query message is used by the simulated training apparatus to determine whether the instructor determines that it is desired to perform a simulated training function.
For example, in this embodiment, the simulated training instruction execution query information includes a text corresponding to the simulated training instruction information.
For example, if the voice message is "activate landing gear fault", the teaching person expects the simulation training device to simulate the landing gear fault scene of the airplane, and the simulation training instruction is "activate landing gear fault", the simulation training instruction execution inquiry message may be "execute or not execute activate landing gear fault".
For example, on the basis of the contents recorded in step S102 and step S103, if a piece of simulated training instruction information is determined, a piece of simulated training instruction execution inquiry information is generated;
and if the information of the plurality of simulated training instructions is determined, generating a plurality of simulated training instruction execution inquiry information.
And S105, receiving the simulated training instruction to execute the inquiry feedback information, and executing the inquiry feedback information according to the simulated training instruction to generate a simulated training instruction.
Illustratively, in this embodiment, the simulated training instruction execution inquiry feedback information indicates that the instructor determines that the simulated training apparatus is expected to perform a simulated training function, or negates that the simulated training apparatus is expected to perform a simulated training function.
For example, the simulated training instruction execution inquiry feedback information may be "yes", "no", "cancel", or the like, based on the content recorded in step S104.
For example, in the present embodiment, if the simulated training instruction execution inquiry feedback information is affirmative information (for example, "yes"), the simulated training instruction is generated;
if the simulated training instruction execution inquiry feedback information is negative information (for example, "no"), no action is performed.
For example, in this embodiment, the simulated training instruction is an apparatus instruction that can be directly executed by the simulated training apparatus, and the apparatus instruction is used to control the simulated training apparatus to start executing a certain simulated training function.
For example, in this embodiment, the specific content of the simulated training instruction is related to the simulated training instruction information, and one piece of simulated training instruction information corresponds to one piece of simulated training instruction.
For example, in the present embodiment, simulating the training instruction execution query information includes: the voice simulation training instruction executes the query message (namely displaying the query message in a voice broadcasting manner), or the text simulation training instruction executes the query message (namely displaying the query message in a text manner);
simulating the training instruction execution inquiry feedback information comprises: the voice simulation training instruction executes the inquiry feedback information (namely, the information is fed back in a voice mode), or the text simulation training instruction executes the inquiry feedback information (namely, the information is fed back in a selected text mode).
For example, in one possible implementation, if the simulated training instruction execution query information uses the voice simulated training instruction execution query information, and the simulated training instruction execution query feedback information uses the voice simulated training instruction execution query feedback information, then:
when a plurality of pieces of voice simulation training execution inquiry information are generated, if the voice simulation training execution inquiry feedback information corresponding to the current voice simulation training execution inquiry information is negative information, sequentially outputting the next voice simulation training execution inquiry information.
The embodiment provides an interactive control method for simulated training equipment, wherein simulated training instruction information is generated through voice information, and a simulated training instruction is generated based on the simulated training instruction information, wherein the simulated training instruction can control the simulated training equipment to execute a certain simulated training function;
in addition, the method provided by the embodiment determines the simulated training instruction information matched with the voice information according to the name and verb of the conjunction word in the voice information, and based on the method, when a teaching worker issues an instruction, the teaching worker can correspondingly generate an accurate simulated training instruction under the condition of not using accurate professional wording, so that the use difficulty of the simulated training equipment is reduced.
Fig. 2 is a flow chart of another interactive control method for a simulated training device in an example, and referring to fig. 2, in an implementation, on the basis of the contents recorded in the scheme shown in fig. 1, the interactive control method may further be:
s201, receiving voice information, judging whether a connection word, a verb and a noun exist in the voice information, and if the connection word exists in the voice information, removing the connection word.
S202, if the voice information comprises verbs and nouns, inquiring simulated training instruction information matched with the verbs and the nouns.
S203, if the voice information comprises nouns, inquiring at least one piece of simulated training instruction information matched with the nouns.
And S204, generating at least one piece of simulated training instruction execution inquiry information according to the simulated training instruction information.
S205, receiving the simulated training instruction to execute the inquiry feedback information, and executing the inquiry feedback information according to the simulated training instruction to generate a simulated training instruction.
In this embodiment, the embodiment of step S201 to step S205 is the same as the embodiment of step S101 to step S105.
S206, generating a simulation training instruction and sending inquiry information.
For example, in this scheme, the simulated training instruction is used to send query information to indicate that the simulated training device can output text query information or voice query information that can be acquired by a teaching person.
In the present exemplary embodiment, the simulated training instruction sending query information is used by the simulated training device to determine whether the trainee determines that the simulated training instruction is expected to be sent to the simulated training device, specifically to a software functional module or a hardware unit for executing a certain simulated training function.
For example, in the present embodiment, the simulated training instruction may be generated according to the simulated training instruction to send the query message. For example, if the simulation training instruction is "activate landing gear fault", the simulation training instruction transmission inquiry message may be "whether to transmit the activate landing gear fault".
And S207, receiving the simulated training instruction, sending inquiry feedback information, and sending the simulated training instruction according to the simulated training instruction.
In the present embodiment, for example, the simulated training instruction sending inquiry feedback information indicates that the teaching person determines to send the simulated training instruction, or negatively sends the simulated training instruction.
For example, the simulation training instruction transmission inquiry feedback information may be "yes", "no", "cancel", or the like, based on the content described in step S206.
For example, in the present embodiment, if the simulated training instruction sends the inquiry feedback information as positive information (for example, "yes"), the simulated training instruction is sent, and thereafter, the simulated training device executes the specified simulated training function;
if the simulated training instruction sends the inquiry feedback information as negative information (for example, "no"), the simulated training device does not perform subsequent actions or returns to the initial state.
For example, in one possible implementation, sending the query feedback information sending simulation training instruction according to the simulation training instruction may include:
if the inquiry feedback information sent by the simulated training instruction is negative information, regenerating the simulated training instruction to send the inquiry information;
and if the inquiry feedback information sent by the second received simulated training instruction is negative information, stopping sending the simulated training instruction.
Exemplarily, in the scheme, if the inquiry feedback information sent by the simulated training instruction is positive information, the simulated training instruction is sent;
if the inquiry feedback information sent by the first received simulated training instruction is negative information, regenerating the simulated training instruction to send the inquiry information;
after the simulated training instruction is regenerated and the inquiry information is sent, if the inquiry feedback information sent by the received simulated training instruction is positive information, the simulated training instruction is sent;
after the simulated training instruction is regenerated again to send the inquiry information, if the received simulated training instruction sending inquiry feedback information is still negative information (namely negative information is continuously received for the second time), the sending of the simulated training instruction is stopped, and the simulated training equipment returns to the initial state.
On the basis of the beneficial effects of the scheme shown in fig. 1, in the scheme, after the simulated training instruction is generated, the simulated training instruction is also generated to send inquiry information, and when the simulated training instruction sends inquiry feedback information as positive information, the simulated training instruction is sent again, so that the simulated training equipment executes the corresponding simulated training function.
Fig. 3 is a flowchart of another interactive control method for simulation training equipment in an embodiment, and referring to fig. 3, in an implementation manner, on the basis of the contents recorded in the scheme shown in fig. 1, the interactive control method may further be:
s301, judging whether the voice information contains Chinese and foreign languages at the same time, and if the voice information contains Chinese and foreign languages at the same time, unifying the voice information into Chinese voice information or foreign language voice information.
For example, in the present embodiment, the speech information may include both chinese and foreign language, for example, one piece of speech information may be "Shutdown engine".
In the scheme, for example, an automatic word segmentation method can be adopted to realize word segmentation, then whether each word is Chinese or foreign language is judged, and when the word is foreign language, which language belongs to is determined, so that when foreign language voice information is unified, which foreign language is unified is determined.
For example, if the speech information is "Shutdown engine", the speech signal contains both english and chinese, and if the speech information is unified as chinese speech information, the speech information is "Shutdown engine", and if the speech information is unified as english speech information, the speech information is "Shutdown the engine".
S302, receiving the voice information, judging whether the voice information contains connection words, verbs and nouns, and if the voice information contains the connection words, removing the connection words.
In this embodiment, for example, based on the content recorded in step S301, the speech information is unified chinese speech information or foreign speech information.
And S303, if the voice information comprises verbs and nouns, inquiring simulated training instruction information matched with the verbs and the nouns.
S304, if the voice information comprises nouns, inquiring at least one piece of simulated training instruction information matched with the nouns
S305, generating at least one simulated training instruction execution inquiry message according to the simulated training instruction message
S306, receiving the simulated training instruction to execute the inquiry feedback information, and executing the inquiry feedback information according to the simulated training instruction to generate a simulated training instruction.
On the basis of the beneficial effects of the scheme shown in fig. 1, in the scheme, the interactive control method supports the voice information of multi-country voice, and the universality of the simulation training equipment configured with the interactive control method can be improved.
Fig. 4 is a flow chart of another interactive control method for a simulated training device in an example, and referring to fig. 4, as an implementable embodiment, on the basis of the schemes shown in fig. 1 to fig. 3, the interactive control method may further include:
s401, judging whether the voice information contains Chinese and foreign language at the same time, and if the voice information contains Chinese and foreign language at the same time, unifying the voice information into Chinese voice information or foreign language voice information.
S402, receiving the voice information, judging whether the voice information contains connection words, verbs and nouns, and if the voice information contains the connection words, removing the connection words.
And S403, if the voice information comprises verbs and nouns, inquiring a piece of simulated training instruction information matched with the verbs and the nouns.
S404, if the voice information comprises nouns, inquiring at least one piece of simulated training instruction information matched with the nouns.
S405, generating at least one simulated training instruction execution inquiry message according to the simulated training instruction message.
And S406, receiving the simulated training instruction to execute the inquiry feedback information, and executing the inquiry feedback information according to the simulated training instruction to generate a simulated training instruction.
And S407, generating a simulation training instruction and sending inquiry information.
S408, receiving the simulated training instruction, sending inquiry feedback information, and sending the simulated training instruction according to the simulated training instruction, sending the inquiry feedback information.
Example two
The embodiment provides an interactive control device for a simulation training device, which includes an interactive control unit, where the interactive control unit is configured to:
receiving voice information, judging whether a connection word, a verb and a noun exist in the voice information, and if the connection word exists in the voice information, removing the connection word;
if the voice information comprises verbs and nouns, inquiring simulated training instruction information matched with the verbs and the nouns;
if the voice information comprises nouns, inquiring at least one piece of simulated training instruction information matched with the nouns;
generating at least one piece of simulated training instruction execution inquiry information according to the simulated training instruction information;
and receiving simulation training instruction execution inquiry feedback information, and generating a simulation training instruction according to the simulation training instruction execution inquiry feedback information.
Illustratively, in one possible embodiment, the interactive control unit may also be configured to implement the scheme shown in FIG. 2.
Illustratively, in one possible embodiment, the interactive control unit may also be configured to implement the scheme shown in FIG. 3.
Illustratively, in one possible embodiment, the interactive control unit may also be configured to implement the scheme shown in FIG. 4.
For example, in this embodiment, the specific implementation and beneficial effects of the interaction control unit are the same as those described in the first embodiment, and detailed descriptions thereof are omitted.
EXAMPLE III
The embodiment provides an interactive control system for simulated training equipment, which includes a controller, where the controller is configured with an executable program, and when the executable program runs, the interactive control method for simulated training equipment described in the first embodiment is implemented.
In an exemplary embodiment, the interactive control system of the simulated training device is specifically applied to a flight simulated training device.
FIG. 5 is a block diagram of an interactive control system of the simulated training apparatus in an example, and referring to FIG. 5, in an embodiment, the simulated training apparatus may include: a voice system 100, an instructor station system 200, a motion system 300, a vision system 400, a SATCE (simulated air traffic control environment) system 500.
Illustratively, the simulation training device shown in fig. 5 is dedicated to flight simulation training, the instructor platform system is an instruction center of the whole flight simulation training device, and the instructor platform system is mainly used for controlling the simulation training device to realize conventional training subjects of the airplane.
In this embodiment, any one of the simulation training device interaction control apparatuses in the second embodiment is further configured in the instructor station system 200.
Illustratively, the speech system 100 is configured to collect speech information, simulate training instructions to execute query feedback information (speech), simulate training instructions to send query feedback information (speech); and outputting a simulated training instruction to execute the inquiry information (voice), and outputting the simulated training instruction to send the inquiry information (voice).
For example, in the present embodiment, the speech system 100 includes a radio device, which includes a wireless bluetooth microphone, a headset for pilot communication on an airplane simulator, and the like.
For example, in the present embodiment, the speech system 100 may be further configured to convert the speech into audio and perform noise reduction processing on the audio, where the noise includes environmental noise, a simulated training device vibration sound effect, an alarm sound, and the like.
Illustratively, the instructor station system 200 may be further configured to collect simulated training instructions to execute query feedback information (text), and to send the query feedback information (text) by the simulated training instructions; and outputting a simulation training instruction to execute the inquiry information (characters), and transmitting the inquiry information (characters) by the simulation training instruction.
In the present embodiment, the motion system 300 simulates the motion of a specific component or assembly of an aircraft, and the vision system 400 is used to provide simulated visual information such as a simulated environment, an interactive interface for aircraft simulated operation, and the like.
Illustratively, in the present embodiment, the following simulated training functions can be implemented by the instructor station system 200, the motion system 300 and the vision system 400:
flight state simulation: performing position freezing, performing flight freezing, performing height freezing, and performing total freezing;
repositioning simulation: relocating runway positions, relocating parking positions, relocating 3 nautical miles, relocating 6 nautical miles, relocating 9 nautical miles, relocating 12 nautical miles, relocating 10000 feet and relocating 35000 feet;
airport selection simulation: setting a take-off airport and a landing airport;
aircraft service setting simulation: switching on a ground power supply, switching on a ground air source, and quickly starting the engine;
and (3) system reset simulation: a reset system, resetting an Auxiliary Power Unit (APU), resetting an engine exhaust temperature (EGT), resetting fuel, resetting a brake temperature, resetting a landing gear flat tire, resetting a Ram Air Turbine (RAT);
and (3) environment setting simulation: setting atmospheric temperature, setting wind direction, setting wind speed, setting gust speed, setting cloud layer, setting fog, setting rain, setting storm, setting volcanic ash, setting bird strike, setting correction sea level air pressure (QNH), setting scene air pressure (QFE), setting visibility (clear days, first-class blind landing, second-class blind landing, third-class blind landing and the like), setting runway roughness, and setting runway states (dry runway, wet runway, ice runway and the like);
wind shear setting simulation: setting takeoff wind shear, landing wind shear and interrupting takeoff wind shear;
initial condition setting simulation: the engine is started on the ground, is arranged in a ground cold cabin and is arranged in the air by 10000 feet;
and (3) fault setting simulation: the method comprises the following steps of overheating a cockpit (ATA 21), disconnecting an automatic accelerator (ATA 22), failing on the long side of a VHF (VHF) engine (ATA 23), turning off a generator 1 (ATA 24), enabling an APU (APU) to control a fire alarm (ATA 26), blocking an elevator (ATA 27), failing on the left side of a central fuel tank (ATA 28), failing on an electric pump 1 (ATA29), failing on an anti-ice valve of an engine 1 (ATA 30), unreliable airspeed on the long side (ATA 34), failing on the bleed air of the engine 1 (ATA 36), failing on the APU (ATA 49), failing on a gate (ATA 52), and stalling on the engine 1 (ATA 71);
quick checklist (QRH) simulation: the starting of the engine is stopped, the airspeed is unreliable, an APU is in fire alarm, the engine drops in an emergency, the pressure is quickly released, the setting surface is out of control, and smoke, burning smell or peculiar smell and the like are generated;
flight plan setting simulation: recording a flight plan and loading the flight plan;
setting and simulating an anti-collision system: conflict, conflict; climbing, climbing; descending, descending; accelerating climbing; accelerating to descend; climbing at a reduced speed; climbing, now climbing; down, now down; maintaining the vertical speed; adjusting the vertical speed; note the vertical velocity; an intersection point; conflict resolution;
light setting simulation: runway lights (runway edge lights, runway entrance lights, entrance wing bank lights, ground zone lights, runway centerline lights, runway end lights, etc. and brightness settings), airplane lights (headlight/glide lights, landing lights, navigation lights, etc. and brightness settings);
door setting simulation: the opening and closing states of a cockpit door, a cabin door, a branch boarding door, a service door, an on-wing emergency door, a front cargo cabin door, a rear cargo cabin door, a bulk cargo cabin door and the like;
sound setting simulation: microphone panel selection, Very High Frequency (VHF)1/2/3, High Frequency (HF)1/2, Cabin (CAB), passenger radio (PA), Navigation (NAV)1/2, etc., selective calling (VHF1/2/3, HF1/2), switching cabin calls, switching ground calls, adjusting volume level;
setting a simulator: the aircraft type selection selects chinese and english, switches over the unit (international unit, the European and American standard), switch analog machine light, opens and stops the motion system, switch visual system, notices: the emergency start-stop function is not in the voice control range;
other settings are as follows: circuit Breaker (Cb) setting, help, etc.
In the present exemplary scenario, SATCE system 500 is primarily used to provide a simulated air traffic control environment.
In the present embodiment, a voice-controlled selection of a designated general training subject of the airplane can be realized based on the voice system 100 and the instructor station system 200.
Illustratively, the instructor station system 200 generates a simulated training instruction, and after the instructor confirms that the simulated training instruction is sent, the instructor station system 200 sends the simulated training instruction to the relevant motion system 300 and vision system 400 to implement the corresponding simulated training function.
In the present exemplary scenario, a simulated air traffic control scenario may be implemented based on the speech system 100, the instructor station system 200, the vision system 400, and the SATCE system 500.
In the present exemplary embodiment, SATCE system 500 is primarily used to implement point-to-point communications between a teacher and a student to simulate real-world interactive communications between a pilot and a tower.
For example, in implementing a simulated air traffic control scenario, the simulated training instructions may be used to configure the volume of the speech output of the SATCE system 500; and generating standard traffic control interactive information.
In the present embodiment, a set of standard traffic control interaction information refers to a predetermined communication interaction process, where the communication interaction process specifies each piece of information (including content and format) that should be provided in sequence when the pilot communicates with the tower by voice, and the content and format when the tower replies to each piece of information.
For example, when the simulated training instruction is used for generating the standard traffic control interaction information, the voice information generally only includes specified nouns, and unlike the conventional training subjects of the selected and specified airplane, the nouns are matched with the simulated training instruction information, but are pre-stored standard traffic control interaction information.
For example, if the noun in the voice message is determined to be "ground", a contact ground database and a pre-navigation information database are called to obtain corresponding standard traffic control interaction information; if the noun in the voice information is determined to be 'tower', a tower database and a departure information database are called to obtain corresponding standard traffic control interaction information.
Illustratively, in one possible implementation, when contacting the ground, the set of standard traffic control interaction information includes the following:
a pilot: beijing, Earth, Accel 320.
And (3) recovering: accel320, ground, good morning/good afternoon/good evening.
Remarking: in the standard reply format, the Accel320 is the model used, the ground is the state quantity, and the morning good/afternoon good/evening good is determined according to the system time of the instructor station system 200.
The pilot: radio testing, do you listen to me a few?
And (3) recovering: accel320, 5.
Remarking: 1 represents that the voice can not be heard at all, 2 represents that the noise is too big to be heard clearly, 3 represents that the voice can be heard clearly, 4 represents that the call quality is good, and 5 represents that the voice is very clear.
The pilot: beijing, land, Accel320, requests a push-out drive.
And (3) recovering: accel320, can push out the driving, the aircraft nose is north.
A pilot: it can be pushed out with the nose facing north, Accel320 (push out rear brake).
A pilot: beijing, Accel320, requests taxi.
And (3) recovering: accel320, to the 36 outer right hand waiting point.
A pilot: may coast, waiting outside the right of runway 36, Accel 320.
Accel320, contact Beijing Tower 118.50, Byehou
A pilot: contact the tower 118.5, see again.
Illustratively, in one possible implementation, when contacting the tower, the set of standard traffic control interaction information includes the following:
a pilot: beijing tower, Accel320, runway 36 waits out to the right, requesting entry to the runway.
And (3) recovering: accel320, see ahead aircraft after takeoff, can enter runway.
A pilot: accel320, has entered right of runway 36.
And (3) recovering: accel320, 100 degrees and 20 knots of ground wind direction, sea pressure correction 1015, takeoff, automatic wave-disengaging from the ground and connection to a departure 123.00.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A method for controlling interaction of a simulated training device is characterized by comprising the following steps:
receiving voice information, judging whether a connection word, a verb and a noun exist in the voice information, and if the connection word exists in the voice information, removing the connection word;
if the voice information comprises the verb and the noun, inquiring a piece of simulated training instruction information matched with the verb and the noun;
if the voice information comprises the noun, inquiring at least one piece of simulated training instruction information matched with the noun;
generating at least one piece of simulated training instruction execution inquiry information according to the simulated training instruction information;
receiving simulation training instruction execution inquiry feedback information, and generating a simulation training instruction according to the simulation training instruction execution inquiry feedback information.
2. The method as claimed in claim 1, wherein the step of generating the simulation training instruction according to the simulation training instruction after executing the query feedback information further comprises:
generating a simulated training instruction and sending inquiry information;
receiving a simulated training instruction and sending inquiry feedback information, and sending the inquiry feedback information according to the simulated training instruction and sending the simulated training instruction.
3. The method of claim 2, wherein sending the simulated training instructions based on the simulated training instructions sending query feedback information comprises:
if the inquiry feedback information sent by the simulated training instruction is negative information, regenerating the inquiry information sent by the simulated training instruction;
and if the inquiry feedback information sent by the second received simulated training instruction is negative information, stopping sending the simulated training instruction.
4. The simulated training apparatus interaction control method as claimed in claim 1, wherein the inquiring of the simulated training instruction information matched with said verb and noun comprises:
determining a synonymous aviation term verb corresponding to the verb, determining a synonymous aviation term noun corresponding to the noun, and querying simulated training instruction information including the synonymous aviation term verb and the synonymous aviation term noun.
5. The method of interactive control of a simulated training device as claimed in claim 1, wherein said simulated training instructions executing query information comprises: the voice simulation training instruction executes the inquiry information, or the character simulation training instruction executes the inquiry information;
the simulation training instruction execution inquiry feedback information comprises: the voice simulation training instruction executes the inquiry feedback information, or the text simulation training instruction executes the inquiry feedback information.
6. The method as claimed in claim 5, wherein if the simulated training instruction execution query message uses a voice simulated training instruction execution query message, and the simulated training instruction execution query feedback message uses a voice simulated training instruction execution query feedback message, then:
and when a plurality of pieces of voice simulation training execution inquiry information are generated, if the voice simulation training execution inquiry feedback information corresponding to the current voice simulation training execution inquiry information is negative information, sequentially outputting the next voice simulation training execution inquiry information.
7. The interactive control method for simulation training equipment of claim 1, wherein the voice information comprises chinese voice information, foreign language voice information.
8. The interactive control method for simulation training equipment of claim 7, wherein if the phonetic information contains both Chinese and foreign languages:
and unifying the voice information into Chinese voice information or foreign language voice information.
9. The interactive control device for the simulation training equipment is characterized by comprising an interactive control unit, wherein the interactive control unit is used for:
receiving voice information, judging whether a connection word, a verb and a noun exist in the voice information, and if the connection word exists in the voice information, removing the connection word;
if the voice information comprises the verb and the noun, inquiring a piece of simulated training instruction information matched with the verb and the noun;
if the voice information comprises the noun, inquiring at least one piece of simulated training instruction information matched with the noun;
generating at least one piece of simulated training instruction execution inquiry information according to the simulated training instruction information;
receiving simulation training instruction execution inquiry feedback information, and generating a simulation training instruction according to the simulation training instruction execution inquiry feedback information.
10. A system for controlling interaction of a simulated training device, comprising a controller configured with an executable program, wherein the executable program is operable to implement the method for controlling interaction of a simulated training device according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210313940.0A CN114664301A (en) | 2022-03-28 | 2022-03-28 | Interactive control method, device and system for simulation training equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210313940.0A CN114664301A (en) | 2022-03-28 | 2022-03-28 | Interactive control method, device and system for simulation training equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114664301A true CN114664301A (en) | 2022-06-24 |
Family
ID=82033760
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210313940.0A Pending CN114664301A (en) | 2022-03-28 | 2022-03-28 | Interactive control method, device and system for simulation training equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114664301A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115630532A (en) * | 2022-12-19 | 2023-01-20 | 安胜（天津）飞行模拟系统有限公司 | Rapid repositioning method for full-motion flight simulator |
-
2022
- 2022-03-28 CN CN202210313940.0A patent/CN114664301A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115630532A (en) * | 2022-12-19 | 2023-01-20 | 安胜（天津）飞行模拟系统有限公司 | Rapid repositioning method for full-motion flight simulator |
| CN115630532B (en) * | 2022-12-19 | 2023-05-05 | 安胜（天津）飞行模拟系统有限公司 | Rapid repositioning method for full-motion flight simulator |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7881832B2 (en) | Automatic speech recognition system and method for aircraft | |
| US10818192B2 (en) | Conflict alerting method based on control voice | |
| CN106910376B (en) | Air traffic operation control instruction monitoring method and system | |
| CN110444201A (en) | The speech recognition system and method for aircraft | |
| CN114664301A (en) | Interactive control method, device and system for simulation training equipment | |
| CN103578299B (en) | A kind of method simulating aircraft process | |
| CN114019939A (en) | Civil aircraft cockpit distributed simulation system | |
| CN111627257B (en) | Control instruction safety rehearsal and verification method based on aircraft motion trend prejudgment | |
| CN114004074A (en) | Comprehensive verification system for situation perception enhancement display system | |
| CN204433075U (en) | Many rotor wing unmanned aerial vehicles acousto-optic interactive device | |
| CN108045589B (en) | A kind of helicopter VNE alarm method | |
| CN110844092B (en) | Aircraft fault warning method and system | |
| CN105204329A (en) | Preflight sound control equipment checking method and system for unmanned aerial vehicle | |
| EP3677515A1 (en) | Systems and methods for optimizing landing lights operation onboard an aircraft | |
| CN114202989B (en) | Universal training equipment and method for different electric vertical take-off and landing airplanes | |
| Silberstein et al. | Cockpit communication under high cognitive workload | |
| CN110702144A (en) | Method for verifying strapdown inertia and GPS satellite integrated navigation system by mounting aircraft | |
| JP3899391B2 (en) | Air traffic simulator | |
| CN111105668A (en) | Flight passenger cabin service simulation training system | |
| CN114927023B (en) | Main navigation system verification system based on airport airspace flight simulation platform | |
| CN108648559B (en) | Reconfigurable simulation cabin equipment system architecture | |
| CN117636851A (en) | Automatic shunting method and device for airborne voice interaction function | |
| CN104168393B (en) | A kind of voice scheduling method for generating the empty call voice content in optimal land | |
| Schäfer | A cognitive model of expert behaviour in an air traffic control task: enhanced speech recognition using situational howledge | |
| CN111833836A (en) | Civil aircraft cabin or cockpit environmental noise simulator |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |