CN116543618A - Virtual reality-based airplane driving teaching method and system - Google Patents
Virtual reality-based airplane driving teaching method and system Download PDFInfo
- Publication number
- CN116543618A CN116543618A CN202310329721.6A CN202310329721A CN116543618A CN 116543618 A CN116543618 A CN 116543618A CN 202310329721 A CN202310329721 A CN 202310329721A CN 116543618 A CN116543618 A CN 116543618A
- Authority
- CN
- China
- Prior art keywords
- training
- simulation
- driving
- scene
- airplane
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000012549 training Methods 0.000 claims abstract description 193
- 238000004088 simulation Methods 0.000 claims abstract description 70
- 238000011156 evaluation Methods 0.000 claims abstract description 33
- 230000008569 process Effects 0.000 claims abstract description 25
- 238000004891 communication Methods 0.000 claims abstract description 16
- 230000000694 effects Effects 0.000 claims abstract description 11
- 238000005516 engineering process Methods 0.000 claims description 9
- 238000004422 calculation algorithm Methods 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 claims description 6
- 238000013079 data visualisation Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 4
- 230000007613 environmental effect Effects 0.000 abstract description 3
- 230000002452 interceptive effect Effects 0.000 abstract description 3
- 238000013461 design Methods 0.000 description 7
- 238000007689 inspection Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 101000799969 Escherichia coli (strain K12) Alpha-2-macroglobulin Proteins 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 229910052760 oxygen Inorganic materials 0.000 description 3
- 239000001301 oxygen Substances 0.000 description 3
- 238000002360 preparation method Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 2
- 238000004804 winding Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- AXCZMVOFGPJBDE-UHFFFAOYSA-L calcium dihydroxide Chemical compound [OH-].[OH-].[Ca+2] AXCZMVOFGPJBDE-UHFFFAOYSA-L 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000013210 evaluation model Methods 0.000 description 1
- 239000010720 hydraulic oil Substances 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000003921 oil Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
- G09B9/08—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
- G09B9/08—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
- G09B9/30—Simulation of view from aircraft
- G09B9/307—Simulation of view from aircraft by helmet-mounted projector or display
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides an aircraft driving teaching method and system based on virtual reality, comprising the following steps: the method comprises the steps of sending an airplane driving training task to a server terminal in the form of an instruction; the server terminal reads the training task instruction, generates a corresponding three-dimensional simulation training scene, and is connected with VR equipment through a communication protocol data interface to perform VR simulation training operation on the training task; the server terminal records the VR simulated training operation process in real time, and compares and judges the VR simulated training operation process with correct steps in the airplane driving operation instruction to generate judgment scores; and transmitting the evaluation score to a display interface for display so as to facilitate the user to check the training result. According to the invention, the immersive scene presentation is performed in a virtual reality mode, so that students are trained in a virtual environment with stereoscopic impression, immersive impression and realism, and are not restricted by weather and environmental factors, the training expense is saved, and the training effect and interactive experience are improved.
Description
Technical Field
The invention relates to the technical field of virtual simulation teaching, in particular to an aircraft driving teaching method and system based on virtual reality.
Background
Before the formal piloting aircraft or when the aircraft piloting aircraft is replaced, the aircraft piloting personnel need to be trained, so that the flight piloting personnel are familiar with the piloting operation of the aircraft, and the aircraft piloting personnel are more and more trained in the piloting training, so that the training cost is increased and the safety is lower if the aircraft piloting personnel are actually operated.
In the prior art, a man-machine interface and a window operation mode are generally adopted to train an airplane pilot, the method cannot provide a vivid and realistic actual flight scene for the trained airplane pilot, and the actual immersion is lacked, so that the training effect is poor, and the safety and accuracy of actually operating the airplane are affected.
Through virtual reality technology (VR, a computer simulation system capable of creating and experiencing virtual worlds), a virtual information environment is created on a multidimensional information space, users can have immersive sense of being personally on the scene), a flight training system is developed, students are immersed in a real aircraft cockpit environment and a realistic flight environment, and personally on the scene learn and drive operations, so that the cost of flight training is reduced, and the safety and accuracy of flight operations are improved.
Disclosure of Invention
According to a first aspect of the object of the present invention, there is provided an aircraft piloting teaching method based on virtual reality, comprising:
step 1, sending an airplane driving training task to a server terminal in the form of an instruction;
step 2, the server terminal reads the training task instruction, generates a corresponding three-dimensional simulation training scene, and connects with VR equipment through a communication protocol data interface to perform VR simulation training operation on the training task;
step 3, the server terminal records the VR simulated training operation process in real time, and compares and judges the VR simulated training operation process with the correct steps in the airplane driving operation instruction to generate judgment scores;
and 4, transmitting the evaluation score to a display interface for displaying so as to facilitate the user to check the training result.
Further, in the foregoing step 1, the sending of the aircraft driving training task to the server terminal in the form of an instruction includes:
setting a flight driving training task according to the flight driving training requirement, wherein the setting content comprises subjects, roles, environments and time;
according to the setting content, reading corresponding resource information in a data resource library, and matching the corresponding resource information into a set flight driving training task in real time;
after matching is completed, adding a flight route to the set flight driving training task, wherein the flight starting point is fixed, a landing airport is selected, and the setting of the flight driving training task is completed;
and generating a training task instruction for the successfully set flight driving training task, and sending the training task instruction to the server terminal for execution.
Further, in the foregoing step 2, the server terminal reads the training task instruction, generates a corresponding three-dimensional simulated training scene, and connects to the VR device through the communication protocol data interface, and performs VR simulated training operation on the training task, including:
the server terminal reads the training task instruction, and invokes three-dimensional scene data matched with flight driving training task information resources in a three-dimensional scene database to generate a three-dimensional simulation training scene;
the VR equipment is connected with the server terminal through a communication protocol data interface;
the VR equipment reads the three-dimensional simulation training scene through a virtual simulation display technology to generate a virtual simulation training scene;
the virtual simulation training scene displays the flight driving training task in a virtual reality mode, and the VR simulation training operation in the virtual simulation training scene is controlled through the VR equipment.
Further, in the step 3, the server terminal records the VR simulation training operation process in real time, and compares the VR simulation training operation process with the correct step of the airplane driving operation instruction to obtain a judgment score, which includes:
the server terminal records the VR simulated training operation process in real time, and invokes correct steps in the airplane driving operation instruction stored in the data center to compare with the operation steps in the VR simulated training operation process;
and calculating the coincidence degree of the correct step and the operation step by using the judgment model, and generating a judgment score.
Further, in the step 4, the server terminal transmits the generated evaluation score to a display interface, and displays the evaluation score in a data visualization manner.
According to a second aspect of the object of the present invention, there is provided an aircraft piloting teaching system based on virtual reality, comprising:
the instructor side module is used for managing the aircraft driving teaching system, receiving the scores generated by the evaluation module so as to count and analyze training effects of students, providing setting services of aircraft driving training tasks for the instructor, calling corresponding resource information in the data resource library, and generating corresponding training task instructions;
the student end module is used for receiving the training task instruction to call three-dimensional scene data matched with flight driving training task information resources in a three-dimensional scene database and generate a three-dimensional simulation training scene;
the visual simulation module is used for simulating the cockpit environment and the flight environment of the airplane, and comprises VR equipment, wherein the three-dimensional simulation training scene in the student side module is read through the input of data signals to generate a virtual simulation training scene, and VR simulation training operation in the virtual simulation training scene is controlled through the VR equipment;
the evaluation module is used for evaluating the operation data in the VR simulation training operation process, extracting characteristic factors of the operation data through an evaluation algorithm, and comparing the characteristic factors with correct step data in the airplane driving operation description to generate scores.
Further, the learner-side module is connected with the instructor-side module through a data protocol stack.
Further, the view simulation module is connected with the student side module through a digital information protocol interface, and the student side module records VR simulation training operation performed in the view simulation module in real time.
Further, the evaluation module is connected with the student end module through a digital information protocol interface, acquires VR simulation training operation records in the student end module, invokes a judgment algorithm to carry out comparison evaluation, and generates a score.
Further, the teaching system also comprises a display interface;
the display interface is connected with the instructor side module and the learner side module through a protocol interface, and is used for visually processing the scores generated by the evaluation module through data and displaying the scores.
Compared with the prior art, the invention has the beneficial effects that: according to the invention, the immersive scene presentation is performed in a virtual reality mode, so that students are trained in a virtual environment with stereoscopic impression, immersive impression and realism, and are not restricted by weather and environmental factors, the training expense is saved, and the training effect and interactive experience are improved.
It should be understood that all combinations of the foregoing concepts, as well as additional concepts described in more detail below, may be considered a part of the inventive subject matter of the present disclosure as long as such concepts are not mutually inconsistent. In addition, all combinations of claimed subject matter are considered part of the disclosed inventive subject matter.
The foregoing and other aspects, embodiments, and features of the present teachings will be more fully understood from the following description, taken together with the accompanying drawings. Other additional aspects of the invention, such as features and/or advantages of the exemplary embodiments, will be apparent from the description which follows, or may be learned by practice of the embodiments according to the teachings of the invention.
Drawings
The drawings are not intended to be drawn to scale. In the drawings, each identical or nearly identical component that is illustrated in various figures may be represented by a like numeral. For purposes of clarity, not every component may be labeled in every drawing. Embodiments of various aspects of the invention will now be described, by way of example, with reference to the accompanying drawings.
FIG. 1 is a schematic flow diagram of a virtual reality-based airplane pilot teaching method of the present invention;
fig. 2 is a schematic block diagram of the virtual reality-based airplane pilot teaching system according to the present invention;
fig. 3 is a schematic diagram of an overall frame structure of the virtual reality-based airplane pilot teaching method and system according to the present invention.
Detailed Description
For a better understanding of the technical content of the present invention, specific examples are set forth below, along with the accompanying drawings.
Aspects of the invention are described in this disclosure with reference to the drawings, in which are shown a number of illustrative embodiments. The embodiments of the present disclosure are not necessarily intended to include all aspects of the invention. It should be understood that the various concepts and embodiments described above, as well as those described in more detail below, may be implemented in any of a number of ways, as the disclosed concepts and embodiments are not limited to any implementation. Additionally, some aspects of the disclosure may be used alone or in any suitable combination with other aspects of the disclosure.
According to an embodiment of the present invention, in conjunction with the flowchart shown in fig. 1, an aircraft driving teaching method based on virtual reality includes four stages:
a training preparation stage, a training implementation stage, a training evaluation stage and a training result display stage;
specifically, the four stages include the following steps:
[ training preparation stage ]
Step 1, sending an airplane driving training task to a server terminal in the form of an instruction;
the step needs to be described as follows:
setting a flight driving training task according to the flight driving training requirement, wherein the setting content comprises subjects, roles, environments and time;
according to the setting content, reading corresponding resource information in a data resource library, and matching the corresponding resource information into a set flight driving training task in real time;
after matching is completed, adding a flight route to the set flight driving training task, wherein the flight starting point is fixed, a landing airport is selected, and the setting of the flight driving training task is completed;
and generating training task instructions for the successfully set flight driving training tasks, and sending the training task instructions to the server terminal for execution.
[ training implementation stage ]
Step 2, the server terminal reads the training task instruction, generates a corresponding three-dimensional simulation training scene, and connects with VR equipment through a communication protocol data interface to perform VR simulation training operation on the training task;
the step needs to be described as follows:
the method comprises the steps that a server terminal reads a training task instruction, and three-dimensional scene data matched with flight driving training task information resources in a three-dimensional scene database is called to generate a three-dimensional simulation training scene;
the VR equipment is connected with the server terminal through a communication protocol data interface;
the VR equipment reads the three-dimensional simulation training scene through a virtual simulation display technology, and generates a virtual simulation training scene;
the virtual simulation training scene displays the flight driving training task in a virtual reality mode, and VR simulation training operation in the virtual simulation training scene is controlled through VR equipment.
[ training evaluation stage ]
Step 3, the server terminal records the VR simulated training operation process in real time, and compares and judges the VR simulated training operation process with the correct steps in the airplane driving operation instruction to generate judgment scores;
the step needs to be described as follows:
the server terminal records the VR simulated training operation process in real time, and invokes correct steps in the airplane driving operation instruction stored in the data center to compare with the operation steps in the VR simulated training operation process;
and calculating the coincidence degree of the correct step and the operation step by using the judgment model, and generating a judgment score.
Further, performing the evaluation model calculation includes:
extracting characteristic values of the operation steps to perform standardization treatment to obtain standardized indexes;
based on the fuzzy comprehensive judgment matrix, constructing a judgment model, importing a standardized index for operation, and generating a score, wherein the mathematical expression formula is as follows:
B i ＝[b i1 ，b i2 ，…，im]
P＝A·B i ·τ
wherein b i1 Evaluating 1 compliance for a standardized index of operating step feature values for correct steps in an aircraft cockpit operating specification, b i2 Evaluating 2 compliance for a standardized index of operating step feature values for correct steps in an aircraft cockpit operating specification, b im And evaluating the conformity of m for the standardized index of the characteristic value of the operation step to the correct step in the airplane driving operation description, wherein B is the evaluation conformity to the standardized index, P is the judgment score, A is the weight value, and tau is the fuzzy comprehensive judgment parameter.
[ training results display stage ]
And 4, the server terminal transmits the generated judgment score to a display interface, and the judgment score is displayed in a data visualization mode so that a user can conveniently check a training result.
It should be noted that, in this embodiment, the airplane driving training mode is immersively presented in a virtual reality mode, and virtual simulation training scenes are constructed by introducing virtual reality technology (VR), so that students perform training interaction in a virtual environment with three-dimensional sense, immersive sense and realism, and master the operation and use methods, notes, programs at each stage of take-off and landing, and special situation treatment methods of airplane driving, so that the students generate thick learning interests.
Preferably, in the embodiment, the consistency of the operation steps in the VR simulation training operation process and the correct steps in the airplane driving operation description is judged by adopting the fuzzy comprehensive judgment matrix, the extracted characteristic values are subjected to standardized index processing, the judgment accuracy is improved, the dimension influence is eliminated by combining the weight and the reference of the fuzzy comprehensive judgment parameters, the judgment accuracy is further improved, and the generated judgment score has more confidence.
The method for matching resources and calculating indexes and scoring for the flight driving training task can be performed by means of a mode and means in the prior art, and is not described in detail in this example.
Referring to fig. 2 and fig. 3, the present embodiment further provides an aircraft driving teaching system implemented by an aircraft driving teaching method based on virtual reality, which includes a instructor side module, a learner side module, a view simulation module, an evaluation module, and a display interface;
the instructor side module is used for managing the airplane steering teaching system, receiving the scores generated by the evaluation module so as to count and analyze the training effect of the trainee, providing setting service of airplane steering training tasks for the instructor, calling corresponding resource information in the data resource library, and generating corresponding training task instructions;
the student end module is connected with the instructor end module through a data protocol stack, and is used for receiving training task instructions so as to call three-dimensional scene data matched with flight driving training task information resources in a three-dimensional scene database and generate a three-dimensional simulation training scene, and the student end module records VR simulation training operation performed in the vision simulation module in real time;
the visual simulation module is connected with the student side module through a digital information protocol interface and is used for simulating and simulating the aircraft cockpit environment and the flight environment, the visual simulation module comprises VR equipment, the three-dimensional simulation training scene in the student side module is read through the input of data signals, a virtual simulation training scene is generated, and VR simulation training operation in the virtual simulation training scene is controlled through the VR equipment;
the evaluation module is connected with the student side module through a digital information protocol interface and is used for acquiring VR simulation training operation records in the student side module, calling a judgment algorithm to compare and judge operation data in the VR simulation training operation process with correct step data in the airplane driving operation description, and generating scores;
the display interface is connected with the instructor side module and the learner side module through the protocol interface, and is used for visually processing the scores generated by the evaluation module and displaying the scores.
As an alternative embodiment, the virtual reality-based airplane steering teaching system adopts a modular design, and consists of a core technology layer, a data service layer, a software application layer, a user interaction layer and a hardware device layer.
As an optional embodiment, the hardware device layer is used for constructing a hardware environment capable of guaranteeing the operation of the teaching system, and comprises a learner-side module and a instructor-side module, wherein the learner-side module is matched with the VR integrated machine device, is connected in a networking manner through a wireless router, can perform collaborative simulation training, sees a three-dimensional simulation scene generated by the live-action simulation module in the VR helmet, and controls the simulation scene to operate by utilizing a handle; the instructor side module is provided with a high-performance notebook computer so as to ensure smooth running of instructor side software and monitor the instructor side software in the operation process of the instructor side.
As an alternative embodiment, the user interaction layer is to design input and output and communication functions in the teaching system, the design of the system communication network adopts the communication principle of UDP/TCP, the network communication design is carried out by Socket (the Socket is a group of network programming interfaces, two computers transmit data through the network interfaces just like the pipeline communication of the same computer), the network communication between the learner side module and the learner side module can be met, the learner side module can detect the online condition of the learner side module and issue subjects to the learner side module, and transmit the real-time three-dimensional simulation operation data, operation step text, judgment results, scores and other data of the learner side module back to the learner side module, and the learner side module can store the data so as to view the data at any time.
As an optional embodiment, the software application layer is used for designing software functions in the teaching system, such as a three-dimensional simulation scene model and an operation evaluation function, wherein the three-dimensional simulation scene model is used for three-dimensional visual simulation of a standard flight program and equipment simulation of an operation model, and the three-dimensional simulation scene model is generated by analyzing photos, explanatory diagrams and dimension diagram data of the operation model and restoring detailed characteristics of aircraft equipment by utilizing a three-dimensional modeling technology; the operation evaluation function compares and evaluates the operation steps of the software at the trainee end, and the whole training subject design comprises correct program tasks and special condition program tasks.
As an optional embodiment, the core technology layer is to build a simulation system basic framework by using a virtual simulation three-dimensional engine, the whole teaching system can be subjected to modularized design by using the simulation system basic framework, the three-dimensional scene and the training task are managed, the three-dimensional simulation model scene is modeled and optimized by using the three-dimensional engine, and the physical special effects, the collision effects and the shadow effects of the model are simulated by using a core algorithm.
As an alternative embodiment, the data service layer is to design a proper database to manage the data in the teaching system, and the teaching system adopts an open source database as a bottom database, has stable and efficient big data information processing capability and is used for storing scene data, model data, sound data, training data and test question library data.
Preferably, the present embodiment is exemplified by an aircraft cockpit device inspection training task, and is illustrated in conjunction with the foregoing, to more specifically describe the implementation and/or effects of certain examples of the present invention.
[ training preparation stage ]
After the instructor logs in the instructor side module, a room is created to set an aircraft cockpit device inspection training task, an aircraft cockpit device inspection subject, a trainee training and a common flight environment (sunny days and plain zones) are selected, and the training time is set to be one hour;
the instructor side module adaptively reads corresponding resource information in the data resource base according to the content set by the instructor, and matches the corresponding resource information to the set flight driving training task in real time;
after completion of the progress bar to be matched, the instructor selects an added flight route, such as: the Nanjing post airport is flown to the Beijing Daxing airport and the Nanjing post airport is flown to the Chengdu International airport;
the aircraft cockpit device checks that the training task setting is completed, the instructor selects a storage room (namely stores the created training task) and issues the room to the trainee side module, and the instructor side module adaptively generates instructions according to the instructor's options and transmits the instructions to the trainee side module for execution.
[ training implementation stage ]
The student end module reads the instruction sent by the instructor end module, and invokes three-dimensional scene data matched with the information resource of the inspection training task of the aircraft cockpit equipment in the three-dimensional scene database to generate a three-dimensional simulation training scene;
the visual simulation module is connected to the VR all-in-one equipment through a communication protocol interface, reads the three-dimensional simulation training scene in the trainee terminal module by utilizing a virtual simulation display technology, generates a virtual simulation training scene, and controls VR simulation training operation in the virtual simulation training scene through the VR all-in-one equipment;
the learner-side module records the VR simulation training operation in real time.
[ training evaluation stage ]
The evaluation module reads the VR simulation training operation process recorded by the student end module, and performs comparison judgment with the correct operation steps in real time through the judgment model;
for example: in the cockpit, subjects are prepared in advance, and the correct operation flow is as follows:
checking an engine panel, wherein the engine main electric doors 1 and 2 are closed;
normal position of the engine mode selector;
detecting a weather radar panel, and closing a radar electric door;
wind shear/predictive wind shear electric door closure;
gain knob auto-bit or CAL bit;
the mode selector is used for selecting the mode according to the requirement;
the landing gear handle is checked in the down position;
two wiper selectors are closed;
checking/setting the storage battery, and automatically positioning the buttons of the storage battery 1 and the storage battery 2;
if the external power supply is connected, when an AVAIL lamp on the external power supply button is on, the external power supply button is on;
the APU fire alarm test is carried out, and an APU fire alarm button is pressed in and a protecting cover is covered;
the fire extinguishing bottle indicator lamp is turned off;
the APU fire alarm test button is pressed, harmonic sounds are continuously repeated, if alternating current is available, the main warning lamp is turned on, the APU fire alarm button is turned on, the SQUIB lamp and the DISCH lamp are turned on, and APUFIRE on ECAM is used for warning;
then, the APU can be started, the main power valve of the APU is opened, the page of the APU which is turned on by the lamp appears on the SD, and at least 3 seconds is waited before the button power valve of the APUSTART is selected;
the APU starting button is turned on, and the aircraft unit is kept to be connected with an external power supply component so as to reduce the load of the APU, especially under the hot weather condition;
an air conditioner panel is arranged. When the APU is available, the APU bleed button is on;
delivering the automatic position of the air selector;
the zone temperature selector is on demand;
the dome lamp is opened to be dark and bright, and the light of other cockpit lamps is adjusted according to the requirement;
next, an ECAM/record check is made, with the RCL button pressed for 3 seconds, this action reproducing all warnings of the last flight crew clearance or cancellation;
checking a record book, checking release conditions of MEL/CDL project (according to requirements), and accepting execution by an airplane;
operating engineering annunciation OEB inspection;
next, ECAM page checks are performed. At the hatch/oxygen page, an oxygen pressure check is made to verify that the oxygen pressure is sufficient for the planned flight;
checking the oil level of hydraulic oil in a normal range on a hydraulic page;
engine page, checking that engine slip is within a normal range, CFM engine slip should be equal to or greater than 9.5 quart + projected consumption (average projected consumption 0.5 quart per hour);
the flap checking position is used for checking that the flap position displayed on the upper half part of the ECAM is consistent with the handle;
a speed reducing plate handle for checking and recovering and releasing the pre-positioning;
and (5) performing stop brake inspection. The accumulator pressure indication checks. The accumulator pressure indication must be in the green zone, if needed, using an electric pump for the yellow hydraulic system to supply pressure to the accumulator;
and stopping the brake handle to brake. In the process of checking the winding machine, the unit must brake the stop brake so as to check the brake wear indicator;
and (5) checking emergency equipment. The rear and top jump switch panels are checked to check all jump switch settings and reset as needed;
checking landing gear pins and sleeves, wherein three are stored on an airplane;
after the cockpit is prepared in advance, PM performs external winding machine inspection;
the evaluation module generates a judgment score by comparing the coincidence of the correct step in the airplane driving operation instruction and the VR simulation training operation step.
[ training results display stage ]
The evaluation module transmits the generated scores to a display interface, displays the scores in a data visualization mode, and stores student information (the date, time, name, account number, subject, role, total operation duration and scores of student training) for checking training tasks of the aircraft cockpit equipment to a instructor side module so as to know the actual training condition of the student.
Preferably, the airplane driving teaching method and system based on virtual reality provided by the embodiment perform immersive scene presentation in a virtual reality mode, so that students are trained in a virtual environment with three-dimensional sense, immersive sense and realism sense, are not restricted by weather and environmental factors, training expenses are saved, and training effect and interactive experience sense are improved.
While the invention has been described with reference to preferred embodiments, it is not intended to be limiting. Those skilled in the art will appreciate that various modifications and adaptations can be made without departing from the spirit and scope of the present invention. Accordingly, the scope of the invention is defined by the appended claims.
Claims (10)
1. An aircraft pilot teaching method based on virtual reality is characterized by comprising the following steps:
step 1, sending an airplane driving training task to a server terminal in the form of an instruction;
step 2, the server terminal reads the training task instruction, generates a corresponding three-dimensional simulation training scene, and connects with VR equipment through a communication protocol data interface to perform VR simulation training operation on the training task;
step 3, the server terminal records the VR simulated training operation process in real time, and compares and judges the VR simulated training operation process with the correct steps in the airplane driving operation instruction to generate judgment scores;
and 4, transmitting the evaluation score to a display interface for displaying so as to facilitate the user to check the training result.
2. The virtual reality-based airplane pilot teaching method according to claim 1, wherein in the step 1, the step of sending the airplane pilot training task to the server terminal in the form of an instruction includes:
setting a flight driving training task according to the flight driving training requirement, wherein the setting content comprises subjects, roles, environments and time;
according to the setting content, reading corresponding resource information in a data resource library, and matching the corresponding resource information into a set flight driving training task in real time;
after matching is completed, adding a flight route to the set flight driving training task, wherein the flight starting point is fixed, a landing airport is selected, and the setting of the flight driving training task is completed;
and generating a training task instruction for the successfully set flight driving training task, and sending the training task instruction to the server terminal for execution.
3. The virtual reality-based airplane driving teaching method according to claim 2, wherein in the step 2, the server terminal reads a training task instruction, generates a corresponding three-dimensional simulated training scene, connects with VR equipment through a communication protocol data interface, and performs VR simulated training operation on the training task, and includes:
the server terminal reads the training task instruction, and invokes three-dimensional scene data matched with flight driving training task information resources in a three-dimensional scene database to generate a three-dimensional simulation training scene;
the VR equipment is connected with the server terminal through a communication protocol data interface;
the VR equipment reads the three-dimensional simulation training scene through a virtual simulation display technology to generate a virtual simulation training scene;
the virtual simulation training scene displays the flight driving training task in a virtual reality mode, and the VR simulation training operation in the virtual simulation training scene is controlled through the VR equipment.
4. The virtual reality-based airplane driving teaching method according to claim 3, wherein in the step 3, the server terminal records the VR simulation training operation process in real time, and compares the VR simulation training operation process with the correct airplane driving operation instruction to obtain a judgment score, and the method comprises the following steps:
the server terminal records the VR simulated training operation process in real time, and invokes correct steps in the airplane driving operation instruction stored in the data center to compare with the operation steps in the VR simulated training operation process;
and calculating the coincidence degree of the correct step and the operation step by using the judgment model, and generating a judgment score.
5. The virtual reality-based airplane driving teaching method according to claim 4, wherein in the step 4, the server terminal transmits the generated evaluation score to a display interface, and displays the evaluation score in a data visualization manner.
6. An aircraft pilot teaching system based on virtual reality implemented by the aircraft pilot teaching method according to any one of claims 1-5, comprising:
the instructor side module is used for managing the aircraft driving teaching system, receiving the scores generated by the evaluation module so as to count and analyze training effects of students, providing setting services of aircraft driving training tasks for the instructor, calling corresponding resource information in the data resource library, and generating corresponding training task instructions;
the student end module is used for receiving the training task instruction to call three-dimensional scene data matched with flight driving training task information resources in a three-dimensional scene database and generate a three-dimensional simulation training scene;
the visual simulation module is used for simulating the cockpit environment and the flight environment of the airplane, and comprises VR equipment, wherein the three-dimensional simulation training scene in the student side module is read through the input of data signals to generate a virtual simulation training scene, and VR simulation training operation in the virtual simulation training scene is controlled through the VR equipment;
the evaluation module is used for evaluating the operation data in the VR simulation training operation process, extracting characteristic factors of the operation data through an evaluation algorithm, and comparing the characteristic factors with correct step data in the airplane driving operation description to generate scores.
7. The virtual reality-based airplane cockpit tutoring system of claim 6, wherein the learner-side module is connected to the instructor-side module via a data protocol stack.
8. The virtual reality-based airplane driving teaching system of claim 7, wherein the vision simulation module is connected with the learner-side module through a digital information protocol interface, and the learner-side module records VR simulation training operations performed in the vision simulation module in real time.
9. The virtual reality-based airplane driving teaching system according to claim 8, wherein the evaluation module is connected with the learner-side module through a digital information protocol interface, and the evaluation module obtains VR simulation training operation records in the learner-side module, invokes a judgment algorithm to perform comparison evaluation, and generates a score.
10. The virtual reality-based airplane cockpit tutorial system of claim 6, further comprising a display interface;
the display interface is connected with the instructor side module and the learner side module through a protocol interface, and is used for visually processing the scores generated by the evaluation module through data and displaying the scores.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310329721.6A CN116543618A (en) | 2023-03-30 | 2023-03-30 | Virtual reality-based airplane driving teaching method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310329721.6A CN116543618A (en) | 2023-03-30 | 2023-03-30 | Virtual reality-based airplane driving teaching method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116543618A true CN116543618A (en) | 2023-08-04 |
Family
ID=87456711
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310329721.6A Pending CN116543618A (en) | 2023-03-30 | 2023-03-30 | Virtual reality-based airplane driving teaching method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116543618A (en) |
-
2023
- 2023-03-30 CN CN202310329721.6A patent/CN116543618A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106128210B (en) | A kind of airborne radar Repair Training System and its control method | |
| CN106485980A (en) | A kind of airplane engines ground test run exercise system and its control method | |
| CA3000452C (en) | Assessing a training activity performed by a user in an interactive computer simulation | |
| US10991262B2 (en) | Performance metrics in an interactive computer simulation | |
| CN108229791A (en) | For reporting the electronic device and method of the training session based on sign | |
| CN106781809A (en) | A kind of training method and system for helicopter emergency management and rescue task | |
| CA2981338C (en) | Method and system for customizing a recorded real time simulation based on simulation metadata | |
| CN104111861A (en) | Unmanned aerial vehicle simulation training system and control method thereof | |
| EP2439718A1 (en) | Vehicle simulation system and procedure integrated training | |
| KR20190124045A (en) | System for training and education using augmented reality and method for training and education using therof | |
| CN109389879A (en) | A kind of helicopter rescue skills virtual emulation tutoring system | |
| CN111341166A (en) | Control method and system of emergency drilling system | |
| CN108831237A (en) | The improper driving training examination system of the engine drivers in locomotive depot of immersive VR | |
| CN110942698B (en) | Simulation real operation control platform for distribution network uninterrupted operation | |
| CN109712461A (en) | A kind of aircraft maintenance virtual training system | |
| CN112309196B (en) | Platform door simulation training system and method | |
| CN113128716A (en) | Operation guidance interaction method and system | |
| EP3547289A1 (en) | Standard operating procedures feedback during an interactive computer simulation | |
| CN116543618A (en) | Virtual reality-based airplane driving teaching method and system | |
| CN115063272A (en) | 3D nursing teaching system | |
| CN110320996B (en) | Re-authentication of interactive computer simulation stations | |
| CN113706967A (en) | Comprehensive simulation maintenance training system for engineering | |
| CN113299141A (en) | Aviation air-ride simulation training system and training method | |
| KR20220030760A (en) | Customized Pilot Training System and Method with Collaborative Deep Learning in Virtual Reality and Augmented Reality Environment | |
| CN111276015A (en) | Subway driver emergency disposal training system and method based on virtual reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |