CN114360312A - Ground service maintenance training system and method based on augmented reality technology - Google Patents

Ground service maintenance training system and method based on augmented reality technology Download PDF

Info

Publication number
CN114360312A
CN114360312A CN202111545804.6A CN202111545804A CN114360312A CN 114360312 A CN114360312 A CN 114360312A CN 202111545804 A CN202111545804 A CN 202111545804A CN 114360312 A CN114360312 A CN 114360312A
Authority
CN
China
Prior art keywords
training
equipment
cabin
augmented reality
ground service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111545804.6A
Other languages
Chinese (zh)
Inventor
刘强飞
夏文彦
谭云
汪晓翠
方满雄
喻虹娜
张洁
高洁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangxi Hongdu Aviation Industry Group Co Ltd
Original Assignee
Jiangxi Hongdu Aviation Industry Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangxi Hongdu Aviation Industry Group Co Ltd filed Critical Jiangxi Hongdu Aviation Industry Group Co Ltd
Priority to CN202111545804.6A priority Critical patent/CN114360312A/en
Publication of CN114360312A publication Critical patent/CN114360312A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/08Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention relates to a ground service maintenance training system and method based on an augmented reality technology, and belongs to the technical field of aviation simulation training. The training system comprises a cabin, AR equipment, an instructor console and a computer control cabinet; the cabin comprises a cabin frame and a seat; the AR device is used for generating a virtual cockpit, an extravehicular environment and a three-dimensional airplane; the teacher console is used for training, managing and controlling the maintenance simulation training system; and a computer and network equipment are placed in the computer control cabinet. The invention can solve the problems of long development cycle, high price and difficult product updating iteration of the current general ground service maintenance simulator.

Description

Ground service maintenance training system and method based on augmented reality technology
Technical Field
The invention relates to a ground service maintenance training system and method based on an augmented reality technology, and belongs to the technical field of aviation simulation training.
Background
Modern aircraft structures and systems are very complex, and the specialties are highly crossed, so that the complexity of maintenance work caused by the complex is far higher than that of the traditional aircraft. In order for ground crew to master these complex maintenance tasks, systematic training of the ground crew is required. Training ground service personnel by using a ground service maintenance simulator is an effective training means recognized in the industry. However, a general ground service simulator usually adopts a physical simulation cockpit, 1:1 interior trim and manipulation equipment for restoring an aircraft cockpit. Such simulators tend to have two disadvantages: firstly, the hardware development period of the physical simulation cabin is long, and the price is high; secondly, due to the fact that physical simulation equipment is adopted in the cabin, if the cabin needs to be adjusted finely, hardware of the simulation cabin needs to be replaced, and updating iteration cost is very high.
Augmented Reality (AR) generates virtual objects that are not present in Reality by using computer graphics technology and visualization technology, and can present virtual images in a real environment according to actual needs by using technologies such as related sensing information. With AR technology, virtual instruments and consoles can be generated within the aircraft cockpit of an empty shell. The maintenance training product adopting the augmented reality technology is very convenient to adjust or update iteration because the cabin is virtually generated through software, and the cost is lower than that of a physical cabin. Developing maintenance training products using augmented reality technology is a very good option.
Disclosure of Invention
The invention aims to provide a ground service maintenance training system and method based on an augmented reality technology, and solves the problems that the existing general ground service maintenance simulator is long in development period, high in price and difficult in product updating iteration.
In order to achieve the purpose, the invention adopts the following technical scheme: a ground service maintenance training system based on augmented reality technology comprises a cockpit, AR equipment, an instructor console and a computer control cabinet;
the cabin comprises a cabin frame and a seat;
the AR device is used for generating a virtual cockpit, an extravehicular environment and a three-dimensional airplane;
the teacher console is used for training, managing and controlling the maintenance simulation training system;
and a computer and network equipment are placed in the computer control cabinet.
Further, a gesture recognition sensor is also included in the AR device.
A training method of a ground service maintenance training system based on an augmented reality technology comprises the following steps:
the AR equipment is used for generating a virtual cockpit, an extravehicular environment and a three-dimensional airplane; after a training person enters the cabin, the AR equipment generates control and display equipment in the aircraft cabin through the positioning device, and simultaneously generates an extravehicular environment and a three-dimensional aircraft;
the teacher console is used for training and controlling the maintenance simulation training system;
the method comprises the following steps that (1) trainees wear AR equipment to enter a cabin, and the AR equipment generates a virtual cabin, an environment outside the cabin and a three-dimensional airplane in the cabin by identifying positioning points in the cabin;
the method comprises the following steps that a trainee operates virtual equipment or a three-dimensional airplane in a virtual cockpit, the AR equipment identifies the gesture of the trainee in real time through a sensor carried by the AR equipment, so that an operation instruction is generated and transmitted to an airplane system simulation module, and the airplane system simulation module transmits a resolving result to a virtual instrument for displaying.
Furthermore, video signals observed on the AR equipment are transmitted to the instructor console in real time through the wireless transmission equipment, and the instructor console can monitor the operation conditions of trained personnel in real time.
Further, the virtual cockpit includes interior trim, a console, and an instrument panel.
Further, the instructor console is used to perform training settings.
Further, the instructor console is used to monitor the training of the trainee.
Further, the instructor console performs recording of the training files.
The invention has the beneficial effects that:
the invention can solve the problems of long development cycle, high price and difficult product updating iteration of the current general ground service maintenance simulator. In addition, virtual cabins and virtual extravehicular environments of airplanes of different models are produced through the AR equipment, so that one set of system can be used for training multiple models, the placement space of the equipment is effectively saved, and the cost for developing and purchasing ground service maintenance training equipment is greatly reduced.
Drawings
FIG. 1 is a schematic diagram of the system of the present invention;
FIG. 2 is a flow chart of the method of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
A ground service maintenance training system based on augmented reality technology comprises a cockpit 1, AR equipment 2, an instructor console 3 and a computer control cabinet 4;
the cabin 1 comprises a cabin frame 11 and a seat 12;
the AR device 2 is used for generating a virtual cockpit, an extravehicular environment and a three-dimensional airplane;
the teacher console 3 is used for training, managing and controlling the maintenance simulation training system;
the computer control cabinet 4 is internally provided with a computer and network equipment.
Further, a gesture recognition sensor is also included in the AR device 2.
A training method of a ground service maintenance training system based on an augmented reality technology comprises the following steps:
the AR equipment is used for generating a virtual cockpit, an extravehicular environment and a three-dimensional airplane; after a training person enters the cabin, the AR equipment generates control and display equipment in the aircraft cabin through the positioning device, and simultaneously generates an extravehicular environment and a three-dimensional aircraft;
the teacher console 3 is used for training and controlling the maintenance simulation training system;
the trainees wear the AR equipment 2 to enter the cockpit 1, and the AR equipment 2 generates a virtual cockpit, an extravehicular environment and a three-dimensional airplane in the cockpit 1 by identifying positioning points in the cockpit;
the trainee operates the virtual equipment or the three-dimensional airplane in the virtual cockpit, the AR equipment 2 recognizes the gesture of the trainee in real time through a sensor carried by the AR equipment, so that an operation instruction is generated and transmitted to the airplane system simulation module, and the airplane system simulation module transmits the calculation result to the virtual instrument for displaying.
Furthermore, video signals observed on the AR equipment are transmitted to the instructor console in real time through the wireless transmission equipment, and the instructor console can monitor the operation conditions of trained personnel in real time.
Further, the virtual cockpit includes interior trim, a console, and an instrument panel.
Further, the instructor console 3 is used to perform training settings.
Further, the instructor console 3 is used to monitor the training of the trainee.
Further, the instructor console 3 performs recording of the training files.
While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and variations may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (8)

1. The utility model provides a training system is maintained to ground service based on augmented reality technique which characterized in that: the training system comprises a cabin (1), AR equipment (2), an instructor console (3) and a computer control cabinet (4);
the cabin (1) comprises a cabin frame (11) and a seat (12);
the AR device (2) is used to generate a virtual cockpit, an extravehicular environment and a three-dimensional airplane;
the teacher console (3) is used for training, managing and controlling the maintenance simulation training system;
and a computer and network equipment are placed in the computer control cabinet (4).
2. The augmented reality technology-based ground service maintenance training system of claim 1, wherein: a gesture recognition sensor is also included in the AR device (2).
3. A training method of an augmented reality technology-based ground service maintenance training system according to claim 1, characterized in that:
the AR equipment is used for generating a virtual cockpit, an extravehicular environment and a three-dimensional airplane; after a training person enters the cabin, the AR equipment generates control and display equipment in the aircraft cabin through the positioning device, and simultaneously generates an extravehicular environment and a three-dimensional aircraft;
the teacher console (3) is used for training and controlling the maintenance simulation training system;
the method comprises the following steps that a trainee wears AR equipment (2) to enter a cabin (1), and the AR equipment (2) generates a virtual cabin, an extravehicular environment and a three-dimensional airplane in the cabin (1) by identifying positioning points in the cabin;
the virtual equipment or the three-dimensional airplane in the virtual cockpit is operated by the trainee, the gesture of the trainee is recognized by the AR equipment (2) through the sensor carried by the AR equipment in real time, so that an operation instruction is generated and transmitted to the airplane system simulation module, and the calculation result is transmitted to the virtual instrument by the airplane system simulation module to be displayed.
4. The augmented reality technology-based ground service maintenance training method of claim 3, wherein: video signals observed on the AR equipment are transmitted to the instructor console in real time through the wireless transmission equipment, and the instructor console can monitor the operation condition of trained personnel in real time.
5. The augmented reality technology-based ground service maintenance training method of claim 3, wherein: the virtual cockpit includes interior trim, a console, and an instrument panel.
6. The augmented reality technology-based ground service maintenance training method of claim 3, wherein: the instructor console (3) is used for training settings.
7. The augmented reality technology-based ground service maintenance training method of claim 3, wherein: the instructor console (3) is used for monitoring the training of the training personnel.
8. The augmented reality technology-based ground service maintenance training method of claim 3, wherein: the instructor console (3) records the training files.
CN202111545804.6A 2021-12-17 2021-12-17 Ground service maintenance training system and method based on augmented reality technology Pending CN114360312A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111545804.6A CN114360312A (en) 2021-12-17 2021-12-17 Ground service maintenance training system and method based on augmented reality technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111545804.6A CN114360312A (en) 2021-12-17 2021-12-17 Ground service maintenance training system and method based on augmented reality technology

Publications (1)

Publication Number Publication Date
CN114360312A true CN114360312A (en) 2022-04-15

Family

ID=81099979

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111545804.6A Pending CN114360312A (en) 2021-12-17 2021-12-17 Ground service maintenance training system and method based on augmented reality technology

Country Status (1)

Country Link
CN (1) CN114360312A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204516105U (en) * 2015-03-19 2015-07-29 江西洪都航空工业集团有限责任公司 Simulation trainer is safeguarded in a kind of ground service based on schoolaeroplane
CN204614276U (en) * 2015-03-31 2015-09-02 刘宛平 A kind of emulation omnidirectional simulated flight device with mixed reality function
CN106530897A (en) * 2016-12-28 2017-03-22 中国航空工业集团公司西安飞机设计研究所 Flight simulation training device
WO2018077155A1 (en) * 2016-10-26 2018-05-03 第二空间畅想(北京)科技发展有限公司 Multifunctional vr human-computer interaction and external environment simulator and simulation method
CN110189578A (en) * 2019-05-20 2019-08-30 北京悉见科技有限公司 A kind of method and apparatus that pilot training is carried out based on augmented reality
CN110610547A (en) * 2019-09-18 2019-12-24 深圳市瑞立视多媒体科技有限公司 Cabin training method and system based on virtual reality and storage medium
WO2020178762A2 (en) * 2019-03-06 2020-09-10 Keil Andrew Marc Aviation training system and method
CN113035010A (en) * 2019-12-24 2021-06-25 北京普德诚科技有限责任公司 Virtual and real scene combined visual system and flight simulation device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204516105U (en) * 2015-03-19 2015-07-29 江西洪都航空工业集团有限责任公司 Simulation trainer is safeguarded in a kind of ground service based on schoolaeroplane
CN204614276U (en) * 2015-03-31 2015-09-02 刘宛平 A kind of emulation omnidirectional simulated flight device with mixed reality function
WO2018077155A1 (en) * 2016-10-26 2018-05-03 第二空间畅想(北京)科技发展有限公司 Multifunctional vr human-computer interaction and external environment simulator and simulation method
CN106530897A (en) * 2016-12-28 2017-03-22 中国航空工业集团公司西安飞机设计研究所 Flight simulation training device
WO2020178762A2 (en) * 2019-03-06 2020-09-10 Keil Andrew Marc Aviation training system and method
CN110189578A (en) * 2019-05-20 2019-08-30 北京悉见科技有限公司 A kind of method and apparatus that pilot training is carried out based on augmented reality
CN110610547A (en) * 2019-09-18 2019-12-24 深圳市瑞立视多媒体科技有限公司 Cabin training method and system based on virtual reality and storage medium
CN113035010A (en) * 2019-12-24 2021-06-25 北京普德诚科技有限责任公司 Virtual and real scene combined visual system and flight simulation device

Similar Documents

Publication Publication Date Title
Guo et al. Using virtual reality to support the product’s maintainability design: Immersive maintainability verification and evaluation system
US7117135B2 (en) System for providing a high-fidelity visual display coordinated with a full-scope simulation of a complex system and method of using same for training and practice
US20080064013A1 (en) 3-dimensional apparatus for self-paced integrated procedure training and method of using same
US9583019B1 (en) Cockpit flow training system
CA3000452C (en) Assessing a training activity performed by a user in an interactive computer simulation
US20150111180A1 (en) Methods, systems, and computer readable media for cursor and text entry for aircraft interface simulation
CN113496635A (en) Flight simulator and flight training simulation method
CN111145612A (en) Aviation aircraft work simulation training device
CN110634350A (en) Simulated aircraft simulation system based on distributed virtual reality
CN110709914B (en) Continuous monitoring of models in interactive computer simulation stations
CA2385204C (en) 3-dimensional apparatus for self-paced integrated procedure training and method of using same
CN114360312A (en) Ground service maintenance training system and method based on augmented reality technology
CA3000443C (en) Standard operating procedures feedback during an interactive computer simulation
CN110320996B (en) Re-authentication of interactive computer simulation stations
CN113299141A (en) Aviation air-ride simulation training system and training method
Cetek et al. New directions for air traffic control simulators: A discussion to guide the selection and renovation of simulators
RU176063U1 (en) Helicopter aerobatic stand with hinged rotor
RU2279141C1 (en) Unified procedural training machine for piloting and technical personnel of an aircraft
CN211669784U (en) Aviation ground service personnel simulation training device
RU2784556C1 (en) Modular flight simulation training apparatus with virtual visualisation
CN217008440U (en) Simulation training platform for function test of integrated avionics system
EP3023967A1 (en) Methods, systems, and computer readable media for cursor and text entry for aircraft interface simulation
RU51264U1 (en) HELICOPTER CREW SIMULATOR WITH EXTERNAL SUSPENSION
CN118038732A (en) Simulator system for maintenance and training of airplane
CN111123743A (en) Man-machine interaction system for simulating aircraft

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination