KR102531830B1 - A xr driving education and training system for vr type towing a aircraft - Google Patents

Abstract

The present invention relates to an aircraft towing mock-up equipment type XR driving education and training system, which enables XR driving education and training for the implementation of extended reality based on VR, which is a mock-up equipment, in relation to aircraft towing, which is a special situation.
To this end, a simulator management unit (1) providing an aircraft towing simulation to trainees' VR devices and personal communication terminals; VR training management unit (2) for providing training content to the simulator management unit (1); Multilateral multi-collaboration management unit (3) in charge of message transmission between VR education and training management unit (2) and instructor control management unit (4), synchronization of educational virtual space and training control, and instructor control management unit (4) to control training It will provide an aircraft towing mock-up equipment type XR driving education and training system, characterized in that consisting of.

Description

Aircraft towing mockup type XR driving training system {A XR DRIVING EDUCATION AND TRAINING SYSTEM FOR VR TYPE TOWING A AIRCRAFT}

The present invention relates to an aircraft towing mockup equipment type XR driving training system, which is a system that enables XR driving education and training for the implementation of extended reality based on VR, a mockup equipment, in relation to aircraft towing, which is a special situation.

In the towing of special transportation means such as aircraft, the risk of causing a large-scale accident due to the driver's inexperience and carelessness is higher than in other fields.

However, in the case of special circumstances such as towing an aircraft, there are many cases where it is difficult to conduct education and training.

In particular, since costs may be excessive in the operation of venues and equipment, most lecture-oriented education is inevitable.

In this special situation, it is inevitable to improve the driver's proficiency through direct practice targeting aircraft operating on the runway to support the airport air navigation mission, but such conditions in reality are inevitably difficult.

In addition, in the case of military aircraft, the military service period is short, requiring a long period of at least 5 to 7 months.

Accordingly, various technologies are required in relation to aircraft management, but as a technology for training, Korean Patent Publication No. 10-2014-0083472 (simulation training equipment and aircraft maintenance education method using the same, published on July 04, 2014) ) is an aircraft maintenance education method using a simulation training system, when power is supplied to each subsystem of the simulation training system, performing self-failure diagnosis for each subsystem of the simulation training system (S100); Selecting training items for the aircraft maintenance education (S200), preparing simulation training equipment for the selected training items and initializing the simulation training equipment to start simulation training (S300), and check items and controlling the simulation training equipment for each training procedure (S400), terminating the simulation training and automatically evaluating the simulation training results (S500), and storing the automatically evaluated evaluation results. In addition, including the step (S600) of outputting the evaluation result, a technique of performing the step (S200) to the step (S500) a plurality of times is proposed.

However, only the simulated training method for maintenance as described above has been proposed, and there is no technology related to training and education for special situations such as aircraft towing.

Republic of Korea Patent Registration No. 10-1012727 (Aircraft Traction System, registered on January 27, 2011) Republic of Korea Patent Publication No. 10-2014-0083472 (simulation training equipment and aircraft maintenance training method using the same, published on July 04, 2014)

The present invention is an aircraft towing mock-up for implementing extended reality using VR, which is a mock-up equipment to solve the problem that it is difficult to train skilled workers due to limitations in practice conditions such as time, place, and equipment in special situations such as aircraft towing requiring driver's proficiency. The technical challenge to be solved is to provide an equipment-type XR driving training system.

In the aircraft towing mock-up equipment-type XR driving education and training system for solving the technical problems of the present invention as described above, a simulator management unit (1) providing an aircraft towing simulation to trainees' VR devices and personal communication terminals; VR training management unit (2) for providing training content to the simulator management unit (1); Multi-party multi-collaboration management unit (3) in charge of message transmission between VR education and training management unit (2) and instructor control management unit (4), synchronization of educational virtual space and control of training, and instructor control management unit (4) to control training It will provide an aircraft towing mock-up equipment type XR driving education and training system, characterized in that consisting of.

In addition, the simulator management unit 1 includes a towing vehicle environment simulator 11 that provides environment-related simulations such as the surrounding environment of the towing vehicle and the shape and condition of the towing vehicle, and a towing vehicle operation simulator 12 that provides driving and manipulation simulation of the towing vehicle. and a towing task simulator 13 that provides connection simulation of the towbar of the towing vehicle for towing the aircraft and towing the aircraft, and provides simulation of educational contents to the trainee's VR device and the trainee's personal communication terminal. It provides an aircraft towing mock-up equipment type XR driving education and training system.

The simulator management unit 1 further includes a steering reaction force providing simulator 14 for enhancing the effect of education by providing trainees with a sense of reality according to simulation education.

In addition, in the present invention, the VR education and training management unit 2 provides a towing VR content management module 21 and towing simulation for providing simulation contents for aircraft towing in order to provide educational contents to the simulator management unit 1. A 3D rendering management module (22) that renders the 3D surrounding environment to be created, a physics simulation management module (23) for realizing simulation through a physics engine, and an animation control module for controlling the type and type of animation of contents provided to trainees. (24) and a VR equipment control module (25) for controlling the VR equipment.

In addition, the VR education and training management unit 2 includes a UI/UX management module 26 for reflecting human factors, such as user interface and user experience, in educational contents or collecting information such as trainees' responses. will include more

In addition, in the present invention, the multi-party multi-collaboration management unit 3 includes a multi-party collaboration training support module 31 for supporting multi-party collaborative training, a spatial synchronization management module 32 for synchronizing and managing training virtual space, and data for training. and a data management module 33 for managing data acquired through education and training and a network management module 34 for managing a network for communication between trainees and managers or multilateral aircraft towing mock-up equipment. Provides a Hyungyeong XR driving education and training system.

In addition, in order to manage the instructor's education and training, the instructor control management unit 4 includes a post-criticism management module 41 capable of performing a post-criticism function after the end of education and training, and data for managing data used during education and training. A management module (42), a real-time monitoring management module (43) for monitoring education and training in real time, a VR device control module (44) for controlling VR devices, and educational evaluation and analysis management capable of performing educational evaluation and analysis. It consists of modules 45.

In addition, the instructor control management unit (4) is a technical problem of the present invention by providing an aircraft towing mock-up equipment type XR driving education and training system, characterized in that it further includes an education matter replay management module (46) capable of reproducing training matter to better achieve

By providing the aircraft towing mock-up type XR driving training system of the present invention, it is possible to solve the problem of difficulty in training skilled workers due to limitations in practice conditions such as time, place, and equipment in special situations such as aircraft towing where driver's proficiency is required. There is an effect.

1 is a configuration diagram of an aircraft towing mock-up equipment type XR driving education and training system of the present invention.
2 is a configuration diagram of a simulator management unit 1 according to the present invention.
3 is a block diagram of the VR education and training management unit 2 according to the present invention.
4 is a configuration diagram of a multi-party multi-collaboration management unit 3 according to the present invention.
5 is a configuration diagram of the instructor control management unit 4 according to the present invention.
6 to 8 are exemplary images according to the embodiment of the present invention.

The present invention is to provide an aircraft towing mockup type XR driving training system by implementing extended reality (XR) technology using mockup equipment VR, and based on this, augmented reality (AR) and mixed reality (MR) It is a basic technology that can be extended and implemented up to

In the present invention, although the description is based on extended reality (XR), it is left out that the technical scope can be expanded to the aforementioned augmented reality (AR) and mixed reality (MR).

In addition, the mockup equipment applied in the present invention refers to a VR device capable of realizing virtual reality (VR) or a device equivalent thereto, and in the present invention, description will be made based on VR technology or VR devices.

Hereinafter, the aircraft tow mockup type XR driving education and training system of the present invention will be described in detail with reference to the drawings so that a person skilled in the art can easily implement it.

1 is a configuration diagram of an aircraft towing mockup type XR driving training system according to the present invention, FIG. 2 is a configuration diagram of a simulator management unit 1 according to the present invention, and FIG. 3 is a VR education and training management unit 2 according to the present invention. ), Figure 4 is a configuration diagram of the multi-party multi-collaboration management unit 3 according to the present invention, Figure 5 is a configuration diagram of the instructor control management unit 4 according to the present invention.

6 to 8 are exemplary images according to the embodiment of the present invention.

1 to 8, the aircraft towing mock-up equipment type XR driving education and training system of the present invention includes a simulator management unit 1 and a simulator management unit that provide aircraft towing simulation to trainees' VR devices and personal communication terminals. VR education and training management unit (2) to provide education and training contents to (1), message transmission between VR education and training management unit (2) and instructor control management unit (4), multilateral in charge of synchronization of educational virtual space and control of training It consists of a multi-collaboration management unit (3) and an instructor control management unit (4) to control education and training.

Here, the simulator management unit 1 conducts education and training to trainees using the education and training contents provided by the VR education and training management unit 2. A tow truck environment simulator 11 that provides, a tow truck operation simulator 12 that provides driving and manipulation simulation of a tow truck, and a towing operation simulator that provides connection simulation of towbar towbars for towing aircraft and aircraft towing ( 13), and provides simulation of educational contents to trainees' VR devices and trainees' personal communication terminals.

In addition, a steering reaction force providing simulator 14 is further included to increase the effect of education by providing trainees with a sense of reality according to simulation education.

In more detail, the steering reaction force providing simulator 14 controls the steering reaction force of a mechanical device for providing steering reaction force generated when a steering wheel is operated to drive and drive a tow truck, and simulates to transmit it to trainees. will be provided

To this end, the steering reaction force is differentially applied according to the traction situation through the adjustment of the frictional force and the adjustment of the pressure in the handle-shaped steering device.

At this time, the surrounding environment of the towing vehicle provided by the towing vehicle environment simulator 11 provides simulation of surrounding environments such as a hangar or igloo environment where an aircraft is moored, an aircraft waiting line environment, and an aircraft road (runway) driving environment, Tow truck environment, that is, to provide a simulation of the state environment of the tow truck, such as mechanical performance, age, and vehicle type of the tow truck.

In addition, the towing vehicle operation simulator 12 provides a driver's seat environment of the towing vehicle and provides simulation of a control panel and steering devices disposed in the driver's seat.

In addition, the towing job simulator 13 provides job simulations such as fastening a towbar to a towing vehicle, simulation of surrounding safety checks before towing, and towing operation of an aircraft in order to tow an aircraft.

The VR education and training management unit 2 is for providing educational contents to the simulator management unit 1, a towing VR content management module 21 for providing simulation contents for aircraft towing, and a 3D surrounding environment in which towing simulation will be provided. A 3D rendering management module 22 for rendering, a physics simulation management module 23 for realizing simulation through a physics engine, an animation control module 24 for controlling the shape and type of animation of contents provided to trainees, and It consists of a VR equipment control module 25 for controlling VR equipment.

In addition, it further includes a UI/UX management module 26 for reflecting human factors, such as user interface and user experience, to educational contents or collecting information such as trainees' reactions.

Here, the towing VR content of the towing content management module 21 is VR content provided to the simulator management unit 1, and may be contents such as a towing vehicle environment, towing vehicle operation, towing work, and provision of a counter-force.

In addition, the 3D environment provided according to the 3D rendering of the 3D rendering management module 23 refers to the same as the surrounding natural environment when VR content is provided, for example, the ambient brightness according to working time, the type of runway for work, By reflecting the surrounding scenery and seasonal characteristics, the same or similar environment as the surrounding environment of the air unit or airline where the actual trainee will work or participate in the field after training is provided in 3D.

In addition, the form of animation in the animation control module 24 provides a form of animation in which the form of an avatar to be provided to trainees and the characteristics of each country or unit are reflected.

For example, in the case of an air unit, a specific animation type such as an avatar's clothing type, a national flag attached to clothing, a unit mark, and a rank is provided.

In addition, the VR equipment control in the VR equipment control module 25 controls the equipment control functions such as communication protocol, resolution setting, transmission speed, etc. for implementing the educational environment according to the type of VR equipment and personal communication terminal used by trainees. is to implement

The multilateral multi-collaboration management unit 3 includes a multilateral collaboration training support module 31 for supporting multilateral collaboration training, a spatial synchronization management module 32 for synchronizing and managing training virtual space, and data and training for training. It consists of a data management module 33 for managing data obtained through and a network management module 34 for managing a network for communication between trainees and administrators or multi-party communication.

The multilateral collaborative training of the multilateral collaborative training support module 31 is multilateral collaboration or individual trainees related to communication with the controller of the control tower, field manager or traction control personnel for the virtual field situation provided to trainees through VR educational contents. Or, when a large number of trainees perform education and training sequentially while maintaining simultaneous or time differences, multilateral collaboration is possible.

To this end, it manages real-time communication and messages, and performs tasks such as content transmission between each trainee and education officials participating in multilateral collaborative training.

The space synchronization management module 32 synchronizes the virtual space for training with the virtual training space of the training trainee and the VR device of the person participating in the training or the personal communication terminal.

The data management of the data management module 33 uses a built-in memory or a memory device installed separately from the outside, and is converted into a DB according to the personal information of the trainee to reflect the performance of the previous education and improvement requirements, etc. to provide content.

The network management module 34 is for managing a network for communication between trainees and administrators or between multiple parties.

To this end, it is in charge of management such as speed synchronization and communication security procedures according to the use of the internal computer network or mixed use with the external computer network, depending on the type of network.

Here, in the case of communication security procedures, when using an external computer network, information that is prohibited from leaking to the outside is blocked, and the level of information blocking is set and applied according to the security level of the visitor who accessed through the external network. is to do

The instructor control management unit 4 is for managing the instructor's education and training, the post-criticism management module 41 capable of performing the post-criticism function after the end of training, and data management for managing data used during training module 42, real-time monitoring management module 43 for monitoring education and training in real time, VR device control module 44 for controlling VR devices, and educational evaluation and analysis management module capable of performing educational evaluation and analysis It consists of (45).

In addition, an educational content reproduction management module 46 capable of reproducing educational content is further included.

The post-criticism management module 41 allows the instructor to conduct overall critique on education after the trainee's education and training is completed, real-time critique through the instructor's training, indirect critique through text, or critique manual A critique platform and the like can be provided.

The data management module 42 is for the instructor to manage data such as educational data for each level of training provided to trainees and training schedules tailored to trainees. It is converted into a DB individually according to the data management module 33 so that it can be stored and called.

The real-time monitoring management module 43 allows the instructor to monitor the training situation of the trainee in real time, and receives the same image as the trainee through the instructor's personal communication terminal or instructor VR, or through screen splitting Provide information such as video and educational data.

Here, the education-related data refers to information such as progress time according to education and training, evaluation data of the same education and training in the past, and the like.

The VR device control module 44 can control and control the operation of the trainee's VR device by the instructor, and can perform control and control such as forced termination and resolution setting according to the trainee's training progress and performance. is to allow

The educational evaluation and analysis management module 45 allows the instructor to evaluate education according to the educational performance of the trainee and set the educational achievement level, and to analyze and manage the educational result.

To this end, in order to facilitate the provision of manuals for educational evaluation and analysis and the performance of evaluation and analysis tasks by instructors, a platform with standardized manuals is provided.

By the configuration as described above, it is to provide an aircraft towing mock-up equipment type XR driving education and training system of the present invention.

1: Simulator management department 2: VR education training management department
3: Multilateral multi-collaboration management department 4: Instructor control management department
11: Tow Truck Environment Simulator 12: Tow Truck Operation Simulator
13: Towing operation simulator 14: Steering reaction force providing simulator
21: VR content management module 22: 3D rendering management module
23: physics simulation management module 24: animation control module
25: VR equipment control module 31: multilateral collaboration training support module
32: space synchronization management module 33: data management module
34: network management module 41: post-criticism management module
42: data management module 43: real-time monitoring management module
44: VR device control module 45: educational evaluation and analysis management module

Claims (3)

In the aircraft towing mock-up type XR driving training system,
A simulator management unit (1) providing an aircraft towing simulation to trainees' VR devices and personal communication terminals;
VR education and training management unit (2) for providing training content to the simulator management unit (1);
Multi-party multi-collaboration management unit (3) in charge of message transmission between VR education and training management unit (2) and instructor control management unit (4), synchronization of educational virtual space and control of training, and instructor control management unit (4) to control training composed of,
The simulator management unit 1 includes a towing vehicle environment simulator 11 providing environment-related simulations such as the surrounding environment of the towing vehicle and the shape and state of the towing vehicle, a towing vehicle operation simulator 12 providing driving and manipulation simulation of the towing vehicle, and an aircraft. It consists of a towing task simulator 13 that provides connection simulation of towbar tow bar for towing and aircraft towing, and provides simulation of educational content to trainees' VR devices and trainees' personal communication terminals,
The towing vehicle environment simulator 11 simulates surrounding environments such as a hangar or igloo environment in which an aircraft is moored, an aircraft waiting line environment, and an aircraft driving environment, and conditions of the towing vehicle such as mechanical performance, age, and type of vehicle. It performs the function of providing a simulation like environment,
The towing vehicle operation simulator 12 provides a driver's seat environment of the towing vehicle and performs a function of providing simulation such as a control panel and steering devices disposed in the driver's seat,
The towing task simulator 13 performs a function of providing task simulations such as operation simulation of fastening a towbar to a tow truck, simulation of surrounding safety inspection before towing, and aircraft towing operation in order to tow an aircraft,
The simulator management unit 1 further includes a steering reaction force providing simulator 14 for increasing the effect of education by providing trainees with a sense of reality according to simulation education,
The steering reaction force providing simulator 14 controls the steering reaction force of a mechanical device to provide the steering reaction force generated when the steering wheel is operated to drive and drive the tow truck, and provides a simulation for transmitting it to the trainee. It consists of differentially applying the steering reaction force according to the traction situation through the adjustment of the friction force and the adjustment of the pressure in the steering system of the
The VR education and training management unit 2 is for providing educational contents to the simulator management unit 1, a towing VR content management module 21 for providing simulation contents for aircraft towing, and a 3D surrounding environment in which towing simulation will be provided. A 3D rendering management module 22 for rendering, a physics simulation management module 23 for realizing simulation through a physics engine, an animation control module 24 for controlling the shape and type of animation of contents provided to trainees, and It consists of a VR equipment control module 25 for controlling VR equipment,
The towing VR content of the towing VR content management module 21 is VR content provided to the simulator management unit 1, and is composed of contents such as a towing vehicle environment, towing vehicle operation, towing operation, and provision of a counter-force,
The 3D environment provided according to the 3D rendering of the 3D rendering management module 22 reflects the ambient brightness according to the working time, the shape of the runway for work, the surrounding scenery, and seasonal characteristics when VR content is provided, so that trainees can work after training or It performs the function of providing the same or similar environment in 3D to the surrounding environment of the air unit or airline to participate in the practice,
The animation control module 24 performs a function of providing a specific animation form such as the shape of the avatar to be provided to the trainee, the shape of the avatar's clothing, the national flag attached to the clothing, the unit mark, and the rank,
The VR equipment control module 25 performs a function of controlling equipment such as communication protocol, resolution setting, and transmission speed for realizing an educational environment according to the type of VR equipment and personal communication terminal used by trainees,
The VR education and training management unit 2 includes a UI/UX management module 26 for reflecting human factors, such as user interface and user experience, in educational contents or collecting information such as trainees' responses. include more,
The multilateral multi-collaboration management unit 3 includes a multilateral collaboration training support module 31 for supporting multilateral collaboration training, a spatial synchronization management module 32 for synchronizing and managing training virtual space, and data and training for training. It consists of a data management module 33 for managing data acquired through and a network management module 34 for managing a network for communication between trainees and managers or multilateral,
The multilateral collaborative training of the multilateral collaborative training support module 31 is multilateral collaboration or individual trainees related to communication with the controller of the control tower, field manager or traction control personnel for the virtual field situation provided to trainees through VR educational contents. Or, when a large number of trainees perform education and training sequentially at the same time or with a time difference, and perform a function that enables multilateral collaboration,
Performing functions such as real-time communication and message management, and content transmission between individual trainees and education officials participating in multilateral collaborative training;
The space synchronization management module 32 performs a function of synchronizing the virtual space for training with the virtual training space of the VR device or personal communication terminal of the training trainee and the person participating in the training,
The data management module 33 manages data using a built-in memory or a memory device installed separately from the outside, but converts it into a DB according to the student's personal information to store educational contents reflecting the performance of previous education and improvement requirements. to perform the function of managing
The network management module 34 performs a function of managing a network for communication between trainees and administrators or between multiple parties, but synchronization of speed and communication security procedures according to the use of an internal computer network or mixed use with an external computer network depending on the type of network. Responsible for management such as the performance of
In the case of communication security procedures, a function that blocks information that is prohibited from leaking outside when using an external computer network, and sets and applies the level of information blocking according to the security level of the visitor who accessed through the external network Aircraft towing mock-up equipment type XR driving training system, characterized in that for performing.
According to claim 1,
The instructor control management unit 4 includes a post-criticism management module 41 capable of performing a post-critique function after completion of training, a data management module 42 for managing data used during training, and training in real time. An aircraft characterized in that it consists of a real-time monitoring management module 43 for monitoring, a VR device control module 44 for controlling VR devices, and an educational evaluation and analysis management module 45 capable of performing educational evaluation and analysis. Towing mock-up type XR driving education and training system.
delete

Images