CN113256126A - System and method for detecting training effect based on eye focus position - Google Patents
System and method for detecting training effect based on eye focus position Download PDFInfo
- Publication number
- CN113256126A CN113256126A CN202110600481.XA CN202110600481A CN113256126A CN 113256126 A CN113256126 A CN 113256126A CN 202110600481 A CN202110600481 A CN 202110600481A CN 113256126 A CN113256126 A CN 113256126A
- Authority
- CN
- China
- Prior art keywords
- data
- eye movement
- simulation
- module
- training
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
Abstract
The invention provides a system for detecting training effect based on gaze focus position. The method comprises the following steps: the eye movement detection module is used for acquiring eye movement data of a detector in real time; a storage module for storing analog data; the processing module is electrically connected with the eye movement detection module and the storage module and used for obtaining a calculation result based on the calculation of the simulation data and the eye movement data; and the script control module is electrically connected with the processing module and used for receiving the calculation result, judging and scoring the calculation result and outputting a judgment result. The system for detecting the training effect of the eye focus position solves the problems that a simulation training system in the prior art is lack of a control system and cannot supervise and detect the specific behaviors of a training object in simulation training.
Description
Technical Field
The invention relates to the technical field of simulation training, in particular to a system and a method for detecting a training effect based on a gaze focus position.
Background
In real life, a plurality of high-risk working environments and environment scenes with complex operation or difficult reality of entertainment consumption exist, for example, the specific real operation of scenes such as aircraft driving training, military simulation training, petroleum drilling and mechanical control and the like, the real site scene is required to be adopted in the training or entertainment process, the cost is high, the danger is high, and the difficulty in realizing the degree is high. The existing simulation training system is basically composed of a 3D simulation scene and simulation control, the simulation scene is provided with different modes and conditions according to a real scene, so that a control flow is set, but the simulation training system is lack of a control system, so that the specific behaviors of a training object cannot be supervised and detected in the simulation training.
Disclosure of Invention
The invention aims to provide a system and a method for detecting a training effect based on a gaze focus position, which can solve the problems that a simulation training system in the prior art lacks a control system and cannot supervise and detect the specific behavior of a training object in simulation training.
In order to achieve the above purpose, the invention provides the following technical scheme:
a system for detecting a training effect based on gaze focus position, comprising:
the eye movement detection module is used for acquiring eye movement data of a detector in real time;
a storage module for storing analog data;
the processing module is electrically connected with the eye movement detection module and the storage module and used for obtaining a calculation result based on the calculation of the simulation data and the eye movement data;
and the script control module is electrically connected with the processing module and used for receiving the calculation result, judging and scoring the calculation result and outputting a judgment result.
On the basis of the technical scheme, the invention can be further improved as follows:
further, the script control module comprises an identification unit, and the identification unit is electrically connected with the processing module and used for receiving the calculation result and scoring and judging the calculation result to obtain a judgment result.
The voice conversion unit is electrically connected with the recognition unit and is used for converting the judgment result into a voice signal;
and the voice output unit is electrically connected with the voice conversion unit and is used for outputting the voice signal.
Furthermore, the display unit is electrically connected with the identification unit and used for outputting the judgment result.
Furthermore, the script control module further comprises an alarm unit, wherein the alarm unit is electrically connected with the identification unit and used for outputting an alarm reminding signal according to the judgment result.
Further, the system for detecting the training effect based on the gaze focus position further comprises a 3D simulation model formed by performing 3D simulation modeling according to the training scene;
the eye movement detection module is electrically connected with the storage module and acquires specific operation data of a trainer in a simulation environment according to the 3D simulation model to obtain simulation data; the storage module is used for storing the analog data.
A method for detecting a training effect based on a gaze focus position, the method comprising:
s101, acquiring eye movement data of a detector in real time through an eye movement detection module;
s102, analog data are stored through a storage module;
s103, comparing the simulation data with the eye movement data through a processing module to obtain a calculation result;
and S104, receiving the calculation result through a script control module, judging and scoring the calculation result, and outputting a judgment result.
Further, the S102 specifically includes S1021, and performs 3D simulation modeling according to a training scenario;
s1022, collecting specific operation data of a trainer in a simulation environment to obtain simulation data;
and S1023, storing the analog data to the storage module.
Further, the S104 specifically includes S1041, and the identification unit receives the calculation result, and performs scoring determination on the calculation result to obtain a determination result.
Converting the determination result into a voice signal by a voice conversion unit;
and S1043, outputting the voice signal through a voice output unit.
Further, S104 specifically includes S1044 that the determination result is output through a display unit;
further, S104 specifically includes S1045, and an alarm unit outputs an alarm prompt signal.
The invention has the following advantages:
the system for detecting the training effect based on the gaze focus position further increases the 3D model construction of eye movement operation on the basis of the original 3D modeling technology; an eye movement detection module is additionally arranged and used for recording the eye movement direction vector; comparing the established simulation data with the actually recorded eye movement data through a processing module; a script control module is additionally arranged to judge and score the calculation result and give guidance and feedback to a trainer in time; eye operation dimension detection lacking in the original training system is supplemented, and detection dimension comprehensiveness is improved; and a script control module for accurate judgment, guidance and feedback is added, so that the intellectualization of the training process is ensured. The problem of among the prior art simulation training system lack the control system, can't supervise and detect the concrete action of training object in the simulation training is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a control schematic diagram of a system for detecting training effects based on gaze focus position in an embodiment of the present invention;
FIG. 2 is a control schematic diagram of a system for detecting training effects based on gaze focus position in an embodiment of the present invention;
FIG. 3 is a flowchart of a method for detecting training effects based on gaze focus position in an embodiment of the present invention;
FIG. 4 is a flowchart illustrating the detailed process of S102 according to an embodiment of the present invention;
fig. 5 is a flowchart illustrating S104 in an embodiment of the present invention.
The device comprises an eye movement detection module 10, a storage module 20, a processing module 30, a script control module 40, a recognition unit 401, a voice conversion unit 402, a voice output unit 403, a display unit 404 and an alarm unit 405.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the following embodiments, and it should be understood that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, a system for detecting training effect based on gaze focus position comprises:
the eye movement detection module 10 is used for acquiring eye movement data of a detector in real time; because the eyes of the person begin to be watched in parallel by the eyes beyond 50 meters, the eyes have fixed focuses in a certain space range, the eye movement detection module 10 is additionally arranged to track and collect the focuses of the eyes of the trainer in real time, and the eye movement data is transmitted to the processing module 30;
a storage module 20 for storing analog data; the simulation data is subjected to 3D simulation modeling according to a training scene; performing virtual reduction according to the real training scene to obtain simulation data; the analog data is stored to the storage module 20.
The processing module 30 is electrically connected with the eye movement detection module 10 and the storage module 20, and is used for comparing and calculating the simulation data and the eye movement data to obtain a calculation result; the processing module 30 calculates various types of collected data and obtains a calculation result. Aiming at the eye movement data of the trainer, the eye movement data collected by the eye movement detection module 10 is compared with the simulation data stored by the storage module 20 for calculation, and whether the eye operation of the trainer strictly operates according to the requirements of a real scene is judged to obtain a calculation result.
And the script control module 40 is electrically connected with the processing module 30 and is used for receiving the calculation result, judging and scoring the calculation result and outputting a judgment result. The script control module 40 records the behavior conclusion of the trainer obtained by the processing module 30 each time, performs scoring judgment on the behavior conclusion, and gives feedback to the trainer on the calculation result through the modes of sound production of the voice output unit 403, display of the display unit 404, reminding of the alarm unit 405 and the like. And detecting each dimensionality in the training.
In the simulation training process of scenes such as aircraft driving training, military simulation training, oil drilling and production, mechanical control and the like, besides the training of a basic operation process, the attention of a trainer, namely the eye confirmation, is still an important index needing to be detected;
on the basis of the original 3D modeling technology, the invention further increases the 3D model construction of eye movement operation; an eye movement detection module 10 is additionally arranged for recording the eye movement direction vector; comparing the established simulation data with the actually recorded eye movement data through the processing module 30; and a script control module 40 is additionally arranged to judge and score the calculation result and give guidance and feedback to the trainer in time.
In the aircraft driving training, the simulation of the crisis condition requires eyes of a trainer to confirm related instruments, so that a 3D model is established according to the requirements of an actual scene, and data of the part of the instruments needing eye operation is set in a system; secondly, tracking the recorded eye movement data through an eye movement detection module 10 and collecting specific operation data of a trainer in a simulation environment; the processing module 30 compares the data of the two steps to obtain a calculation result indicating whether the operation of the trainer is qualified, and transmits the calculation result to the script control module 40.
On the basis of the technical scheme, the invention can be further improved as follows:
as shown in fig. 2, the script control module 40 includes an identification unit 401, where the identification unit 401 is electrically connected to the processing module 30, and is configured to receive the calculation result and perform scoring determination on the calculation result to obtain a determination result.
Further, the script control module 40 further includes a voice conversion unit 402 and a voice output unit 403, the voice conversion unit 402 is electrically connected to the recognition unit 401 and is configured to convert the determination result into a voice signal, and the voice output unit 403 is electrically connected to the voice conversion unit 402 and is configured to output the voice signal.
Further, the script control module 40 further includes a display unit 404 electrically connected to the identification unit 401 for outputting a determination result.
Further, the script control module 40 further includes an alarm unit 405, and the alarm unit 405 is electrically connected to the identification unit 401, and is configured to output an alarm prompt signal according to the determination result.
Further, the system for detecting the training effect based on the gaze focus position further comprises a 3D simulation model formed by performing 3D simulation modeling according to the training scene;
the eye movement detection module 10 is electrically connected with the storage module 20, and the eye movement detection module 10 acquires specific operation data of a trainer in a simulation environment according to the 3D simulation model to obtain simulation data; the storage module 20 is used for storing the analog data.
As shown in fig. 3, a method for detecting a training effect based on a gaze focus position specifically includes:
s101, an eye movement detection module collects eye movement data;
in this step, the eye movement data of the detector is collected in real time through the eye movement detection module 10;
s102, a storage module stores analog data;
in this step, analog data is stored by the storage module 20;
s103, the processing module obtains a calculation result;
in this step, the analog data and the eye movement data are compared by the processing module 30 to obtain a calculation result;
s104, the script control module outputs a judgment result;
in this step, the calculation result is received by the script control module 40, and the calculation result is judged and scored, and a judgment result is output.
As shown in fig. 4, the S102 specifically includes S1021, 3D simulation modeling;
in the step, 3D simulation modeling is carried out according to a training scene;
s1022, collecting analog data;
in the step, specific operation data of a trainer in a simulation environment is collected to obtain simulation data;
s1023, analog data are stored;
in this step, the analog data is stored in the storage module 20.
As shown in fig. 5, the S104 specifically includes S1041, and the identification unit obtains a determination result;
in this step, the calculation result is received by the recognition unit 401, and the calculation result is scored and determined to obtain a determination result.
Further, the S104 specifically includes S1042, where the voice conversion unit obtains a voice signal;
in this step, the determination result is converted into a voice signal by the voice conversion unit 402;
s1043, outputting a voice signal by a voice output unit;
in this step, the voice signal is output through the voice output unit 403.
Further, S104 specifically includes S1044 in which the display unit outputs the determination result;
in this step, the determination result is output through the display unit 404;
s1045, outputting an alarm reminding signal by an alarm unit;
in this step, an alarm reminding signal is output through the alarm unit 405.
The system based on the gaze focus position detection training effect is used as follows:
when the eye movement detection device is used, the eye movement data of a detector is collected in real time through the eye movement detection module 10; storing the analog data by the storage module 20; comparing the simulated data and the eye movement data by the processing module 30 to obtain a calculation result; receiving the calculation result through the script control module 40, judging and scoring the calculation result, and outputting a judgment result.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
One or more embodiments of the present description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. One or more embodiments of the specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only an example of this document and is not intended to limit this document. Various modifications and changes may occur to those skilled in the art from this document. Any modifications, equivalents, improvements, etc. which come within the spirit and principle of the disclosure are intended to be included within the scope of the claims of this document.
Claims (10)
1. A system for detecting a training effect based on gaze focus position, comprising:
the eye movement detection module is used for acquiring eye movement data of a detector in real time;
a storage module for storing analog data;
the processing module is electrically connected with the eye movement detection module and the storage module and used for obtaining a calculation result based on the calculation of the simulation data and the eye movement data;
and the script control module is electrically connected with the processing module and used for receiving the calculation result, judging and scoring the calculation result and outputting a judgment result.
2. The system for detecting training effects based on gaze focus positions of claim 1, wherein the script control module specifically comprises:
the identification unit is electrically connected with the processing module and used for receiving the calculation result and scoring and judging the calculation result to obtain a judgment result;
the voice conversion unit is electrically connected with the recognition unit and is used for converting the judgment result into a voice signal;
and the voice output unit is electrically connected with the voice conversion unit and is used for outputting the voice signal.
3. The system for detecting training effects based on gaze focus positions according to claim 2, wherein the script control module further comprises a display unit, the display unit being electrically connected to the recognition unit for outputting the determination result.
4. The system for detecting training effect based on gaze focus position according to claim 2, wherein the script control module further comprises an alarm unit, the alarm unit being electrically connected to the recognition unit for outputting an alarm prompt signal according to the determination result.
5. The system for detecting training effects based on gaze focus positions of claim 1, further comprising a 3D simulation model formed by 3D simulation modeling according to a training scenario;
the eye movement detection module is electrically connected with the storage module and acquires specific operation data of a trainer in a simulation environment according to the 3D simulation model to obtain simulation data; the storage module is used for storing the analog data.
6. A method for detecting a training effect based on a gaze focus position is characterized by specifically comprising the following steps:
s101, acquiring eye movement data of a detector in real time through an eye movement detection module;
s102, analog data are stored through a storage module;
s103, comparing the simulation data with the eye movement data through a processing module to obtain a calculation result;
and S104, receiving the calculation result through a script control module, judging and scoring the calculation result, and outputting a judgment result.
7. The method for detecting training effects based on gaze focus positions of claim 6, wherein the S102 specifically comprises S1021, performing 3D simulation modeling according to a training scenario;
s1022, collecting specific operation data of a trainer in a simulation environment to obtain simulation data;
and S1023, storing the analog data to the storage module.
8. The method according to claim 7, wherein the S104 specifically includes S1041, and the calculating result is received by an identifying unit, and is subjected to scoring judgment to obtain a judgment result;
s1042, converting the judgment result into a voice signal through a voice conversion unit;
and S1043, outputting the voice signal through a voice output unit.
9. The method for detecting training effects based on gaze focus positions according to claim 8, wherein the step S104 further comprises the step S1044 of outputting the determination result through a display unit.
10. The method for detecting training effects based on gaze focus position according to claim 9, wherein S104 further comprises S1045, and an alarm reminding signal is output by an alarm unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110600481.XA CN113256126A (en) | 2021-05-31 | 2021-05-31 | System and method for detecting training effect based on eye focus position |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110600481.XA CN113256126A (en) | 2021-05-31 | 2021-05-31 | System and method for detecting training effect based on eye focus position |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113256126A true CN113256126A (en) | 2021-08-13 |
Family
ID=77185434
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110600481.XA Pending CN113256126A (en) | 2021-05-31 | 2021-05-31 | System and method for detecting training effect based on eye focus position |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113256126A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107519622A (en) * | 2017-08-21 | 2017-12-29 | 南通大学 | Spatial cognition rehabilitation training system and method based on virtual reality and the dynamic tracking of eye |
| JP2018049258A (en) * | 2016-09-14 | 2018-03-29 | 公益財団法人鉄道総合技術研究所 | Program and train operation simulator |
| CN107884947A (en) * | 2017-11-21 | 2018-04-06 | 中国人民解放军海军总医院 | Auto-stereoscopic mixed reality operation simulation system |
| CN109582140A (en) * | 2018-11-23 | 2019-04-05 | 哈尔滨工业大学 | A kind of architecture indoor pathfinding element vision significance assessment system and method based on virtual reality and eye movement tracking |
| CN112785890A (en) * | 2020-12-24 | 2021-05-11 | 中国人民解放军空军工程大学 | Tower flight command simulation training controller attention assessment system and method thereof |
-
2021
- 2021-05-31 CN CN202110600481.XA patent/CN113256126A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018049258A (en) * | 2016-09-14 | 2018-03-29 | 公益財団法人鉄道総合技術研究所 | Program and train operation simulator |
| CN107519622A (en) * | 2017-08-21 | 2017-12-29 | 南通大学 | Spatial cognition rehabilitation training system and method based on virtual reality and the dynamic tracking of eye |
| CN107884947A (en) * | 2017-11-21 | 2018-04-06 | 中国人民解放军海军总医院 | Auto-stereoscopic mixed reality operation simulation system |
| CN109582140A (en) * | 2018-11-23 | 2019-04-05 | 哈尔滨工业大学 | A kind of architecture indoor pathfinding element vision significance assessment system and method based on virtual reality and eye movement tracking |
| CN112785890A (en) * | 2020-12-24 | 2021-05-11 | 中国人民解放军空军工程大学 | Tower flight command simulation training controller attention assessment system and method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 陈瑜;李锦涛;徐军莉;陈威月;: "基于眼动特征的驾驶员疲劳预警系统设计", 软件导刊, no. 05 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109686036B (en) | Fire monitoring method and device and edge computing device | |
| JP7031594B2 (en) | Anomaly detection device, anomaly detection method, and program | |
| CN107730017B (en) | Intelligent metallurgical equipment operation diagnosis system | |
| Cochran et al. | Earthquake early warning ShakeAlert system: Testing and certification platform | |
| CN104573706A (en) | Object identification method and system thereof | |
| KR20180114983A (en) | Apparatus and method for detecting anomaly behavior in plant pipe using multiple meta-learning | |
| EP3759789B1 (en) | System and method for audio and vibration based power distribution equipment condition monitoring | |
| KR101174105B1 (en) | Non-contact method for generating parameter data for measuring displacement of structure | |
| Vanfretti et al. | A phasor measurement unit based fast real-time oscillation detection application for monitoring wind-farm-to-grid sub–synchronous dynamics | |
| CN115357470A (en) | Information generation method and device, electronic equipment and computer readable medium | |
| CN117055739B (en) | Holographic equipment interaction method, device, equipment and storage medium | |
| KR102477509B1 (en) | Method for generating weather prediction information and computing device for executing the method | |
| CN116186642B (en) | Distributed optical fiber sensing event early warning method based on multidimensional feature fusion | |
| CN113256126A (en) | System and method for detecting training effect based on eye focus position | |
| CN115406626A (en) | AR (augmented reality) glasses-based fault detection method and device, AR glasses and medium | |
| US20230024104A1 (en) | Identification of false transformer humming using machine learning | |
| CN116055521A (en) | Inspection system and image recognition method for electric inspection robot | |
| WO2014148933A1 (en) | Method and monitoring device for monitoring a structure | |
| CN114187751A (en) | Adaptability evaluation method, device and equipment of early warning system and readable storage medium | |
| CN113542358A (en) | Monitoring system and monitoring method | |
| Lowin et al. | From physical to virtual: leveraging drone imagery to automate photovoltaic system maintenance | |
| CN117349102B (en) | Digital twin operation and maintenance data quality inspection method, system and medium | |
| CN113240057B (en) | High-precision error detection method and system based on electric power data acquisition | |
| KR20190062874A (en) | A machine learning based evaluating method of soundness for soil and structure and a device thereof | |
| Biswas et al. | An Open-Source Library of Phasor Measurement Unit Data Capturing Real Bulk Power Systems Behavior |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |