CN113570330A - System and method for evaluating simulation training effect of emergency environment - Google Patents
System and method for evaluating simulation training effect of emergency environment Download PDFInfo
- Publication number
- CN113570330A CN113570330A CN202110790042.XA CN202110790042A CN113570330A CN 113570330 A CN113570330 A CN 113570330A CN 202110790042 A CN202110790042 A CN 202110790042A CN 113570330 A CN113570330 A CN 113570330A
- Authority
- CN
- China
- Prior art keywords
- evaluation
- index
- module
- training
- emergency environment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012549 training Methods 0.000 title claims abstract description 99
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000004088 simulation Methods 0.000 title claims abstract description 31
- 230000000694 effects Effects 0.000 title claims abstract description 29
- 238000011156 evaluation Methods 0.000 claims abstract description 332
- 238000013461 design Methods 0.000 claims abstract description 21
- 238000007781 pre-processing Methods 0.000 claims abstract description 20
- 238000001914 filtration Methods 0.000 claims abstract description 7
- 230000008569 process Effects 0.000 claims description 32
- 238000004422 calculation algorithm Methods 0.000 claims description 20
- 238000004364 calculation method Methods 0.000 claims description 16
- 238000011065 in-situ storage Methods 0.000 claims description 8
- 238000005553 drilling Methods 0.000 claims description 7
- 230000006835 compression Effects 0.000 claims description 3
- 238000007906 compression Methods 0.000 claims description 3
- 238000012937 correction Methods 0.000 claims description 3
- 238000012552 review Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 238000011511 automated evaluation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000012854 evaluation process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 238000011158 quantitative evaluation Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
- G06Q50/2057—Career enhancement or continuing education service
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Educational Administration (AREA)
- Tourism & Hospitality (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Theoretical Computer Science (AREA)
- Educational Technology (AREA)
- Marketing (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Operations Research (AREA)
- Development Economics (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Game Theory and Decision Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Monitoring And Testing Of Nuclear Reactors (AREA)
Abstract
The invention relates to an imminence emergency environment simulation training effect evaluation system and an evaluation method, wherein the evaluation system comprises the following steps: the template setting module is used for setting different evaluation templates; an index design module for determining an evaluation index corresponding to each evaluation template and determining a weight of each evaluation index; an evaluation operator design module, which is used for designing an evaluation operator according to the evaluation index and the weight; and the automatic evaluation module is connected with the evaluation operator design module and is used for evaluating the index to be evaluated according to an evaluation rule and an evaluation operator which are provided with a standard operation flow inside so as to automatically calculate the operation score of each trainee. The method comprises the steps of obtaining a data set by preprocessing evaluation original data such as filtering and the like, matching the data set with preset evaluation indexes to automatically, quickly and accurately calculate the operation score of each trained person, and ensuring that the final evaluation result is more accurate by combining artificial comprehensive evaluation of experts.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to an imminence emergency environment simulation training effect evaluation system and an evaluation method.
Background
At present, there are technical schemes for performing various in-situ emergency environment simulation training through VR (virtual reality) and AR (augmented reality) technologies, such as nuclear leakage accidents, large-scale epidemic emergency treatment, and the like, to provide the experience close to real operation for the trainees, thereby enhancing the training effect.
Thus, a large amount of data is generated during the above-mentioned simulation training process, and the data needs to be analyzed and evaluated accordingly to evaluate the training effect. However, the existing evaluation process is limited by mass data, and the data cannot be processed quickly to obtain an evaluation result accurately, so that the whole training process cannot be performed efficiently.
Disclosure of Invention
The invention aims to provide an evaluation system and an evaluation method for the simulated training effect of an in-situ emergency environment, which are used for automatically, quickly and accurately calculating the operation score of each trainee by preprocessing evaluation original data such as filtering and matching the data set with preset evaluation indexes and ensuring the final evaluation result to be more accurate by combining artificial comprehensive evaluation of experts.
In order to achieve the purpose, the invention adopts the following technical scheme:
in one aspect, a system for evaluating the simulated training effect of an in-situ emergency environment is provided, which includes:
the template setting module is used for setting different evaluation templates according to different simulation training schemes;
the index design module is used for determining the evaluation indexes corresponding to the evaluation templates and determining the weight of each evaluation index, and establishing an evaluation index system according to the evaluation indexes or directly loading a pre-stored evaluation index system;
an evaluation operator design module, which is used for designing an evaluation operator according to the evaluation index and the weight;
and the automatic evaluation module is connected with the evaluation operator design module and used for confirming the index to be evaluated of each trainee according to the evaluation original data and evaluating the index to be evaluated according to an evaluation rule and an evaluation operator which are internally provided with a standard operation flow so as to automatically calculate the operation score of each trainee.
Preferably, the system for evaluating the simulated training effect of the emergency environment further comprises:
the automatic evaluation and correction module is connected with the evaluation operator design module and is used for correcting the weight and/or the evaluation operator of each evaluation index so as to correct the operation score of the trainee;
the expert evaluation module is used for carrying out artificial comprehensive evaluation on the imminence emergency environment simulation training process of the trainees by the experts so as to generate an expert evaluation result including the operation scores of the experts on each trainee;
and the evaluation result output module is connected with the automatic evaluation module and/or the expert evaluation module and is used for displaying and outputting the operation scores of the trainees and/or the expert evaluation results obtained by automatic calculation.
Preferably, the system for evaluating the simulated training effect of the emergency environment further comprises:
and the playback module is used for acquiring the video and/or audio of the simulated training process of the trained personnel and playing the video and/or audio so as to provide the personnel to review the whole training process after the training is finished.
Preferably, the automatic evaluation module includes:
the evaluation rule management module is used for storing an evaluation rule corresponding to the evaluation index, the evaluation rule comprises an evaluation algorithm and an in-place emergency environment simulation training standard operation process, and the evaluation algorithm in the evaluation rule is defined according to the evaluation index;
the evaluation index management module is used for editing the evaluation index through an external programming tool, an application programming interface and the like, and when the evaluation index is edited, an evaluation index system containing the evaluation index and an evaluation rule corresponding to the evaluation index are synchronously changed so as to ensure the correspondence between the evaluation rule and the evaluation index;
the raw data preprocessing module is used for preprocessing the evaluation raw data to filter the evaluation raw data to obtain a data set, and matching the data set with the evaluation indexes in the index design module to obtain the indexes to be evaluated of each trained person from the data set;
and the automatic score calculation module is respectively connected with the original data preprocessing module and the evaluation rule management module, and is used for automatically loading the corresponding evaluation rule according to the index to be evaluated and automatically calculating the operation score of each trainee according to an evaluation algorithm and an evaluation operator.
Preferably, the pretreatment comprises: one or more of data grouping, data filtering, attribute screening, data set merging, attribute compression and transformation, statistical calculation, correlation calculation and the like.
Preferably, the raw evaluation data is presented in a database and/or XML file format.
Preferably, the evaluation result output module includes:
the score management module is used for displaying training questions, the assessment results of each trained person under different training questions and the comprehensive assessment results of each department participating in training;
and the personal training process display module is used for displaying the scene pictures of the trainee in training, and comprises a training video of the trainee under each training topic.
Preferably, the evaluation raw data is derived from the process of the training personnel performing the imminence emergency environment simulation training through one or more of VR, AR and MR systems.
The method for evaluating the simulation training effect of the immersive emergency environment, which is realized by the simulation training effect evaluation system of the immersive emergency environment, comprises the following steps:
s1, obtaining evaluation original data generated when the trainees perform the imminence emergency environment simulation training;
s2, determining the evaluation indexes corresponding to each evaluation template and the weight of each evaluation index according to different evaluation templates, and establishing an evaluation index system according to the evaluation indexes, or directly loading a pre-stored evaluation index system;
s3, designing an evaluation operator according to the evaluation index and the weight, prestoring an evaluation rule which comprises an evaluation algorithm and an in-situ emergency environment simulation training standard operation process and corresponds to the evaluation index, and defining the evaluation algorithm in the evaluation rule according to the evaluation index;
s4, preprocessing the evaluation original data to filter the evaluation original data to obtain a corresponding data set, and matching the data set with the evaluation indexes to obtain the indexes to be evaluated of each trainee from the data set;
s5, automatically loading an evaluation rule corresponding to the index to be evaluated according to the index to be evaluated, automatically calculating the operation score of each trainee according to an evaluation algorithm and an evaluation operator in the evaluation rule, and/or carrying out manual comprehensive evaluation on the whole marine nuclear accident emergency drilling process by experts so as to generate an expert evaluation result;
and S6, outputting the operation scores of the trainees and/or the expert evaluation results obtained by automatic calculation.
Preferably, the method for evaluating the simulated training effect of the emergency environment further comprises the following steps:
editing the evaluation index, and synchronously changing an evaluation index system containing the evaluation index and an evaluation rule corresponding to the evaluation index when the evaluation index is edited so as to ensure the correspondence between the evaluation rule and the evaluation index;
and/or correcting the weight and/or the evaluation operator of each evaluation index so as to correct the operation score of the trained personnel.
The invention has at least the following beneficial effects:
according to the invention, the evaluation original data is filtered to obtain a data set, and the data set is matched with a preset evaluation index, so that the operation score of each trained person is automatically, quickly and accurately calculated, and the final evaluation result is ensured to be more accurate by combining with the artificial comprehensive evaluation of experts.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic structural diagram of an in-situ emergency environment simulation training effect evaluation system according to the present invention;
FIG. 2 is a schematic diagram of the structural arrangement of the evaluation index system according to the present invention;
FIG. 3 is a schematic diagram of an interface for an evaluation system for simulating training effect in an emergency environment to automatically calculate an operation score according to the present invention;
FIG. 4 is a schematic diagram of an automated evaluation module according to the present invention;
FIG. 5 is a schematic structural diagram of an evaluation result output module according to the present invention;
FIG. 6 is a schematic diagram of an interface for personal drill performance in accordance with the present invention;
FIG. 7 is a schematic view of an interface of the comprehensive assessment results of the department according to the present invention;
FIG. 8 is a flowchart illustrating the steps of the method for evaluating the simulated training effect of the emergency environment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Example 1:
as shown in fig. 1-2, the present embodiment provides a system for evaluating the effect of simulated training in a contingency environment, wherein the contingency environment includes, but is not limited to, a nuclear power accident for a ship, and further, the system for evaluating the effect of simulated training in a contingency environment includes:
the template setting module 1 is used for setting different evaluation templates according to different simulation training schemes;
an index design module 2, configured to determine an evaluation index (such as response time, target recognition rate, operation specification degree, and the like shown in fig. 2) corresponding to each evaluation template and determine a weight of each evaluation index, and establish an evaluation index system according to the evaluation index, or directly load a pre-stored evaluation index system, where the evaluation index system may reflect a simulated training effect of a trained person; as shown in fig. 2, the evaluation index system (including the established evaluation index system and the directly loaded pre-stored evaluation index system) includes: the evaluation indexes are arranged according to a multi-level search tree structure; a unique global retrieval ID corresponding to each evaluation index, so as to perform operations such as rapid internal retrieval and program identification through the ID;
an evaluation operator design module 3, configured to design an evaluation operator according to the evaluation index and the weight, such as weighted summation, integral, derivation, arithmetic averaging, and the like;
an automatic evaluation module 4, connected to the evaluation operator design module 3, configured to confirm an index to be evaluated of each trainee according to the evaluation original data, and evaluate the index to be evaluated according to an evaluation rule and an evaluation operator that are built in with a standard operation flow, so as to automatically calculate an operation score (as shown in fig. 3) of each trainee; in this embodiment, the evaluation raw data is derived from a process in which a trainee performs an in-the-scene emergency environment simulation training through one or more of VR (virtual reality), AR (augmented reality), and MR (mixed reality) systems, and the data may be stored in a corresponding data storage, and may be uploaded/downloaded through an internal program/external interface, etc. as needed for analysis;
the automatic evaluation and correction module 5 is connected with the evaluation operator design module 63 and is used for correcting the weight and/or the evaluation operator of each evaluation index so as to correct the operation score of the trainee;
the expert evaluation module 6 is used for the experts to perform artificial comprehensive evaluation on the imminence emergency environment simulation training process of the trainees so as to generate an expert evaluation result including the operation scores of the experts on each trainee; in the embodiment, an expert can perform comprehensive evaluation combining qualitative and quantitative evaluation on timeliness of emergency decision of trained personnel, effectiveness of a rescue scheme, analysis efficiency of the surrounding environment of an event, deployment efficiency of division of work and responsibility of departments and the like in the training process by means of watching the training process in real time or reviewing a training video and the like in a training field in combination with standard operation;
the evaluation result output module 7 is connected with the automatic evaluation module 4 and/or the expert evaluation module 6 and is used for displaying and outputting the operation scores and/or expert evaluation results of the trainees obtained by automatic calculation; the evaluation result output module 7 includes an EXCEL form editing module, a word document editing module, a printing device, and the like;
the playback module 8 is used for acquiring the video and/or audio of the simulated training process of the trainee and playing the video and/or audio so as to provide the trainee to review the whole training process after the training is finished; the playback module 8 comprises a high definition camera.
Further, as shown in fig. 4, the automatic evaluation module 4 includes:
an evaluation rule management module 41, configured to store an evaluation rule corresponding to the evaluation index, where the evaluation rule includes an evaluation algorithm and an operation procedure of a real-time emergency environment simulation training standard, and define the evaluation algorithm in the evaluation rule according to the evaluation index, for example, select a corresponding algorithm model;
an evaluation index management module 42, connected to the index design module 2, for editing the evaluation index through an external programming tool, an application programming interface, and the like, and when the evaluation index is edited, an evaluation index system including the evaluation index and an evaluation rule corresponding to the evaluation index are changed synchronously to ensure the correspondence between the evaluation rule and the evaluation index; editing comprises operations of new creation, deletion, retrieval and the like of evaluation indexes;
a raw data preprocessing module 43, connected to the index design module 2, for preprocessing the raw evaluation data to filter the raw evaluation data to obtain a data set, and matching the data set with the evaluation indexes in the index design module 2 to obtain the indexes to be evaluated of each trainee from the data set; wherein the pre-processing comprises: one or more of data grouping, data filtering, attribute screening, data set merging, attribute compression and transformation, statistical calculation, correlation calculation and the like, wherein the evaluation original data is presented in a database and/or XML file format; because the massive data generated by the trainee in the drilling process are not required to be evaluated, the evaluation original data generated in the drilling process of the trainee are input into the original data preprocessing module 43 through a data table or an XML file conforming to the evaluation data specification, and after data preprocessing, irrelevant data can be quickly removed, so that the time for obtaining the evaluation index to be evaluated is greatly reduced, and the efficiency of subsequent processing of the data is improved;
and the automatic score calculation module 44 is respectively connected with the raw data preprocessing module 43 and the evaluation rule management module 41, and is configured to automatically load the evaluation rule corresponding to the index to be evaluated according to the index to be evaluated, and automatically calculate the operation score of each trainee according to an evaluation algorithm and an evaluation operator.
Therefore, in the embodiment, the evaluation original data is preprocessed through filtering to obtain a data set, the data set is matched with a preset evaluation index to quickly obtain an index to be evaluated of each trainee, then an evaluation rule corresponding to the index to be evaluated is automatically loaded, an operation score of each trainee is automatically, quickly and accurately calculated according to an evaluation algorithm and an evaluation operator, the score can be corrected to accurately obtain a drilling result of each trainee, meanwhile, in order to avoid large errors caused by automatic calculation of the score, an expert evaluation module can be arranged to allow an expert to perform artificial comprehensive evaluation on the whole marine nuclear accident emergency drilling process, and the final evaluation result is ensured to be more accurate.
Example 2:
the present embodiment is different from embodiment 1 in that, as shown in fig. 5 to 7, the evaluation result output module 7 includes:
a performance management module 71 for displaying training subjects, the assessment results (i.e., "personal performance") of each trainee (e.g., "Zhang III") under different training subjects (e.g., "fire extinguishing", "steam leakage", "water treatment", etc.), and the comprehensive assessment results (i.e., "department assessment index") of each department participating in training, wherein the assessment results of the trainee include: scores and total scores of different indexes (such as 'completion time', 'operation accuracy', 'average interval of response', 'operation step', 'cooperation' and the like) under each training topic (such as 'fire extinguishing'), the scores can be automatically calculated by the automatic evaluation module 4, and/or obtained by the expert evaluation module 6, and the comprehensive evaluation result of each department comprises: the number of individuals, the number of teams, the qualification rate, the accuracy, the score and the like involved in the department;
the personal training process display module 72 is configured to display a scene screen of a trainee during training, and includes a training video of the trainee under each training topic, as shown in fig. 6, first, selects a training topic "steam leakage" and an index "training duration 40 minutes" corresponding to the training topic, "record" mark after "zhang san" is clicked, and then, a training video of zhang san under the "steam leakage" topic for training for 40 minutes can be displayed.
Example 3:
the embodiment provides a method for evaluating the effect of a simulated training in a immersive emergency environment, which is implemented by the system for evaluating the effect of a simulated training in an immersive emergency environment according to embodiment 1 or 2, as shown in fig. 8, the method includes the following steps:
s1, obtaining an evaluation original number generated when the trainee carries out the imminence emergency environment simulation training;
s2, determining the evaluation indexes corresponding to each evaluation template and the weight of each evaluation index according to different evaluation templates, and establishing an evaluation index system according to the evaluation indexes, or directly loading a pre-stored evaluation index system;
s3, designing an evaluation operator according to the evaluation index and the weight, prestoring an evaluation rule which comprises an evaluation algorithm and an in-situ emergency environment simulation training standard operation process and corresponds to the evaluation index, and defining the evaluation algorithm in the evaluation rule according to the evaluation index;
s4, preprocessing the raw evaluation data (i.e., a data preprocessing process 1,2, 3.), so as to filter the raw evaluation data to obtain a corresponding data set (i.e., data set 1,2, 3.), and matching the data set with the evaluation index, so as to obtain an index to be evaluated (i.e., index 1,2, 3.) of each trainee from the data set;
s5, automatically loading corresponding evaluation rules according to the indexes to be evaluated, such as loading the evaluation rule 1 corresponding to the indexes 1,2,3 and 4, automatically calculating the operation score of each trainee according to the evaluation algorithm and the evaluation operator in the evaluation rules, and/or manually and comprehensively evaluating the whole marine nuclear accident emergency drilling process by experts to generate expert evaluation results;
and S6, outputting the operation scores of the trainees and/or the expert evaluation results obtained by automatic calculation.
Preferably, the method for evaluating the simulated training effect of the emergency environment further comprises: editing the evaluation index through an external programming tool and an application programming interface, and synchronously changing an evaluation index system containing the evaluation index and an evaluation rule corresponding to the evaluation index when the evaluation index is edited so as to ensure the correspondence between the evaluation rule and the evaluation index;
and/or correcting the weight and/or the evaluation operator of each evaluation index so as to correct the operation score of the trained personnel.
In summary, the invention performs preprocessing such as filtering on the evaluation raw data in the training process of the trainees to obtain a data set, matches the data set with the preset evaluation index to automatically, rapidly and accurately calculate the operation score of each trainee, and combines the artificial comprehensive evaluation of experts to ensure that the final evaluation result is more accurate.
It should be noted that the technical features of the above embodiments 1 to 3 can be arbitrarily combined, and the technical solutions obtained by combining the technical features belong to the scope of the present application.
The foregoing illustrates and describes the principles, general features, and advantages of the present invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are merely illustrative of the principles of the invention, but that various changes and modifications may be made without departing from the spirit and scope of the invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (10)
1. An in-situ emergency environment simulation training effect evaluation system, comprising:
the template setting module is used for setting different evaluation templates according to different simulation training schemes;
the index design module is used for determining the evaluation indexes corresponding to the evaluation templates and determining the weight of each evaluation index, and establishing an evaluation index system according to the evaluation indexes or directly loading a pre-stored evaluation index system;
an evaluation operator design module, which is used for designing an evaluation operator according to the evaluation index and the weight;
and the automatic evaluation module is connected with the evaluation operator design module and used for confirming the index to be evaluated of each trainee according to the evaluation original data and evaluating the index to be evaluated according to an evaluation rule and an evaluation operator which are internally provided with a standard operation flow so as to automatically calculate the operation score of each trainee.
2. The system for assessing the effectiveness of immersive emergency environment simulated training of claim 1, wherein the system for assessing the effectiveness of immersive emergency environment simulated training further comprises:
the automatic evaluation and correction module is connected with the evaluation operator design module and is used for correcting the weight and/or the evaluation operator of each evaluation index so as to correct the operation score of the trainee;
the expert evaluation module is used for carrying out artificial comprehensive evaluation on the imminence emergency environment simulation training process of the trainees by the experts so as to generate an expert evaluation result including the operation scores of the experts on each trainee;
and the evaluation result output module is connected with the automatic evaluation module and/or the expert evaluation module and is used for displaying and outputting the operation scores of the trainees and/or the expert evaluation results obtained by automatic calculation.
3. The system for assessing the effectiveness of immersive emergency environment simulated training of claim 1, wherein the system for assessing the effectiveness of immersive emergency environment simulated training further comprises:
and the playback module is used for acquiring the video and/or audio of the simulated training process of the trained personnel and playing the video and/or audio so as to provide the personnel to review the whole training process after the training is finished.
4. The system for assessing the effectiveness of simulated training in an immersive emergency environment of any of claims 1-3, wherein the automated assessment module comprises:
the evaluation rule management module is used for storing an evaluation rule corresponding to the evaluation index, the evaluation rule comprises an evaluation algorithm and an in-place emergency environment simulation training standard operation process, and the evaluation algorithm in the evaluation rule is defined according to the evaluation index;
the evaluation index management module is used for editing the evaluation index through an external programming tool, an application programming interface and the like, and when the evaluation index is edited, an evaluation index system containing the evaluation index and an evaluation rule corresponding to the evaluation index are synchronously changed so as to ensure the correspondence between the evaluation rule and the evaluation index;
the raw data preprocessing module is used for preprocessing the evaluation raw data to filter the evaluation raw data to obtain a data set, and matching the data set with the evaluation indexes in the index design module to obtain the indexes to be evaluated of each trained person from the data set;
and the automatic score calculation module is respectively connected with the original data preprocessing module and the evaluation rule management module, and is used for automatically loading the corresponding evaluation rule according to the index to be evaluated and automatically calculating the operation score of each trainee according to an evaluation algorithm and an evaluation operator.
5. The system for assessing the effectiveness of immersive emergency environment simulation training of claim 4, wherein the preprocessing comprises: one or more of data grouping, data filtering, attribute screening, data set merging, attribute compression and transformation, statistical calculation, correlation calculation and the like.
6. The system for assessing the effectiveness of simulated training in an immersive emergency environment of claim 4, wherein the raw data for assessment is presented in a database and/or XML file format.
7. The system for evaluating the effect of the immersive emergency environment simulation training according to claim 2, wherein the evaluation result output module comprises:
the score management module is used for displaying training questions, the assessment results of each trained person under different training questions and the comprehensive assessment results of each department participating in training;
and the personal training process display module is used for displaying the scene pictures of the trainee in training, and comprises a training video of the trainee under each training topic.
8. The system for evaluating the effect of the immersive emergency environment simulation training of claim 1, wherein the evaluation raw data is derived from the process of the immersive emergency environment simulation training performed by the trainee through one or more of VR, AR and MR systems.
9. A method for evaluating the effect of the immersive emergency environment simulated training, which is implemented by the system for evaluating the effect of the immersive emergency environment simulated training according to claim 4, comprising the steps of:
s1, obtaining evaluation original data generated when the trainees perform the imminence emergency environment simulation training;
s2, determining the evaluation indexes corresponding to each evaluation template and the weight of each evaluation index according to different evaluation templates, and establishing an evaluation index system according to the evaluation indexes, or directly loading a pre-stored evaluation index system;
s3, designing an evaluation operator according to the evaluation index and the weight, prestoring an evaluation rule which comprises an evaluation algorithm and an in-situ emergency environment simulation training standard operation process and corresponds to the evaluation index, and defining the evaluation algorithm in the evaluation rule according to the evaluation index;
s4, preprocessing the evaluation original data to filter the evaluation original data to obtain a corresponding data set, and matching the data set with the evaluation indexes to obtain the indexes to be evaluated of each trainee from the data set;
s5, automatically loading an evaluation rule corresponding to the index to be evaluated according to the index to be evaluated, automatically calculating the operation score of each trainee according to an evaluation algorithm and an evaluation operator in the evaluation rule, and/or carrying out manual comprehensive evaluation on the whole marine nuclear accident emergency drilling process by experts so as to generate an expert evaluation result;
and S6, outputting the operation scores of the trainees and/or the expert evaluation results obtained by automatic calculation.
10. The method for evaluating the effect of the immersive emergency environment simulated training of claim 9, wherein the method for evaluating the effect of the immersive emergency environment simulated training further comprises the steps of:
editing the evaluation index, and synchronously changing an evaluation index system containing the evaluation index and an evaluation rule corresponding to the evaluation index when the evaluation index is edited so as to ensure the correspondence between the evaluation rule and the evaluation index;
and/or correcting the weight and/or the evaluation operator of each evaluation index so as to correct the operation score of the trained personnel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110790042.XA CN113570330A (en) | 2021-07-13 | 2021-07-13 | System and method for evaluating simulation training effect of emergency environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110790042.XA CN113570330A (en) | 2021-07-13 | 2021-07-13 | System and method for evaluating simulation training effect of emergency environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113570330A true CN113570330A (en) | 2021-10-29 |
Family
ID=78164634
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110790042.XA Pending CN113570330A (en) | 2021-07-13 | 2021-07-13 | System and method for evaluating simulation training effect of emergency environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113570330A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114706743A (en) * | 2022-04-27 | 2022-07-05 | 中电普信(北京)科技发展有限公司 | Comprehensive evaluation method supporting real-time evaluation |
| CN116629715A (en) * | 2023-07-25 | 2023-08-22 | 中国船舶集团有限公司第七〇七研究所 | Simulation training comprehensive evaluation method and system based on-the-fly event and emergency event |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107909265A (en) * | 2017-11-13 | 2018-04-13 | 陈琳琳 | Fight-terrorism warfare capability evaluation system and method |
| CN111126732A (en) * | 2018-10-31 | 2020-05-08 | 北京国双科技有限公司 | Index data evaluation method and device |
| CN111191879A (en) * | 2019-12-11 | 2020-05-22 | 中电普信(北京)科技发展有限公司 | Comprehensive evaluation method and system |
| CN112053042A (en) * | 2020-08-20 | 2020-12-08 | 湖南新航动力信息科技有限公司 | Method, system, computer device and storage medium for dynamically constructing efficiency evaluation system |
| CN112288301A (en) * | 2020-11-05 | 2021-01-29 | 南京莱斯信息技术股份有限公司 | Multidimensional and multiscale command training evaluation system and method |
| CN113095978A (en) * | 2021-03-05 | 2021-07-09 | 苏州真趣信息科技有限公司 | Emergency drilling system based on personnel positioning technology |
-
2021
- 2021-07-13 CN CN202110790042.XA patent/CN113570330A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107909265A (en) * | 2017-11-13 | 2018-04-13 | 陈琳琳 | Fight-terrorism warfare capability evaluation system and method |
| CN111126732A (en) * | 2018-10-31 | 2020-05-08 | 北京国双科技有限公司 | Index data evaluation method and device |
| CN111191879A (en) * | 2019-12-11 | 2020-05-22 | 中电普信(北京)科技发展有限公司 | Comprehensive evaluation method and system |
| CN112053042A (en) * | 2020-08-20 | 2020-12-08 | 湖南新航动力信息科技有限公司 | Method, system, computer device and storage medium for dynamically constructing efficiency evaluation system |
| CN112288301A (en) * | 2020-11-05 | 2021-01-29 | 南京莱斯信息技术股份有限公司 | Multidimensional and multiscale command training evaluation system and method |
| CN113095978A (en) * | 2021-03-05 | 2021-07-09 | 苏州真趣信息科技有限公司 | Emergency drilling system based on personnel positioning technology |
Non-Patent Citations (1)
| Title |
|---|
| 黎大端;何松立;王丹彤;谢春生;: "环境水污染事件应急监测演练评估模型构建研究", 环境科学与管理, no. 07, pages 127 - 132 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114706743A (en) * | 2022-04-27 | 2022-07-05 | 中电普信(北京)科技发展有限公司 | Comprehensive evaluation method supporting real-time evaluation |
| CN114706743B (en) * | 2022-04-27 | 2023-01-06 | 中电普信(北京)科技发展有限公司 | Comprehensive evaluation method supporting real-time evaluation |
| CN116629715A (en) * | 2023-07-25 | 2023-08-22 | 中国船舶集团有限公司第七〇七研究所 | Simulation training comprehensive evaluation method and system based on-the-fly event and emergency event |
| CN116629715B (en) * | 2023-07-25 | 2023-10-13 | 中国船舶集团有限公司第七〇七研究所 | Simulation training comprehensive evaluation method and system based on-the-fly event and emergency event |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109242246B (en) | Scene construction method, emergency drilling method and scene construction system | |
| CN113570330A (en) | System and method for evaluating simulation training effect of emergency environment | |
| CN113362671B (en) | Marine nuclear emergency drilling simulation system and drilling method | |
| WO2022199179A1 (en) | Remaining life prediction model modeling system and method for equipment, and prediction system | |
| CN113407651A (en) | Progress information feedback and deviation real-time display method | |
| CN112509583A (en) | Auxiliary supervision method and system based on scheduling operation order system | |
| CN115062675A (en) | Full-spectrum pollution tracing method based on neural network and cloud system | |
| CN110147926A (en) | A kind of risk class calculation method, storage medium and the terminal device of type of service | |
| CN112632179A (en) | Model construction method and device, storage medium and equipment | |
| CN114638442B (en) | Flight training scheme generation system, method and equipment for individual difference | |
| CN116305797A (en) | Construction risk assessment system based on BIM and multisource quality information fusion | |
| CN107506509A (en) | Using logic and its verification method and constructive method | |
| CN112256576B (en) | Man-machine dialogue corpus testing method, device, equipment and storage medium | |
| CN113706513A (en) | Vehicle damage image analysis method, device, equipment and medium based on image detection | |
| CN111611973B (en) | Target user identification method, device and storage medium | |
| TWI771632B (en) | Learning support device, learning support method, and recording medium | |
| CN112598547A (en) | Education topic generation method and device based on automatic production line and electronic equipment | |
| CN116662186A (en) | Log playback assertion method and device based on logistic regression and electronic equipment | |
| Heath et al. | Uncertainty analysis of the Limits to Growth model: sensitivity is high, but trends are stable | |
| CN114691903A (en) | Intelligent course testing method and system, electronic equipment and storage medium | |
| CN114048148A (en) | Crowdsourcing test report recommendation method and device and electronic equipment | |
| CN113609643B (en) | Time acquisition method and system for digital operation basic action unit of nuclear power station | |
| RU2710914C1 (en) | Automated method of spatial economic studies | |
| CN114238613B (en) | Method and device for determining mastery degree of knowledge points and electronic equipment | |
| CN114998070B (en) | Immersive digital learning method and system for enterprise digital learning platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |