CN114282795B - Network target range personnel skill evaluation method, device, equipment and readable storage medium - Google Patents
Network target range personnel skill evaluation method, device, equipment and readable storage medium Download PDFInfo
- Publication number
- CN114282795B CN114282795B CN202111572769.7A CN202111572769A CN114282795B CN 114282795 B CN114282795 B CN 114282795B CN 202111572769 A CN202111572769 A CN 202111572769A CN 114282795 B CN114282795 B CN 114282795B
- Authority
- CN
- China
- Prior art keywords
- skill
- behavior
- role
- process key
- actual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application provides a network range staff skill evaluation method, which comprises the following steps: matching a reference role behavior according to the behavior characteristics of the actual role behavior of the target user; identifying the process key nodes of the actual role behaviors according to the process key nodes corresponding to the matched reference role behaviors, wherein the process key nodes corresponding to the reference role behaviors are obtained by segmenting the behavior process of correctly using standard skills to complete the target task; and comparing each process key node identified from the actual role behaviors with the corresponding process key node of the reference role behaviors on the skill characteristics to generate the skill difference characteristics corresponding to each process key node of the actual role behaviors. The method and the device can efficiently and flexibly carry out automatic skill evaluation on the network target range. The application also provides a network shooting range personnel skill evaluation device, equipment and a computer readable storage medium.
Description
Technical Field
The present application relates to the field of network security, and in particular, to a method, an apparatus, a device, and a computer-readable storage medium for evaluating skills of people in a network shooting range.
Background
The network target range is a technology or a product for simulating and reproducing the running states and running environments of network architecture, system equipment and business processes in a real network space based on a virtualization technology. Network shooting ranges have become an essential network space security core infrastructure for network space security research, learning, testing, verification, drilling and the like in various countries. The network shooting range construction is highly valued by all countries in the world and is used as an important means for construction support of safety capacity.
A large number of network security personnel can participate in the activities of the network shooting range, play different roles in the network shooting range, such as attackers, defenders, observers, operation and maintenance personnel and the like, complete respective tasks, and participate in mutual cooperation or game. Therefore, skill management needs to be performed on the network shooting range, and the skill management is the core capability of the network shooting range platform.
In the existing skill evaluation method, currently mainstream training platforms (network security skill training platforms) are all matched with a middle-time/high-time/university course system for training design, the study of knowledge points is emphasized, and the skill evaluation depends on the investigation condition of the knowledge points, such as question and answer accuracy, but if the investigated knowledge points are incomplete and the organization is not good, the actual skill condition cannot be reflected; in addition, the written response condition depending on the final result lacks attention to the core process, only the final result is required to be correct, and the actual skill level capability cannot be reflected (such as proficiency, generality and badness).
If the existing skill evaluation method is used for technical evaluation on the network target range, when the complex situation of the network target range is faced, the existing skill evaluation method cannot meet the skill evaluation requirements under the conditions of multiple roles, large scale and the like of the network target range due to insufficient flexibility, cannot meet the requirements of different scenes of the network target range, and cannot realize automatic management and control.
Disclosure of Invention
The application provides a method, a device and equipment for evaluating skills of network range personnel, and a computer readable storage medium, which can efficiently and flexibly carry out automatic skill evaluation on a network range.
In a first aspect, the present application provides a network range personnel skill assessment method, comprising:
recording the actual role behavior of a target user, wherein the actual role behavior is a network behavior process implemented aiming at a target task when the target user plays a selected role in a target scene of a network target range;
according to the behavior characteristics of the actual role behaviors, performing characteristic matching with a role behavior set constructed in advance so as to match a reference role behavior from the role behavior set;
identifying the process key nodes of the actual role behaviors according to the process key nodes corresponding to the matched reference role behaviors, wherein the process key nodes corresponding to the reference role behaviors are obtained by segmenting the behavior process of correctly using standard skills to complete the target task;
and comparing each process key node identified from the actual role behaviors with the corresponding process key node of the reference role behaviors in skill characteristics to generate skill difference characteristics corresponding to each process key node of the actual role behaviors.
Optionally, the recording the actual role behavior of the target user includes:
and when the target user performs skill operation based on the definition of the process key node corresponding to the reference role behavior, or when the target user performs skill operation based on the process key node defined by the target user, recording the actual role behavior of the target user.
Optionally, the comparing, in skill characteristics, each process key node identified from the actual role behavior with the process key node corresponding to the reference role behavior respectively includes:
comparing each process key node identified from the actual role behaviors with the corresponding process key node of the reference role behaviors on the basis of the node skill characteristics of each process key node of the reference role behaviors;
wherein the node skill characteristics include at least one of:
the time taken to perform the corresponding standard skill;
implementation difficulty in executing the corresponding standard skill;
the operation behaviors required when the corresponding standard skills are executed;
and executing the skill effect achieved when the corresponding standard skill is executed.
Optionally, the reference role behavior corresponds to a skill process diagram, and the skill process diagram defines an execution relationship between each process key node corresponding to the reference role behavior; then, the method further comprises:
and comparing the execution relation of each process key node of the actual role behavior with each process key node of the reference role behavior based on the skill process diagram to generate execution difference characteristics.
Optionally, the execution relationship includes synchronous execution and sequential execution.
Optionally, the method further includes:
and after the difference features are obtained through comparison, generating a skill scoring result corresponding to the actual role behavior based on the score of each difference feature and the weight corresponding to each difference feature.
In a second aspect, the present application provides a network range staff skill assessment apparatus, comprising:
the behavior recording unit is used for recording the actual role behavior of the target user, wherein the actual role behavior is a network behavior process implemented aiming at a target task when the target user plays a selected role in a target scene of a network target range;
the behavior matching unit is used for performing characteristic matching with a role behavior set constructed in advance according to the behavior characteristics of the actual role behavior so as to match a reference role behavior from the role behavior set;
the key point identification unit is used for identifying process key nodes of the actual role behaviors according to the process key nodes corresponding to the matched reference role behaviors, and the process key nodes corresponding to the reference role behaviors are obtained by segmenting the behavior process of correctly using standard skills to complete the target task;
and the skill evaluation unit is used for respectively comparing each process key node identified from the actual role behaviors with the corresponding process key node of the reference role behaviors in the skill characteristics, and generating the skill difference characteristics corresponding to each process key node of the actual role behaviors.
Optionally, the behavior recording unit is specifically configured to record the actual role behavior of the target user when the target user performs a skill operation based on the definition of the process key node corresponding to the reference role behavior, or when the target user performs a skill operation based on the process key node defined by the target user.
Optionally, the skill evaluation unit is specifically configured to compare, on the basis of the node skill characteristics of each process key node of the reference role behavior, each process key node identified from the actual role behavior with the corresponding process key node of the reference role behavior in the skill characteristics, and generate a skill difference characteristic corresponding to each process key node of the actual role behavior;
wherein the node skill characteristics include at least one of:
the time taken to perform the corresponding standard skill;
implementation difficulty in executing the corresponding standard skill;
the operation behaviors required when the corresponding standard skills are executed;
and executing the skill effect achieved when the corresponding standard skill is executed.
Optionally, the reference role behavior corresponds to a skill process diagram, and the skill process diagram defines an execution relationship between each process key node corresponding to the reference role behavior; then, the skill assessment unit is further configured to:
and comparing the execution relation of each process key node of the actual role behavior with each process key node of the reference role behavior based on the skill process diagram to generate execution difference characteristics.
Optionally, the execution relationship includes synchronous execution and sequential execution.
Optionally, the apparatus further comprises:
and the skill scoring unit is used for generating a skill scoring result corresponding to the actual role behavior based on the score of each difference characteristic and the weight corresponding to each difference characteristic after each difference characteristic is obtained through comparison.
In a third aspect, the present application provides an electronic device, comprising: a processor, a memory;
the memory for storing a computer program;
the processor is used for executing the network range staff skill evaluation method by calling the computer program.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the network range personnel skill assessment method described above.
In the technical scheme provided by the application, the operation process corresponding to the actual role behavior of the target user is decomposed to obtain each process key node of the actual role behavior, so that the effectiveness of skill evaluation can be improved; the standardized operation of the reference role behavior is introduced and used as a reference standard, the skill difference characteristic corresponding to each process key node of the actual role behavior is generated through characteristic comparison, and the auditing efficiency is improved through the evaluation and auditing of each process key node of the actual role behavior; therefore, the automatic skill evaluation method and the automatic skill evaluation system can efficiently and flexibly carry out automatic skill evaluation on the network target range.
Drawings
FIG. 1 is a schematic flow chart of a network range personnel skill assessment method shown in the present application;
FIG. 2 is a schematic diagram of the components of a network range personnel skill assessment device shown in the present application;
fig. 3 is a schematic structural diagram of an electronic device shown in the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Before the network range personnel skill evaluation method provided by the embodiment of the application is executed, the skill required to be used when a certain task is completed by a certain class of users in a certain scene in the network range can be preliminarily evaluated, namely, the skill and level requirements of the class of users are obtained through scene decomposition, and are initially defined; then adopting the skill to carry out standardized operation according to correct user operation; then, the standardized operation process is separated into process key nodes, and the stage content corresponding to each process key node can be subjected to feature description in a user-defined mode, so that feature data of each process key node and the final result characteristic obtained by using the skill to perform operation are recorded and used as benchmarking references of similar users of the scene. By the method, different benchmarking references corresponding to different user categories of different scenes can be obtained.
Specifically, the skills required for a scene in the network range may be identified and defined as an initial tag. For convenience of description, in the embodiments of the present application, a standard network behavior process implemented when the skill is used to complete a corresponding task is defined as a reference role behavior, that is, the reference role behavior is a standard network behavior process implemented for a certain task when a certain user plays a selected role in a certain scene of a network target range. Therefore, different tasks of different classes of users in different scenes correspond to different reference role behaviors, and the reference role behaviors form a role behavior set.
For each reference role behavior in the role behavior set, skill decomposition can be performed on the task completed by the reference role behavior, and the behavior process corresponding to the reference role behavior is segmented, so that a plurality of process key nodes are obtained, each process key node is a standard and key skill behavior stage in the corresponding task, and node skill characteristics can be labeled for each process key node to embody the key characteristics of the standard skill behavior.
Wherein the node skill characteristics of the process key nodes may include at least one of the following characteristics:
the time taken to perform the corresponding standard skill;
implementation difficulty in executing the corresponding standard skill;
the operation behaviors required when the corresponding standard skills are executed;
and executing the skill effect achieved when the corresponding standard skill is executed.
Therefore, in the embodiment of the application, when a certain skill is used to complete a corresponding task according to correct operation in a certain scene, a reference role behavior is formed, each key process node is recorded and analyzed, each key process node is a behavior subprocess, and related node skill characteristics are recorded and used as benchmarking references of similar users in the scene.
How to evaluate the skill of the actual role behavior of the current user based on the process key nodes corresponding to the reference role behaviors is described below.
According to the skill evaluation method for the network shooting range personnel, the skill management of the network shooting range platform can be efficiently and flexibly realized, the best practice (namely role task path) is provided, and the skill difference of the user role is found through comparison, so that the skill level of each role is improved.
Referring to fig. 1, a schematic flow chart of a network range staff skill evaluation method provided in the embodiment of the present application is shown, where the method includes the following steps:
s101: and recording the actual role behavior of the target user, wherein the actual role behavior is a network behavior process implemented for the target task when the target user plays a selected role in a target scene of the network shooting range.
In the embodiment of the present application, any user of the network target range may be defined as a target user, the target user may play a certain role (such as an attacker or a defender) in the network target range, a network scene in which the user role of the target user is located may be defined as a target scene, and a task that the target user needs to complete in the target scene is defined as a target task.
When a target user uses the role skill to operate to complete a target task, the operation process is the actual role behavior of the target user, and the skill evaluation needs to be performed on the actual role behavior of the target user in the embodiment of the application.
In an implementation manner of the embodiment of the present application, the "recording the actual role behavior of the target user" in S101 may include: and when the target user performs skill operation based on the definition of the process key node corresponding to the reference role behavior, or when the target user performs skill operation based on the process key node defined by the target user, recording the actual role behavior of the target user.
In this implementation manner, since the reference role behavior is a process of a correct user operation behavior performed using standard skills, the target user may operate based on the definition of the process key node corresponding to the reference role behavior, and of course, the target user may also operate according to the process key node defined by the target user, so as to form the actual role behavior of the target user.
S102: and performing characteristic matching with a pre-constructed role behavior set according to the behavior characteristics of the actual role behavior so as to match a reference role behavior from the role behavior set.
In the embodiment of the present application, based on the role behavior set introduced in the above, the role behavior set may include a plurality of reference role behaviors, and the reference role behaviors are processes of correct user operation behaviors performed using standard skills, so that feature matching may be performed on a role behavior set constructed in advance according to behavior features of actual role behaviors, so as to match a reference role behavior from the role behavior set.
For the matched reference role behaviors and actual role behaviors, the user roles, skills to be used, scenes where the user roles are located and tasks to be completed of the reference role behaviors and the actual role behaviors are the same, so that when the actual role behaviors are matched with the reference role behaviors, feature matching can be performed from the aspects.
S103: and identifying the process key nodes of the actual role behaviors according to the process key nodes corresponding to the matched reference role behaviors, wherein the process key nodes corresponding to the reference role behaviors are obtained by segmenting the behavior process of correctly using standard skills to complete the target task.
In the embodiment of the application, the actual role behavior of the target user can be analyzed, so that the identification operation is performed on each process key node corresponding to the matched reference role behavior in a full-text retrieval mode, and the process key nodes in the reference role behavior in the actual role behavior are identified, and the identification result is recorded.
Therefore, the operation behaviors of each process key node corresponding to the reference role behaviors can be defined in advance, whether the process key node exists in the actual role behaviors of the target user or not is judged according to the definition content corresponding to each process key node, and if yes, the process key node is used as one process key node identified from the actual role behaviors.
It should be noted that, in the network shooting range, a monitoring program and a network traffic packet monitoring program can be embedded in a virtual machine of the network shooting range, behavior auditing of a target user is realized through the monitoring program and the network traffic packet monitoring program, and after a reference mode is started, characteristics of process key nodes in actual role behaviors are identified and recorded, so that key points and contents of auditing are quickly found, and auditing detection efficiency is accelerated. Therefore, the normal operation (namely the actual role behavior) of the target user is monitored and audited by the monitoring program and the network traffic packet monitoring program, all data are gathered to the data warehouse of the network target range so as to be searched in full text, and thus the behavior records of the process key nodes in the actual role behavior are extracted (the function can be automatically completed by the system, and can also be directly filled and submitted by the target user).
S104: and comparing each process key node identified from the actual role behaviors with the corresponding process key node of the reference role behaviors on the skill characteristics to generate the skill difference characteristics corresponding to each process key node of the actual role behaviors.
In the embodiment of the application, an analytic hierarchy process may be adopted to combine the quantitative analysis and the qualitative analysis, so as to form a skill scoring result by performing comparative analysis on the user characteristics and the reference characteristics. Specifically, for each process key node in the actual role behavior, the node skill characteristics of the process key node may be used as user characteristics, and the standard and accurate node skill characteristics of the process key node in the corresponding reference role behavior may be used as reference characteristics, which are compared to output differences between the user characteristics and the reference characteristics, and the differences may be embodied as specific skill scoring results, that is, the skill difference characteristics corresponding to the process key node are embodied by using the skill scoring results.
After the skill difference characteristic corresponding to each process key node of the actual role behavior is obtained, the embodiment of the application can further give an improvement suggestion about the process key node to the target user, and the improvement suggestion can prompt the target user how to perform skill operation so as to achieve the operation effect of the reference characteristic of the process key node.
In an implementation manner of the embodiment of the present application, the "comparing each process key node identified from the actual role behavior with the corresponding process key node of the reference role behavior in the skill characteristics" in S104 may include: based on the node skill characteristics of each process key node of the reference role behavior, comparing each process key node identified from the actual role behavior with the corresponding process key node of the reference role behavior on the skill characteristics; wherein the node skill characteristics include at least one of:
the time taken to perform the corresponding standard skill;
implementation difficulty in executing the corresponding standard skill;
the operation behaviors required when the corresponding standard skills are executed;
and executing the skill effect achieved when the corresponding standard skill is executed.
In this implementation manner, for the same process key node in the actual role behavior and the reference role behavior, each skill characteristic thereof may be compared to obtain respective difference characteristics, which may specifically be a time difference, an implementation difficulty difference, an operation behavior difference, a skill effect difference, and the like.
Further, the embodiment of the present application may further include: and comparing each process key node of the actual role behavior with each process key node of the reference role behavior based on the skill process diagram to generate an execution difference characteristic.
Specifically, the reference role behavior corresponds to a skill process diagram, and the skill process diagram defines an execution relationship between each process key node corresponding to the reference role behavior, and the execution relationship may include synchronous execution and sequential execution. Therefore, the execution relation of each key process node of the reference role behavior is defined in advance, a complete process diagram of standard skills used by the reference role behavior is formed, and based on the complete process diagram, the detailed evaluation of the skills based on process elements can be realized on the actual role behavior of the target user, so that the difference characteristics of the execution relation of each process key node of the actual role behavior and each process key node of the reference role behavior are formed; in addition, the performance difference feature can also be embodied in a specific skill scoring result.
Further, the embodiment of the present application may further include: and after the difference features are obtained through comparison, generating a skill scoring result corresponding to the actual role behavior based on the score of each difference feature and the weight corresponding to each difference feature.
Specifically, the difference features may be obtained by the comparison operation, and the difference features may include a skill difference feature corresponding to each process key node of the actual role behavior, and may further include an execution difference feature between the actual role behavior and the reference role behavior with respect to each process key node. Based on this, each difference feature can be given a weight value according to the importance degree of the difference feature in advance, so that after each difference feature is obtained, the skill scoring result corresponding to each difference feature and the weight value corresponding to each difference feature can be weighted to obtain a weight value, the skill evaluation level of the actual role behavior of the target user is reflected by the weight value, and the higher the score value is, the higher the skill level is, and vice versa.
It can be understood that, in the embodiment of the application, by defining the skill of the scene, separating and recording the process key nodes, and clearly defining the process key nodes, the skill evaluation based on the process behavior monitoring analysis is realized, and meanwhile, the standard behavior characteristics are introduced, so that the analysis efficiency of the behavior monitoring is accelerated; in addition, the difference punctuation is found in time, the focus of practical training and the shortage of personnel are conveniently and deeply known, and the targeted guidance work is conveniently carried out, so that the requirement of the skill level is quickly met.
In the network range staff skill evaluation method provided by the embodiment of the application, the operation process corresponding to the actual role behavior of the target user is decomposed to obtain each process key node of the actual role behavior, so that the effectiveness of skill evaluation can be improved; the standardized operation of the reference role behavior is introduced and used as a reference standard, the skill difference characteristic corresponding to each process key node of the actual role behavior is generated through characteristic comparison, and the auditing efficiency is improved through the evaluation and auditing of each process key node of the actual role behavior; therefore, the technical assessment method and the technical assessment device can efficiently and flexibly carry out automatic technical assessment on the network target range. In addition, by adopting a hierarchical analysis method, a simple and feasible qualitative/quantitative analysis method is provided, and a scoring result can be flexibly and quickly obtained.
Referring to fig. 2, a schematic composition diagram of a network range staff skill evaluation device provided in the embodiment of the present application, the device includes:
a behavior recording unit 210, configured to record an actual role behavior of a target user, where the actual role behavior is a network behavior process implemented for a target task when the target user plays a selected role in a target scene of a network target range;
a behavior matching unit 220, configured to perform feature matching with a pre-constructed role behavior set according to the behavior features of the actual role behavior, so as to match a reference role behavior from the role behavior set;
a key point identification unit 230, configured to identify process key nodes for the actual role behavior according to the process key nodes corresponding to the matched reference role behavior, where the process key nodes corresponding to the reference role behavior are obtained by splitting a behavior process of correctly using standard skills to complete the target task;
a skill evaluation unit 240, configured to compare each process key node identified from the actual role behavior with a corresponding process key node of the reference role behavior in a skill characteristic, and generate a skill difference characteristic corresponding to each process key node of the actual role behavior.
In an implementation manner of the embodiment of the present application, the behavior recording unit 210 is specifically configured to record the actual role behavior of the target user when the target user performs a skill operation based on the definition of the process key node corresponding to the reference role behavior, or when the target user performs a skill operation based on the process key node defined by the target user.
In an implementation manner of the embodiment of the present application, the skill evaluation unit 240 is specifically configured to perform, based on node skill characteristics of each process key node of the reference role behavior, a comparison on the skill characteristics of each process key node identified from the actual role behavior with the corresponding process key node of the reference role behavior, respectively, to generate a skill difference characteristic corresponding to each process key node of the actual role behavior;
wherein the node skill characteristics include at least one of:
the time taken to perform the corresponding standard skill;
implementation difficulty in executing the corresponding standard skill;
the operation behaviors required when the corresponding standard skills are executed;
and executing the skill effect achieved when the corresponding standard skill is executed.
In an implementation manner of the embodiment of the present application, the reference role behavior corresponds to a skill process diagram, and the skill process diagram defines an execution relationship between process key nodes corresponding to the reference role behavior; then, the skill evaluation unit 240 is further configured to:
and comparing the execution relation of each process key node of the actual role behavior with each process key node of the reference role behavior based on the skill process diagram to generate execution difference characteristics.
In an implementation manner of the embodiment of the present application, the execution relationship includes synchronous execution and sequential execution.
In an implementation manner of the embodiment of the present application, the apparatus further includes:
and the skill scoring unit is used for generating a skill scoring result corresponding to the actual role behavior based on the score of each difference characteristic and the weight corresponding to each difference characteristic after each difference characteristic is obtained through comparison.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.
An embodiment of the present application further provides an electronic device, a schematic structural diagram of the electronic device is shown in fig. 3, the electronic device 3000 includes at least one processor 3001, a memory 3002, and a bus 3003, and the at least one processor 3001 is electrically connected to the memory 3002; memory 3002 is configured to store at least one computer-executable instruction that processor 3001 is configured to execute in order to perform the steps of any of the network range personnel skill assessment methods as provided by any of the embodiments or any of the alternative embodiments herein.
Further, the processor 3001 may be an FPGA (Field-Programmable Gate Array) or other devices with logic processing capability, such as an MCU (micro controller Unit) and a CPU (Central processing Unit).
By applying the embodiment of the application, the operation process corresponding to the actual role behavior of the target user is decomposed to obtain each process key node of the actual role behavior, so that the effectiveness of skill evaluation can be improved; the standardized operation of the reference role behavior is introduced and used as a reference standard, the skill difference characteristic corresponding to each process key node of the actual role behavior is generated through characteristic comparison, and the auditing efficiency is improved through the evaluation and auditing of each process key node of the actual role behavior; in addition, by adopting a hierarchical analysis method, a simple and feasible qualitative/quantitative analysis method is provided, and a scoring result can be flexibly and quickly obtained.
The embodiments of the present application further provide another computer-readable storage medium, which stores a computer program, and the computer program is used for implementing, when executed by a processor, the steps of any one of the network range personnel skill assessment methods provided in any one of the embodiments or any one of the alternative embodiments of the present application.
The computer-readable storage medium provided by the embodiments of the present application includes, but is not limited to, any type of disk including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks, ROMs (Read-Only memories), RAMs (Random Access memories), EPROMs (Erasable Programmable Read-Only memories), EEPROMs (Electrically Erasable Programmable Read-Only memories), flash memories, magnetic cards, or optical cards. That is, a readable storage medium includes any medium that stores or transmits information in a form readable by a device (e.g., a computer).
By applying the embodiment of the application, the operation process corresponding to the actual role behavior of the target user is decomposed to obtain each process key node of the actual role behavior, so that the effectiveness of skill evaluation can be improved; the standardized operation of the reference role behavior is introduced and used as a reference standard, the skill difference characteristic corresponding to each process key node of the actual role behavior is generated through characteristic comparison, and the auditing efficiency is improved through the evaluation and auditing of each process key node of the actual role behavior; in addition, by adopting a hierarchical analysis method, a simple and feasible qualitative/quantitative analysis method is provided, and a scoring result can be flexibly and quickly obtained.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (9)
1. A network range personnel skill assessment method is characterized by comprising the following steps:
recording the actual role behavior of a target user, wherein the actual role behavior is a network behavior process implemented aiming at a target task when the target user plays a selected role in a target scene of a network target range;
according to the behavior characteristics of the actual role behaviors, performing characteristic matching with a role behavior set constructed in advance so as to match a reference role behavior from the role behavior set;
identifying the process key nodes of the actual role behaviors according to the process key nodes corresponding to the matched reference role behaviors, wherein the process key nodes corresponding to the reference role behaviors are obtained by segmenting the behavior process of correctly using standard skills to complete the target task;
comparing each process key node identified from the actual role behaviors with the corresponding process key node of the reference role behaviors on skill characteristics respectively to generate skill difference characteristics corresponding to each process key node of the actual role behaviors;
and after the difference features are obtained through comparison, generating a skill scoring result corresponding to the actual role behavior based on the score of each difference feature and the weight corresponding to each difference feature.
2. The method of claim 1, wherein the recording of the actual role behavior of the target user comprises:
and when the target user performs skill operation based on the definition of the process key node corresponding to the reference role behavior, or when the target user performs skill operation based on the process key node defined by the target user, recording the actual role behavior of the target user.
3. The method of claim 1, wherein comparing each process key node identified from the actual character behavior with the corresponding process key node of the reference character behavior in a skill characteristic manner comprises:
comparing each process key node identified from the actual role behaviors with the corresponding process key node of the reference role behaviors on the basis of the node skill characteristics of each process key node of the reference role behaviors;
wherein the node skill characteristics include at least one of:
the time taken to perform the corresponding standard skill;
implementation difficulty in executing the corresponding standard skill;
the operation behaviors required when the corresponding standard skills are executed;
and executing the skill effect achieved when the corresponding standard skill is executed.
4. The method of claim 1, wherein the reference role behavior corresponds to a skill process diagram, and the skill process diagram defines the execution relationship between each process key node corresponding to the reference role behavior; then, the method further comprises:
and comparing the execution relation of each process key node of the actual role behavior with each process key node of the reference role behavior based on the skill process diagram to generate execution difference characteristics.
5. The method of claim 4, wherein the execution relationship comprises a synchronous execution and a sequential execution.
6. A network range personnel skill assessment device, comprising:
the behavior recording unit is used for recording the actual role behavior of the target user, wherein the actual role behavior is a network behavior process implemented aiming at a target task when the target user plays a selected role in a target scene of a network target range;
the behavior matching unit is used for performing characteristic matching with a role behavior set constructed in advance according to the behavior characteristics of the actual role behavior so as to match a reference role behavior from the role behavior set;
the key point identification unit is used for identifying the process key nodes of the actual role behaviors according to the process key nodes corresponding to the matched reference role behaviors, wherein the process key nodes corresponding to the reference role behaviors are obtained by segmenting the behavior process of correctly using standard skills to complete the target task;
the skill evaluation unit is used for respectively comparing each process key node identified from the actual role behaviors with the corresponding process key node of the reference role behaviors in the skill characteristics, and generating the skill difference characteristics corresponding to each process key node of the actual role behaviors;
and the skill scoring unit is used for generating a skill scoring result corresponding to the actual role behavior based on the score of each difference characteristic and the weight corresponding to each difference characteristic after each difference characteristic is obtained through comparison.
7. The apparatus according to claim 6, wherein the skill evaluation unit is specifically configured to compare, on the basis of the node skill characteristics of each process key node of the reference character behavior, each process key node identified from the actual character behavior with the corresponding process key node of the reference character behavior in the skill characteristics, and generate a skill difference characteristic corresponding to each process key node of the actual character behavior;
wherein the node skill characteristics include at least one of:
the time taken to perform the corresponding standard skill;
implementation difficulty in executing the corresponding standard skill;
the operation behavior required when executing the corresponding standard skill;
and executing the skill effect achieved when the corresponding standard skill is executed.
8. An electronic device, comprising: a processor, a memory;
the memory for storing a computer program;
the processor for executing the network range staff skill assessment method of any one of claims 1-5 by invoking the computer program.
9. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out the network range staff skill assessment method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111572769.7A CN114282795B (en) | 2021-12-21 | 2021-12-21 | Network target range personnel skill evaluation method, device, equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111572769.7A CN114282795B (en) | 2021-12-21 | 2021-12-21 | Network target range personnel skill evaluation method, device, equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114282795A CN114282795A (en) | 2022-04-05 |
| CN114282795B true CN114282795B (en) | 2022-09-16 |
Family
ID=80873669
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111572769.7A Active CN114282795B (en) | 2021-12-21 | 2021-12-21 | Network target range personnel skill evaluation method, device, equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114282795B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117709774A (en) * | 2023-11-30 | 2024-03-15 | 永信至诚科技集团股份有限公司 | Real operation evaluation method, system, electronic equipment and medium for network target range |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8204809B1 (en) * | 2008-08-27 | 2012-06-19 | Accenture Global Services Limited | Finance function high performance capability assessment |
| WO2014184638A1 (en) * | 2013-05-17 | 2014-11-20 | Safe Way S.R.L. | Method for the prevention of accidents and system implementing said method |
| CN105117575A (en) * | 2015-06-17 | 2015-12-02 | 深圳市腾讯计算机系统有限公司 | Behavior processing method and device |
| CN110351255A (en) * | 2019-06-25 | 2019-10-18 | 北京永信至诚科技股份有限公司 | Collecting method and data collection system in a kind of system of network target range |
| US10757132B1 (en) * | 2017-09-08 | 2020-08-25 | Architecture Technology Corporation | System and method for evaluating and optimizing training effectiveness |
| CN111814201A (en) * | 2020-07-17 | 2020-10-23 | 中国工商银行股份有限公司 | Network drone aircraft data recording method, device and system and electronic equipment |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7805382B2 (en) * | 2005-04-11 | 2010-09-28 | Mkt10, Inc. | Match-based employment system and method |
| US11176845B2 (en) * | 2012-12-11 | 2021-11-16 | Abalta Technologies, Inc. | Adaptive analysis of driver behavior |
| US10291506B2 (en) * | 2015-03-04 | 2019-05-14 | Fisher-Rosemount Systems, Inc. | Anomaly detection in industrial communications networks |
| CN108777081B (en) * | 2018-05-31 | 2021-02-02 | 华中师范大学 | Virtual dance teaching method and system |
| CN108922298A (en) * | 2018-07-23 | 2018-11-30 | 贵州电网有限责任公司信息中心 | A kind of electric power safety operation training system |
| CN109409189A (en) * | 2018-08-20 | 2019-03-01 | 国政通科技有限公司 | Dangerous person's recognition methods and device based on network trace |
| US11138312B2 (en) * | 2018-12-19 | 2021-10-05 | Accenture Global Solutions Limited | Cyber range integrating technical and non-technical participants, participant substitution with AI bots, and AI bot training |
| CN111860196B (en) * | 2020-06-24 | 2023-06-20 | 富泰华工业（深圳）有限公司 | Hand operation action scoring device, method and computer readable storage medium |
-
2021
- 2021-12-21 CN CN202111572769.7A patent/CN114282795B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8204809B1 (en) * | 2008-08-27 | 2012-06-19 | Accenture Global Services Limited | Finance function high performance capability assessment |
| WO2014184638A1 (en) * | 2013-05-17 | 2014-11-20 | Safe Way S.R.L. | Method for the prevention of accidents and system implementing said method |
| CN105117575A (en) * | 2015-06-17 | 2015-12-02 | 深圳市腾讯计算机系统有限公司 | Behavior processing method and device |
| US10757132B1 (en) * | 2017-09-08 | 2020-08-25 | Architecture Technology Corporation | System and method for evaluating and optimizing training effectiveness |
| CN110351255A (en) * | 2019-06-25 | 2019-10-18 | 北京永信至诚科技股份有限公司 | Collecting method and data collection system in a kind of system of network target range |
| CN111814201A (en) * | 2020-07-17 | 2020-10-23 | 中国工商银行股份有限公司 | Network drone aircraft data recording method, device and system and electronic equipment |
Non-Patent Citations (2)
| Title |
|---|
| 基于角色异常行为挖掘的内部威胁检测方法;顾兆军等;《计算机工程与设计》;20201016;第41卷(第10期);第2740-2746页 * |
| 网络化信息系统对抗环境试验结构建立方法研究;汪连栋等;《中国电子科学研究院学报》;20150220;第10卷(第01期);第60-66页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114282795A (en) | 2022-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| LaPorte et al. | What is the Leninist legacy? Assessing twenty years of scholarship | |
| CN106789233B (en) | Automatic scoring method and device for network attack and defense experiment platform | |
| Loh et al. | Predicting expert–novice performance as serious games analytics with objective-oriented and navigational action sequences | |
| Maennel | Learning analytics perspective: Evidencing learning from digital datasets in cybersecurity exercises | |
| CN114282795B (en) | Network target range personnel skill evaluation method, device, equipment and readable storage medium | |
| CN108711031B (en) | Intelligent terminal electronic evidence library management training system and method | |
| US11777982B1 (en) | Multidimensional security situation real-time representation method and system and applicable to network security | |
| KR20200031007A (en) | Method building assessment infomation according to curriculum assessment and method providing thereof | |
| Tobey | A vignette-based method for improving cybersecurity talent management through cyber defense competition design | |
| CN109600382A (en) | Webshell detection method and device, HMM model training method and device | |
| CN114666239A (en) | Visual display method, device and equipment for network shooting range and readable storage medium | |
| CN115225336A (en) | Vulnerability availability calculation method and device for network environment | |
| CN109711849B (en) | Ether house address portrait generation method and device, electronic equipment and storage medium | |
| Snell et al. | Manually classified real and fake news articles | |
| CN113496638A (en) | Network security training system and method | |
| de Almeida Neto et al. | Elicited and mined rules for dropout prevention in online courses | |
| Singh et al. | Towards fine grained human behaviour simulation models | |
| CN114817928A (en) | Network space data fusion analysis method and system, electronic device and storage medium | |
| Khan et al. | Situational requirement engineering: A systematic literature review protocol | |
| CN114301699A (en) | Behavior prediction method and apparatus, electronic device, and computer-readable storage medium | |
| Stahl et al. | Intelligence Techniques in Computer Security and Forensics: at the boundaries of ethics and law | |
| Figueira | Communication and resource usage analysis in online environments: An integrated social network analysis and data mining perspective | |
| Salerno et al. | The national operational environment model (noem) | |
| Zacharis et al. | AI-assisted Cyber Security Exercise Content Generation: Modeling a Cyber Conflict | |
| CN116433082B (en) | Evaluation report generation method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 100094 103, building 6, yard 9, FengHao East Road, Haidian District, Beijing Patentee after: Yongxin Zhicheng Technology Group Co.,Ltd. Address before: 100094 103, building 6, yard 9, FengHao East Road, Haidian District, Beijing Patentee before: BEIJING YONGXIN ZHICHENG TECHNOLOGY CO.,LTD. |
|
| CP01 | Change in the name or title of a patent holder |