CN111612295A - Method, system and equipment for monitoring and analyzing behavior habits of operators in nuclear power station - Google Patents
Method, system and equipment for monitoring and analyzing behavior habits of operators in nuclear power station Download PDFInfo
- Publication number
- CN111612295A CN111612295A CN202010275685.6A CN202010275685A CN111612295A CN 111612295 A CN111612295 A CN 111612295A CN 202010275685 A CN202010275685 A CN 202010275685A CN 111612295 A CN111612295 A CN 111612295A
- Authority
- CN
- China
- Prior art keywords
- operator
- image
- manipulation information
- perspective
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000012544 monitoring process Methods 0.000 title claims abstract description 53
- 239000011159 matrix material Substances 0.000 claims abstract description 39
- 238000000556 factor analysis Methods 0.000 claims abstract description 29
- 230000000007 visual effect Effects 0.000 claims abstract description 27
- 230000006399 behavior Effects 0.000 claims description 66
- 238000012549 training Methods 0.000 claims description 44
- 238000004590 computer program Methods 0.000 claims description 20
- 230000008569 process Effects 0.000 claims description 18
- 238000004458 analytical method Methods 0.000 claims description 16
- 230000000694 effects Effects 0.000 claims description 11
- 238000011156 evaluation Methods 0.000 abstract description 31
- 238000013461 design Methods 0.000 abstract description 6
- 230000004044 response Effects 0.000 description 16
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 206010000369 Accident Diseases 0.000 description 4
- 230000001149 cognitive effect Effects 0.000 description 4
- 230000007812 deficiency Effects 0.000 description 4
- 238000004088 simulation Methods 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 230000003542 behavioural effect Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 206010003591 Ataxia Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000002950 deficient Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06398—Performance of employee with respect to a job function
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
- G06F16/738—Presentation of query results
- G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
- G06Q50/2057—Career enhancement or continuing education service
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
Abstract
The invention is suitable for the technical field of nuclear power station informatization, and provides a method and a system for monitoring and analyzing behavior habits of operators in a nuclear power station, wherein the method comprises the following steps: acquiring an image of first perspective manipulation information of an operator; acquiring an image of third perspective manipulation information of the operator; generating a video matrix according to the image of the first visual angle manipulation information and the image of the third visual angle manipulation information of the operator; displaying operation recording parameters of an operator through a disk table of a virtual master control room; and (4) carrying out factor analysis on an operator by combining the video matrix and the operation recording parameters, and carrying out full closed-loop control. According to the invention, through comprehensive monitoring and evaluation of the first visual angle and the third visual angle, a multi-visual-angle operator behavior evaluation scheme is formed, and the operation recording parameters of the operator are displayed through the virtual main control room panel, so that the weak matters of the operator can be more accurately analyzed, and the full-closed-loop HMI design and the human factor evaluation scheme and strategy are realized.
Description
Technical Field
The invention relates to the technical field of nuclear power station informatization construction, in particular to an informatization operator behavior habit and analysis method, system and equipment.
Background
Most of the existing nuclear power stations adopt a mode control technology, and a large number of hard disk tables and a large number of entity monitoring devices such as manual operators, knobs, buttons, indicator lights, recorders, ID meters and the like which are matched and installed on the hard disk tables are generally used in the nuclear power station master control room. Therefore, the device is bulky and expensive.
In order to overcome the defect, the full-range simulator which is synchronously designed with the nuclear power station and is built in advance for commissioning also adopts the same technology and equipment to completely simulate a field main control room, the nuclear power station trains operation operators under the virtual main control room, when the operation operators train, teachers observe the behavior of the operators through room cameras to judge whether the operation of the operators is proper, but the cameras generally carry out rough observation through a third visual angle (namely the angle of a third person), cannot carefully find whether the behavior habit of the operators is correct, is not convenient for improving the level of human factors in operation training, cannot collect relevant information, and is convenient for design and optimized improvement of a human-computer interface in digital modification.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method, a system, and a terminal device for monitoring and analyzing behavior habits of operators in a nuclear power plant, so as to solve the problems that in the prior art, it is not possible to carefully find whether behavior habits of operators are correct, it is not convenient to improve the level of human factor prevention in operation training, and it is also not possible to design and optimize human-computer interfaces in digital modification through collection of related information.
The first aspect of the embodiment of the invention provides a method for monitoring and analyzing behavior habits of operators in a nuclear power plant, which comprises the following steps:
acquiring an image of first perspective manipulation information of an operator;
acquiring an image of third perspective manipulation information of the operator;
generating a video matrix from the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator;
displaying operation recording parameters of an operator through a disk table of a virtual master control room;
and carrying out human factor analysis on the operator by combining the video matrix and the operation recording parameters of the operator, and carrying out closed-loop control according to the result of the human factor analysis.
In a second aspect, an embodiment of the present application provides an operator behavior habit monitoring and analyzing system, including:
the first acquisition module is used for acquiring an image of first visual angle manipulation information of an operator;
the second acquisition module is used for acquiring an image of third visual angle manipulation information of the operator;
a generating module for generating a video matrix from the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator;
the display module is used for displaying the operation recording parameters of an operator through the virtual main control room disk table;
and the analysis module is used for carrying out the human factor analysis on the operator by combining the video matrix and the operation record parameters of the operator and carrying out closed-loop control according to the result of the human factor analysis.
In a third aspect, an embodiment of the present invention provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps of the method according to the first aspect.
A fourth aspect of embodiments of the present invention provides a computer-readable storage medium, which stores a computer program, wherein the computer program, when executed by a processor, implements the steps of the method according to the first aspect.
It is understood that the beneficial effects of the second to fourth aspects can be seen from the description of the first aspect, and are not described herein again.
Compared with the prior art, the embodiment of the application has the advantages that: manipulating an image of information by acquiring a first perspective of an operator; acquiring an image of third perspective manipulation information of the operator; generating a video matrix from the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator; displaying operation recording parameters of an operator through a disk table of a virtual master control room; and carrying out human factor analysis on the operator by combining the video matrix and the operation recording parameters of the operator, and carrying out closed-loop control according to the result of the human factor analysis. Through the technical scheme of the application, the hardware cost is far lower than that of a real full-range simulator, but more functions including simulator training can be realized. In addition, the method breaks through the limitation of the original evaluation of the third visual angle, realizes the accurate evaluation of the third visual angle and the monitoring and evaluation of the first visual angle, forms a multi-visual-angle operator behavior evaluation scheme, and can realize a plurality of functions of improving human factors research and analysis, observing and improving operator behavior habits by combining operation recording parameters of an operator in a main control room.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a flow chart of an implementation of a method for monitoring and analyzing behavioral habits of operators of a nuclear power plant according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating an implementation of obtaining operator control information according to an embodiment of the present disclosure;
FIG. 3 is a flowchart illustrating an exemplary implementation of a human factor analysis for an operator according to an embodiment of the present disclosure;
FIG. 4 is a general architecture diagram of a virtual main control room system provided by an embodiment of the present application;
FIG. 5 is a schematic diagram of an operator behavioral habit monitoring and analysis system provided by an embodiment of the present invention;
fig. 6 is a schematic diagram of an operator behavior habit monitoring and analyzing terminal device according to an embodiment of the present invention.
Detailed description of the invention
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In order to explain the technical means of the present invention, the following description will be given by way of specific examples.
Referring to fig. 1, fig. 1 is a flowchart illustrating an implementation of a method for monitoring and analyzing behavior habits of a nuclear power plant operator according to an embodiment of the present invention, where an execution subject of the method for monitoring and analyzing behavior habits of a nuclear power plant operator in the embodiment is a terminal, and the terminal includes, but is not limited to, a desktop computer, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), and other terminals. The method for monitoring and analyzing the behavior habits of operators in the nuclear power plant as shown in the figure can comprise the following steps:
s101: an image of first perspective manipulation information of an operator is acquired.
Through the portable video tracking system, the camera acquires the image of the first visual angle operation information of the operator in a wearing mode, a wireless transmission mode and the like, and state information observed when the operator executes an operation instruction can be acquired.
S102: an image of third perspective manipulation information of the operator is acquired.
Through the room camera, an image of the manipulation information of the third viewpoint of the operator is acquired, that is, an image of the manipulation information is acquired from the viewpoint of the instructor or others other than the operator himself.
Specifically, steps S101-S102 further include steps S1011-S1013, and fig. 2 is a flowchart of the specific implementation of steps S101-S102.
S1011: and dividing the whole training process into a plurality of time periods according to the activity units.
The whole training process of an operator can be divided into four activity units of 'monitoring-state evaluation-response planning-execution', the operator obtains the cognitive behaviors of the nuclear power plant information from the environment of a nuclear power plant master control room and generally obtains the cognitive behaviors through a visual and auditory channel, the monitoring behaviors are that the operator controls the door of the nuclear power plant, and the reliability of the subsequent operation behaviors of the operator, such as state evaluation, response planning and execution, is greatly dependent on the accuracy of the operator in obtaining the nuclear power plant information. In this embodiment, the whole training process may be divided into four time periods according to the monitoring, state evaluation, response planning, and execution of four activity units, or the monitoring, state evaluation, response planning, and execution may be further divided, which is not described herein.
S1012: images of first perspective manipulation information of the operator for each time period are acquired, respectively.
Acquiring images of the first perspective manipulation information of the operator for four time periods of monitoring, state evaluation, response planning, execution, or acquiring images of the first perspective manipulation information of the operator for each time period that further details the division of monitoring, state evaluation, response planning, execution.
S1013: an image of the third perspective manipulation information of the operator for each time period is acquired, respectively.
Acquiring images of the third perspective manipulation information of the operator for four time periods of monitoring, state evaluation, response planning, execution, or acquiring images of the third perspective manipulation information of the operator for each time period that further details the division of monitoring, state evaluation, response planning, execution.
In particular, steps S101-S102 may also include S1021-S1022, a flow not shown in the figures.
S1021: firstly, acquiring an image of the operation information of a first view angle of an operator of the whole training process;
s1022: and then acquiring an image of the steering information of the third view angle of the operator of the whole training process.
It should be understood that the order of acquiring the image of the manipulation information of the first perspective of the operator and the image of the manipulation information of the third perspective may be reversed, i.e., the image of the manipulation information of the third perspective of the operator of the entire training program may be acquired first and then the image of the manipulation information of the first perspective of the operator of the entire training program may be acquired.
S103: generating a video matrix from the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator.
Specifically, according to a time sequence, an image of the first perspective manipulation information and an image of the third perspective manipulation information of the operator in a first time period are acquired, an image of the first perspective manipulation information and an image of the third perspective manipulation information of the operator in a second time period are acquired until the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator in the whole training process are acquired, and finally a video matrix is generated according to the acquired images of the manipulation information. Alternatively, a video matrix is generated from the acquired image of the manipulation information of the first perspective of the operator of the entire training procedure and the acquired image of the manipulation information of the third perspective of the operator of the entire training procedure.
It should be understood that through the multi-channel video matrix, the video matrix is generated by the acquired images of the first view angle manipulation information and the images of the third view angle manipulation information of all the operators, so that teaching evaluation by instructors is facilitated, and evaluation of human-computer interface effects of transformation by DCS transformation personnel is facilitated.
S104: and displaying the operation recording parameters of the operator through the virtual main control room disk table.
The real master control room is simulated through the virtual master control room disk table, and the simulated operation information of the operator is displayed in a digital parameter mode, namely, the operation recording parameters of the operator are displayed.
S105: and carrying out human factor analysis on the operator by combining the video matrix and the operation recording parameters of the operator, and carrying out closed-loop control according to the result of the human factor analysis.
Further, in order to improve the design of human factor prevention, the operation of the operator can be accurately analyzed, the analysis of the human factor for the operator by combining the video matrix and the operation recording parameters of the operator may further include steps S1051 to S1054, and fig. 3 is a flowchart of a specific implementation of the human factor analysis for the operator.
S1051: and generating a manipulation record report according to the video matrix and the manipulation record parameters of the operator.
And generating a manipulation record report of the operator according to the manipulation information of the operator in the video matrix and the operation record parameters of the operator, wherein all the manipulation information of the operator from monitoring to executing the whole training process is recorded in the manipulation record report.
S1052: and comparing the manipulation record report with standard manipulation information.
The standard operation information is national standard, standard operation flow and technical manual of the industry.
S1053: and marking the operation information which is not matched with the standard operation information in the operation record report with a cursor color.
For example, the manipulation record report records that the right hand of the operator performs a certain operation in the execution stage, but the left hand is used for performing in the standard manipulation information, and the "XX operation performed by the right hand" is marked with a cursor color.
S1054: and performing human factor analysis on the operator according to the operation information of the marked cursor color, and determining the behavior type corresponding to the operator.
Wherein the behavior types include an up-to-standard type, a skill-lacking type, a knowledge level-lacking type, a task-bearing capacity-lacking type, and a team coordination-lacking type. The standard reaching type is that an operator reaches a standard level; the skill lack type is that the functional grasp of the operator cannot reach a standard level; the knowledge level lacking type is that the operator's grasp of theoretical knowledge cannot reach a standard level; the task bearing capacity deficiency type is that when the task load of an operator exceeds a first preset value but is smaller than a second preset value, the original level of the operator cannot be normally exerted; the group coordination deficient type means that the operator's group coordination ability cannot reach a standard level.
Further, the analyzing the operator and performing the full closed loop control further includes:
performing human factor analysis on the operator, and determining a behavior type corresponding to the operator;
and carrying out special training on the operator according to the behavior type corresponding to the operator.
Specifically, the operator is subjected to factor analysis, and when the behavior type corresponding to the operator is determined to be a standard type, special training is not performed on the operator; when the behavior type corresponding to the operator is determined to be a skill lack type, training practical operation is conducted on the operator; when the behavior type corresponding to the operator is determined to be a knowledge level lacking type, training the theoretical level of the operator; when the behavior type corresponding to the operator is determined to be a task bearing capacity deficiency type, performing task intensity training on the operator; and when the behavior type corresponding to the operator is determined to be a group coordination lack type, performing group coordination capability training on the operator.
Further, in order to enhance the training effect and more conveniently realize the accident simulation, before step S101, the method further includes: and triggering an accident scene through an instructor control system and receiving an operation instruction.
Further, in order to train the operator more conveniently, an accident scenario, such as a fire accident scenario, is triggered by the instructor control system, and then the operator enters into a training operation of the fire accident scenario.
In the present embodiment, the information is manipulated by acquiring an image of the first perspective of the operator; acquiring an image of third perspective manipulation information of the operator; generating a video matrix from the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator; displaying operation recording parameters of an operator through a disk table of a virtual master control room; and carrying out human factor analysis on the operator by combining the video matrix and the operation recording parameters of the operator, and carrying out closed-loop control according to the result of the human factor analysis. The hardware cost is far lower than that of a real full-range simulator, but more functions including simulator training can be realized. In addition, the method breaks through the limitation of the original evaluation of the third visual angle, realizes the accurate evaluation of the third visual angle and the monitoring and evaluation of the first visual angle, forms a multi-visual-angle operator behavior evaluation scheme, and can realize a plurality of functions of improving human factors research and analysis, observing and improving operator behavior habits by combining operation recording parameters of an operator in a main control room.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Referring to fig. 4, fig. 4 is a general architecture diagram of a virtual master control room system, a virtual master control room system 400 includes a behavior acquisition system 410, a multi-channel video matrix 420, a teacher monitoring system 430, an analog simulation system 440 and a teacher control system 450, wherein the behavior acquisition system 410 further includes a room camera 411 and a portable video tracking system 412, the analog simulation system 440 further includes a virtual disk stage 441, a virtual disk stage 442 … … and a virtual disk stage 44n, and the behavior acquisition system 410 and the multi-channel video matrix 420 are connected in a wired or wireless manner.
Referring to fig. 5, fig. 5 is a schematic diagram of an operator behavior habit monitoring and analyzing system according to an embodiment of the present invention. The included units are used for executing steps in the embodiments corresponding to fig. 1 to fig. 3, and refer to the related descriptions in the embodiments corresponding to fig. 1 to fig. 3. For convenience of explanation, only the portions related to the present embodiment are shown. Referring to fig. 5, the operator behavior habit monitoring and analyzing system 5 includes:
a first obtaining module 510 for obtaining an image of the first perspective manipulation information of the operator.
Through the portable video tracking system, the camera acquires the image of the first visual angle operation information of the operator in a wearing mode, a wireless transmission mode and the like, and state information observed when the operator executes an operation instruction can be acquired.
A second acquiring module 520 for acquiring an image of the third viewing angle manipulation information of the operator.
Through the room camera, an image of the manipulation information of the third viewpoint of the operator is acquired, that is, an image of the manipulation information is acquired from the viewpoint of the instructor or others other than the operator himself.
The first obtaining module 510 and the second obtaining module 520 form an obtaining module, and further, the obtaining module further includes:
and the dividing unit is used for dividing the whole training process into a plurality of time periods according to the activity units.
The whole training process of an operator can be divided into four activity units of monitoring, state evaluation, response planning and execution, the operator obtains the cognitive behaviors of the nuclear power plant information from the environment of a nuclear power plant master control room, the cognitive behaviors are generally obtained through visual and auditory channels, the operator controls the door of the nuclear power plant during monitoring the behaviors, and the reliability of the subsequent operation behaviors of the operator, such as state evaluation, response planning and execution, is greatly dependent on the accuracy of the operator in obtaining the nuclear power plant information. In this embodiment, the whole training process may be divided into four time periods according to the monitoring, state evaluation, response planning, and execution of four activity units, or the monitoring, state evaluation, response planning, and execution may be further divided, which is not described herein.
A first acquisition unit for respectively acquiring images of first perspective manipulation information of the operator for each time period.
Acquiring images of the first perspective manipulation information of the operator for four time periods of monitoring, state evaluation, response planning, execution, or acquiring images of the first perspective manipulation information of the operator for each time period that further details the division of monitoring, state evaluation, response planning, execution.
A second acquisition unit configured to acquire an image of third perspective manipulation information of the operator for each time period, respectively.
Acquiring images of the third perspective manipulation information of the operator for four time periods of monitoring, state evaluation, response planning, execution, or acquiring images of the third perspective manipulation information of the operator for each time period that further details the division of monitoring, state evaluation, response planning, execution.
Further, the obtaining module may further include:
and a third acquisition unit for acquiring an image of the manipulation information of the first viewpoint of the operator of the entire training procedure.
And a fourth acquiring unit for re-acquiring an image of the manipulation information of the third viewpoint of the operator of the entire training procedure.
It should be understood that the order of acquiring the image of the manipulation information of the first perspective of the operator and the image of the manipulation information of the third perspective may be reversed, that is, the third acquiring unit may be used to acquire the image of the manipulation information of the third perspective of the operator of the entire training procedure first, and then the fourth acquiring unit may be used to acquire the image of the manipulation information of the first perspective of the operator of the entire training procedure.
A generating module 530 configured to generate a video matrix according to the image of the first view manipulation information and the image of the third view manipulation information of the operator.
Specifically, according to a time sequence, an image of the first perspective manipulation information and an image of the third perspective manipulation information of the operator in a first time period are acquired, an image of the first perspective manipulation information and an image of the third perspective manipulation information of the operator in a second time period are acquired until the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator in the whole training process are acquired, and finally a video matrix is generated according to the acquired images of the manipulation information. Alternatively, a video matrix is generated from the acquired image of the manipulation information of the first perspective of the operator of the entire training procedure and the acquired image of the manipulation information of the third perspective of the operator of the entire training procedure.
It should be understood that through the multi-channel video matrix, the video matrix is generated by the acquired images of the first view angle manipulation information and the images of the third view angle manipulation information of all the operators, so that teaching evaluation by instructors is facilitated, and evaluation of human-computer interface effects of transformation by DCS transformation personnel is facilitated.
And a display module 540, configured to display the operation recording parameters of the operator through the virtual main control room disk table.
The real master control room is simulated through the virtual master control room disk table, and the simulated operation information of the operator is displayed in a digital parameter mode, namely, the operation recording parameters of the operator are displayed.
And an analysis module 550, configured to perform a human factor analysis on the operator by combining the video matrix and the operation recording parameters of the operator, and perform closed-loop control according to a result of the human factor analysis.
Further, in order to improve the design of human protection and allow accurate analysis of the operator's manipulation, the analysis module 550 further comprises:
and the generating unit is used for generating a manipulation record report according to the video matrix and the manipulation record parameters of the operator.
And generating a manipulation record report of the operator according to the manipulation information of the operator of the video matrix and the operation record parameters of the operator, wherein all the manipulation information of the operator from monitoring to executing the whole training process is recorded in the manipulation record report.
And the comparison unit is used for comparing the manipulation record report with standard manipulation information.
The standard operation information is national standard, standard operation flow and technical manual of the industry.
And the marking unit is used for marking the color of the cursor on the operation information which is not matched with the standard operation information in the operation record report.
For example, the manipulation record report records that the right hand of the operator performs a certain operation in the execution stage, but the left hand is used for performing in the standard manipulation information, and the "XX operation performed by the right hand" is marked with a cursor color.
And the determining unit is used for carrying out human factor analysis on the operator according to the operation information of the marked cursor color and determining the behavior type corresponding to the operator.
Wherein the behavior types include an up-to-standard type, a skill-lacking type, a knowledge level-lacking type, a task-bearing capacity-lacking type, and a team coordination-lacking type. The standard reaching type is that an operator reaches a standard level; the skill lack type is that the functional grasp of the operator cannot reach a standard level; the knowledge level lacking type is that the operator's grasp of theoretical knowledge cannot reach a standard level; the task bearing capacity deficiency type is that when the task load of an operator exceeds a first preset value but is smaller than a second preset value, the original level of the operator cannot be normally exerted; the group coordination deficient type means that the operator's group coordination ability cannot reach a standard level.
Further, the analysis module 550 further includes:
and the training unit is used for carrying out special training on the operator according to the behavior type corresponding to the operator.
Specifically, the operator is subjected to factor analysis, and when the behavior type corresponding to the operator is determined to be a standard type, special training is not performed on the operator; when the behavior type corresponding to the operator is determined to be a skill lack type, training practical operation is conducted on the operator; when the behavior type corresponding to the operator is determined to be a knowledge level lacking type, training the theoretical level of the operator; when the behavior type corresponding to the operator is determined to be a task bearing capacity deficiency type, performing task intensity training on the operator; and when the behavior type corresponding to the operator is determined to be a group coordination lack type, performing group coordination capability training on the operator.
Further, in order to enhance the training effect and more conveniently realize the accident simulation, the operator behavior habit monitoring and analyzing system 5 further includes: and the receiving unit is used for triggering an accident scene through the instructor control system and receiving an operation instruction.
Further, in order to train the operator more conveniently, an accident scenario, such as a fire accident scenario, is triggered by the instructor control system, and then the operator enters into a training operation of the fire accident scenario.
Fig. 6 is a schematic diagram of an operator behavior habit monitoring and analyzing terminal device according to an embodiment of the present invention. As shown in fig. 6, the operator behavior habit monitoring and analyzing terminal device 6 of this embodiment includes: a processor 60, a memory 61 and a computer program 62 stored in said memory 61 and executable on said processor 60, such as a display program of operator recorded parameters. The processor 60, when executing the computer program 62, implements the steps in the various plant operator behavioral habit monitoring and analysis method embodiments described above, such as steps S101-S105 shown in fig. 1. Alternatively, the processor 60, when executing the computer program 62, implements the functions of the modules in the above-described device embodiments, such as the functions of the modules 510 to 550 shown in fig. 5.
Illustratively, the computer program 62 may be divided into one or more modules/units, which are stored in the memory 61 and executed by the processor 60 to accomplish the present invention. The one or more modules may be a series of computer program instruction segments capable of performing specific functions for describing the execution of the computer program 62 in the operator behavior habit monitoring and analyzing terminal device 6. For example, the computer program 62 may be divided into a first acquisition module, a second acquisition module, a generation module, a display module, and an analysis module, and each module has the following specific functions:
the first acquisition module is used for acquiring an image of the first visual angle manipulation information of the operator.
And the second acquisition module is used for acquiring an image of the third visual angle manipulation information of the operator.
A generating module for generating a video matrix according to the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator.
And the display module is used for displaying the operation recording parameters of the operator through the virtual main control room disk table.
And the analysis module is used for carrying out the human factor analysis on the operator by combining the video matrix and the operation record parameters of the operator and carrying out closed-loop control according to the result of the human factor analysis.
The operator behavior habit monitoring and analyzing terminal device 6 may be a desktop computer, a notebook, a palm computer, a cloud server, or other computing devices. The operator behavior habit monitoring and analyzing terminal device may include, but is not limited to, a processor 60 and a memory 61. It will be understood by those skilled in the art that fig. 6 is merely an example of the operator behavior habit monitoring and analyzing terminal device 6, does not constitute a limitation of the operator behavior habit monitoring and analyzing terminal device 6, and may include more or less components than those shown, or combine some components, or different components, for example, the operator behavior habit monitoring and analyzing terminal device may further include input-output devices, network access devices, buses, and the like.
The Processor 60 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage 61 may be an internal storage unit of the operator behavior habit monitoring and analyzing device 6, such as a hard disk or a memory of the operator behavior habit monitoring and analyzing terminal device 6. The memory 61 may also be an external storage device of the operator behavior habit monitoring and analyzing terminal device 6, such as a plug-in hard disk provided on the operator behavior habit monitoring and analyzing terminal device 6, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like. Further, the memory 61 may also include both an internal storage unit and an external storage device of the operator behavior habit monitoring and analyzing terminal device 6. The memory 61 is used for storing the computer programs and other programs and data required for the operator behavior habit monitoring and analysis of the terminal device. The memory 61 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. A nuclear power plant operator behavior habit monitoring and analyzing method is characterized by comprising the following steps:
acquiring an image of first perspective manipulation information of an operator;
acquiring an image of third perspective manipulation information of the operator;
generating a video matrix from the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator;
displaying operation recording parameters of an operator through a disk table of a virtual master control room;
and carrying out human factor analysis on the operator by combining the video matrix and the operation recording parameters of the operator, and carrying out closed-loop control according to the result of the human factor analysis.
2. The method of claim 1, further comprising, prior to said acquiring the image of the operator's first perspective manipulation information:
and triggering an accident scene through an instructor control system and receiving an operation instruction.
3. The method of claim 1, wherein the obtaining an image of first perspective manipulation information of an operator; acquiring an image of third perspective manipulation information of the operator, comprising:
dividing the whole training process into a plurality of time periods according to activity units;
respectively acquiring images of first perspective manipulation information of an operator in each time period;
an image of the third perspective manipulation information of the operator for each time period is acquired, respectively.
4. The method of claim 1, wherein the generating a video matrix from the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator comprises:
according to the time sequence, firstly acquiring an image of the first visual angle manipulation information and an image of the third visual angle manipulation information of the operator in a first time period, then acquiring the image of the first visual angle manipulation information and the image of the third visual angle manipulation information of the operator in a second time period until the image of the first visual angle manipulation information and the image of the third visual angle manipulation information of the operator in the whole training process are acquired, and finally generating a video matrix according to the acquired images of the manipulation information.
5. The method of claim 1, wherein said combining said video matrix and said operator's operational recording parameters to perform a human factor analysis on said operator comprises:
generating a manipulation record report according to the video matrix and the operation record parameters of the operator;
comparing the manipulation record report with standard manipulation information;
marking the operation information which is not matched with the standard operation information in the operation record report with a cursor color;
and performing human factor analysis on the operator according to the operation information of the marked cursor color, and determining the behavior type corresponding to the operator.
6. The method of claim 5, wherein the standard operating information is industry's national standard, standardized operational procedures, and technical manuals.
7. The method of claim 1, wherein said analyzing said operator for causes and performing full closed loop control comprises:
performing human factor analysis on the operator, and determining a behavior type corresponding to the operator;
and carrying out special training on the operator according to the behavior type corresponding to the operator.
8. An operator behavior habit monitoring and analysis system, comprising:
the first acquisition module is used for acquiring an image of first visual angle manipulation information of an operator;
the second acquisition module is used for acquiring an image of third visual angle manipulation information of the operator;
a generating module for generating a video matrix from the image of the first perspective manipulation information and the image of the third perspective manipulation information of the operator;
the display module is used for displaying the operation recording parameters of an operator through the virtual main control room disk table;
and the analysis module is used for carrying out the human factor analysis on the operator by combining the video matrix and the operation record parameters of the operator and carrying out closed-loop control according to the result of the human factor analysis.
9. An apparatus comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010275685.6A CN111612295A (en) | 2020-04-09 | 2020-04-09 | Method, system and equipment for monitoring and analyzing behavior habits of operators in nuclear power station |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010275685.6A CN111612295A (en) | 2020-04-09 | 2020-04-09 | Method, system and equipment for monitoring and analyzing behavior habits of operators in nuclear power station |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111612295A true CN111612295A (en) | 2020-09-01 |
Family
ID=72199365
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010275685.6A Pending CN111612295A (en) | 2020-04-09 | 2020-04-09 | Method, system and equipment for monitoring and analyzing behavior habits of operators in nuclear power station |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111612295A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112380393A (en) * | 2020-10-23 | 2021-02-19 | 岭东核电有限公司 | Ticket holding test method and device, computer equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102945375A (en) * | 2012-11-20 | 2013-02-27 | 天津理工大学 | Multi-view monitoring video behavior detection and recognition method under multiple constraints |
| CN103235882A (en) * | 2013-04-23 | 2013-08-07 | 湖南工学院 | Method for judging monitoring behavior reliability of digital master control room operator in nuclear power plant |
| CN105117116A (en) * | 2015-05-06 | 2015-12-02 | 湖南工学院 | System and method for acquiring behavior data generated by executing control task |
| CN109710092A (en) * | 2018-12-12 | 2019-05-03 | 深圳中广核工程设计有限公司 | A kind of nuclear power station virtual master control room man-machine interaction method, system and server |
-
2020
- 2020-04-09 CN CN202010275685.6A patent/CN111612295A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102945375A (en) * | 2012-11-20 | 2013-02-27 | 天津理工大学 | Multi-view monitoring video behavior detection and recognition method under multiple constraints |
| CN103235882A (en) * | 2013-04-23 | 2013-08-07 | 湖南工学院 | Method for judging monitoring behavior reliability of digital master control room operator in nuclear power plant |
| CN105117116A (en) * | 2015-05-06 | 2015-12-02 | 湖南工学院 | System and method for acquiring behavior data generated by executing control task |
| CN109710092A (en) * | 2018-12-12 | 2019-05-03 | 深圳中广核工程设计有限公司 | A kind of nuclear power station virtual master control room man-machine interaction method, system and server |
Non-Patent Citations (3)
| Title |
|---|
| 张力;李林峰;卢长申;陈青青;李鹏程;黄卫刚;戴忠华;黄远征;: "数字化核电厂主控室操纵员监视行为转移规律研究", vol. 34, no. 06, pages 2 * |
| 张力;胡鸿;李鹏程;易灿南;蒋建军;陈青青;: "数字化核电厂操纵员监视行为可靠性分析及其应用", no. 05 * |
| 黑颖顿: ""头戴式摄像机变电站防误操作图像识别"", 云南电力技术, vol. 43, no. 1, 31 December 2015 (2015-12-31), pages 2 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112380393A (en) * | 2020-10-23 | 2021-02-19 | 岭东核电有限公司 | Ticket holding test method and device, computer equipment and storage medium |
| CN112380393B (en) * | 2020-10-23 | 2024-04-12 | 岭东核电有限公司 | Ticket holding test method, device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106057001A (en) | Simulation teaching system of vocational education | |
| CN203397186U (en) | Examination monitoring system | |
| JP2022044816A (en) | Driving training class adjustment method, apparatus, electronic device, storage medium, and program | |
| CN103077650A (en) | Simulation training system device used for testing safety cognition mentality and behavior | |
| CN112365759A (en) | High-voltage power equipment test training system based on virtual reality | |
| CN112309215A (en) | Demonstration system for clinical medicine internal medicine teaching and control method thereof | |
| Gil | Short project-based learning with MATLAB applications to support the learning of video-image processing | |
| CN111369875A (en) | Power transmission line artificial simulation routing inspection training method and system based on VR technology | |
| CN112085984A (en) | Intelligent learning device, customized teaching system and method | |
| CN111612295A (en) | Method, system and equipment for monitoring and analyzing behavior habits of operators in nuclear power station | |
| DE3520649A1 (en) | NUCLEAR SYSTEM TEST SIMULATOR | |
| CN114373351B (en) | Photoelectric theodolite panoramic simulation training system | |
| CN109947233A (en) | A kind of laboratory apparatus operation behavior record system | |
| CN105933667B (en) | Video management system and method | |
| CN102779452A (en) | Minimally invasive surgery training and evaluation method | |
| CN202976570U (en) | Nuclear power station anti human error training device and system | |
| CN109949647B (en) | THDS troubleshooting training system, THDS troubleshooting training method and THDS troubleshooting training device | |
| CN111131905A (en) | Image quality detection method, device, equipment and storage medium | |
| JPH1039728A (en) | Plant simulator | |
| CN113177866B (en) | Evaluation system | |
| CN110322098A (en) | S.O.P. feedback during interactive computer simulation | |
| CN209250794U (en) | A kind of network architecture of big data Network Security Monitor System | |
| CN115406626A (en) | AR (augmented reality) glasses-based fault detection method and device, AR glasses and medium | |
| CN113867532A (en) | Evaluation system and evaluation method based on virtual reality skill training | |
| CN213072720U (en) | Intelligent classroom course arrangement and distribution system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |