CN109377099A - A kind of NPP Operations Personnel performance data acquisition method and system - Google Patents
A kind of NPP Operations Personnel performance data acquisition method and system Download PDFInfo
- Publication number
- CN109377099A CN109377099A CN201811449688.6A CN201811449688A CN109377099A CN 109377099 A CN109377099 A CN 109377099A CN 201811449688 A CN201811449688 A CN 201811449688A CN 109377099 A CN109377099 A CN 109377099A
- Authority
- CN
- China
- Prior art keywords
- data
- performance
- task
- index
- subjective
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 79
- 238000011156 evaluation Methods 0.000 claims abstract description 35
- 210000004556 brain Anatomy 0.000 claims description 16
- 230000004424 eye movement Effects 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 14
- 230000005611 electricity Effects 0.000 claims description 12
- 238000005259 measurement Methods 0.000 claims description 12
- 230000003340 mental effect Effects 0.000 claims description 12
- 238000013441 quality evaluation Methods 0.000 claims description 6
- 238000012552 review Methods 0.000 claims description 3
- 238000013461 design Methods 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 35
- 230000006399 behavior Effects 0.000 description 15
- 238000012360 testing method Methods 0.000 description 12
- 239000000203 mixture Substances 0.000 description 8
- 238000012544 monitoring process Methods 0.000 description 7
- 238000012790 confirmation Methods 0.000 description 6
- 230000004438 eyesight Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000036624 brainpower Effects 0.000 description 2
- 210000003710 cerebral cortex Anatomy 0.000 description 2
- 230000001149 cognitive effect Effects 0.000 description 2
- 230000003931 cognitive performance Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 239000006185 dispersion Substances 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000000691 measurement method Methods 0.000 description 2
- 210000002569 neuron Anatomy 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000033764 rhythmic process Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000016776 visual perception Effects 0.000 description 2
- 230000002265 prevention Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Theoretical Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Educational Administration (AREA)
- Marketing (AREA)
- Development Economics (AREA)
- Health & Medical Sciences (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Public Health (AREA)
- Primary Health Care (AREA)
- Water Supply & Treatment (AREA)
- General Health & Medical Sciences (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A kind of NPP Operations Personnel performance data acquisition method and system；The NPP Operations Personnel performance data acquisition method, the following steps are included: step S1, acquisition operations staff's task execution and performance data evaluate to obtain Performance estimate index, acquisition operations staff evaluates to obtain subjective index to the subjective feeling data of task performed by it, physiological data of the operations staff in the task of execution is acquired to evaluate to obtain physical signs, other people is acquired and the evaluation data of task situation is executed to operations staff to evaluate to obtain safe performance indicators；Step S2, the performance data that operations staff is calculated according to Performance estimate index, subjective index, physical signs and safe performance indicators, the performance of operations staff is evaluated with this.NPP Operations Personnel performance data acquisition method and system design science of the invention, it is practical.
Description
Technical field
The present invention relates to nuclear power field more particularly to a kind of NPP Operations Personnel performance data acquisition method and systems.
Background technique
The acquisition of personnel performance's data is to guarantee nuclear power plant personnel level of performance, carries out the base of personnel performance's monitoring and evaluation
Plinth.Personnel performance's data are of great significance to nuclear power plant's personnel's fail-safe analysis and human-equation error prevention, to guarantee nuclear power plant
Quality, safety and reliability it is most important.
The country not yet establishes the acquisition and analytical technology of NPP Operations Personnel performance data at present, for personnel performance's number
According to composition and its correlation acquisition method lack relevant technology and systems.The acquisition of assigned personnel's performance data and analysis are all
Subjective assessment based on subjective observation and record to evaluation object behavior and evaluation personnel, lacks based on objective data
Multi-dimensional data support.Data are all based on the subjective data that observe and evaluate, and subjectivity is strong, susceptible, consistency compared with
Difference.
Summary of the invention
The present invention in view of the above technical problems, proposes a kind of NPP Operations Personnel performance data acquisition method and system.
Technical solution proposed by the invention is as follows:
The invention proposes a kind of NPP Operations Personnel performance data acquisition methods, comprising the following steps:
Step S1, operations staff's task execution and performance data are acquired to evaluate to obtain Performance estimate index, are acquired
Operations staff evaluates to obtain subjective index to the subjective feeling data of task performed by it, and acquisition operations staff is in the task of execution
When physiological data evaluate to obtain physical signs, acquire other people and the evaluation data of task situation executed to operations staff to evaluate
Obtain safe performance indicators；
Step S2, operations staff is calculated according to Performance estimate index, subjective index, physical signs and safe performance indicators
Performance data, the performance of operations staff is evaluated with this.
In the above-mentioned NPP Operations Personnel performance data acquisition method of the present invention, task execution and performance data packet
When including task completion time and/or task completion rate/accuracy and/or Diagnostic Time and/or main task time/subtask
Between and/or page access/switching times, and/or average page stay time and/or mouse, shortcut key number of clicks and have
Imitate response rate.
In the above-mentioned NPP Operations Personnel performance data acquisition method of the present invention, subjective feeling data include situation awareness
Horizontal data, and/or evaluation of mental workload data and/or Subjective Reports data.
In the above-mentioned NPP Operations Personnel performance data acquisition method of the present invention, physiological data includes eye movement index number
According to, and/or brain electricity EEG signal data.
In the above-mentioned NPP Operations Personnel performance data acquisition method of the present invention, safe performance indicators is obtained for evaluating
Evaluation data include work quality evaluation data, work capacity evaluation data and working attitude evaluation data.
In the above-mentioned NPP Operations Personnel performance data acquisition method of the present invention, step S2 further includes by obtaining performance
Then the respective weights of measurement index, subjective index, physical signs and safe performance indicators calculate Performance estimate index, master
See index, the weight of physical signs and safe performance indicators and, and using the weight and as the performance data of operations staff.
The invention also provides a kind of NPP Operations Personnel performance data acquisition systems, comprising:
Acquisition module refers to for acquiring operations staff's task execution and performance data to evaluate to obtain Performance estimate
Mark, acquisition operations staff evaluate to obtain subjective index to the subjective feeling data of task performed by it, and acquisition operations staff exists
Physiological data when execution task is evaluated to obtain physical signs, acquires other people and executes the review number of task situation to operations staff
According to evaluating to obtain safe performance indicators；
Computing module is transported for being calculated according to Performance estimate index, subjective index, physical signs and safe performance indicators
The performance data of administrative staff evaluates the performance of operations staff with this.
In the above-mentioned NPP Operations Personnel performance data acquisition system of the present invention, task execution and performance data packet
When including task completion time and/or task completion rate/accuracy and/or Diagnostic Time and/or main task time/subtask
Between and/or page access/switching times, and/or average page stay time and/or mouse, shortcut key number of clicks and have
Imitate response rate.
In the above-mentioned NPP Operations Personnel performance data acquisition system of the present invention, subjective feeling data include situation awareness
Horizontal data, and/or evaluation of mental workload data and/or Subjective Reports data.
In the above-mentioned NPP Operations Personnel performance data acquisition system of the present invention, physiological data includes eye movement index number
According to, and/or brain electricity EEG signal data.
In the above-mentioned NPP Operations Personnel performance data acquisition system of the present invention, safe performance indicators is obtained for evaluating
Evaluation data include work quality evaluation data, work capacity evaluation data and working attitude evaluation data.
In the above-mentioned NPP Operations Personnel performance data acquisition system of the present invention, further includes:
Weight Acquisition module, for being referred to by obtaining Performance estimate index, subjective index, physical signs and safe performance
Target respective weights；
Computing module is used to calculate the weight of Performance estimate index, subjective index, physical signs and safe performance indicators
With, and using the weight and as the performance data of operations staff.
The present invention specifies the composition of nuclear power plant personnel performance indicators data, and the characteristics of according to different type performance data
Have chosen suitable acquisition and measurement method.Pass through the subjective and objective collecting method combined of building various dimensions and process, shape
At the personnel of complete set and organizational performance collecting method and system.The present invention be NPP Operations Personnel performance monitoring and
The key technology of evaluation solves and lacks relevant technology for the composition of performance data and its correlation acquisition method at present and be
The problem of system.This item NPP Operations Personnel performance data acquisition method and system may be directly applied to domestic all transporting
The acquisition and analysis of operations staff's performance data of nuclear power plant, by this woprk standardization and systematization.Meanwhile according to the system
The personnel performance's database set up can be supplied to all nuclear power units of operation and designing unit uses, as personnel performance
With the basic database of human reliability analysis.NPP Operations Personnel performance data acquisition method of the invention and system design
Science, it is practical.
Detailed description of the invention
Present invention will be further explained below with reference to the attached drawings and examples, in attached drawing:
Fig. 1 shows a preferred embodiment of NPP Operations Personnel performance data acquisition method and system of the invention
The composition schematic diagram for the performance to be acquired；
Fig. 2 shows the functional module block diagrams of NPP Operations Personnel performance data acquisition system of the invention；
Fig. 3 shows the function of a preferred embodiment of NPP Operations Personnel performance data acquisition system shown in Fig. 2
It can block diagram.
Specific embodiment
The technical problems to be solved by the present invention are: not yet establishing NPP Operations Personnel performance data due to domestic at present
Acquisition and analytical technology, composition and its correlation acquisition method for performance data lack relevant technology and systems.It is existing
Performance acquisition and analytical technology are mainly based upon subjective observation and subjective assessment, and data subjectivity is strong, result susceptible, unanimously
Property is poor.The technical thought that the present invention is proposed with regard to the technical problem is: specifying NPP Operations Personnel performance indicators data
Composition form the personnel of complete set and by the subjective and objective collecting method combined of building various dimensions and process
And organizational performance collecting method and system.
In order to keep technical purpose of the invention, technical solution and technical effect apparent, in order to art technology
Personnel understand and implement the present invention, and the present invention will be further described in detail below in conjunction with the accompanying drawings and the specific embodiments.
The invention proposes a kind of NPP Operations Personnel performance data acquisition methods, comprising the following steps:
Step S1, operations staff's task execution and performance data are acquired to evaluate to obtain Performance estimate index, are acquired
Operations staff evaluates to obtain subjective index to the subjective feeling data of task performed by it, and acquisition operations staff is in the task of execution
When physiological data evaluate to obtain physical signs, acquire other people and the evaluation data of task situation executed to operations staff to evaluate
Safe performance indicators is obtained, as shown in Figure 1；
In this step, operations staff's task execution and performance data include that task completion time and/or task are complete
At rate/accuracy and/or Diagnostic Time and/or main task time/subtask time and/or page access/switching times,
And/or be averaged page stay time and/or mouse, shortcut key number of clicks and significant response rate.
Wherein, task completion time refers to since task to the duration that task termination or completion are used.When task is completed
Between be no more than task setting time window.Time window: the predetermined of some task or a series of tasks of some scene is defined
Maximum duration.In actual measurement, if arrival time window task remains unfulfilled, task terminates automatically.
Task completion time is the important indicator of operations staff's task performance, and the deadline is shorter, same scene difference weight
Variance is smaller between multiple, illustrates that performance is better, and system design is more reasonable.If the record of the task completion time in data is repeatedly equal to
The scene time window preset time, in the case where test is not made a fault, the system of reflecting can not support normal efficiency
Operation, need to optimize.
The acquisition of task completion time uses operating process data acquisition software, which is embedded in analog machine or actual
In master control room computer system, the behaviors such as click in operation pages, resident can be acquired.
Task completion rate/accuracy indicates task completion rate and task accuracy.Wherein, task completion rate is defined as completing
Task quantity and the ratio between task total amount.Task accuracy is defined as the task ratio of number for the task and completion being correctly completed.
Task completion rate can be defined from multiple dimensions.For example, the task completion rate of test (trial): some scene
The task completion rate of certain lower test, reflects the performance of this test, if completion rate is lower than expected standard, integrates system
System exact p-value cannot pass through.The task completion rate of teams and groups: the task completion rate of some teams and groups reflects the operation amount of teams and groups
Degree and professional skill.It is compared by the completion rate to different teams and groups' same tasks, can reflect out the achievement of teams and groups personnel
Imitate difference.Task accuracy can be equally defined from multiple dimensions, specifically can analogy task completion rate.
The acquisition of task completion rate/accuracy use operating process data acquisition software, the software be embedded in analog machine or
In actual master control room computer system, the behaviors such as click in operation pages, resident can be acquired, and carry out to operating process
Whole process record, analysis personnel judge task completion rate/accuracy by record.
Diagnostic Time is defined as occurring from alarm to this period for recalling regulation.If Diagnostic Time exceeds preassigned,
Then need the bottleneck occurred in analyzing and diagnosing in further detail, confirmation system asking on information tissue and information organization form
Topic.
The acquisition of Diagnostic Time uses operating process data acquisition software, which is embedded in analog machine or actual master control
In the computer system of room, the behaviors such as click in operation pages, resident can be acquired, and whole record is carried out to operating process,
Analysis personnel calculate Diagnostic Time by record.
Main task time/subtask time includes main task time and subtask time.The main task time refers to operation people
The time of member's executive director's business；The subtask time refers to that operations staff executes the time of subtask.Wherein, main task refers to operation people
Member is functional task performed by monitoring nuclear power system, such as: monitoring, Situation assessment, predicated response, is realized and is rung diagnosis
Answer etc..Subtask refers to when interact with nuclear power system operations staff needs to do, the purpose is to assist the task of main task,
Such as: navigation and human-computer interaction confirmation.
For alarm system and Computerized procedures system, main task and subtask can be carried out tentatively by action type
It divides, such as: alarm bar is handled in alarm system, opening regulation belongs to main task scope；The relevant operation of alarm sequence is clicked to belong to
In subtask scope.In addition, main task and subtask can also be distinguished by way of expert's hand labeled.
When designing system, under the premise of assurance function and interactive experience, unnecessary time should be reduced to the greatest extent and appointed
It is engaged in the time.If system subtask time accounting is greater than preassigned, integrated system confirmation cannot pass through, need to the part system
System design optimizes.
The acquisition of main task time/subtask time uses operating process data acquisition software, which is embedded in simulation
In machine or actual master control room computer system, the behaviors such as click in operation pages, resident can be acquired, and to operating process
Whole record is carried out, analysis personnel calculate main task time/subtask time by record.
Page access/switching times include page access number and page switching number.Wherein, page access number and page
If face switching times are defined in scene or task level, the complexity of the scene or task can reflect.If the page is visited
Ask that number, page switching number are higher, and task completion time is longer or task completion rate is lower, then supports the interface of the task
Content and requirements of process optimization.
The acquisition of page access/switching times use operating process data acquisition software, the software be embedded in analog machine or
In actual master control room computer system, the behaviors such as click in operation pages, resident, programming count page access can be acquired
Number, page switching number.
Average page stay time indicates operations staff in the mean residence time of each page.Specifically, the average page
Stay time is given a definition in scene, task, step dimension: Taver=T/n；
Wherein, TaverIndicate average page stay time；
T indicates (scene, task, step) total deadline；
N indicates the page quantity occurred (duplicate pages are calculated multiple).
If average page stay time variable defines in scene, task dimension, the rhythm of task completion is reflected.Such as
Fruit is averaged page stay time lower than preassigned lower limit, then shows that changing interface is excessively frequent, and the information that the page is presented is excessively
Dispersion；If average page stay time is higher than the preassigned upper limit, it is multiple to need to judge whether there is page info overload, the page
It is miscellaneous to spend the problems such as high.
The acquisition of average page stay time uses operating process data acquisition software, which is embedded in analog machine or reality
In the master control room computer system on border, the behaviors such as click in operation pages, resident can be acquired, the programming count page that is averaged stops
Stay duration.
Mouse, shortcut key number of clicks and significant response rate are the significant process measurement indexes during task execution,
The click of no feedback or shortcut key can bring puzzlement, it should be checked and be modified as design defect.
The acquisition of mouse, shortcut key number of clicks and significant response rate uses operating process data acquisition software, the software
It is embedded in analog machine or actual master control room computer system, the behaviors such as click in operation pages, resident can be acquired, from
Dynamic statistics mouse, shortcut key number of clicks and significant response rate.
Further, subjective feeling data include situation awareness horizontal data, and/or evaluation of mental workload data, and/or
Subjective Reports data.Wherein, situation awareness is for describing attention, perception and decision process.The present invention is combined using subjective and objective
Mode carry out situation awareness horizontal checkout, situation awareness horizontal data is acquired with this；Objective evaluation is used especially by joint
Method (such as SAGAT, Situation Awareness Global Assessment Technique) and self subjective scoring
(such as SART, Situation Awareness Rating Test) measurement.
Evaluation of mental workload data can be filled in Mental Workload measurement subjective questionnaire (NASA-TLX) by operations staff and be carried out
Measurement is collected, and can also measure collection by filling in the Mental Workload questionnaire designed for task situation.
Subjective Reports data are that spatial information is presented in operations staff, human-computer interaction process and efficiency carry out subjective assessment
Data.
Further, physiological data includes eye movement achievement data, and/or brain electricity EEG signal data.In the present embodiment,
Association evaluation is carried out to operations staff's performance using eye movement achievement data and brain electricity EEG signal data.
Specifically, eye movement achievement data can be used for from visual search angle changing rate Different Cognitive characterizing population group in different skies
Between information in cognitive performance difference now.The acquisition of eye movement achievement data uses eye tracker, by recorder in processing vision
The characteristics of eye movement feature when information, analysis people handles vision input and process, it is also possible to obtain during task operating
Attention and visual perception distribution etc..
Brain electricity EEG signal data are acquired for carrying out assistant analysis by electroencephalograph.Electroencephalograph mainly acquires
The signal intensity situation of human brain during task operating.Brain power technology mainly measures the cynapse of cerebral cortex a group neuronal cell
Current potential afterwards, time accuracy is also very high, advantage be it is not damaged, it is highly-safe.Event correlation and common brain electricity can be technically divided into
Record.Wherein event related potential can disclose the detailed process of psychological activity, be the movable direct embodiment of brain area.
Further, for the evaluation data of safe performance indicators by using the safe performance appraisal of NPP Operations Personnel
Table is evaluated in terms of work quality, ability to work and working attitude three and is obtained, including work quality evaluation data, work energy
Power evaluates data and working attitude evaluates data.Safe performance indicators takes many-to-one method to be evaluated.It is required that understanding quilt
The different immediate superior manager of three or more of test run administrative staff's situation or colleague simultaneously carry out subject operations staff
Performance appraisal marking, then summarizes the safe performance total score for obtaining every subject according to the weight coefficient of three broad aspects, finally
It is averaged and obtains personal security's performance score.
Step S2, operations staff is calculated according to Performance estimate index, subjective index, physical signs and safe performance indicators
Performance data, the performance of operations staff is evaluated with this.
It specifically, in this step, can be by obtaining Performance estimate index, subjective index, physical signs and safety
Then the respective weights of performance indicators calculate the power of Performance estimate index, subjective index, physical signs and safe performance indicators
And, the performance of operations staff is evaluated with this again.Herein, Performance estimate index, subjective index, physical signs and safe performance
The performance data of the weight of index and as operations staff.
It is appreciated that can not also just be gone to live in the household of one's in-laws on getting married one by one here using other algorithms to calculate the performance data of operations staff
It states.
Further, the invention also provides a kind of NPP Operations Personnel performance data acquisition systems, comprising:
Acquisition module 100 is evaluated to obtain Performance estimate for acquiring operations staff's task execution and performance data
Index, acquisition operations staff evaluate to obtain subjective index to the subjective feeling data of task performed by it, acquire operations staff
Physiological data in the task of execution is evaluated to obtain physical signs, acquires other people and executes the evaluation of task situation to operations staff
Data evaluate to obtain safe performance indicators, as shown in Figure 1；
Herein, operations staff's task execution and performance data include that task completion time and/or task are completed
Rate/accuracy and/or Diagnostic Time and/or main task time/subtask time and/or page access/switching times, and/
Or be averaged page stay time and/or mouse, shortcut key number of clicks and significant response rate.
Wherein, task completion time refers to since task to the duration that task termination or completion are used.When task is completed
Between be no more than task setting time window.Time window: the predetermined of some task or a series of tasks of some scene is defined
Maximum duration.In actual measurement, if arrival time window task remains unfulfilled, task terminates automatically.
Task completion time is the important indicator of operations staff's task performance, and the deadline is shorter, same scene difference weight
Variance is smaller between multiple, illustrates that performance is better, and system design is more reasonable.If the record of the task completion time in data is repeatedly equal to
The scene time window preset time, in the case where test is not made a fault, the system of reflecting can not support normal efficiency
Operation, need to optimize.
The acquisition of task completion time uses operating process data acquisition software, which is embedded in analog machine or actual
In master control room computer system, the behaviors such as click in operation pages, resident can be acquired.
Task completion rate/accuracy indicates task completion rate and task accuracy.Wherein, task completion rate is defined as completing
Task quantity and the ratio between task total amount.Task accuracy is defined as the task ratio of number for the task and completion being correctly completed.
Task completion rate can be defined from multiple dimensions.For example, the task completion rate of test (trial): some scene
The task completion rate of certain lower test, reflects the performance of this test, if completion rate is lower than expected standard, integrates system
System exact p-value cannot pass through.The task completion rate of teams and groups: the task completion rate of some teams and groups reflects the operation amount of teams and groups
Degree and professional skill.It is compared by the completion rate to different teams and groups' same tasks, can reflect out the achievement of teams and groups personnel
Imitate difference.Task accuracy can be equally defined from multiple dimensions, specifically can analogy task completion rate.
The acquisition of task completion rate/accuracy use operating process data acquisition software, the software be embedded in analog machine or
In actual master control room computer system, the behaviors such as click in operation pages, resident can be acquired, and carry out to operating process
Whole process record, analysis personnel judge task completion rate/accuracy by record.
Diagnostic Time is defined as occurring from alarm to this period for recalling regulation.If Diagnostic Time exceeds preassigned,
Then need the bottleneck occurred in analyzing and diagnosing in further detail, confirmation system asking on information tissue and information organization form
Topic.
The acquisition of Diagnostic Time uses operating process data acquisition software, which is embedded in analog machine or actual master control
In the computer system of room, the behaviors such as click in operation pages, resident can be acquired, and whole record is carried out to operating process,
Analysis personnel calculate Diagnostic Time by record.
Main task time/subtask time includes main task time and subtask time.The main task time refers to operation people
The time of member's executive director's business；The subtask time refers to that operations staff executes the time of subtask.Wherein, main task refers to operation people
Member is functional task performed by monitoring nuclear power system, such as: monitoring, Situation assessment, predicated response, is realized and is rung diagnosis
Answer etc..Subtask refers to when interact with nuclear power system operations staff needs to do, the purpose is to assist the task of main task,
Such as: navigation and human-computer interaction confirmation.
For alarm system and Computerized procedures system, main task and subtask can be carried out tentatively by action type
It divides, such as: alarm bar is handled in alarm system, opening regulation belongs to main task scope；The relevant operation of alarm sequence is clicked to belong to
In subtask scope.In addition, main task and subtask can also be distinguished by way of expert's hand labeled.
When designing system, under the premise of assurance function and interactive experience, unnecessary time should be reduced to the greatest extent and appointed
It is engaged in the time.If system subtask time accounting is greater than preassigned, integrated system confirmation cannot pass through, need to the part system
System design optimizes.
The acquisition of main task time/subtask time uses operating process data acquisition software, which is embedded in simulation
In machine or actual master control room computer system, the behaviors such as click in operation pages, resident can be acquired, and to operating process
Whole record is carried out, analysis personnel calculate main task time/subtask time by record.
Page access/switching times include page access number and page switching number.Wherein, page access number and page
If face switching times are defined in scene or task level, the complexity of the scene or task can reflect.If the page is visited
Ask that number, page switching number are higher, and task completion time is longer or task completion rate is lower, then supports the interface of the task
Content and requirements of process optimization.
The acquisition of page access/switching times use operating process data acquisition software, the software be embedded in analog machine or
In actual master control room computer system, the behaviors such as click in operation pages, resident, programming count page access can be acquired
Number, page switching number.
Average page stay time indicates operations staff in the mean residence time of each page.Specifically, the average page
Stay time is given a definition in scene, task, step dimension: Taver=T/n；
Wherein, TaverIndicate average page stay time；
T indicates (scene, task, step) total deadline；
N indicates the page quantity occurred (duplicate pages are calculated multiple).
If average page stay time variable defines in scene, task dimension, the rhythm of task completion is reflected.Such as
Fruit is averaged page stay time lower than preassigned lower limit, then shows that changing interface is excessively frequent, and the information that the page is presented is excessively
Dispersion；If average page stay time is higher than the preassigned upper limit, it is multiple to need to judge whether there is page info overload, the page
It is miscellaneous to spend the problems such as high.
The acquisition of average page stay time uses operating process data acquisition software, which is embedded in analog machine or reality
In the master control room computer system on border, the behaviors such as click in operation pages, resident can be acquired, the programming count page that is averaged stops
Stay duration.
Mouse, shortcut key number of clicks and significant response rate are the significant process measurement indexes during task execution,
The click of no feedback or shortcut key can bring puzzlement, it should be checked and be modified as design defect.
The acquisition of mouse, shortcut key number of clicks and significant response rate uses operating process data acquisition software, the software
It is embedded in analog machine or actual master control room computer system, the behaviors such as click in operation pages, resident can be acquired, from
Dynamic statistics mouse, shortcut key number of clicks and significant response rate.
Further, subjective feeling data include situation awareness horizontal data, and/or evaluation of mental workload data, and/or
Subjective Reports data.Wherein, situation awareness is for describing attention, perception and decision process.The present invention is combined using subjective and objective
Mode carry out situation awareness horizontal checkout, situation awareness horizontal data is acquired with this；Objective evaluation is used especially by joint
Method (such as SAGAT, Situation Awareness Global Assessment Technique) and self subjective scoring
(such as SART, Situation Awareness Rating Test) measurement.
Evaluation of mental workload data can be filled in Mental Workload measurement subjective questionnaire (NASA-TLX) by operations staff and be carried out
Measurement is collected, and can also measure collection by filling in the Mental Workload questionnaire designed for task situation.
Subjective Reports data are that spatial information is presented in operations staff, human-computer interaction process and efficiency carry out subjective assessment
Data.
Further, physiological data includes eye movement achievement data, and/or brain electricity EEG signal data.In the present embodiment,
Association evaluation is carried out to operations staff's performance using eye movement achievement data and brain electricity EEG signal data.
Specifically, eye movement achievement data can be used for from visual search angle changing rate Different Cognitive characterizing population group in different skies
Between information in cognitive performance difference now.The acquisition of eye movement achievement data uses eye tracker, by recorder in processing vision
The characteristics of eye movement feature when information, analysis people handles vision input and process, it is also possible to obtain during task operating
Attention and visual perception distribution etc..
Brain electricity EEG signal data are acquired for carrying out assistant analysis by electroencephalograph.Electroencephalograph mainly acquires
The signal intensity situation of human brain during task operating.Brain power technology mainly measures the cynapse of cerebral cortex a group neuronal cell
Current potential afterwards, time accuracy is also very high, advantage be it is not damaged, it is highly-safe.Event correlation and common brain electricity can be technically divided into
Record.Wherein event related potential can disclose the detailed process of psychological activity, be the movable direct embodiment of brain area.
Further, for the evaluation data of safe performance indicators by using the safe performance appraisal of NPP Operations Personnel
Table is evaluated in terms of work quality, ability to work and working attitude three and is obtained, including work quality evaluation data, work energy
Power evaluates data and working attitude evaluates data.Safe performance indicators takes many-to-one method to be evaluated.It is required that understanding quilt
The different immediate superior manager of three or more of test run administrative staff's situation or colleague simultaneously carry out subject operations staff
Performance appraisal marking, then summarizes the safe performance total score for obtaining every subject according to the weight coefficient of three broad aspects, finally
It is averaged and obtains personal security's performance score.
Computing module 200, based on according to Performance estimate index, subjective index, physical signs and safe performance indicators
The performance data for calculating operations staff, the performance of operations staff is evaluated with this, as shown in Figure 2.
Specifically, in the present embodiment, as shown in figure 3, NPP Operations Personnel performance data acquisition system further include:
Weight Acquisition module 300, for by obtaining Performance estimate index, subjective index, physical signs and safe achievement
Imitate the respective weights of index；
Computing module 200 is used to calculate the power of Performance estimate index, subjective index, physical signs and safe performance indicators
And, the performance of operations staff is evaluated with this again.Herein, Performance estimate index, subjective index, physical signs and safe performance
The performance data of the weight of index and as operations staff.
It is appreciated that can not also just be gone to live in the household of one's in-laws on getting married one by one here using other algorithms to calculate the performance data of operations staff
It states.
The present invention specifies the composition of nuclear power plant personnel performance indicators data, and the characteristics of according to different type performance data
Have chosen suitable acquisition and measurement method.Pass through the subjective and objective collecting method combined of building various dimensions and process, shape
At the personnel of complete set and organizational performance collecting method and system.The present invention be NPP Operations Personnel performance monitoring and
The key technology of evaluation solves and lacks relevant technology for the composition of performance data and its correlation acquisition method at present and be
The problem of system.This item NPP Operations Personnel performance data acquisition method and system may be directly applied to domestic all transporting
The acquisition and analysis of operations staff's performance data of nuclear power plant, by this woprk standardization and systematization.Meanwhile according to the system
The personnel performance's database set up can be supplied to all nuclear power units of operation and designing unit uses, as personnel performance
With the basic database of human reliability analysis.NPP Operations Personnel performance data acquisition method of the invention and system design
Science, it is practical.
The embodiment of the present invention is described with above attached drawing, but the invention is not limited to above-mentioned specific
Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art
Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much
Form, all of these belong to the protection of the present invention.
Claims (12)
1. a kind of NPP Operations Personnel performance data acquisition method, which comprises the following steps:
Step S1, operations staff's task execution and performance data are acquired to evaluate to obtain Performance estimate index, acquisition operation
Personnel evaluate to obtain subjective index to the subjective feeling data of task performed by it, acquire operations staff in the task of execution
Physiological data is evaluated to obtain physical signs, acquires other people and executes the evaluation data of task situation to operations staff to evaluate to obtain
Safe performance indicators；
Step S2, the achievement of operations staff is calculated according to Performance estimate index, subjective index, physical signs and safe performance indicators
Data are imitated, the performance of operations staff is evaluated with this.
2. NPP Operations Personnel performance data acquisition method according to claim 1, which is characterized in that task execution and
Performance data include task completion time and/or task completion rate/accuracy and/or Diagnostic Time and/or main task
Time/subtask time and/or page access/switching times, and/or average page stay time and/or mouse, shortcut key
Number of clicks and significant response rate.
3. NPP Operations Personnel performance data acquisition method according to claim 1, which is characterized in that subjective feeling number
According to including situation awareness horizontal data, and/or evaluation of mental workload data and/or Subjective Reports data.
4. NPP Operations Personnel performance data acquisition method according to claim 1, which is characterized in that physiological data packet
Include eye movement achievement data, and/or brain electricity EEG signal data.
5. NPP Operations Personnel performance data acquisition method according to claim 1, which is characterized in that for evaluating
Evaluation data to safe performance indicators include work quality evaluation data, work capacity evaluation data and working attitude review number
According to.
6. NPP Operations Personnel performance data acquisition method according to claim 1, which is characterized in that step S2 is also wrapped
It includes by obtaining Performance estimate index, subjective index, physical signs and the respective weights of safe performance indicators, then calculates achievement
Imitate measurement index, subjective index, physical signs and safe performance indicators weight and, and using the weight and as operation people
The performance data of member.
7. a kind of NPP Operations Personnel performance data acquisition system characterized by comprising
Acquisition module (100) refers to for acquiring operations staff's task execution and performance data to evaluate to obtain Performance estimate
Mark, acquisition operations staff evaluate to obtain subjective index to the subjective feeling data of task performed by it, and acquisition operations staff exists
Physiological data when execution task is evaluated to obtain physical signs, acquires other people and executes the review number of task situation to operations staff
According to evaluating to obtain safe performance indicators；
Computing module (200), for being calculated according to Performance estimate index, subjective index, physical signs and safe performance indicators
The performance data of operations staff evaluates the performance of operations staff with this.
8. NPP Operations Personnel performance data acquisition system according to claim 7, which is characterized in that task execution and
Performance data include task completion time and/or task completion rate/accuracy and/or Diagnostic Time and/or main task
Time/subtask time and/or page access/switching times, and/or average page stay time and/or mouse, shortcut key
Number of clicks and significant response rate.
9. NPP Operations Personnel performance data acquisition system according to claim 7, which is characterized in that subjective feeling number
According to including situation awareness horizontal data, and/or evaluation of mental workload data and/or Subjective Reports data.
10. NPP Operations Personnel performance data acquisition system according to claim 7, which is characterized in that physiological data
Including eye movement achievement data, and/or brain electricity EEG signal data.
11. NPP Operations Personnel performance data acquisition system according to claim 7, which is characterized in that for evaluating
The evaluation data for obtaining safe performance indicators include work quality evaluation data, work capacity evaluation data and working attitude evaluation
Data.
12. NPP Operations Personnel performance data acquisition system according to claim 7, which is characterized in that further include:
Weight Acquisition module (300), for by obtaining Performance estimate index, subjective index, physical signs and safe performance
The respective weights of index；
Computing module (200) is used to calculate the weight of Performance estimate index, subjective index, physical signs and safe performance indicators
With, and using the weight and as the performance data of operations staff.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811449688.6A CN109377099A (en) | 2018-11-29 | 2018-11-29 | A kind of NPP Operations Personnel performance data acquisition method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811449688.6A CN109377099A (en) | 2018-11-29 | 2018-11-29 | A kind of NPP Operations Personnel performance data acquisition method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109377099A true CN109377099A (en) | 2019-02-22 |
Family
ID=65374867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811449688.6A Pending CN109377099A (en) | 2018-11-29 | 2018-11-29 | A kind of NPP Operations Personnel performance data acquisition method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109377099A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110046793A (en) * | 2019-02-28 | 2019-07-23 | 北京新研汇医药研发有限公司 | A kind of the job evaluation method and terminal of clinical research expeditor |
| CN111027470A (en) * | 2019-12-09 | 2020-04-17 | 南京航空航天大学 | Behavior measurement and evaluation method based on cognitive decomposition |
| CN111913618A (en) * | 2020-07-08 | 2020-11-10 | 核动力运行研究所 | Detection method and device |
| CN114707895A (en) * | 2022-04-27 | 2022-07-05 | 核动力运行研究所 | Nuclear power plant continuous performance monitoring method |
| CN115458153A (en) * | 2022-08-29 | 2022-12-09 | 北京津发科技股份有限公司 | Method, system and storage medium for evaluating and training personal situational awareness |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103784119A (en) * | 2014-01-24 | 2014-05-14 | 北京航空航天大学 | Pilot mental load measurement system based on flight simulator |
| CN106127400A (en) * | 2016-06-29 | 2016-11-16 | 北京奇虎科技有限公司 | Work behavior analyzes method and device |
| CN106529770A (en) * | 2016-10-18 | 2017-03-22 | 深圳市喜悦智慧数据有限公司 | System and method for tracking state of work tasks |
| CN107224291A (en) * | 2017-05-27 | 2017-10-03 | 西南交通大学 | Dispatcher's capacity test system |
| CN107239895A (en) * | 2017-05-27 | 2017-10-10 | 西南交通大学 | The method and system examined for Sustained attention power |
| CN107644566A (en) * | 2017-08-17 | 2018-01-30 | 北京航空航天大学 | A kind of brain electricity evaluation system of the simulated flight device based on brain electricity |
-
2018
- 2018-11-29 CN CN201811449688.6A patent/CN109377099A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103784119A (en) * | 2014-01-24 | 2014-05-14 | 北京航空航天大学 | Pilot mental load measurement system based on flight simulator |
| CN106127400A (en) * | 2016-06-29 | 2016-11-16 | 北京奇虎科技有限公司 | Work behavior analyzes method and device |
| CN106529770A (en) * | 2016-10-18 | 2017-03-22 | 深圳市喜悦智慧数据有限公司 | System and method for tracking state of work tasks |
| CN107224291A (en) * | 2017-05-27 | 2017-10-03 | 西南交通大学 | Dispatcher's capacity test system |
| CN107239895A (en) * | 2017-05-27 | 2017-10-10 | 西南交通大学 | The method and system examined for Sustained attention power |
| CN107644566A (en) * | 2017-08-17 | 2018-01-30 | 北京航空航天大学 | A kind of brain electricity evaluation system of the simulated flight device based on brain electricity |
Non-Patent Citations (1)
| Title |
|---|
| 王以群 等: "大数据背景下核能安全人因数据采集与处理系统框架", 《南华大学学报(社会科学版)》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110046793A (en) * | 2019-02-28 | 2019-07-23 | 北京新研汇医药研发有限公司 | A kind of the job evaluation method and terminal of clinical research expeditor |
| CN111027470A (en) * | 2019-12-09 | 2020-04-17 | 南京航空航天大学 | Behavior measurement and evaluation method based on cognitive decomposition |
| CN111027470B (en) * | 2019-12-09 | 2023-06-27 | 南京航空航天大学 | Behavior measurement and evaluation method based on cognitive decomposition |
| CN111913618A (en) * | 2020-07-08 | 2020-11-10 | 核动力运行研究所 | Detection method and device |
| CN111913618B (en) * | 2020-07-08 | 2022-04-19 | 核动力运行研究所 | Detection method and device |
| CN114707895A (en) * | 2022-04-27 | 2022-07-05 | 核动力运行研究所 | Nuclear power plant continuous performance monitoring method |
| CN115458153A (en) * | 2022-08-29 | 2022-12-09 | 北京津发科技股份有限公司 | Method, system and storage medium for evaluating and training personal situational awareness |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109377099A (en) | A kind of NPP Operations Personnel performance data acquisition method and system | |
| Fallahi et al. | Effects of mental workload on physiological and subjective responses during traffic density monitoring: A field study | |
| Bhavsar et al. | Quantifying situation awareness of control room operators using eye-gaze behavior | |
| Griffin et al. | Modeling organizational processes across hierarchical levels: climate, leadership, and group process in work groups | |
| Trucco et al. | A quantitative approach to clinical risk assessment: the CREA method | |
| Park et al. | An experimental investigation on relationship between PSFs and operator performances in the digital main control room | |
| Chen et al. | Comprehensive evaluation method for user interface design in nuclear power plant based on mental workload | |
| CN104636890A (en) | Measurement method for workload of air traffic controller | |
| Argyle et al. | Investigating the relationship between eye movements and situation awareness in weather forecasting | |
| Xiang et al. | Cognitive mechanism of construction workers’ unsafe behavior: A systematic review | |
| Park et al. | Analysis of human performance differences between students and operators when using the Rancor Microworld simulator | |
| CN109918791A (en) | A kind of nuclear plant digital master control room operator human reliability analysis method | |
| Reinerman-Jones et al. | Developing methodology for experimentation using a nuclear power plant simulator | |
| Ha et al. | HUPESS: Human performance evaluation support system | |
| Abdul Samad et al. | Effect of Mental Workload on Heart Rate Variability and Reaction Time of Aircraft Maintenance Personnel | |
| Kölling et al. | Current considerations and future directions of psychometric training monitoring of recovery-stress states | |
| CN110148450A (en) | A kind of Training Administration System | |
| Straussberger et al. | Monotony in air traffic control | |
| CN112257190B (en) | Method for monitoring abnormal people in ring flight simulation environment | |
| Tichon | Evaluation of virtual reality training using affect | |
| Ryan | A task analysis-linked approach for integrating the human factor in reliability assessments of nuclear power plants | |
| Kim et al. | An experimental approach to estimate operator’s information processing capacity for diagnosing tasks in NPPs | |
| Ujita | Human characteristics of plant operation and man-machine interface | |
| Iordache et al. | The Assessment of Mental Load of Air Traffic Controllers Based on Psychophysiological Indicators | |
| Zhang et al. | Workload evaluation model of nuclear power plant operator in integrated system validation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190222 |