CN115097933A - Concentration determination method and device, computer equipment and storage medium - Google Patents
Concentration determination method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN115097933A CN115097933A CN202210663566.7A CN202210663566A CN115097933A CN 115097933 A CN115097933 A CN 115097933A CN 202210663566 A CN202210663566 A CN 202210663566A CN 115097933 A CN115097933 A CN 115097933A
- Authority
- CN
- China
- Prior art keywords
- image
- nuclear power
- power plant
- plant personnel
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06311—Scheduling, planning or task assignment for a person or group
- G06Q10/063114—Status monitoring or status determination for a person or group
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Abstract
The disclosure provides a method and a device for determining concentration degree, computer equipment and a storage medium, and relates to the technical field of nuclear power. The method comprises the following steps: acquiring a collected voice instruction and a Virtual Reality (VR) image, wherein the voice instruction is audio data sent by personnel in a nuclear power plant, and the VR image is a collected nuclear power equipment image in a current space range; processing the voice instruction to determine a first equipment number contained in the voice instruction; analyzing the VR image to determine a corresponding equipment number set in the VR image; determining a first area in the VR image based on the first equipment number and a second equipment number contained in the equipment number set; monitoring the sight of the nuclear plant personnel to determine a first duration for the nuclear plant personnel to watch the first area; whether the work concentration degree of the nuclear power plant personnel is normal or not is determined based on the relation between the first duration and the threshold value, and therefore the safety and the reliability of the operation of the nuclear power plant are improved.
Description
Technical Field
The disclosure relates to the technical field of nuclear power, and in particular relates to a method and a device for determining concentration degree, computer equipment and a storage medium.
Background
Generally, nuclear power plants have been receiving social attention for their safety issues due to their specificity and sensitivity. In the whole life cycle of the nuclear power plant, the stages of design and construction, installation and debugging, production and operation, maintenance test and the like need to be carried out. After the unit is put into operation formally, whether repair work or regular test, a large amount of operations have high risk, and the risk consequences include but are not limited to unit transient state, shutdown and shutdown, equipment damage, even more serious nuclear accidents, and serious economic loss and bad social influence.
Among the various operational related factors, the most important factor is usually personnel. When a person has an abnormality in the state of performing operations such as command processing, action execution, result evaluation, and the like, the person may directly affect the operation result. For example, due to limited energy, inertial thinking, environmental disturbance, physical fatigue, etc., a deviation may occur in the execution of a link, resulting in an error of the operation target. Therefore, how to improve the safety and reliability of the operation of the nuclear power plant is very important.
Disclosure of Invention
The present disclosure is directed to solving, at least to some extent, one of the technical problems in the related art.
An embodiment of a first aspect of the present disclosure provides a method for determining a concentration degree, including:
acquiring a collected voice instruction and a Virtual Reality (VR) image, wherein the voice instruction is audio data sent by personnel in a nuclear power plant, and the VR image is a collected nuclear power equipment image in a current space range;
processing the voice instruction to determine a first equipment number contained in the voice instruction;
analyzing the VR image to determine a corresponding equipment number set in the VR image, wherein the equipment number set comprises at least one second equipment number;
determining a first region in the VR image based on the first device number and a second device number included in the device number set;
monitoring a line of sight of the nuclear plant personnel to determine a first duration for which the nuclear plant personnel gazed at the first area;
and determining whether the work concentration degree of the nuclear power plant personnel is normal or not based on the relation between the first duration and the threshold value.
An embodiment of a second aspect of the present disclosure provides an apparatus for determining concentration degree, including:
the acquisition module is used for acquiring a collected voice instruction and a Virtual Reality (VR) image, wherein the voice instruction is audio data sent by personnel in the nuclear power plant, and the VR image is a collected nuclear power equipment image in the current space range;
the processing module is used for processing the voice instruction so as to determine a first equipment number contained in the voice instruction;
the analysis module is used for analyzing the VR image to determine a corresponding equipment number set in the VR image, wherein the equipment number set comprises at least one second equipment number;
a first determining module, configured to determine a first area in the VR image based on the first device number and a second device number included in the device number set;
the monitoring module is used for monitoring the sight of the nuclear power plant personnel to determine a first duration for the nuclear power plant personnel to watch the first area;
and the second determination module is used for determining whether the work concentration degree of the nuclear power plant personnel is normal or not based on the relation between the first time length and the threshold value.
An embodiment of a third aspect of the present disclosure provides a computer device, including: memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method for determining the degree of concentration as set forth in an embodiment of the first aspect of the disclosure when the program is executed.
A fourth aspect of the present disclosure provides a non-transitory computer-readable storage medium storing a computer program, which when executed by a processor implements the method for determining a concentration level as set forth in the first aspect of the present disclosure.
A fifth aspect of the present disclosure provides a computer program product, which when executed by an instruction processor in the computer program product performs the method for determining the concentration degree of the first aspect of the present disclosure.
The utility model provides a concentration degree determination method, device, computer equipment and storage medium can acquire the voice command and the virtual reality VR image of collection earlier, later can handle voice command to confirm the first equipment serial number that contains wherein, and right the VR image is analyzed, in order to confirm the equipment serial number set that corresponds in the VR image, later can confirm first region in the VR image based on the second equipment serial number that contains in first equipment serial number and the equipment serial number set, and monitor nuclear power plant personnel's sight, in order to confirm that nuclear power plant personnel gazed first time of first region, later can confirm whether normal the work concentration degree of nuclear power plant personnel is concentrated on based on the relation between first time and the threshold value. From this, can be through analyzing voice command and VR image to determine the first region of treating the concern, later through monitoring nuclear power plant personnel, can confirm that this nuclear power plant personnel watch the first time of first region, and then based on first time and threshold value, can determine nuclear power plant personnel's work concentration degree, and then can determine nuclear power plant personnel's operating condition based on work concentration degree, thereby the security and the reliability of nuclear power plant operation have been improved as far as possible, provide the condition for guaranteeing nuclear power plant normal operating.
Additional aspects and advantages of the disclosure will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the disclosure.
Drawings
The foregoing and/or additional aspects and advantages of the present disclosure will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic flow chart illustrating a method for determining concentration according to an embodiment of the present disclosure;
fig. 2 is a schematic flow chart illustrating a method for determining concentration according to another embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a device for determining concentration according to an embodiment of the disclosure;
FIG. 4 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present disclosure.
Detailed Description
Reference will now be made in detail to the embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be illustrative of the present disclosure, and should not be construed as limiting the present disclosure.
A method, an apparatus, a computer device, and a storage medium for determining the degree of concentration of the embodiments of the present disclosure are described below with reference to the accompanying drawings.
The disclosed embodiments are exemplified in that the method for determining the concentration degree is configured in the concentration degree determining apparatus, and the concentration degree determining apparatus can be applied to any computer device, so that the computer device can execute the function of determining the concentration degree.
The Computer device may be a Personal Computer (PC), a cloud device, a mobile device, and the like, and the mobile device may be a hardware device having various operating systems, touch screens, and/or display screens, such as a mobile phone, a tablet Computer, a Personal digital assistant, a wearable device, and an in-vehicle device.
Fig. 1 is a schematic flow chart of a method for determining concentration according to an embodiment of the present disclosure.
As shown in fig. 1, the method for determining the concentration may include the following steps:
The voice instruction may be audio data sent by a nuclear power plant personnel, and the audio data sent by the nuclear power plant personnel may be obtained in real time by monitoring the nuclear power plant personnel, which is not limited in this disclosure.
In addition, Virtual Reality (VR) is understood to mean that virtual and real are combined with each other. The virtual reality technology can utilize data in real life, electronic signals generated by the computer technology are combined with various output devices to be converted into phenomena which can be felt by people, the phenomena can be true and true objects in reality and can also be substances which can not be seen by naked eyes, and the phenomena are expressed by a three-dimensional model.
The VR image may be an acquired nuclear power plant image in a current spatial range, where the VR image may include one nuclear power plant or may also include a plurality of nuclear power plants, and the like, which is not limited in this disclosure.
It is understood that the voice command and VR image obtained may correspond to nuclear plant personnel. For the personnel 1 in the nuclear power plant, the collected data can be a voice instruction 1 and a VR image 1; for the nuclear plant personnel 2, the collected may be voice instructions 2 and VR images 2.
Optionally, any VR device may be utilized to obtain VR images of nuclear power plant personnel. For example, each nuclear plant personnel may wear VR glasses to obtain observed VR images of each nuclear plant personnel using VR glasses, and so on, which are not limited by the present disclosure.
It should be noted that any desirable way may be adopted to obtain the voice command of the nuclear power plant personnel; for example, the audio data of the nuclear power plant personnel may be obtained through a recording device and recording software, which is not limited in this disclosure.
For example, by performing parsing processing on a voice command, it is determined that voice data included in the voice command is "turn on device 1", and then the corresponding first device number may be "1", which is not limited in this disclosure.
It is understood that the voice command may include one device number, or may also include a plurality of device numbers, and the like, and the disclosure is not limited thereto.
And 103, analyzing the VR image to determine a corresponding equipment number set in the VR image, wherein the equipment number set comprises at least one second equipment number.
It can be understood that, since the VR image is a range visible to the current sight of the nuclear plant personnel, the VR image may include one nuclear power plant or may include a plurality of nuclear power plants. Then the VR image is parsed to determine the set of device numbers contained therein. Accordingly, the device number set may include one second device number, or may also include a plurality of second device numbers, and the like, which is not limited in this disclosure.
It should be noted that step 102 may be executed first, and then step 103 is executed; or step 103 may be executed first, and then step 102 may be executed; or step 102 and step 103 may be performed simultaneously, and so on, which is not limited in this disclosure.
And 104, determining a first area in the VR image based on the first equipment number and a second equipment number contained in the equipment number set.
And if the equipment number exists, determining the area where the nuclear power equipment corresponding to the second equipment number in the VR image is located as the first area.
For example, in a case where the first device number is "310 TO", if each of the second device numbers included in the device number set is: 210TO, 1001, and 410, if there is a second device number in the device number set that is consistent with the first device number "310 TO", then the area where the nuclear power device corresponding TO "310 TO" in the VR image is located may be determined as the first area, and the like, which is not limited in this disclosure.
Wherein, can send out voice command after the nuclear power plant personnel, monitor this nuclear power plant personnel's sight to confirm that this nuclear power plant personnel's sight falls the first duration on the first region.
Optionally, the line of sight of the nuclear plant personnel may be monitored based on eye tracking technology to determine a first duration of time that the nuclear plant personnel is gazing at the first area.
Among them, eye tracking can be understood as a process of measuring the eye movement, the most interesting event of which is to determine where a human or animal looks, such as the fixation point, etc. Alternatively, it may also be understood that the image processing technology is performed by an instrument device, the pupil position is located, the coordinates are obtained, and the point of eye fixation or gaze fixation is calculated by a certain algorithm, which is not limited in this disclosure.
Alternatively, the eye tracking technology in the present disclosure may be a "non-invasive" technology based on eye video analysis (VOG), and the basic principle thereof may be: the method comprises the steps of aligning a beam of light, such as near-infrared light and a camera to eyes of personnel in the nuclear power plant, deducing the watching direction of the personnel in the nuclear power plant through light and rear-end analysis, recording an interactive process by the camera and the like, and accordingly determining the first duration of the first area watched by the personnel in the nuclear power plant.
And 106, determining whether the work concentration degree of the nuclear power plant personnel is normal or not based on the relation between the first time length and the threshold value.
The threshold may be a preset value, for example, 5 seconds, 1 minute, and the like, which is not limited in this disclosure.
In addition, the work concentration degree can be understood as the concentration degree of the nuclear power plant personnel on the current work.
Optionally, determining that the work concentration of the nuclear power plant personnel is normal when the first duration is greater than or equal to the threshold; or, determining that the work concentration of the nuclear plant personnel is abnormal when the first time length is less than the threshold value.
For example, in the case that the threshold value is 5 seconds, if the first duration of time for which the nuclear plant personnel gazes at the first area is 1 second, which is less than the threshold value of 5 seconds, then it may be determined that the concentration of the nuclear plant personnel is abnormal; alternatively, if the first duration of the plant personnel gazing at the first area is 7 seconds, which is greater than the threshold value of 5 seconds, then it may be determined that the concentration of the plant personnel is normal.
It should be noted that the above examples are only illustrative and should not be taken as limitations on the threshold, the first duration, and the manner of determining whether the work concentration of the nuclear plant personnel is normal in the embodiments of the present disclosure.
Optionally, under the unusual condition of work concentration degree appearance of nuclear power plant personnel, can also carry out unusual warning to indicate this nuclear power plant personnel current work unusual, avoided as far as possible because energy is limited, inertia thinking, environmental disturbance, health fatigue etc. lead to the deviation to appear in the time of in the execution link, and then influence the normal operating of nuclear power plant, thereby improved the accuracy and the reliability of executive operation, and then also improved the security and the reliability of nuclear power plant operation.
Therefore, in the embodiment of the disclosure, can be through analyzing voice command and VR image, with determine the first region of treating the concern, later through monitoring the personnel of nuclear power plant, can confirm that this personnel of nuclear power plant gazes first regional first time long, and then based on first time long and threshold value, can determine the work concentration degree of personnel of nuclear power plant, and then can determine the operating condition of personnel of nuclear power plant based on work concentration degree, thereby the security and the reliability of nuclear power plant operation have been improved as far as possible, provide the condition for guaranteeing the normal operating of nuclear power plant.
The utility model discloses embodiment can acquire the pronunciation instruction and the virtual reality VR image of collection earlier, later can handle the pronunciation instruction to confirm the first equipment number that wherein contains, and right the VR image is analyzed, in order to confirm the equipment number set that corresponds in the VR image, later can be based on the second equipment number that first equipment number and equipment number set contain, confirm the first region in the VR image to monitor nuclear power plant personnel's sight, watch on with the first length of time of confirming nuclear power plant personnel gazing first region, later can be based on the relation between first length of time and threshold value, confirm whether nuclear power plant personnel's work concentration degree is normal. From this, can be through analyzing voice command and VR image to determine the first region of treating the concern, later through monitoring nuclear power plant personnel, can confirm that this nuclear power plant personnel watch the first time of first region, and then based on first time and threshold value, can determine nuclear power plant personnel's work concentration degree, and then can determine nuclear power plant personnel's operating condition based on work concentration degree, thereby the security and the reliability of nuclear power plant operation have been improved as far as possible, provide the condition for guaranteeing nuclear power plant normal operating.
Fig. 2 is a schematic flow chart of a method for determining concentration according to an embodiment of the present disclosure.
As shown in fig. 2, the method for determining the concentration may include the following steps:
The voice command may be subjected to voice recognition, and then the voice recognition result may be converted into a text, so as to determine text information included in the voice command, and then the text information may be analyzed, for example, the first device number included in the text information may be determined through entity recognition, semantic analysis, and the like, which is not limited in this disclosure.
For example, if the voice command is subjected to voice recognition and converted, and the determined text information is "shift the 111 device down by one", then the text information is analyzed, and it can be determined that the first device number included therein is: 111, etc., as the present disclosure is not limited in this regard.
It should be noted that the above examples are merely illustrative, and should not be taken as limitations on the text information, the first device number, and the like in the embodiments of the present disclosure.
The device number set may include at least one second device number, for example, may include one second device number, or may also include a plurality of second device numbers, and the like, which is not limited in this disclosure.
The initial model can be trained to obtain a trained image recognition model, so that the VR image is input into the image recognition model, and the device number set corresponding to the VR image can be obtained through processing of the image recognition model.
Optionally, a training data set may be set, where the training data set may include a plurality of reference VR images and a labeling device number set corresponding to each reference VR image, and each reference VR image may include nuclear power devices to be identified. The multiple reference VR images can be input into an initial model, so that a prediction device number set corresponding to each reference VR image output by the initial model can be obtained through processing of the initial model, and then the initial model can be trained on the basis of the difference between the prediction device number sets and the corresponding annotation device number sets, so that a trained image recognition model is obtained. Therefore, the trained image recognition model can be used for directly processing the VR image, and a corresponding equipment number set and the like can be obtained, which is not limited by the disclosure.
Optionally, image recognition may be performed on the VR image to determine a corresponding device number set in the VR image.
The VR image may be used to perform image segmentation, edge detection, and other processing, so as to obtain each nuclear power device that may be included in the VR image, and then characters included in each nuclear power device may be analyzed, so as to obtain a type, a number, and the like of the nuclear power device.
It should be noted that image recognition may be performed on the VR image in any desirable manner, which is not limited by the present disclosure.
It will be appreciated that each second device number in the device number set may be traversed based on the first device number to determine whether any second device number in the device number set matches the first device number.
In step 206, when any second device number matching the first device number exists in the device number set, the region to which the second device corresponding to any second device number in the VR image belongs is determined as the first region.
For example, if the first device number is "310 TO", the second device numbers included in the device number set are: 210TO, 1001, and 410, each second device number in the device number set may be traversed based on "310 TO", and since a second device number consistent with the first device number "310 TO" exists in the device number set, an area where the nuclear power device corresponding TO "310 TO" in the VR image is located may be determined as the first area, and the like, which is not limited in this disclosure.
Optionally, the first region may be specially displayed, for example, a background color of a portion of the first region may be changed, or a picture of the first region may be enlarged, and the like, which is not limited in this disclosure.
And step 208, determining that the work concentration degree of the nuclear power plant personnel is normal under the condition that the first duration is greater than or equal to the threshold value.
And step 209, determining that the work concentration degree of the nuclear power plant personnel is abnormal under the condition that the first time length is less than the threshold value.
It can be understood that under the unusual condition of degree is absorbed in nuclear power plant personnel's work, can carry out the unusual suggestion of degree of absorbing in to remind this nuclear power plant personnel current operation deviation probably appears, thereby can in time help nuclear power plant personnel to discover the problem, the emergence of the condition such as minimize work error.
For example, the voice broadcast prompt can be broadcasted through a loudspeaker to remind a user that the current concentration degree is abnormal; or special display can be performed in a specific area in the display interface, for example, words such as "concentration degree abnormal, please check" and the like can appear at the center position of the display interface of the VR glasses; or, the user can be reminded that the current concentration degree is abnormal through the vibration function of the VR glasses.
The above examples are merely illustrative, and are not intended to limit the manner of presenting an abnormality in the embodiments of the present disclosure.
Therefore, in the embodiment of the disclosure, the state of the personnel in the nuclear power plant can be monitored, the work concentration degree of the personnel in the nuclear power plant is determined, abnormal prompt can be carried out under the condition that the work concentration degree is abnormal, so that the personnel in the nuclear power plant can be reminded in time, and the deviation appears in the execution link due to limited energy, inertial thinking, environmental interference, physical fatigue and the like, so that the normal operation of the nuclear power plant is influenced, and the safety and the reliability of the operation of the nuclear power plant are improved.
In the embodiment of the disclosure, the collected voice instruction and the virtual reality VR image may be obtained first, then the voice instruction may be recognized and converted to determine text information included in the voice instruction, then the text information is analyzed to determine a first device number included, then the VR image may be input into a trained image recognition model to determine a device number set corresponding to the VR image, and traverse each second device number in the device number set to determine whether any second device number matching the first device number exists, and when any second device number matching the first device number exists in the device number set, determine a region to which a second device corresponding to any second device number in the VR image belongs as a first region, and monitor the sight line of personnel in the nuclear power plant based on an eye tracking technology, the method comprises the steps of determining the first duration of the first region watched by the nuclear power plant personnel, then determining whether the concentration degree is abnormal or not based on the relation between the first duration and a threshold value, and prompting the abnormality of the concentration degree under the abnormal condition. From this, through analyzing voice command and VR image, in order to determine the first region of treating to pay attention to, later through monitoring the nuclear power plant personnel, can confirm that this nuclear power plant personnel gazes first time of first region, and then based on first time and threshold value, can determine the work of nuclear power plant personnel and be absorbed in the degree, and then can be absorbed in the degree based on work and determine the operating condition of nuclear power plant personnel, thereby the security and the reliability of nuclear power plant operation have been improved as far as possible, provide the condition for guaranteeing the normal operating of nuclear power plant.
In order to implement the above embodiments, the present disclosure also provides a device for determining concentration.
Fig. 3 is a schematic structural diagram of a device for determining concentration provided in an embodiment of the present disclosure.
As shown in fig. 3, the concentration determining apparatus 100 may include: the system comprises an acquisition module 110, a processing module 120, a parsing module 130, a first determination module 140, a monitoring module 150, and a second determination module 160.
The acquisition module 110 is used for acquiring the acquired voice instruction and the virtual reality VR image, wherein the voice instruction is audio data sent by personnel in the nuclear power plant, and the VR image is an acquired image of the nuclear power equipment in the current space range.
The processing module 120 is configured to process the voice instruction to determine a first device number included in the voice instruction.
An analyzing module 130, configured to analyze the VR image to determine a corresponding device number set in the VR image, where the device number set includes at least one second device number.
A first determining module 140, configured to determine a first region in the VR image based on the first device number and a second device number included in the set of device numbers.
A monitoring module 150 configured to monitor a line of sight of the nuclear plant personnel to determine a first duration that the nuclear plant personnel gazed at the first area.
A second determining module 160, configured to determine whether the work concentration of the nuclear power plant personnel is normal based on a relationship between the first duration and a threshold.
Optionally, the processing module is specifically configured to:
recognizing and converting the voice command to determine text information contained in the voice command;
and analyzing the text information to determine the included first equipment number.
Optionally, the parsing module is specifically configured to:
inputting the VR image into a trained image recognition model to determine a corresponding equipment number set in the VR image; alternatively, the first and second electrodes may be,
and performing image recognition on the VR image to determine a corresponding device number set in the VR image.
Optionally, the first determining module is specifically configured to:
traversing each second device number in the set of device numbers to determine whether any second device number matching the first device number exists;
and when any second equipment number matched with the first equipment number exists in the equipment number set, determining the area to which the second equipment corresponding to the any second equipment number in the VR image belongs as a first area.
Optionally, the monitoring module is specifically configured to:
based on eye tracking technology, the sight of the nuclear power plant personnel is monitored to determine a first duration for which the nuclear power plant personnel gazes at the first area.
Optionally, the second determining module is specifically configured to:
determining that the work concentration of the nuclear power plant personnel is normal if the first duration is greater than or equal to the threshold;
determining that the work concentration of the nuclear plant personnel is abnormal if the first time period is less than the threshold.
Optionally, the method further includes:
the prompt module is used for performing concentration degree abnormity prompt, wherein the abnormity prompt comprises at least one of the following items: voice broadcast prompt and interface display prompt.
The functions and specific implementation principles of the modules in the embodiments of the present disclosure may refer to the embodiments of the methods, and are not described herein again.
The utility model discloses a device for confirming of degree of concentration can acquire the voice command and the virtual reality VR image of collection earlier, later can handle voice command to confirm the first equipment serial number that wherein contains, and right the VR image is analyzed, in order to confirm the equipment serial number set that corresponds in the VR image, later can be based on the second equipment serial number that first equipment serial number and equipment serial number set contained, confirm the first region in the VR image to monitor nuclear power plant personnel's sight, watch on the first duration in first region with the personnel of confirming nuclear power plant, later can confirm whether nuclear power plant personnel's work is concentrated in the degree and is normal based on the relation between first duration and threshold value. From this, can be through analyzing voice command and VR image to determine the first region of treating the concern, later through monitoring nuclear power plant personnel, can confirm that this nuclear power plant personnel watch the first time of first region, and then based on first time and threshold value, can determine nuclear power plant personnel's work concentration degree, and then can determine nuclear power plant personnel's operating condition based on work concentration degree, thereby the security and the reliability of nuclear power plant operation have been improved as far as possible, provide the condition for guaranteeing nuclear power plant normal operating.
In order to implement the foregoing embodiments, the present disclosure also provides a computer device, including: a memory, a processor and a computer program stored on the memory and executable on the processor, when executing the program, implementing the method of determining a degree of concentration as set forth in the foregoing embodiments of the disclosure.
In order to achieve the above embodiments, the present disclosure also proposes a non-transitory computer-readable storage medium storing a computer program which, when executed by a processor, implements the method of determining the concentration as proposed by the foregoing embodiments of the present disclosure.
To achieve the above embodiments, the present disclosure also proposes a computer program product, which when executed by an instruction processor in the computer program product, performs the method for determining the concentration as proposed by the foregoing embodiments of the present disclosure.
FIG. 4 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present disclosure. The computer device 12 shown in fig. 4 is only one example and should not impose any limitations on the functionality or scope of use of embodiments of the disclosure.
As shown in FIG. 4, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
Computer device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the embodiments described in this disclosure.
Computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with computer device 12, and/or with any devices (e.g., network card, modem, etc.) that enable computer device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Moreover, computer device 12 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public Network such as the Internet) via Network adapter 20. As shown, network adapter 20 communicates with the other modules of computer device 12 via bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 16 executes various functional applications and data processing, for example, implementing the methods mentioned in the foregoing embodiments, by executing programs stored in the system memory 28.
According to the technical scheme of this disclosure, can acquire the voice command and the virtual reality VR image of collection earlier, later can handle voice command to confirm the first equipment number that wherein contains, and right the VR image is analyzed, in order to confirm the equipment number set that corresponds in the VR image, later can be based on the second equipment number that first equipment number and equipment number set contained, confirm the first region in the VR image to monitor nuclear power plant personnel's sight, in order to confirm that nuclear power plant personnel gazed first duration in first region, later can be based on the relation between first duration and threshold value, confirm whether nuclear power plant personnel's work is concentrated in the degree normally. From this, can be through carrying out the analysis to voice command and VR image, in order to determine the first region of treating the attention, later through monitoring the nuclear power plant personnel, can confirm that this nuclear power plant personnel gazes first time of first region, and then based on first time and threshold value, can determine the work of nuclear power plant personnel and be absorbed in the degree, and then can be absorbed in the degree based on work and determine the operating condition of nuclear power plant personnel, thereby the security and the reliability of nuclear power plant operation have been improved as far as possible, provide the condition for guaranteeing the normal operating of nuclear power plant.
In the description of the present specification, reference to the description of "one embodiment," "some embodiments," "an example," "a specific example," or "some examples" or the like means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Moreover, various embodiments or examples and features of various embodiments or examples described in this specification can be combined and combined by one skilled in the art without being mutually inconsistent.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, "a plurality" means at least two, e.g., two, three, etc., unless explicitly specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present disclosure in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present disclosure.
The logic and/or steps represented in the flowcharts or otherwise described herein, for example, as a sequential list of executable instructions that may be thought of as implementing logical functions, may be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that may fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried out in the method of implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and the program, when executed, includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present disclosure have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present disclosure, and that changes, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present disclosure.
Claims (10)
1. A method for determining concentration, comprising:
acquiring a collected voice instruction and a Virtual Reality (VR) image, wherein the voice instruction is audio data sent by personnel in a nuclear power plant, and the VR image is a collected nuclear power equipment image in a current space range;
processing the voice instruction to determine a first equipment number contained in the voice instruction;
analyzing the VR image to determine a corresponding equipment number set in the VR image, wherein the equipment number set comprises at least one second equipment number;
determining a first region in the VR image based on the first device number and a second device number included in the device number set;
monitoring a line of sight of the nuclear plant personnel to determine a first duration for which the nuclear plant personnel gazed at the first area;
and determining whether the work concentration degree of the nuclear power plant personnel is normal or not based on the relation between the first time length and the threshold value.
2. The method of claim 1, wherein said processing the voice instruction to determine the first device number included in the voice instruction comprises:
recognizing and converting the voice command to determine text information contained in the voice command;
and analyzing the text information to determine the included first equipment number.
3. The method of claim 1, wherein parsing the VR image to determine a corresponding set of device numbers in the VR image comprises:
inputting the VR image into a trained image recognition model to determine a corresponding equipment number set in the VR image; alternatively, the first and second liquid crystal display panels may be,
and performing image recognition on the VR image to determine a corresponding device number set in the VR image.
4. The method of claim 1, wherein determining the first region in the VR image based on the first device number and a second device number included in the set of device numbers comprises:
traversing each second device number in the set of device numbers to determine whether any second device number matching the first device number exists;
and when any second equipment number matched with the first equipment number exists in the equipment number set, determining the area to which the second equipment corresponding to the any second equipment number in the VR image belongs as a first area.
5. The method of claim 1, wherein the monitoring the line of sight of the nuclear plant personnel to determine a first duration of time that the nuclear plant personnel are looking at the first area comprises:
based on eye tracking technology, the sight of the nuclear power plant personnel is monitored to determine a first duration for which the nuclear power plant personnel gazes at the first area.
6. The method of claim 1, wherein determining whether the work concentration of the nuclear plant personnel is normal based on the relationship between the first length of time and a threshold comprises:
determining that the work concentration of the nuclear power plant personnel is normal if the first duration is greater than or equal to the threshold;
determining that the work concentration of the nuclear plant personnel is abnormal if the first time period is less than the threshold.
7. The method of claim 6, further comprising, after the determining the abnormality in the work concentration of the nuclear plant personnel:
performing a concentration exception prompt, wherein the exception prompt comprises at least one of: voice broadcast prompt and interface display prompt.
8. A device for attentiveness determination, comprising:
the acquisition module is used for acquiring a collected voice instruction and a Virtual Reality (VR) image, wherein the voice instruction is audio data sent by personnel in the nuclear power plant, and the VR image is a collected nuclear power equipment image in the current space range;
the processing module is used for processing the voice instruction so as to determine a first equipment number contained in the voice instruction;
the analysis module is used for analyzing the VR image to determine a corresponding equipment number set in the VR image, wherein the equipment number set comprises at least one second equipment number;
a first determining module, configured to determine a first area in the VR image based on the first device number and a second device number included in the device number set;
the monitoring module is used for monitoring the sight of the nuclear power plant personnel to determine a first duration for the nuclear power plant personnel to watch the first area;
and the second determination module is used for determining whether the work concentration degree of the nuclear power plant personnel is normal or not based on the relation between the first time length and the threshold value.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor when executing the program implementing the method of determining a degree of concentration as claimed in any one of claims 1-7.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method of determining a degree of concentration according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210663566.7A CN115097933A (en) | 2022-06-13 | 2022-06-13 | Concentration determination method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210663566.7A CN115097933A (en) | 2022-06-13 | 2022-06-13 | Concentration determination method and device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115097933A true CN115097933A (en) | 2022-09-23 |
Family
ID=83291569
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210663566.7A Pending CN115097933A (en) | 2022-06-13 | 2022-06-13 | Concentration determination method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115097933A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107783945A (en) * | 2017-11-13 | 2018-03-09 | 山东师范大学 | A kind of search result web page notice assessment method and device based on the dynamic tracking of eye |
| CN107832036A (en) * | 2017-11-22 | 2018-03-23 | 北京小米移动软件有限公司 | Sound control method, device and computer-readable recording medium |
| CN108922085A (en) * | 2018-07-18 | 2018-11-30 | 北京七鑫易维信息技术有限公司 | A kind of monitoring method, device, custodial care facility and storage medium |
| CN110045830A (en) * | 2019-04-17 | 2019-07-23 | 努比亚技术有限公司 | Application operating method, apparatus and computer readable storage medium |
| CN111325109A (en) * | 2020-01-22 | 2020-06-23 | 福建中医药大学 | Attention training method |
| CN111597916A (en) * | 2020-04-24 | 2020-08-28 | 深圳奥比中光科技有限公司 | Concentration degree detection method, terminal device and system |
| CN111709264A (en) * | 2019-03-18 | 2020-09-25 | 北京市商汤科技开发有限公司 | Driver attention monitoring method and device and electronic equipment |
| CN113313019A (en) * | 2021-05-27 | 2021-08-27 | 展讯通信(天津)有限公司 | Distracted driving detection method, system and related equipment |
| CN113420678A (en) * | 2021-06-25 | 2021-09-21 | 阿波罗智联(北京)科技有限公司 | Gaze tracking method, device, apparatus, storage medium, and computer program product |
-
2022
- 2022-06-13 CN CN202210663566.7A patent/CN115097933A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107783945A (en) * | 2017-11-13 | 2018-03-09 | 山东师范大学 | A kind of search result web page notice assessment method and device based on the dynamic tracking of eye |
| CN107832036A (en) * | 2017-11-22 | 2018-03-23 | 北京小米移动软件有限公司 | Sound control method, device and computer-readable recording medium |
| CN108922085A (en) * | 2018-07-18 | 2018-11-30 | 北京七鑫易维信息技术有限公司 | A kind of monitoring method, device, custodial care facility and storage medium |
| CN111709264A (en) * | 2019-03-18 | 2020-09-25 | 北京市商汤科技开发有限公司 | Driver attention monitoring method and device and electronic equipment |
| CN110045830A (en) * | 2019-04-17 | 2019-07-23 | 努比亚技术有限公司 | Application operating method, apparatus and computer readable storage medium |
| CN111325109A (en) * | 2020-01-22 | 2020-06-23 | 福建中医药大学 | Attention training method |
| CN111597916A (en) * | 2020-04-24 | 2020-08-28 | 深圳奥比中光科技有限公司 | Concentration degree detection method, terminal device and system |
| CN113313019A (en) * | 2021-05-27 | 2021-08-27 | 展讯通信(天津)有限公司 | Distracted driving detection method, system and related equipment |
| CN113420678A (en) * | 2021-06-25 | 2021-09-21 | 阿波罗智联(北京)科技有限公司 | Gaze tracking method, device, apparatus, storage medium, and computer program product |
Non-Patent Citations (2)
| Title |
|---|
| 姜婷婷 等: "眼动追踪技术在国外信息行为研究中的应用", 情报学报, pages 1 - 2 * |
| 张红军;: "核电厂如何做好防人因失误管理", 中国核工业, pages 64 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Stauffert et al. | Latency and cybersickness: Impact, causes, and measures. A review | |
| Uwano et al. | Analyzing individual performance of source code review using reviewers' eye movement | |
| CN108542404B (en) | Attention evaluation device, VR device, and readable storage medium | |
| Shi et al. | Galvanic skin response (GSR) as an index of cognitive load | |
| US8136944B2 (en) | System and method for identifying the existence and position of text in visual media content and for determining a subjects interactions with the text | |
| US9411416B2 (en) | Computer device operable with user's eye movement and method for operating the computer device | |
| Braunagel et al. | Online recognition of driver-activity based on visual scanpath classification | |
| JPH02277196A (en) | Man-machine system | |
| CN109835260B (en) | Vehicle information display method, device, terminal and storage medium | |
| US20160278684A1 (en) | Monitoring a person for indications of a brain injury | |
| Chen et al. | Automatic and continuous user task analysis via eye activity | |
| CN110569347A (en) | Data processing method and device, storage medium and electronic equipment | |
| Pohl et al. | Analysing interactivity in information visualisation | |
| Bayat et al. | The influence of text difficulty level and topic on eye-movement behavior and pupil size during reading | |
| CN114327077B (en) | Method and device for analyzing learner perception capability level based on eye movement tracking | |
| US11666258B2 (en) | Eye-tracking system for detection of cognitive load | |
| CN113317792A (en) | Attention detection system and method based on binocular eye vector analysis | |
| EP3801252A1 (en) | Technology adapted to enable improved collection of involuntary eyelid movement parameters, including collection of eyelid movement parameters to support analysis of neurological factors | |
| CN115097933A (en) | Concentration determination method and device, computer equipment and storage medium | |
| Dai et al. | Detection of Operator Fatigue in the Main Control Room of a Nuclear Power Plant Based on Eye Blink Rate, PERCLOS and Mouse Velocity | |
| CN103577715B (en) | Case history input unit and case history input method | |
| Kong et al. | Remote photoplethysmography and motion tracking convolutional neural network with bidirectional long short-term memory: Non-invasive fatigue detection method based on multi-modal fusion | |
| Kovesdi et al. | Measuring human performance in simulated nuclear power plant control rooms using eye tracking | |
| CN107291571B (en) | Debugging method and device of VR (virtual reality) all-in-one machine | |
| Chen et al. | Blinking: Toward wearable computing that understands your current task |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |