CN111506196A - Pupil screen compounding method for attention evaluation - Google Patents
Pupil screen compounding method for attention evaluation Download PDFInfo
- Publication number
- CN111506196A CN111506196A CN202010315325.4A CN202010315325A CN111506196A CN 111506196 A CN111506196 A CN 111506196A CN 202010315325 A CN202010315325 A CN 202010315325A CN 111506196 A CN111506196 A CN 111506196A
- Authority
- CN
- China
- Prior art keywords
- attention
- information
- user
- screen
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 210000001747 pupil Anatomy 0.000 title claims abstract description 15
- 238000013329 compounding Methods 0.000 title claims abstract description 11
- 238000011156 evaluation Methods 0.000 title claims abstract description 8
- 150000001875 compounds Chemical class 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 abstract description 4
- 230000036544 posture Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 208000003028 Stuttering Diseases 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- General Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- Economics (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Operations Research (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a pupil screen compounding method for attention assessment, which comprises the following steps: recording operation process information of a user on a computer, and adding a time stamp to each operation process; recording the attention position information of the user on a computer screen, and adding a time stamp to each attention position; and correlating the operation process information with the concerned position information according to the time sequence, analyzing and judging whether the user pays attention to the screen and the concerned specific operation process when paying attention to the screen, and counting the concerned time length so as to realize the attention evaluation of the user. The invention can be applied to the office monitoring of enterprises, the concentration condition of the staff when the staff operates the computer on duty can be known, and the staff can be pointed right in time when the staff loses work concentration seriously, thereby improving the working efficiency of the staff and avoiding the occurrence of negative working phenomenon; in addition, the operation process information and the eye attention position information are compounded, so that the operation efficiency of the staff can be known, and the relationship between the operation efficiency of the staff and the work attention of the staff can be explained.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a pupil screen compounding method for attention assessment.
Background
In the network era, more and more work is done on computers. For workers who complete tasks on computers, a good monitoring and evaluation system or method is not available at present. Many people do not work as best as possible in half of the time, and the attention of the people is dispersed in the matters of chatting, playing mobile phones, stuttering and the like, so that the working efficiency is low.
Disclosure of Invention
The invention aims to provide a pupil screen compound method for attention assessment, which realizes monitoring and assessment of attention of workers during computer work.
The invention realizes the purpose through the following technical scheme:
a pupil screen compound method for attention assessment comprises the following steps:
recording operation process information of a user on a computer, and adding a time stamp to each operation process;
recording the attention position information of the user on a computer screen, and adding a time stamp to each attention position;
and step three, correlating the operation process information with the attention position information according to the time sequence, analyzing and judging whether the user pays attention to the screen and the specific operation process concerned when the user pays attention to the screen, and counting attention duration so as to realize the attention evaluation of the user.
The computer is further improved in that two storage modules are built in the computer and are respectively used for storing the recorded operation process information and the concerned position information, the storage modules are respectively provided with a time stamp module, and the time stamp module is used for providing current time data when the information is stored in the storage modules.
The further improvement is that the recording of the attention position information of the user is realized through a camera of a computer.
In a further improvement, the multi-position gaze location is performed before recording the user gaze focus position information, the location operation comprising: opening a camera, displaying a target image on a screen, controlling the target image to continuously move on the computer screen, staring at the moving target image by the vision of a user, and recording the corresponding user vision of the target image at different positions by the camera to form position-vision corresponding information;
and when the attention position information of the user is recorded, determining the attention position of the user according to the position-attention corresponding information.
In a further improvement, the multi-position gaze fixation comprises a most common position gaze fixation, a most comfortable position gaze fixation and other position gaze fixation.
The further improvement lies in that the recording of the operation process information of the user on the computer is divided into:
the first grade information is recorded without content information, means that only the operation type of a user is recorded, and is stored in a cloud database;
and second-level information, which is a record with content information, records the operation type and the operation content of the user, and stores the operation type and the operation content in a local database.
The further improvement is that the operation types are divided into working operation types and non-working operation types in advance, and when the duration of the working operation types focused by users is lower than a threshold value, warning information is sent out.
The further improvement is that the operation types at least comprise opening/closing a computer, opening/closing office software, printing, processing a folder, opening/closing a browser, opening/closing chat software, opening/closing game software and opening/closing video and audio software;
the operation content at least comprises document information, table information, picture information and webpage information.
The invention has the beneficial effects that: the attention assessment of the user is realized by recording the operation process information of the user on the computer and the eye attention position information of the user, the method is applied to the office monitoring of enterprises, the concentration condition of the employee when the employee operates the computer during working can be known, and the employee can be pointed right in time when the employee loses work concentration seriously, so that the working efficiency of the employee is improved, and the negative working phenomenon is avoided; in addition, the operation process information and the attention position information are compounded, so that the operation efficiency of the staff can be known, and the relationship between the operation efficiency of the staff and the attention force of the staff can be explained.
Drawings
FIG. 1 is a schematic flow chart of the method of the present invention.
Detailed Description
The present application will now be described in further detail with reference to the drawings, it should be noted that the following detailed description is given for illustrative purposes only and is not to be construed as limiting the scope of the present application, as those skilled in the art will be able to make numerous insubstantial modifications and adaptations to the present application based on the above disclosure.
As shown in fig. 1, a pupil screen compound method for attention assessment includes the following steps:
recording operation process information of a user on a computer, and adding a time stamp to each operation process;
recording the attention position information of the user on a computer screen, and adding a time stamp to each attention position;
and step three, correlating the operation process information with the attention position information according to the time sequence, analyzing and judging whether the user pays attention to the screen and the specific operation process concerned when the user pays attention to the screen, and counting attention duration so as to realize the attention evaluation of the user.
The method relies on a computer hardware and software system, when recording information, two storage modules are established in a computer and are respectively used for storing the recorded operation process information and the concerned position information, and the storage modules are provided with time stamp modules and are used for providing current time data when the storage modules store the information.
The recording of the attention position information of the user is realized through a camera of the computer. Performing multi-position gaze location before recording user gaze focus location information, the location operation comprising: opening the camera, displaying a target image (which can be a double-eye picture) on the screen, controlling the target image to continuously move on the computer screen, staring at the moving target image by the vision of the user, and recording the corresponding user vision of the target image at different positions by the camera to form position-vision corresponding information.
The multi-position gaze location comprises a most common position gaze location, a most comfortable position gaze location and other position gaze locations, wherein the most common position gaze location refers to the gaze location of a position corresponding to a sitting posture which is most common when a user works, the most comfortable position gaze location refers to the gaze location of a position corresponding to a sitting posture when the user selects to stretch waist, and the other position gaze location refers to the gaze location which can be selected by the user to perform other sitting postures. The camera also identifies the sitting posture of the user while identifying the gaze, and the position-gaze corresponding information is determined and formed according to the sitting posture and the gaze.
When recording the attention position information of the user gaze, determining the attention position of the user gaze according to the position-gaze corresponding information, namely comparing the recorded real-time gaze with each stored gaze in the position-gaze corresponding information one by one to match the stored gaze identical to the real-time gaze, wherein the position corresponding to the stored gaze is the attention position of the real-time gaze; if the same stored gaze is not matched, the focus position of the real-time gaze is not in the screen. For example, table one below, the recorded results of location information are focused on the morning hours for a certain company employee.
Table one: recording result of gaze attention position information
In addition, recording the operation process information of the user on the computer is divided into: the first grade information is recorded without content information, means that only the operation type of a user is recorded, and is stored in a cloud database; and second-level information, which is a record with content information, records the operation type and the operation content of the user, and stores the operation type and the operation content in a local database. The information stored in the local database is generally confidential information inside a company, and can be used for deeper behavior analysis inside an enterprise, such as working capacity, efficiency and the like; in addition, through the information stored in the cloud database, the operation information among different users can be transversely compared, and the position of the operation efficiency of the user can be analyzed.
The operation types are divided into a working operation type and a non-working operation type in advance, and when the duration that a user pays attention to the working operation type is lower than a threshold value, warning information is sent out. For example, the time length for setting the type of paying attention to the non-working operation every day should not exceed 2h, and a caption for paying attention to the working efficiency or the like is issued on the computer desktop after the time length exceeds the time length.
Particularly, the operation types at least comprise opening/closing a computer, opening/closing office software, printing, processing a folder, opening/closing a browser, opening/closing chat software, opening/closing game software and opening/closing video software; the operation content at least comprises working contents such as document information, table information, picture information, webpage information and the like. For example, as shown in table two, the result of recording the information of the operation process on the computer for the employee of a certain company during the morning work in one day:
table two: recorded result of operation process information
And correlating the operation process information with the attention position information according to the time sequence through a computer, analyzing and judging whether the user pays attention to the screen and the specific operation process concerned when the user pays attention to the screen, and counting attention duration so as to realize the attention evaluation of the user.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.
Claims (8)
1. A pupil screen compound method for attention assessment is characterized in that: comprises the steps of
Recording operation process information of a user on a computer, and adding a time stamp to each operation process;
recording the attention position information of the user on a computer screen, and adding a time stamp to each attention position;
and step three, correlating the operation process information with the attention position information according to the time sequence, analyzing and judging whether the user pays attention to the screen and the specific operation process concerned when the user pays attention to the screen, and counting attention duration so as to realize the attention evaluation of the user.
2. The pupil screen compounding method for attention assessment according to claim 1, wherein: two storage modules are established in a computer and are respectively used for storing the recorded operation process information and the concerned position information, the storage modules are respectively provided with a time stamp module, and the time stamp module is used for providing current time data when the storage modules store the information.
3. The pupil screen compounding method for attention assessment according to claim 1, wherein: the recording of the attention position information of the user is realized through a camera of the computer.
4. A pupil screen compounding method of attention assessment according to claim 3, characterized by: performing multi-position gaze location before recording user gaze focus location information, the location operation comprising: opening a camera, displaying a target image on a screen, controlling the target image to continuously move on the computer screen, staring at the moving target image by the vision of a user, and recording the corresponding user vision of the target image at different positions by the camera to form position-vision corresponding information;
and when the attention position information of the user is recorded, determining the attention position of the user according to the position-attention corresponding information.
5. The pupil screen compounding method for attention assessment according to claim 4, wherein: the multi-position gaze location includes a most common position gaze location, a most comfortable position gaze location, and other position gaze locations.
6. The pupil screen compounding method for attention assessment according to claim 1, wherein: recording the operation process information of a user on a computer comprises the following steps:
the first grade information is recorded without content information, means that only the operation type of a user is recorded, and is stored in a cloud database;
and second-level information, which is a record with content information, records the operation type and the operation content of the user, and stores the operation type and the operation content in a local database.
7. The pupil screen compounding method for attention assessment according to claim 6, wherein: the operation types are divided into a working operation type and a non-working operation type in advance, and when the duration that a user pays attention to the working operation type is lower than a threshold value, warning information is sent out.
8. A pupil screen compounding method of attention assessment according to claim 6 or 7, characterized by: the operation types at least comprise opening/closing a computer, opening/closing office software, printing, processing a folder, opening/closing a browser, opening/closing chat software, opening/closing game software and opening/closing video software;
the operation content at least comprises document information, table information, picture information and webpage information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010315325.4A CN111506196B (en) | 2020-04-21 | 2020-04-21 | Pupil screen compounding method for attention evaluation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010315325.4A CN111506196B (en) | 2020-04-21 | 2020-04-21 | Pupil screen compounding method for attention evaluation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111506196A true CN111506196A (en) | 2020-08-07 |
| CN111506196B CN111506196B (en) | 2022-12-23 |
Family
ID=71872908
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010315325.4A Expired - Fee Related CN111506196B (en) | 2020-04-21 | 2020-04-21 | Pupil screen compounding method for attention evaluation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111506196B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113760098A (en) * | 2021-09-18 | 2021-12-07 | 陕西师范大学 | Time integration-based attention efficient quantification method and system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060093998A1 (en) * | 2003-03-21 | 2006-05-04 | Roel Vertegaal | Method and apparatus for communication between humans and devices |
| CN101399716A (en) * | 2008-10-28 | 2009-04-01 | 深圳市中科新业信息科技发展有限公司 | Distributed audit system and method for monitoring using state of office computer |
| CN102087582A (en) * | 2011-01-27 | 2011-06-08 | 广东威创视讯科技股份有限公司 | Automatic scrolling method and device |
| CN103595753A (en) * | 2013-05-24 | 2014-02-19 | 漳州师范学院 | Remote learning monitoring system based on eye movement locus tracking, and monitoring method of remote learning monitoring system |
| CN104780217A (en) * | 2015-04-24 | 2015-07-15 | 福建师范大学 | Method, system and client terminal for detecting working efficiency of user |
| CN105243522A (en) * | 2015-11-24 | 2016-01-13 | 北京华夏威科软件技术有限公司 | Working behavior analysis method and system based on massive user operation behavior data |
| CN106725531A (en) * | 2016-12-03 | 2017-05-31 | 西安科锐盛创新科技有限公司 | Children's concentration detecting and analysing system and method based on sight line |
| CN108108684A (en) * | 2017-12-15 | 2018-06-01 | 杭州电子科技大学 | A kind of attention detection method for merging line-of-sight detection |
| CN108764007A (en) * | 2018-02-10 | 2018-11-06 | 集智学园（北京）科技有限公司 | Based on OCR with text analysis technique to the measurement method of attention |
-
2020
- 2020-04-21 CN CN202010315325.4A patent/CN111506196B/en not_active Expired - Fee Related
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060093998A1 (en) * | 2003-03-21 | 2006-05-04 | Roel Vertegaal | Method and apparatus for communication between humans and devices |
| CN101399716A (en) * | 2008-10-28 | 2009-04-01 | 深圳市中科新业信息科技发展有限公司 | Distributed audit system and method for monitoring using state of office computer |
| CN102087582A (en) * | 2011-01-27 | 2011-06-08 | 广东威创视讯科技股份有限公司 | Automatic scrolling method and device |
| CN103595753A (en) * | 2013-05-24 | 2014-02-19 | 漳州师范学院 | Remote learning monitoring system based on eye movement locus tracking, and monitoring method of remote learning monitoring system |
| CN104780217A (en) * | 2015-04-24 | 2015-07-15 | 福建师范大学 | Method, system and client terminal for detecting working efficiency of user |
| CN105243522A (en) * | 2015-11-24 | 2016-01-13 | 北京华夏威科软件技术有限公司 | Working behavior analysis method and system based on massive user operation behavior data |
| CN106725531A (en) * | 2016-12-03 | 2017-05-31 | 西安科锐盛创新科技有限公司 | Children's concentration detecting and analysing system and method based on sight line |
| CN108108684A (en) * | 2017-12-15 | 2018-06-01 | 杭州电子科技大学 | A kind of attention detection method for merging line-of-sight detection |
| CN108764007A (en) * | 2018-02-10 | 2018-11-06 | 集智学园（北京）科技有限公司 | Based on OCR with text analysis technique to the measurement method of attention |
Non-Patent Citations (1)
| Title |
|---|
| 卫晓娜: "E-Learning系统中基于Adaboost算法的注意力识别", 《电脑知识与技术》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113760098A (en) * | 2021-09-18 | 2021-12-07 | 陕西师范大学 | Time integration-based attention efficient quantification method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111506196B (en) | 2022-12-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Shrestha et al. | Detection of question-answer pairs in email conversations | |
| US9705834B2 (en) | System and method for analyzing communications | |
| DE112013000922T5 (en) | Multi-level approach to e-mail prioritization | |
| US20050204001A1 (en) | Method and devices for prioritizing electronic messages | |
| Elsweiler et al. | Understanding re-finding behavior in naturalistic email interaction logs | |
| NO338030B1 (en) | Procedures and systems for processing email messages | |
| US20220059133A1 (en) | Intelligent video editing method and system | |
| WO2014029314A1 (en) | Information aggregation, classification and display method and system | |
| CN111506196B (en) | Pupil screen compounding method for attention evaluation | |
| US20090083221A1 (en) | System and Method for Estimating and Storing Skills for Reuse | |
| KR20070008210A (en) | Method and apparatus for blocking the objectionable multimedia information | |
| CN108388672A (en) | Lookup method, device and the computer readable storage medium of video | |
| US8209323B2 (en) | Methods and apparatuses for dynamically searching for electronic mail messages | |
| CN109670079A (en) | Supervisor's method and system based on monitoring system | |
| CN107465519B (en) | Data management system based on instant messaging application | |
| US20190199858A1 (en) | Voice recognition system and call evaluation setting method | |
| WO2021073258A1 (en) | Task follow-up method, apparatus and device based on emotion analysis, and storage medium | |
| Stolfo et al. | Email mining toolkit supporting law enforcement forensic analyses | |
| EP3318021B1 (en) | Managing and indexing communication data, and recommending communication type | |
| US20170039273A1 (en) | System and method for generating a customized singular activity stream | |
| CN113918548A (en) | Questionnaire survey method and device based on private domain flow and storage medium | |
| DE112012005344T5 (en) | Method, computer program and computer for detecting trends in social media | |
| KR100483602B1 (en) | Method and system for monitoring e-mail | |
| JP2007108839A (en) | Method and device for determining importance of information | |
| CN111143688A (en) | Evaluation method and system based on mobile news client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20221223 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |