CN106123819B - A kind of ' s focus of attention measurement method - Google Patents

A kind of ' s focus of attention measurement method Download PDF

Info

Publication number
CN106123819B
CN106123819B CN201610503932.7A CN201610503932A CN106123819B CN 106123819 B CN106123819 B CN 106123819B CN 201610503932 A CN201610503932 A CN 201610503932A CN 106123819 B CN106123819 B CN 106123819B
Authority
CN
China
Prior art keywords
focus
attention
test object
measuring instrument
cluster
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610503932.7A
Other languages
Chinese (zh)
Other versions
CN106123819A (en
Inventor
徐晶
刘威
许炜
张谦益
范子健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huazhong University of Science and Technology
Original Assignee
Huazhong University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huazhong University of Science and Technology filed Critical Huazhong University of Science and Technology
Priority to CN201610503932.7A priority Critical patent/CN106123819B/en
Publication of CN106123819A publication Critical patent/CN106123819A/en
Application granted granted Critical
Publication of CN106123819B publication Critical patent/CN106123819B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B21/00Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • G06F18/232Non-hierarchical techniques
    • G06F18/2321Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • G06F18/23213Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering

Abstract

The invention discloses a kind of ' s focus of attention measurement methods, are measured in real time the head bias data of test object, and the ' s focus of attention position of test object is estimated according to measurement data;Group's attention measurement error caused by partial test object dispersion attention is eliminated by anomalous discrimination and cluster;This ' s focus of attention measurement method provided by the invention is applied to monitor classroom situation in classroom environment, reliable and intuitive data can be provided to understand student's class state, the monitoring for learning situation for current classroom instruction middle school student has higher value.

Description

A kind of ' s focus of attention measurement method
Technical field
The invention belongs to field of information processing, more particularly, to a kind of ' s focus of attention measurement method.
Background technology
With the development of science and technology, information intelligence has been widely used for the every field in people's daily life. In teaching field, ' s focus of attention when student listens to the teacher is the index that manager and teacher pay much attention to.
The measuring system and method for current existing attention of student focus are surveyed by detecting the sight of student Amount;Including close-in measurement and telemeasurement two ways;The visual line measurement of short distance mostly uses preposition measuring instrument, such as Tobii etc. can more accurately measure the sight data of short distance student in the state that human body attitude is substantially stationary, from And it extrapolates student's sight and falls position on the screen to determine ' s focus of attention;But if hypertelorism, due to human body appearance The influence of the factors such as state, sight DATA REASONING error is larger, and survey calculation is inaccurate.Remote visual line measurement is mostly used Wear-type measuring instrument, the sight data of the student are directly measured by wear-type measuring instrument, and then are extrapolated student's sight and fallen Position on teaching screen determines ' s focus of attention.But this mode needs each student to wear wear-type measuring instrument, at This cost is high, and largely effects on the Teaching Experience and teaching efficiency of student.
Invention content
For the disadvantages described above or Improvement requirement of the prior art, the present invention provides a kind of surveys of test object ' s focus of attention Amount system, its object is to the ' s focus of attention positions of each test object of head bias data acquisition according to test object to go forward side by side Row correction improves the accuracy that existing ' s focus of attention measures.
To achieve the above object, according to one aspect of the present invention, a kind of ' s focus of attention measurement method is provided, specifically Include the following steps:
(1) it is acquired by measuring instrument and obtains test object head bias data, including pitch angle αk, deflection angle βk, test pair As head center point is in the coordinate (x of space coordinatesk, yk, zk), the spacing z of test object and measuring instrument1And measuring instrument with The spacing d of teaching screen;
Wherein, space coordinates are using measuring instrument point as coordinate origin, with measuring instrument and plane where teaching screen Parallel expansion plane is Z=0 planes, using measuring instrument horizontal direction as X-direction, using measuring instrument vertical direction as Y direction;
(2) inclination angle of the height and measuring instrument according to test object head center point coordinates, measuring instrument apart from ground γ, to above-mentioned pitch angle αk, deflection angle βkIt is calibrated;
(3) according to the spacing z of pitch angle α, deflection angle β and test object and measuring instrument after calibration1, measuring instrument with The spacing d of teaching screen;Obtain the ' s focus of attention coordinate (x, y, z) of test object;
Wherein,
(4) anomalous discrimination and clustering method is used to eliminate test object group's attention region measurement error, focus point is sat Mark carries out error correction.
Preferably, above-mentioned ' s focus of attention measurement method,
Pitch angle after calibration
Deflection angle after calibration
Wherein, hkRefer to height of the measuring instrument apart from ground, γ refers to measuring instrument in the vertical direction perpendicular to horizontal plane On inclination angle.
Preferably, above-mentioned ' s focus of attention measurement method, step (3) include following sub-step:
(3.1) anomalous discrimination
Detect the resident duration of the ' s focus of attention of single test object;The focus that resident duration is more than to pre-set threshold value is sentenced It is set to inactive ' s focus of attention, remaining is determined as active attention power focus;Wherein, predetermined threshold value uses adjustable experience Threshold value;
(3.2) focus clusters
Inactive ' s focus of attention is abandoned, active attention power focus is clustered using K-Means clustering algorithms, it will N active attention power focus is divided into k focus cluster;
(3.3) cluster centre for obtaining and each clustering is calculated;Cluster centre coordinate is according to all object coordinates in the cluster Mean set;
(3.4) using cluster centre as the center of circle, the circle that a radius is r, the attention as test object group are exhaled Power region;The attention region is the ' s focus of attention region of current time test object group;Wherein, the size etc. of r In cluster centre and the cluster apart from the farthest focus of cluster centre the distance between.
Above-mentioned error correction further gets the note of test object group according to the ' s focus of attention of test object Power of anticipating region;Due to the otherness of test object individual, partial test object may be absent minded, so as to cause test pair As the measurement error in group's attention region can effectively avoid inactive measurement point from bringing using the method for anomalous discrimination Resultant error;Using K-Means clustering algorithms, after eliminating abnormal focus, the characteristics of using cluster, by discrete multiple tests Object ' s focus of attention is divided into k cluster, i.e. k group's ' s focus of attention region, makes the attention area results of acquisition more Accurately.
In general, through the invention it is contemplated above technical scheme is compared with the prior art, can obtain down and show Beneficial effect:
' s focus of attention measurement method provided by the invention calculates each survey according to the head bias data of test object Try the focal position of object attention;And caused using anomalous discrimination and clustering processing elimination partial test object dispersion attention Group's attention measurement error, to obtain region-of-interest of the test object group to screen;This method is applied to religion When in room environmental, classroom situation is monitored for instructor, student's class state is understood and provides reliable and intuitive data;Effectively keep away Exempt from the accidental error and measurement error that are generated by individual student ' s focus of attention, improves accuracy of measurement.
Description of the drawings
Fig. 1 is application scenario diagram of the ' s focus of attention measurement method provided in an embodiment of the present invention under classroom environment;
Fig. 2 is the space coordinates schematic diagram in the embodiment of the present invention;
Fig. 3 is that the calibration for the head deflection angle brought to the movement of test object head center in the embodiment of the present invention is illustrated Figure;
Fig. 4 is the schematic diagram at Kinect measuring instruments inclination angle in the embodiment of the present invention;
Fig. 5 is the head pitch angle of the test object in the embodiment of the present invention and the schematic diagram of deflection angle;
Fig. 6 is the flow diagram of error correction in ' s focus of attention measurement method provided in an embodiment of the present invention.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and It is not used in the restriction present invention.As long as in addition, technical characteristic involved in the various embodiments of the present invention described below It does not constitute a conflict with each other and can be combined with each other.
Fig. 1 show the application scenario diagram of embodiment;Teaching screen is located in the middle part of the metope of classroom forefront, and teacher station exists It as currently gives lessons before screen, at teacher's pointer instruction where emphasis and test object currently most answers considerable focus;It is imparting knowledge to students One Kinect measuring instrument is installed on the ceiling between screen and test object, several test objects can be detected simultaneously Head deflection data, test object position is before desk;The focus measurement method provided through the invention can know test pair As whether the current ' s focus of attention of group gives lessons on emphasis currently.This application scenarios with reference to embodiments, are specifically explained ' s focus of attention test method provided by the invention is stated, this method specifically includes following steps:
(1) collecting test object header offset data, including pitch angle αk, deflection angle βk, test object head center point exists Coordinate (the x of space coordinatesk, yk, zk), the spacing z of test object and measuring instrument1And the spacing of measuring instrument and teaching screen d;
Wherein, space coordinates are using Kinect measuring instruments point as coordinate origin, with measuring instrument and teaching screen place The parallel expansion plane of plane is Z=0 planes, using measuring instrument horizontal direction as X-direction, using measuring instrument vertical direction as Y-axis Direction;
(2) inclination angle of the height and measuring instrument according to test object head center point coordinates, measuring instrument apart from ground γ, to above-mentioned pitch angle αk, deflection angle βkIt is calibrated;
(3) according to the spacing z of pitch angle α, deflection angle β and test object and measuring instrument after calibration1, measuring instrument with The spacing d of teaching screen;Obtain the ' s focus of attention coordinate (x, y, z) of test object;
Wherein,
(4) anomalous discrimination and clustering method is used to eliminate test object group's attention region measurement error, focus point is sat Mark carries out error correction.
It is the space coordinates schematic diagram in embodiment shown in Fig. 2;Using Kinect measuring instruments point as three dimensions In the coordinate system that coordinate origin is established, coordinate (x of the test object head center point in space coordinatesk, yk, zk), pitch angle αk, deflection angle βk, test object and measuring instrument spacing z1And the spacing d of measuring instrument and teaching screen is by Kinect measuring instruments It measures and obtains.
Shown in Fig. 3, the calibration of the head deflection angle to be brought to the movement of test object head center in embodiment is illustrated Figure;As shown in the drawing, under actual scene, test object ' s focus of attention focuses on the points of the P on X/Y plane, Kinect measuring instruments Measure obtained head deflection angle [alpha]kk;However, practical pitch angle is α as shown in the figure, actual deflection angle is as shown in the figure β, the measured value of Kinect measuring instruments cannot directly be used as head deflection angle-data, be calibrated.
Fig. 4 is the inclination angle schematic diagram of Kinect measuring instruments in the vertical direction in the embodiment of the present invention;Kinect is measured The inclination angle of instrument in the vertical direction is γ;Pitch angle and deflection angle are calibrated according to the method provided by the invention,
Pitch angle after calibration
Deflection angle after calibration
It is the head pitch angle and deflection angle schematic diagram of test object in embodiment shown in Fig. 5;Wherein, α is test object The pitch angle (Pitch) on head, β are the deflection angle (Yaw) on test object head.
It is the flow diagram of error correction in the ' s focus of attention measurement method that embodiment provides shown in Fig. 6, it is specific to wrap Include following steps:
(3.1) test object individual ' s focus of attention residence time is obtained;
(3.2) inactive focus data is abandoned, active attention power focus data is obtained;In embodiment, it is believed that residence time Focus of 1 minute more than empirical value is inactive focus;
(3.3) space clustering is carried out to active attention power focus;
In embodiment, using K-Means clustering algorithms, n focus data of acquisition is divided into k cluster, forms k Focus clusters;In embodiment, k=n/5;
(3.4) cluster centre for obtaining and each clustering is calculated, cluster centre coordinate is by all object coordinates in the cluster Mean value determines;
(3.5) using cluster centre as the center of circle, the circle of a radius r is exhaled, as the attention region of student group, The region is region-of-interest of the current time student group to screen of imparting knowledge to students;Wherein, it is poly- to this to be equal to cluster centre for the size of r Apart from the distance of the farthest focus of cluster centre in class;
(3.6) discrete focus cluster is removed, student group ' s focus of attention region is obtained;In embodiment, institute is eliminated Including number of focus is less than the cluster item of focus sum 10%.
As it will be easily appreciated by one skilled in the art that the foregoing is merely illustrative of the preferred embodiments of the present invention, not to The limitation present invention, all within the spirits and principles of the present invention made by all any modification, equivalent and improvement etc., should all include Within protection scope of the present invention.

Claims (2)

1. a kind of ' s focus of attention measurement method, which is characterized in that include the following steps:
(1) it is acquired by measuring instrument and obtains test object head bias data, including pitch angle αk, deflection angle βk, test object head Coordinate (x of portion's central point in space coordinatesk, yk, zk), the spacing z of test object and measuring instrument1And measuring instrument and teaching The spacing d of screen;
(2) the height h according to test object head center point coordinates, measuring instrument apart from groundkAnd the inclination angle γ of measuring instrument, To above-mentioned pitch angle αk, deflection angle βkIt is calibrated;
(3) according to the spacing z of pitch angle α, deflection angle β and test object and measuring instrument after calibration1, measuring instrument and teaching are shielded The spacing d of curtain;Obtain the ' s focus of attention coordinate (x, y, z) of test object;
Wherein,
The step (3) includes following sub-step:
(3.1) the resident duration of the ' s focus of attention of single test object is detected;Resident duration is more than to the focus of pre-set threshold value It is determined as inactive ' s focus of attention, remaining is determined as active attention power focus;
(3.2) abandon the inactive ' s focus of attention, for the active attention power focus using K-Means clustering algorithms into N active attention power focus is divided into k focus cluster by row cluster;
(3.3) cluster centre for obtaining and each clustering is calculated;
(3.4) using the cluster centre as the center of circle, the circle that a radius is r, the attention as test object group are exhaled Power region;The attention region is the ' s focus of attention region of current time test object group;Wherein, the size etc. of r In cluster centre and the cluster apart from the farthest focus of cluster centre the distance between;
(4) anomalous discrimination and clustering method is used to eliminate test object group's attention region measurement error, focusing point coordinates into Row error correction.
2. ' s focus of attention measurement method as described in claim 1, which is characterized in that
Pitch angle after calibration
Deflection angle after calibration
Wherein, γ refers to inclination angle of the measuring instrument on the vertical direction perpendicular to horizontal plane.
CN201610503932.7A 2016-06-29 2016-06-29 A kind of ' s focus of attention measurement method Active CN106123819B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610503932.7A CN106123819B (en) 2016-06-29 2016-06-29 A kind of ' s focus of attention measurement method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610503932.7A CN106123819B (en) 2016-06-29 2016-06-29 A kind of ' s focus of attention measurement method

Publications (2)

Publication Number Publication Date
CN106123819A CN106123819A (en) 2016-11-16
CN106123819B true CN106123819B (en) 2018-07-24

Family

ID=57285752

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610503932.7A Active CN106123819B (en) 2016-06-29 2016-06-29 A kind of ' s focus of attention measurement method

Country Status (1)

Country Link
CN (1) CN106123819B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108304779B (en) * 2017-12-28 2021-11-26 合肥智权信息科技有限公司 Intelligent regulation and control method for student education management
CN108509923A (en) * 2018-03-30 2018-09-07 百度在线网络技术(北京)有限公司 Classroom attention detection method, device, equipment and computer-readable medium
CN110210369B (en) * 2019-05-28 2021-04-06 华中科技大学 Student attention measuring system based on movable seat
CN112989865B (en) * 2019-12-02 2023-05-30 山东浪潮科学研究院有限公司 Crowd attention focus judging method based on head gesture judgment
CN113133583B (en) * 2021-04-28 2022-06-28 重庆电子工程职业学院 Multifunctional workbench for computer software developer

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6553281B1 (en) * 1997-08-26 2003-04-22 Heinrich-Hertz-Institut Fuer Nachrichtentechnik Berlin Gmbh Device for determining a fixation point
CN102149325A (en) * 2008-09-26 2011-08-10 松下电器产业株式会社 Line-of-sight direction determination device and line-of-sight direction determination method
CN102473033A (en) * 2009-09-29 2012-05-23 阿尔卡特朗讯 Method for viewing points detecting and apparatus thereof
CN104517102A (en) * 2014-12-26 2015-04-15 华中师范大学 Method and system for detecting classroom attention of student
CN105279493A (en) * 2015-10-22 2016-01-27 四川膨旭科技有限公司 System for identifying visions of drivers in vehicle running process

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4517049B2 (en) * 2003-12-25 2010-08-04 国立大学法人静岡大学 Gaze detection method and gaze detection apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6553281B1 (en) * 1997-08-26 2003-04-22 Heinrich-Hertz-Institut Fuer Nachrichtentechnik Berlin Gmbh Device for determining a fixation point
CN102149325A (en) * 2008-09-26 2011-08-10 松下电器产业株式会社 Line-of-sight direction determination device and line-of-sight direction determination method
CN102473033A (en) * 2009-09-29 2012-05-23 阿尔卡特朗讯 Method for viewing points detecting and apparatus thereof
CN104517102A (en) * 2014-12-26 2015-04-15 华中师范大学 Method and system for detecting classroom attention of student
CN105279493A (en) * 2015-10-22 2016-01-27 四川膨旭科技有限公司 System for identifying visions of drivers in vehicle running process

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于深度图像的多学习者姿态识别;张鸿宇等;《计算机科学》;20150930;第42卷(第9期);第299-302页 *

Also Published As

Publication number Publication date
CN106123819A (en) 2016-11-16

Similar Documents

Publication Publication Date Title
CN106123819B (en) A kind of ' s focus of attention measurement method
US8009515B2 (en) Ground threat location for an aircraft
CN109284737A (en) A kind of students ' behavior analysis and identifying system for wisdom classroom
CN106412573B (en) A kind of method and apparatus of detector lens stain
US20080306708A1 (en) System and method for orientation and location calibration for image sensors
CN106203370B (en) A kind of test near and distance system based on computer vision technique
CN110251070B (en) Eye health condition monitoring method and system
CN111339801B (en) Personnel attention detection method, device, equipment and system
CN111597990B (en) RSVP (resource reservation protocol) model-based brain-computer combined target detection method and system
CN109003665A (en) Vision testing method, device, equipment and storage medium based on terminal device
Meyer et al. A single-camera remote eye tracker
CN108304779B (en) Intelligent regulation and control method for student education management
CN112016492A (en) Teaching attention monitoring system and method based on vision
CN113198166A (en) Long jump detection method and detection device
CN105701578A (en) Method for predicting smoke plume front end diffusion path based on electric noses and infrared video cameras
CN111680569B (en) Attendance rate detection method, device, equipment and storage medium based on image analysis
US20220319150A1 (en) Regularity measurement system and method for seat arrangement
CN110986784B (en) Reference coordinate acquisition method and application thereof
CN115205714A (en) Fire point positioning method and device, electronic equipment and storage medium
CN116403085A (en) Multi-pointer instrument identification method and device for transformer substation based on multitasking
CN112556655B (en) Forestry fire prevention monocular positioning method and system
CN110210369B (en) Student attention measuring system based on movable seat
KR20190143742A (en) The Device for improving the study concentration
Chen et al. Kinect-based behavior measurement in group discussion
CN111507555B (en) Human body state detection method, classroom teaching quality evaluation method and related device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant