Children's concentration detecting and analysing system and method based on sight line
Technical field
The invention belongs to eyeball tracking technical field, and in particular to a kind of children's concentration test analysis system based on sight line
System and method.
Background technology
Psychologic research shows that any psychological activity, the emotional reactions of the mankind can cause the change of correspondingly physiological parameter
Change, these physiological parameters due to being arranged by automatic nervous system, automatic nervous system due to commander maincenter hypothalamus without
Cerebral cortex, so general do not controlled by the consciousness of people, but autonomous action, occur that a series of conditions are anti-under environmental stimuli
Penetrate phenomenon.
So-called concentration, is often referred to notice, refers in the long period on psychologic category and notice is still kept collection
In it is a certain activity on ability.Refer to just that the sense organs such as vision, the sense of hearing, tactile can be concentrated on certain by they for children
In one things, the purpose of understanding things is reached.Concentration is the first element of baby development, is also with children's lifelong development ratio
Indispensable important quality.Psychological study shows that absorbed state is very advantageous in children and objective things are made with clear, complete
Judgement, to ensure that intellection is successfully produced and developed.
Test assessment typically for children's concentration can be same by the observation of father and mother, the feedback of teacher, and surrounding
Feedback is drawn, it is also possible to which the survey tested by children's concentration is drawn.For example:U.S.'s Vanderbilt notice
Diagnosis report parent test and appraisal table, the most authoritative notice test and appraisal form of current world wide, directs DSM-IV standards (U.S. god
Through State Diagnosis and statistic handbook).Certain survey is completed by parent, professional assessment is carried out to child attention.
In current children's concentration measuring technology scheme, it is impossible to which objective appraisal goes out the grade of children's concentration, only
The appraisal report drawn by subjective question and answer possesses certain one-sidedness and personal emotion color.Therefore, how one kind is designed
Children's concentration detecting and analysing system of more rationality and low cost just becomes of crucial importance.
The content of the invention
In order to solve the above-mentioned problems in the prior art, the invention provides a kind of children's concentration based on sight line
Detecting and analysing system and method.Including:Children's concentration tests arrangement for reading and children's concentration test result record analysis dress
Put, and children's concentration test arrangement for reading and children's concentration test result record analysis device are in communication with each other connection;
Children's concentration test result record analysis device includes pupil image collector, processor, memory;Wherein,
In initial phase, the pupil image collector collection tested children watch children's concentration test attentively and read
The first pupil image during bright spot in equipment, and it is special using first pupil image and the children by the processor
Bright spot in note power test arrangement for reading carries out the initialization that tested children read sight line track positioning;
In test phase, the second pupil during the pupil image collector collection tested children reading display content is controlled
Image, when calculating tested children's reading according to the view data of second pupil image by the processor, its sight line exists
Position on children's concentration test arrangement for reading, forms tested children and reads sight line track, and the tested children are read
Read sight line track to be contrasted with the order track of the display content of children's concentration test arrangement for reading, ultimately form survey
Examination analyze data.
On the basis of foregoing invention, children's concentration test arrangement for reading includes:Panel computer or electronic reading
Device.
On the basis of foregoing invention, children's concentration test result record analysis device is glasses system, including
Picture frame, temple and it is arranged at the USB interface of the temple end and is arranged at the pupil image of the picture frame middle position and adopt
Storage.
On the basis of foregoing invention, the processor and the memory may be contained within temple near the position of the picture frame
Put place.
The present invention also provides a kind of children's concentration method for testing and analyzing based on sight line, including:
The first pupil image during the bright spot that collection tested children are watched attentively in children's concentration test arrangement for reading;
Tested children are carried out using the bright spot in first pupil image and children's concentration test arrangement for reading
Read the initialization of sight line track positioning;
Collection tested children read content of the children's concentration test arrangement for reading by rule display set in advance
When the second pupil image;
View data according to second pupil image calculates the screen position of children's concentration test arrangement for reading
Coordinate is put, tested children is formed and is read sight line track;
Contrast the tested children and read sight line track with formation testing and analysis data in rule display track set in advance.
On the basis of foregoing invention, the bright spot that tested children are watched attentively in children's concentration test arrangement for reading, including:
Occur M bright spot successively in children's concentration test arrangement for reading screen, and point out tested children to distinguish
Watch the M bright spot attentively successively, the M bright spot is displayed in children's concentration test arrangement for reading screen according to program setting
Various location.
On the basis of foregoing invention, using in first pupil image and children's concentration test arrangement for reading
Bright spot carry out the initialization that tested children read sight line track positioning, including:
Pupil edge information is determined according to first pupil image treatment, and institute is determined according to the pupil edge information
State the pupil center of tested children;
According to the M bright spot relative to the azimuthal coordinates and described in children's concentration test arrangement for reading screen
The azimuthal coordinates of pupil center form corresponding mapping model (X, Y)=F (x, y) to complete the initial of children's reading sight line positioning
Change;Wherein, (X, Y) is the M bright spot relative to the azimuthal coordinates in children's concentration test arrangement for reading screen,
(x, y) is the azimuthal coordinates of the pupil center, and F is mapping function.
On the basis of foregoing invention, pupil edge information is determined according to first pupil image treatment, and according to institute
The pupil center that pupil edge information determines the tested children is stated, including:
Treatment is carried out to first pupil image and forms grey scale change figure;
Initial point is selected in the grey scale change figure, and gray scale change is found along different directions of rays centered on initial point
The maximum point of rate is used as the pupil edge point along current ray direction;
Multiple pupil edge points are fitted to form class elliptic curve;
The intersection point of the major axis and short axle that calculate the class elliptic curve forms the pupil center.
On the basis of foregoing invention, the view data according to second pupil image calculates the test of children's concentration and reads
The screen position coordinate of reading equipment, forms tested children and reads sight line track, including:
The orientation of pupil center of the tested children in second pupil image is determined according to second pupil image
Coordinate;
The current reading sight line of the tested children is calculated in the children according to the mapping model (X, Y)=F (x, y)
The azimuthal coordinates of the screen position of concentration test arrangement for reading;
The screen position coordinate fitting for testing arrangement for reading according to children's concentration is curve movement, you can form tested youngster
Child reads sight line track.
The embodiment of the present invention, records the movement locus that tested children read sight line by way of using Eye-controlling focus, note
The address book stored movement locus and can copy or transmit the movement locus of the reading sight line to tester, which can be carried
Accurate objective assessment children's concentration grade and the low cost product, there is wide market prospects.
Brief description of the drawings
Fig. 1 is a kind of structural representation of children's concentration detecting and analysing system based on sight line provided in an embodiment of the present invention
Figure;
Fig. 2 is that a kind of contour structures of children's concentration test result record analysis device provided in an embodiment of the present invention show
It is intended to;
Fig. 3 is the contour structures of another children's concentration test result record analysis device provided in an embodiment of the present invention
Schematic diagram;
Fig. 4 is that a kind of circuit structure of children's concentration test result record analysis device provided in an embodiment of the present invention shows
It is intended to;
Fig. 5 is the schematic diagram of children's concentration method for testing and analyzing provided in an embodiment of the present invention;
A kind of schematic diagram of sight line localization method that Fig. 6 is provided for present invention implementation.
Specific embodiment
Further detailed description is done to the present invention with reference to specific embodiment, but embodiments of the present invention are not limited to
This.
Embodiment one
Fig. 1 is referred to, Fig. 1 is a kind of children's concentration detecting and analysing system based on sight line provided in an embodiment of the present invention
Structural representation.The system 10 includes that children's concentration tests arrangement for reading 11 and children's concentration test result record analysis
Device 13.Children's concentration test arrangement for reading 11 can be panel computer and electronic reader.Wherein, children's concentration
Test arrangement for reading 11 and the cooperation of children's concentration test result record analysis device 13 complete tested children carries out concentration survey
Sight line positioning initialization work before examination.
Fig. 2 is referred to, Fig. 2 is a kind of children's concentration test result record analysis device provided in an embodiment of the present invention
Contour structures schematic diagram, the shape of children's concentration test result record analysis device 13 could be arranged to the shape similar to glasses
Shape, including picture frame 131, temple 133 and the usb 1 34 of the end of temple 133 is arranged at, and the interposition for being arranged at picture frame 131
The pupil image collector 135 put.Wherein it is possible to multiple pupil image collectors 135 are set in the inner side of picture frame 131, herein not
Do any limitation.The outward appearance of shape of glasses is selected to be advantageous in that:When the test of children's concentration is done, wearing spectacles are this common
Device, the intense strain for mitigating children plays larger effect, it is easy to is received by children, smoothly completes test.
It is another children's concentration test result record point provided in an embodiment of the present invention to refer to Fig. 3 and Fig. 4, Fig. 3
The contour structures schematic diagram of analysis apparatus, Fig. 4 is a kind of children's concentration test result record analysis provided in an embodiment of the present invention
The electrical block diagram of device.The circuit composition of children's concentration test result record analysis device 13 includes:Pupillogram
As collector, memory, processor and communication module, preferably LED light is additionally provided with outside.Wherein, pupil image is adopted
Storage, memory, communication module are electrically connected to processor.Communication module preferably uses WIFI module, pupil image collector
It is the image pick-up device for including at least one infrared lamp source.The memory, processor, communication module and indicator lamp may be contained within class glasses
The temple 133 of structure is near at the position of picture frame 131 1331.
Specific operation principle is as follows:
1st, initial phase, after children's concentration test arrangement for reading 11 starts, configures relevant communication parameter, connects automatically
The communication module of children's concentration test result record analysis device is connect, children's concentration test arrangement for reading 11 and children are completed
Concentration test result record analysis device 13 is in communication with each other connection.
Triggering children concentration test arrangement for reading 11 sends the first initialization control command, children's concentration test result
After record analysis device 13 receives the first initialization control command, children's concentration test result record analysis dress is sent to
13 processor is put, the initialization of children's concentration test result record analysis device 13 is completed, starts pupil image collector,
And send the second initialization command to children's concentration test arrangement for reading 11.Children's concentration test arrangement for reading 11 is received
To after the second initialization command, occur M bright spot successively in the screen of children's concentration test arrangement for reading 11, and point out
Tested children watch the M bright spot attentively successively respectively.Wherein when tested children watch a certain bright spot attentively, pupil image collector shoots
First pupil image, and first pupil image is sent to processor, synchronously obtained according in initialization program by processor
Determine that tested children read the parameter of sight line locus model to the bright spot positional information in children's concentration test arrangement for reading 11.
Assuming that the current center coordinate of eye pupil of tested children is (x, y), the coordinate of the bright spot position in screen is (X, Y), then set up correspondence
Mapping model is:(X, Y)=F (x, y).
2nd, test phase, after the completion of initialization, be stored in for children's sight line locus model (X, Y)=F (x, y) by processor
In memory, and response is sent to children's concentration test arrangement for reading 11 by communication module, the test of children's concentration is read
Equipment 11 points out tester after receiving response.After tester receives prompting, click on and start children's concentration test arrangement for reading 11
In test function enter test phase.
Specifically, the test function in children's concentration test arrangement for reading 11 is the display of reading content, is tested and reads
Content shows that test tested children start to read display content, and locate in the screen of children's concentration test arrangement for reading
Reason device control pupil image collector gathers second pupil image of tested children, by the view data of second pupil image
Synchronous transfer is to processor so that the processor is processed.Processor is passed through using the view data of the second pupil image
Mapping model (X, Y)=F (x, y), calculates coordinate (X, Y), and the as current sight line of the children is incident upon the survey of children's concentration
Try the position coordinates on the screen of arrangement for reading.Processor is fitted screen position coordinate by related algorithm, forms tested children
Sight line track is read, and is stored in memory.The storage format of tested children's sight line track can for JPE, BMP, GIF,
PNG etc., and can be derived by communication module or USB interface.
It is pointed out that the tested children for being formed read sight line track with display in children's concentration test arrangement for reading
The track difference of content must not exceed default threshold value, then it is assumed that the concentration of tested children is preferable.Wherein, tested children read
Sight line track is the real-time track of the children, and the track of display content is also real-time track.According to above two real-time track
Degree of agreement, evaluates the attention children.
The present embodiment, sight line track is read by obtaining tested children using Eye Tracking Technique, and by the tested children
Read sight line track and save as picture format, compare with the word track in tested reading content, assess children and be absorbed in
The grade of power.
Embodiment two
Fig. 5 is referred to, Fig. 5 is the schematic diagram of children's concentration method for testing and analyzing provided in an embodiment of the present invention.This hair
Bright children's concentration method for testing and analyzing comprises the following steps:
Step 1, control pupil image collector collection tested children watch bright in children's concentration test arrangement for reading attentively
The first pupil image during point;
Step 2, tested in arrangement for reading using first pupil image and children's concentration by processor
Bright spot carries out the initialization that tested children read sight line track positioning;
Step 3, children's concentration test arrangement for reading is read using pupil image collector collection tested children press
The second pupil image during the content of rule display set in advance;
Step 4, the test of children concentration is calculated according to the view data of second pupil image by the processor read
The screen position coordinate of reading equipment, forms tested children and reads sight line track.
Specifically, step 1 can include:
Start the function of initializing in children's concentration test arrangement for reading 11, children's concentration test screen of arrangement for reading 11
Occur M bright spot successively in curtain, and point out tested children to watch the M bright spot attentively successively respectively.Wherein when tested children watch attentively
During a certain bright spot, pupil image collector shoots the first pupil image.
Step 2 can include:
Step 21, pupil edge information is determined according to first pupil image treatment by the processor, and according to institute
State the pupil center that pupil edge information determines the tested children;
Step 22, according to the M bright spot relative to children's concentration test arrangement for reading screen in azimuthal coordinates and
The azimuthal coordinates of the pupil center form corresponding mapping model (X, Y)=F (x, y) to complete children's reading sight line positioning
Initialization;Wherein, (X, Y) is the M bright spot relative to the azimuthal coordinates in children's concentration test arrangement for reading screen,
(x, y) is the azimuthal coordinates of the pupil center, and F is mapping function.
Specifically, selected mapping function can be:
Wherein, reflected by described in the M coordinate of bright spot (X, Y) and corresponding pupil center's point coordinates (x, y) determination
Parameter a, b, c, d, e, f, g, h, k, l, m and n of model are penetrated, to complete the foundation of the mapping model.
For example, M bright spot is X=(X relative to the coordinate record in children's concentration test arrangement for reading screen1,X2,
X3…Xm), Y=(Y1,Y2,Y3…Ym), corresponding center coordinate of eye pupil is x=(x1,x2,x3…xm), y=(y1,y2,y3…ym),
The foundation of model can then use following expression matrix:
F (x, y) represents a kind of relation of x and y, represents mapping relations function F, K and represents pupil center location and screen
Mapping parameters between coordinate.
The model that the present invention sets up is as follows:
The model is expressed as using matrix form:
Then
In this model, when taking M=6, to that should have 6 screen coordinates, pupil accordingly also has 6 correspondence centre coordinates for X, Y,
X=| X1,X2,X3,X4,X5,X6|, Y=| Y1,Y2,Y3,Y4,Y5,Y6|, similarly, x=| x1,x2,x3,x4,x5,x6|, y=| y1,y2,
y3,y4,y5,y6|, then matrix above can be further rewritten as:
A, b, c, d, e, f, g, h, k, l, m and n are obtained by equation group, and then obtains the mapping model.
In addition, step 21 can include:
Step 211, first pupil image is carried out treatment formed grey scale change figure;
Step 212, initial point is selected in the grey scale change figure, and sought along different directions of rays centered on initial point
The maximum point of rate of gray level is looked for as the pupil edge point along current ray direction;
Step 213, multiple pupil edge points are fitted to form class elliptic curve;
The intersection point of step 214, the major axis for calculating the class elliptic curve and short axle forms the pupil center.
Wherein, the selection of initial point position can be in the following way in step 212:
The coordinate (xmin, ymin) of pupil center location is estimated on the amendment infrared image using gray integration method;
Wherein, the formula of xmin and ymin is:
Wherein, min is represented and is taken minimum operation, and sum represents summation operation.
Because most dark at pupil center location, by the above-mentioned method minimized, it is estimated that pupil center is thick
Slightly position, using the position as initial point.
Step 4 can include:
Step 41, determine tested children in second pupil image according to second pupil image by the processor
In in pupil center azimuthal coordinates;
Step 42, the current reading sight line of the tested children is calculated according to the mapping model (X, Y)=F (x, y) exist
The azimuthal coordinates of the screen position of children's concentration test arrangement for reading;
Step 43, by the processor according to children's concentration test arrangement for reading screen position coordinate fitting for motion
Curve, you can form tested children and read sight line track.
The present embodiment, first by tested children watch attentively children's concentration test arrangement for reading in bright spot position coordinates and
The coordinate of corresponding pupil center determines children's reading direction of visual lines, and children's reading sight line is completed after forming specific mapping relations
The initialization of positioning, the movement locus of children's reading sight line is formed secondly by the word content of the screen of positioning arrangement for reading,
Compare with the word track in tested reading content finally by by the movement locus of children's reading sight line, commented for tester
Determine the grade of children's concentration.
Embodiment three
Refer to Fig. 6, a kind of schematic diagram of sight line localization method that Fig. 6 is provided for present invention implementation.The sight line positioning side
Method is that on the basis of above-described embodiment, the sight line localization method for initial phase and test phase is described in detail.
Specifically, the method includes:
Step a, the pupil edge point for extracting tested children;
Step b, pupil center's point that testee is determined according to the pupil edge point;
Step c, the impact point observed according to pupil center's point and tested children determine the direction of visual lines of tested children.
Wherein, step a can include:
Step a1, the acquisition pupil image information;
Step a2, the pupil image information is processed, obtain the pupil image information grey in the direction indicated
The Grad of degree, and position where when the Grad of the gray scale is reached into maximum is defined as the position of pupil edge point.
Specifically, pupil is inside and outside has apparent difference to ultrared reflection.The image of shooting is in pupil region light
Relatively strong, brightness is high;In non-lesser ring of Merkel then dark images, brightness is low.Pupil region gray scale is significantly lower than other regions, in margin location
Place is put, graded is violent.In the image information crossed after treatment, in a specified direction, the gray value of lesser ring of Merkel and non-pupil
The gray value in area has violent change in intersection, and maximum can be also reached in the Grad of intersection, and pupil side is judged accordingly
The position of edge point.
For example, it is gray values of the image f at coordinate (i, j) place to set f (i, j), the partial differential of gray value is:
The then shade of gray of the directionD maximum point is marginal point.
Wherein, step b can include:
Step b1, extract the pupil edge point information and be fitted and form class elliptic curve;
Step b2, the intersection point for calculating the class elliptic curve major axis and short axle, the pupil is defined as by the intersection point
Central point.
Specifically, step b1 can include:
Step b11, any 5 points are chosen from N number of marginal point, carrying out ellipse fitting using least square method forms first
Class elliptic equation;
Step b12, office is carried out by the first kind elliptic equation using stochastical sampling consistency algorithm to N number of marginal point
Interior drawn game exterior point is screened, and statistics obtains M intra-office point and N-M point not in the know;
Alternatively, the point fallen on class ellipse, is considered as point not in the know.Certainly, the present invention is limited not herein.
Step b13, judge intra-office point occupation rateWhether first threshold t1 is less than;If, it is determined that 5 points
It is atypical characteristics point, fitted ellipse is oval atypical characteristics, then re-execute step b11;If not, it is determined that described 5
Point is characteristic feature point, then perform step b14;
Step b14, shape is optimized to the first kind elliptic equation using least square method according to the M intra-office point
Into Equations of The Second Kind elliptic equation, and point not in the know to the N-M passes through Equations of The Second Kind ellipse using stochastical sampling consistency algorithm
Equation carries out the examination of intra-office point drawn game exterior point, and final statistics obtains M1 intra-office point and N-M1 points not in the know;
Step b15, judge intra-office point occupation rateWhether Second Threshold t2 is more than;In this way, then iteration is terminated, it is believed that
The Equations of The Second Kind elliptic equation is Optimality equations;If it is not, then performing step b14.
Above content is to combine specific preferred embodiment further description made for the present invention, it is impossible to assert
Specific implementation of the invention is confined to these explanations.For general technical staff of the technical field of the invention,
On the premise of not departing from present inventive concept, some simple deduction or replace can also be made, should be all considered as belonging to of the invention
Protection domain.