CN113425247B - Eye movement data visualization method, device and equipment - Google Patents
Eye movement data visualization method, device and equipment Download PDFInfo
- Publication number
- CN113425247B CN113425247B CN202110650030.7A CN202110650030A CN113425247B CN 113425247 B CN113425247 B CN 113425247B CN 202110650030 A CN202110650030 A CN 202110650030A CN 113425247 B CN113425247 B CN 113425247B
- Authority
- CN
- China
- Prior art keywords
- eye jump
- eye
- jump
- current
- fixation point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/0016—Operational features thereof
- A61B3/0025—Operational features thereof characterised by electronic signal processing, e.g. eye models
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1103—Detecting eye twinkling
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Pathology (AREA)
- Signal Processing (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Physiology (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides an eye movement data visualization method, device and equipment, wherein when a visualization instruction is received, original eye movement data collected by an eye movement instrument are obtained; when the visualization instruction indicates that the eye jump data are visualized, the fixation time, the eye jump time and the visual direction of each fixation point in the original eye movement data are obtained; representing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the sequence of the fixation time, and representing whether each eye jump is a retrospective eye jump or not by using two triangles based on the eye jump time and the visual direction to obtain a script banner; wherein the retrospective eye jump is an eye jump with a visual direction offset by more than 90 degrees compared with the original visual direction; and taking the script banner image as the visual characteristic corresponding to the visual instruction. The scheme can reduce the complexity of the visual features, thereby improving the analysis efficiency of the visual features.
Description
Technical Field
The invention relates to the technical field of eye movement data analysis, in particular to an eye movement data visualization method, device and equipment.
Background
The eye movement data analysis can acquire thousands of even tens of thousands of original eye movement data through the eye movement instrument, further acquire the visual characteristics of the user based on the original eye movement data, and analyze and acquire user behavior data such as behavior logic and preference of the user using the product. The user behavior data can be used for improving the aspects of interface design, content distribution and the like of the product. Therefore, the eye movement data analysis is widely applied to fields requiring the acquisition of user behavior data, such as user interface analysis, reading habit analysis, and the like.
In specific application, the visual characteristics of the user are acquired based on the original eye movement data, the original eye movement data can be subjected to visualization processing, the visualization result is used as the visual characteristics of the user to be subjected to manual analysis or machine vision analysis, and data such as user behavior data and characteristics of product images watched by the user are acquired. The visualization process may specifically be a rendering of the raw eye movement data as a scan path. Illustratively, as shown in FIG. 1. In the stimulus, namely a query result page of a product image 'Shenzhen to Wuhan ticket' viewed by a user, a circle is used for representing that the user has one fixation at the position, the size of the circle represents the length of the fixation time at the position, the numbers (not shown in the figure) on the circle represent the sequence of the measured fixation, and the connecting line between the circles represents the process that the user has one eye jump between two fixation points. Thus, FIG. 1 is a scan path. Among these, eye jump can be understood as a shift of the user's gaze.
However, the scanning paths obtained by the above visualization processing, that is, the visual features, are often distributed in a messy manner and have poor regularity, which results in higher complexity of the analyzed visual features and low analysis efficiency.
Disclosure of Invention
The embodiment of the invention aims to provide a method, a device and equipment for visualizing eye movement data, so as to achieve the effect of improving the analysis efficiency of visual characteristics of a user. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides an eye movement data visualization method, where the method includes:
when a visualization instruction is received, acquiring original eye movement data acquired by an eye movement instrument;
when the visualization instruction indicates that the eye jump data is visualized, acquiring the fixation time, the eye jump time and the visual direction of each fixation point in the original eye movement data;
representing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the sequence of the fixation time, and representing whether each eye jump is a retrospective eye jump or not by using two triangles based on the eye jump time and the visual direction to obtain a script map; wherein the retrospective eye jump is an eye jump with a visual direction offset by more than 90 degrees compared with the original visual direction;
and taking the script banner image as the visual characteristic corresponding to the visual instruction.
In a second aspect, an embodiment of the present invention provides an eye movement data visualization apparatus, including:
the original data acquisition module is used for acquiring original eye movement data acquired by the eye tracker when a visualization instruction is received;
the characteristic data acquisition module is used for acquiring the fixation time, the eye jump time and the visual direction of each fixation point in the original eye movement data when the visualization instruction shows that the eye jump data is visualized;
the characteristic visualization module is used for representing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the sequence of the fixation time, and representing whether each eye jump is a retrospective eye jump or not by using two triangles based on the eye jump time and the visual direction to obtain a script banner; wherein the retrospective eye jump is an eye jump with a visual direction offset by more than 90 degrees compared with the original visual direction; and taking the script banner picture as the visual characteristic corresponding to the visual instruction.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus; a memory for storing a computer program; and the processor is used for realizing the steps of the method for visualizing the eye movement data provided by the first aspect when the processor executes the program stored in the memory.
The embodiment of the invention has the following beneficial effects:
in the scheme provided by the embodiment of the invention, each fixation point is represented by a circle corresponding to fixation time, the circles are transversely arranged according to the sequence of the fixation time, and whether each eye jump is retrospective based on the eye jump time and the visual direction is represented by two triangles to obtain a script banner; wherein, the retrospective eye jump is an eye jump with a visual direction offset more than 90 degrees compared with the original visual direction; the script banner picture is used as visual characteristics corresponding to the visual instruction. Therefore, the retrospective eye jump is displayed in order by combining the fixation time and the eye jump time with the circle and the triangle under the condition of being separated from the stimulus, so that the problem of complex visual characteristics caused by the eye jump visualization mode based on the stimulus is solved. Therefore, the scheme can reduce the complexity of the visual features, thereby improving the analysis efficiency of the visual features.
Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
FIG. 1 is an exemplary graph of scan paths obtained by visualizing raw eye movement data;
fig. 2 is a flowchart illustrating an eye movement data visualization method according to an embodiment of the present invention;
fig. 3 (a) is an exemplary diagram of a script banner in an eye movement data visualization method according to an embodiment of the present invention;
fig. 3 (b) is a schematic drawing diagram of a script banner in an eye movement data visualization method according to an embodiment of the present invention;
fig. 3 (c) is an exemplary application diagram of a script banner in an eye movement data visualization method according to an embodiment of the present invention;
fig. 4 (a) is an exemplary diagram of a sailboat diagram in an eye movement data visualization method according to another embodiment of the present invention;
fig. 4 (b) is a schematic drawing diagram of a sailboat chart in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 4 (c) is a diagram illustrating an application example of a sailboat diagram in an eye movement data visualization method according to another embodiment of the present invention;
fig. 4 (d) is an application example diagram of a sailboat chart in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 4 (e) is a diagram illustrating an application example of a sailboat diagram in an eye movement data visualization method according to another embodiment of the present invention;
fig. 4 (f) is a diagram illustrating an application example of a sailboat chart in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 5 (a) is an exemplary diagram of a eclipse map in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 5 (b) is a schematic drawing of a eclipse map in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 5 (c) is a diagram illustrating an application example of a halation diagram in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 5 (d) is a diagram illustrating an application example of a halation diagram in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 5 (e) is a diagram illustrating an application example of a halation diagram in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 5 (f) is a diagram illustrating an application example of a halation diagram in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 5 (g) is a diagram illustrating an application example of a eclipse graph in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 5 (h) is a diagram illustrating an application example of a eclipse graph in a method for visualizing eye movement data according to another embodiment of the present invention;
fig. 6 is a schematic structural diagram of an eye movement data visualization apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
In a specific application, the method for visualizing the eye movement data provided by the embodiment of the invention can be applied to electronic equipment. Illustratively, the electronic device may include: desktop computers, portable computers, mobile terminals, wearable devices, internet televisions, and servers, among others.
As shown in fig. 2, an eye movement data visualization method provided by an embodiment of the present invention may include the following steps:
s201, when the visualization instruction is received, original eye movement data collected by the eye movement instrument are obtained.
In particular applications, the manner in which the raw eye movement data collected by the eye tracker is obtained may be varied. For example, raw eye movement data collected by an eye tracker may be input by a user into an electronic device that visualizes the eye movement data; alternatively, the electronics that visualize the eye movement data read the raw eye movement data directly from the eye tracker. In addition, the acquired original eye movement data corresponds to a visualization instruction, and the visualization instruction can indicate information such as identification, acquisition time, and acquisition object of the original eye movement data.
S202, when the visualization instruction indicates that the eye jump data are visualized, the fixation time, the eye jump time and the visual direction of each fixation point in the original eye movement data are obtained.
Wherein the visualization instructions may indicate which eye movement data to visualize. The embodiment of the invention can perform different visualization processing aiming at different eye movement data, and the visualization instruction can show that various eye movement data are visualized. Thus, a plurality of visualization processing results can be obtained, and the richness of the visual features can be improved compared with the visualization of only one kind of eye movement data, thereby improving the accuracy of the analysis based on the visual features.
S203, representing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the sequence of the fixation time, and representing whether each eye jump is a retrospective eye jump or not by using two triangles based on the eye jump time and the visual direction to obtain a script banner.
Wherein the retrospective eye jump is an eye jump with a visual direction offset by more than 90 ° compared to the original visual direction.
Exemplarily, as shown in fig. 3 (a). The circles in the script banner image represent the fixation points, the fixation points are transversely arranged according to the sequence of fixation time, and the size of the circles is determined by the length of the fixation time, so that the circles correspond to the fixation time. Furthermore, script banner diagrams include two types of triangles: a first triangle characterizing that the eye jump is not a retrospective eye jump, and a second triangle characterizing that the eye jump is a retrospective eye jump. For convenience of understanding and reasonable layout, the acquisition mode of the script banner is specifically described in the form of an alternative embodiment.
And S204, taking the script banner as the visual characteristic corresponding to the visual instruction.
The visualization result, such as a script banner image, is used as a visual characteristic corresponding to the visualization instruction, and the visual characteristic can be analyzed subsequently through manual or machine vision, so that user behavior data, characteristics of a product image watched by a user and the like are obtained.
In the scheme provided by the embodiment of the invention, each fixation point is represented by a circle corresponding to fixation time, the circles are transversely arranged according to the sequence of the fixation time, and whether each eye jump is retrospective based on the eye jump time and the visual direction is represented by two triangles to obtain a script banner; wherein, the retrospective eye jump is an eye jump with a visual direction offset more than 90 degrees compared with the original visual direction; and taking the script banner image as the visual characteristic corresponding to the visual instruction. Therefore, the retrospective eye jump is displayed in order by combining the fixation time and the eye jump time with the circle and the triangle under the condition of being separated from the stimulus, so that the problem of complex visual characteristics caused by the eye jump visualization mode based on the stimulus is solved. Therefore, the scheme can reduce the complexity of the visual features, thereby improving the analysis efficiency of the visual features.
In an optional implementation manner, the representing each gaze point by using the circle corresponding to the gaze time, transversely arranging the circles according to the sequence of the gaze time, and representing whether each eye jump is a retrospective eye jump by using two triangles based on the eye jump time to obtain the script map specifically may include the following steps:
for each fixation point, the radius of a circle corresponding to the fixation point is the product of fixation time of the fixation point and a first coefficient, when eye jump exists in the fixation point, the initial position of the eye jump is the circle center position of the fixation point, and the direction of the eye jump is the physical direction of the eye jump; wherein, the circle center position is the product of the sum of the eye jump time of each fixation point and a second coefficient;
transversely arranging circles and eye jumps according to the sequence of the fixation time, and drawing each fixation point as follows to obtain a script banner picture:
if the visual direction of the previous eye jump is horizontal:
making a vertical line in the horizontal direction where the gaze point jumps up one eye from the current gaze point; the vertical line is a solid line;
if the visual direction of the previous eye jump is horizontal to the left, and the current eye jump is located on the left side of the vertical line or is superposed with the vertical line, determining that the current eye jump is not the retrospective eye jump, and drawing a first triangle corresponding to the current eye jump by taking the previous fixation point and the current fixation point as vertexes, and taking the vertical line and a connecting line between the previous fixation point and the current fixation point as sides;
if the visual direction of the previous eye jump is horizontal to the left and the current eye jump is located on the right side of the vertical line, determining that the current eye jump is retrospective eye jump, and drawing a second triangle corresponding to the current eye jump by taking the previous fixation point and the current fixation point as vertexes, and taking the vertical line and a connection line between the previous fixation point and the current fixation point as edges;
if the visual direction of the previous eye jump is horizontal to the right and the current eye jump is located on the left side of the vertical line or is superposed with the vertical line, determining that the current eye jump is a retrospective eye jump, and drawing a second triangle corresponding to the current eye jump;
if the visual direction of the previous eye jump is horizontal to the right and the current eye jump falls on the right side of the vertical line, determining that the current eye jump is not the retrospective eye jump, and drawing a first triangle corresponding to the current eye jump;
if the visual direction of the previous eye jump is not horizontal:
making a vertical line from a straight line where the current fixation point jumps upwards at one glance to form an intersection point, taking the previous fixation point as a circle center, and taking a connecting line between the previous fixation point and the intersection point as a radius to draw an arc line; the vertical line is a dotted line;
if the intersection point falls on the ray extension line of the previous eye jump and falls into the inner side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is the retrospective eye jump, taking the previous fixation point, the current fixation point and the intersection point as vertexes, and taking a connecting line between the previous fixation point and the current fixation point as an edge, and drawing a second triangle corresponding to the current eye jump;
if the intersection point falls on the ray extension line of the previous eye jump and falls on the outer side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is not the retrospective eye jump, taking the previous fixation point, the current fixation point and the intersection point as vertexes, and taking a connecting line between the previous fixation point and the current fixation point as an edge, and drawing a first triangle corresponding to the current eye jump;
if the intersection point falls on the ray reverse extension line of the previous eye jump and falls into the inner side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is not the retrospective eye jump, and drawing a first triangle corresponding to the current eye jump;
and if the intersection point falls on the ray reverse extension line of the previous eye jump and falls on the outer side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is the retrospective eye jump, and drawing a second triangle corresponding to the current eye jump.
Illustratively, as shown in FIG. 3 (b). Circular radius R corresponding to gaze point i = fixation time T of the fixation point fi X a first coefficient k; jumping of the eye S i Starting position of (I) i = circle center position of circle representing point of regard P i = (eye jump time T) s1 + \8230 ++ 8230 ++ eye jump time T si-2 + eye jump time T si-1 ) Second coefficient h. Wherein the eye jump time T s1 Time to eye jump T si-1 To make an eye jump S i Eye jump time of previous eye jump. In a specific application, the perpendicular line may be a unit length. In FIG. 3 (b) the eye jump S is shown i+1 For the current eye jump, eye jump S i For the last jump: last jump S i Is horizontally leftwards and is made into a vertical line F i+1 L i+1 Current eye jump S i+1 Visual direction D of i+1 Falls on the vertical line F i+1 L i+1 Left side, therefore, current eye jump S i+1 Instead of retrospective eye jump, draw a first triangle Δ F i F i+1 L i+1 . In FIG. 3 (b) the eye jump S is shown i For the current eye jump, eye jump S i-1 For the last jump: current point of regard F i Jump one eye upwards S i-1 On the straight line F i-1 C i I.e. last jump S i-1 Visual direction D of i-1 Make the perpendicular line F i C i At the intersection point C i (ii) a With F i-1 As a center F i-1 C i Drawing arc A for radius i . Thus, the point of intersection C i Last eye jump S i-1 On the ray extension of (1) and along the current eye jump S i The ray direction falls into an arc line A i Medial, current eye jump S i Is retrospective eye jump, draw a second triangle Δ F i-1 F i C i . In FIG. 3 (b) the eye jump S is shown i-1 For the current eye jump, eye jump S i-2 (not shown) for the last hop: intersection point C i-1 Last eye jump S i-1 On the ray extension of (1) and along the current eye jump S i-1 The ray direction falls into an arc line A i Outside, therefore, the current eye jump S i-1 Instead of retrospective eye jump, draw a first triangle Δ F i-2 F i-1 C i-1 。
In an optional implementation manner, after the circles and the eyejumps are transversely arranged according to the sequence of the gaze time and each gaze point is drawn as follows to obtain a script banner, the method for visualizing the eye movement data provided by the embodiment of the present invention may further include the following steps:
acquiring the total number of triangles in the script banner and the number of second triangles;
and acquiring the complexity of the user interface according to a rule that the proportion of the second triangles is in direct proportion to the complexity of the user interface corresponding to the original eye movement data based on the total number of the triangles and the number of the second triangles.
Exemplarily, as shown in fig. 3 (c). The interface complexity of 4 independent stimulators arranged from top to bottom on the left side in the figure is from low to high, and the right side of each independent stimulator is corresponding to a script banner diagram. According to the length of the script banner and the occurrence frequency of retrospective eye jumps, namely, the occupation ratio of the second triangles is calculated based on the total number of the triangles and the number of the second triangles, the interface complexity can be determined to be sequentially increased. Moreover, among the 4 independent stimulators, the stimulators a and b with the same order of magnitude and size of the target element have more retrospective eye jumps, so that the stimulators b, i.e. the user interface b, have more interferents than the user interface a, and the complexity of the user interface b is higher than that of the user interface a. Similarly, a script pattern difference between stimulus c and stimulus d is also caused by a difference in the amount of interferents.
In an optional embodiment, when the visualization instruction indicates that the eye movement data are visualized, the fixation time, the eye jump time, the visual direction and the eye jump length of each fixation point in the original eye movement data are obtained;
representing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the sequence of the eye jump time, and vertically and longitudinally distributing the eye jump length on an initial fixation point corresponding to the eye jump length to obtain a sailboat graph; wherein the non-right base angle of each right triangle in the sailboat graph reflects the speed of each eye jump;
and taking the sailing chart as a visual feature corresponding to the visualization instruction.
Exemplarily, as shown in fig. 4 (a). The height of the right-angled triangle in the sailboat graph is the eye jump length, namely the relative eye jump amplitude, the non-right angle base angle reflects the speed of each eye jump, and the size of the circle depends on the length of the fixation time. For ease of understanding and reasonable layout, the following description of the sailboat drawings is provided in the form of an alternative embodiment.
In an optional embodiment, the characterizing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the order of eye jump times, and vertically and longitudinally distributing the eye jump length on the initial fixation point corresponding to the eye jump length to obtain the sailboat graph specifically includes the following steps:
for each fixation point, the radius of a circle corresponding to the fixation point is the product of fixation time of the fixation point and a first coefficient, when eye jump exists in the fixation point, the initial position of the eye jump is the circle center position of the fixation point, and the direction of the eye jump is the physical direction of the eye jump; wherein, the circle center position is the product of the sum of the eye jump time of each fixation point and a second coefficient;
transversely arranging circles and eye jumps according to the sequence of the eye jump time, and drawing each fixation point as follows to obtain a sailboat graph:
and vertically drawing a right-angle side of the eye jump length of the eye jump starting from the current fixation point on the current fixation point, and drawing a right-angle triangle by taking the current fixation point and the next fixation point as end points and the right-angle side and a connecting line between the current fixation point and the next fixation point as sides.
Exemplarily, as shown in fig. 4 (b). Radius of fixation point R i = fixation time T fi X the first coefficient k. Starting position of eye jump I i = center position P of gaze point i = (eye jump time T) s1 + \8230 +\ 8230 ++ eye jump time T si-2 + eye jump time T si-1 ) X a second coefficient h. Alpha is alpha i Is the non-right base angle of the right triangle in the sailboat diagram. Relative eye jump distance D i = degree of eye movement a si X a third coefficient d. Eye movement speed of current eye jump = eye jump relative distance D i Eye jump time T divided between current eye jumps si ＝tg(α i )。
In an optional implementation manner, after the circles and the eye jumps are transversely arranged according to the order of the eye jump time, and each fixation point is drawn as follows to obtain the sailboat graph, the eye movement data visualization method provided by the embodiment of the present invention may further include the following steps:
obtaining the tangent value of the opposite angle of the right-angle side of the right-angle triangle; the tangent value is the eye movement speed of the right triangle corresponding to the eye jump;
based on the tangent value, acquiring the visual sensitivity of the user according to a rule that the visual load of the user is larger when the eye movement speed is larger;
acquiring the total number of right-angled triangles in the sailboat graph and the height of the right-angled triangles;
and acquiring a user search strategy for the user interface according to a rule that the number of sailing ships is in direct proportion to the complexity of the user interface corresponding to the original eye movement data and the height of the sailing ships is in direct proportion to the visual angle span of the user based on the total number of the right triangles and the height of the right triangles.
Wherein the tangent value of the opposite angle of the right-angle side of the right-angle triangle is tg (alpha) i ). Exemplarily, as shown in fig. 4 (c), fig. 4 (d), fig. 4 (e) and fig. 4 (f). Two groups of stimuli, wherein stimulus a of fig. 4 (c) and stimulus b of fig. 4 (d) are one group, stimulus c of fig. 4 (e) and stimulus d of fig. 4 (f) are one group, and the same group of stimuli have the same target order of magnitude. From the fact that the "number of sails" in the sailboat diagrams for stimulus a and stimulus b is much smaller than the "number of sailboats" in the sailboat diagrams for stimulus c and stimulus d, it can be determined that stimulus a and stimulus b have a target order of magnitude smaller than stimulus c and stimulus d, the higher the target order of magnitude, the more complex the user interface. Wherein, the number of sailing ships is the total number of the right-angle triangles in the sailing ship diagram. Moreover, the "sailing boat height" of the stimulus a is higher than that of the stimulus b, the "sailing boat height" of the stimulus c is higher than that of the stimulus d, and the tangential angles of the stimulus a and the stimulus c are also larger than those of the stimulus b and the stimulus d, so that the search strategy of the user in the stimulus b and the stimulus d, namely the reading habit is a careful visual small step search mode, and the search strategy of the user in the stimulus a and the stimulus c is a comparatively bold visual sweep mode, can be determined. Thus, stimulus a has a larger target element than stimulus b, and stimulus c has a larger target element than stimulus d, as the left stimulus exhibits. Thus, the eye velocity visualization graphic "sailboat" is effective in determining the number of user interface elements and the size of the interface elements.
In an alternative embodiment, when the visualization instructions indicate that the eye jump data is visualized, the pupil diameters in the original eye movement data are obtained, as well as a timestamp for each pupil diameter;
acquiring the occurrence frequency of pupil diameters with the same diameter based on the timestamp of each pupil diameter, and taking the pupil diameters with the same diameter as the pupil diameters of the same kind;
drawing a plurality of concentric rings with different transparencies by taking the preset width as the ring width and taking the diameter of each type of pupils as the ring diameter to obtain a halation map; wherein one ring represents a pupil diameter and the transparency of the ring represents the frequency of occurrence of the pupil diameter;
and taking the eclipse graph as a visual feature corresponding to the visualization instruction.
In a specific application, the occurrence frequency of pupil diameters with the same diameter is acquired based on the timestamp of each pupil diameter, and the pupil diameters with the same diameter are taken as the pupil diameters of the same kind, which may be various. For example, pupil diameters with the same diameter may be used as the same type of pupil diameter to obtain multiple types of pupil diameters, and the number of pupil diameters at each timestamp in each type of pupil diameter is counted as the occurrence frequency of the type of pupil diameter. Or, for example, for each diameter length, comparing whether the pupil diameter of each time stamp is equal to the diameter length, and adding 1 to the occurrence frequency of the diameter length when the pupil diameter is equal to the diameter length until the comparison between the pupil diameters of all time stamps and the diameter length is completed to obtain the occurrence frequency of the pupil diameter of the diameter length.
Exemplarily, as shown in fig. 5 (a). Reference opacity X%, the maximum value F of each frequency of appearance of the pupil diameter is selected max So that the opacity alpha of each ring k ＝X％+(1-X％)*(F k /F max ). Width W of each ring k ＝[L k -L (k-1) ]/2,L k Represents the length of the k-th pupil diameter, and the diameters are arranged in ascending order from 1 to k. Because of L k -L (k-1) Is a constant value, so that the width W of each ring k Also constant, so that a halo map design is presented as shown in fig. 5 (a). After the pupil diameters of different diameters are arranged in the form of concentric circles, a complete halation diagram as shown in fig. 5 (b) can be obtained. The structure of the halation diagram is divided into two parts, namely a pupil fluctuation curve changing along with time and a pupil frequency distribution ring. The outermost edge of the ring corresponds to the maximum value of the pupil, the innermost edge of the ring corresponds to the minimum value of the pupil, the color saturation in the ring corresponds to the frequency of the appearance of the corresponding pupil diameter, the deepest part of the color represents the maximum frequency, and the average value of the pupil data is also likely to be distributed in the deepest part of the color. The eclipse graph has the advantages that the fluctuation condition of the pupil is displayed together with the distribution condition of the pupil data, and the display form is very intuitive.
In an optional implementation manner, after the halo map is used as the visual feature corresponding to the visualization instruction, the method for visualizing the eye movement data according to the embodiment of the present invention may further include the following steps:
acquiring the distribution positions of target rings with transparency smaller than a transparency threshold in the halation image;
based on the distribution position, acquiring the interference element condition of the user interface according to a rule that the closer the target circular ring is to the outer edge of the vignetting diagram, the less interference elements are in the user interface corresponding to the original eye movement data.
Illustratively, as shown in fig. 5 (c) -5 (h). Fig. 5 (c) -5 (h) show six classes of stimuli: the common property of the halation patterns of the stimuli a to f is that the darker the portion of the halation pattern is closer to the outer edge, the fewer the elements on the interface, and the smaller the target element. After the order of magnitude of an interface target object and the interference condition are determined, if the target object is the same and the interference condition is also the same, the darker color of a halation image is closer to the outer edge, and the smaller the elements in the interface are; when the target is the same and the target size is the same, the interference in the interface is more as the dark color of the vignetting diagram is closer to the inner side.
Corresponding to the method embodiment, the embodiment of the invention also provides an eye movement data visualization device.
As shown in fig. 6, an embodiment of the present invention provides a structure of an eye movement data visualization apparatus, where the apparatus may include:
the original data acquisition module 601 is used for acquiring original eye movement data acquired by an eye tracker when a visualization instruction is received;
the characteristic data obtaining module 602 is configured to obtain a fixation time, an eye jump time, and a visual direction of each fixation point in the original eye movement data when the visualization instruction indicates that the eye jump data is visualized;
a feature visualization module 603, configured to represent each fixation point by using a circle corresponding to the fixation time, transversely arrange the circles according to the sequence of the fixation time, and represent whether each eye jump is a retrospective eye jump by using two triangles based on the eye jump time and the visual direction, so as to obtain a script banner image; wherein the retrospective eye jump is an eye jump with a visual direction offset of more than 90 ° compared to the original visual direction; and taking the script banner picture as the visual characteristic corresponding to the visual instruction.
In the scheme provided by the embodiment of the invention, each fixation point is represented by a circle corresponding to fixation time, the circles are transversely arranged according to the sequence of the fixation time, and whether each eye jump is a retrospective eye jump is represented by two triangles based on the eye jump time and the visual direction to obtain a script banner; wherein, the retrospective eye jump is an eye jump with a visual direction offset more than 90 degrees compared with the original visual direction; the script banner picture is used as visual characteristics corresponding to the visual instruction. Therefore, the retrospective eye jump is displayed in order by combining the fixation time and the eye jump time with the circle and the triangle under the condition of being separated from the stimulus, so that the problem of complex visual characteristics caused by the eye jump visualization mode based on the stimulus is solved. Therefore, the scheme can reduce the complexity of the visual features, thereby improving the analysis efficiency of the visual features.
An embodiment of the present invention further provides an electronic device, as shown in fig. 7, including a processor 701, a communication interface 702, a memory 703 and a communication bus 704, where the processor 701, the communication interface 702, and the memory 703 complete mutual communication through the communication bus 704,
a memory 703 for storing a computer program;
the processor 701 is configured to implement the following steps when executing the program stored in the memory 703:
when a visualization instruction is received, acquiring original eye movement data acquired by an eye movement instrument;
when the visualization instruction indicates that the eye jump data is visualized, acquiring the fixation time, the eye jump time and the visual direction of each fixation point in the original eye movement data;
representing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the sequence of the fixation time, and representing whether each eye jump is a retrospective eye jump or not by using two triangles based on the eye jump time and the visual direction to obtain a script banner; wherein the retrospective eye jump is an eye jump with a visual direction offset by more than 90 degrees compared with the original visual direction;
and taking the script banner image as the visual characteristic corresponding to the visual instruction.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In a further embodiment of the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, which, when being executed by a processor, implements the steps of any of the above-mentioned eye movement data visualization methods.
In a further embodiment provided by the present invention, there is also provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform any of the eye movement data visualization methods of the embodiments described above.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on differences from other embodiments. In particular, for the apparatus and device embodiments, the description is relatively simple, as it is substantially similar to the method embodiments, and reference may be made to some of the description of the method embodiments for relevant points.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (9)
1. A method for visualizing ocular motility data, the method comprising:
when a visualization instruction is received, acquiring original eye movement data acquired by an eye movement instrument;
when the visualization instruction indicates that the eye jump data is visualized, acquiring the fixation time, the eye jump time and the visual direction of each fixation point in the original eye movement data;
each fixation point is represented by a circle corresponding to the fixation time, the circles are transversely arranged according to the sequence of the fixation time, and whether each eye jump is a retrospective eye jump is represented by two triangles based on the eye jump time and the visual direction, so that a script banner picture is obtained, wherein the script banner picture comprises the following steps:
aiming at each fixation point, the radius of a circle corresponding to the fixation point is the product of fixation time of the fixation point and a first coefficient, when eye jump exists in the fixation point, the initial position of the eye jump is the circle center position of the fixation point, and the direction of the eye jump is the physical direction of the eye jump; wherein the center of the circle is the product of the sum of the eye jump time of each fixation point and a second coefficient;
transversely arranging the circles and the eye jumps according to the sequence of the fixation time, and drawing each fixation point as follows to obtain the script banner picture:
if the visual direction of the previous eye jump is horizontal:
making a vertical line from the current fixation point to the horizontal direction of the previous jump; the vertical line is a solid line;
if the visual direction of the previous eye jump is horizontal to the left, and the current eye jump is located on the left side of the vertical line or is overlapped with the vertical line, determining that the current eye jump is not a retrospective eye jump, and drawing a first triangle corresponding to the current eye jump by taking the vertical line and a connecting line between the previous fixation point and the current fixation point as edges and taking the previous fixation point and the current fixation point as vertexes;
if the visual direction of the previous eye jump is horizontal to the left and the current eye jump is located on the right side of the vertical line, determining that the current eye jump is retrospective eye jump, and drawing a second triangle corresponding to the current eye jump by taking the vertical line and a connecting line between the previous fixation point and the current fixation point as sides and taking the previous fixation point and the current fixation point as vertexes;
if the visual direction of the previous eye jump is horizontal to the right, and the current eye jump is located on the left side of the vertical line or is overlapped with the vertical line, determining that the current eye jump is a retrospective eye jump, and drawing a second triangle corresponding to the current eye jump;
if the visual direction of the previous eye jump is horizontal to the right and the current eye jump is located on the right side of the vertical line, determining that the current eye jump is not a retrospective eye jump, and drawing a first triangle corresponding to the current eye jump;
if the visual direction of the previous eye jump is not horizontal:
making a perpendicular line from the current fixation point to the straight line where the previous jump is located to form an intersection point, taking the previous fixation point as a circle center, and drawing an arc line by taking a connecting line between the previous fixation point and the intersection point as a radius; the vertical line is a dotted line;
if the intersection point falls on the ray extension line of the previous eye jump and falls into the inner side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is retrospective eye jump, and drawing a second triangle corresponding to the current eye jump by taking a connecting line between the previous fixation point and the current fixation point as an edge and taking an upper fixation point, the current fixation point and the intersection point as vertexes;
if the intersection point falls on the ray extension line of the previous eye jump and falls on the outer side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is not the retrospective eye jump, and drawing a first triangle corresponding to the current eye jump by taking the previous fixation point, the current fixation point and the intersection point as vertexes and taking a connecting line between the previous fixation point and the current fixation point as an edge;
if the intersection point falls on the ray reverse extension line of the previous eye jump and falls into the inner side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is not a retrospective eye jump, and drawing a first triangle corresponding to the current eye jump;
if the intersection point falls on the ray reverse extension line of the previous eye jump and falls on the outer side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is a retrospective eye jump, and drawing a second triangle corresponding to the current eye jump; wherein the retrospective eye jump is an eye jump with a visual direction offset by more than 90 degrees compared with the original visual direction;
and taking the script banner image as the visual characteristic corresponding to the visual instruction.
2. The method of claim 1, wherein after said arranging said circle and said eye jump horizontally in chronological order of gaze time and rendering each gaze point as follows to obtain said script tag map, said method further comprises:
acquiring the total number of triangles in the script banner picture and the number of second triangles;
and acquiring the complexity of the user interface according to a rule that the proportion of the second triangles is in direct proportion to the complexity of the user interface corresponding to the original eye movement data based on the total number of the triangles and the number of the second triangles.
3. The method according to claim 1, characterized in that when the visualization instruction indicates to visualize the eye movement data, the gaze time, the eye jump time, the visual direction and the eye jump length of each gaze point in the original eye movement data are obtained;
representing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the sequence of the eye jump time, and vertically and longitudinally distributing the eye jump length on an initial fixation point corresponding to the eye jump length to obtain a sailboat graph; wherein the non-right base angle of each right triangle in the sailboat plot reflects the speed of each eye jump;
and taking the sailboat graph as a visual feature corresponding to the visualization instruction.
4. The method according to claim 3, wherein the characterizing each fixation point by a circle corresponding to the fixation time, arranging the circles horizontally according to the sequence of eye jump time, and vertically distributing the eye jump length vertically and longitudinally on the initial fixation point corresponding to the eye jump length to obtain the sailboat graph comprises:
aiming at each fixation point, the radius of a circle corresponding to the fixation point is the product of fixation time of the fixation point and a first coefficient, when eye jump exists in the fixation point, the initial position of the eye jump is the circle center position of the fixation point, and the direction of the eye jump is the physical direction of the eye jump; wherein the center of the circle is the product of the sum of the eye jump time of each fixation point and a second coefficient;
transversely arranging the circles and the eye jumps according to the sequence of the eye jump time, and drawing each fixation point as follows to obtain the sailboat graph:
and vertically drawing a right-angle side of the eye jump length of the eye jump starting from the current fixation point on the current fixation point, and drawing a right-angle triangle by taking the current fixation point and the next fixation point as end points and the right-angle side and a connecting line between the current fixation point and the next fixation point as sides.
5. The method of claim 4, wherein after the circle and the eye jump are arranged transversely in the order of the eye jump time, and each fixation point is rendered as follows to obtain the sailboat graph, the method further comprises:
obtaining the tangent value of the opposite angle of the right-angle side of the right-angle triangle; the tangent value is the eye movement speed of the right triangle corresponding to the eye jump;
based on the tangent value, acquiring the visual sensitivity of the user according to a rule that the visual load of the user is larger when the eye movement speed is larger;
acquiring the total number of right-angled triangles in the sailboat graph and the height of the right-angled triangles;
and acquiring a user search strategy for the user interface based on the total number of the right triangles and the height of the right triangles according to a rule that the number of sailing boats is in direct proportion to the complexity of the user interface corresponding to the original eye movement data, and the height of the sailing boats is in direct proportion to the visual angle span of the user.
6. The method of claim 1, wherein when the visualization instructions indicate to visualize eye jump data, pupil diameters in the raw eye movement data are obtained, along with a timestamp for each pupil diameter;
acquiring the occurrence frequency of the pupil diameters with the same diameter based on the timestamp of each pupil diameter, and taking the pupil diameters with the same diameter as the pupil diameters of the same kind
Drawing a plurality of concentric rings with different transparencies by taking the preset width as the ring width and taking the diameter of each type of pupil as the ring diameter to obtain a halation diagram; wherein, a ring represents a pupil diameter, and the transparency of the ring represents the frequency of occurrence of the pupil diameter;
and taking the eclipse graph as a visual feature corresponding to the visualization instruction.
7. The method of claim 6, wherein after the determining the vignetting map as the visual feature corresponding to the visualization instruction, the method further comprises:
acquiring the distribution positions of target rings with transparency smaller than a transparency threshold in the halation image;
based on the distribution position, acquiring the interference element condition of the user interface according to a rule that the closer the target ring is to the outer edge of the halation diagram, the less interference elements are in the user interface corresponding to the original eye movement data.
8. An ocular motility data visualization device, characterized in that said device comprises:
the original data acquisition module is used for acquiring original eye movement data acquired by the eye tracker when a visualization instruction is received;
the characteristic data acquisition module is used for acquiring the fixation time, eye jump time and visual direction of each fixation point in the original eye movement data when the visualization instruction shows that the eye jump data is visualized;
the characteristic visualization module is used for representing each fixation point by using a circle corresponding to the fixation time, transversely arranging the circles according to the sequence of the fixation time, and representing whether each eye jump is a retrospective eye jump or not by using two triangles based on the eye jump time and the visual direction to obtain a script banner; wherein the retrospective eye jump is an eye jump with a visual direction offset by more than 90 degrees compared with the original visual direction; taking the script banner picture as a visual characteristic corresponding to the visual instruction;
wherein the feature visualization module is specifically configured to: aiming at each fixation point, the radius of a circle corresponding to the fixation point is the product of fixation time of the fixation point and a first coefficient, when eye jump exists in the fixation point, the initial position of the eye jump is the circle center position of the fixation point, and the direction of the eye jump is the physical direction of the eye jump; wherein the center of the circle is the product of the sum of the eye jump time of each fixation point and a second coefficient;
transversely arranging the circles and the eye jumps according to the sequence of the fixation time, and drawing each fixation point as follows to obtain the script banner diagram:
if the visual direction of the previous eye jump is horizontal:
making a vertical line from the current fixation point to the horizontal direction of the previous jump; the vertical line is a solid line;
if the visual direction of the previous eye jump is horizontal to the left, and the current eye jump is located on the left side of the vertical line or is overlapped with the vertical line, determining that the current eye jump is not a retrospective eye jump, and drawing a first triangle corresponding to the current eye jump by taking the vertical line and a connecting line between the previous fixation point and the current fixation point as edges and taking the previous fixation point and the current fixation point as vertexes;
if the visual direction of the previous eye jump is horizontal to the left and the current eye jump is located on the right side of the vertical line, determining that the current eye jump is retrospective eye jump, and drawing a second triangle corresponding to the current eye jump by taking the vertical line and a connecting line between the previous fixation point and the current fixation point as sides and taking the previous fixation point and the current fixation point as vertexes;
if the visual direction of the previous eye jump is horizontal to the right, and the current eye jump is located on the left side of the vertical line or is overlapped with the vertical line, determining that the current eye jump is a retrospective eye jump, and drawing a second triangle corresponding to the current eye jump;
if the visual direction of the previous eye jump is horizontal to the right and the current eye jump is located on the right side of the vertical line, determining that the current eye jump is not a retrospective eye jump, and drawing a first triangle corresponding to the current eye jump;
if the visual direction of the last eye jump is not horizontal:
making a vertical line from the current fixation point to the straight line where the previous eye jump is located to form an intersection point, taking the previous fixation point as a circle center, and drawing an arc line by taking a connecting line between the previous fixation point and the intersection point as a radius; the vertical line is a dotted line;
if the intersection point falls on the ray extension line of the previous eye jump and falls into the inner side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is retrospective eye jump, and drawing a second triangle corresponding to the current eye jump by taking a connecting line between the previous fixation point and the current fixation point as an edge and taking an upper fixation point, the current fixation point and the intersection point as vertexes;
if the intersection point falls on the ray extension line of the previous eye jump and falls on the outer side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is not the retrospective eye jump, and drawing a first triangle corresponding to the current eye jump by taking the previous fixation point, the current fixation point and the intersection point as vertexes and taking a connecting line between the previous fixation point and the current fixation point as an edge;
if the intersection point falls on the ray reverse extension line of the previous eye jump and falls into the inner side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is not the retrospective eye jump, and drawing a first triangle corresponding to the current eye jump;
and if the intersection point falls on the ray reverse extension line of the previous eye jump and falls on the outer side of the arc line along the ray direction of the current eye jump, determining that the current eye jump is a retrospective eye jump, and drawing a second triangle corresponding to the current eye jump.
9. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any one of claims 1 to 7 when executing a program stored in a memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110650030.7A CN113425247B (en) | 2021-06-10 | 2021-06-10 | Eye movement data visualization method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110650030.7A CN113425247B (en) | 2021-06-10 | 2021-06-10 | Eye movement data visualization method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113425247A CN113425247A (en) | 2021-09-24 |
| CN113425247B true CN113425247B (en) | 2022-12-23 |
Family
ID=77755609
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110650030.7A Active CN113425247B (en) | 2021-06-10 | 2021-06-10 | Eye movement data visualization method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113425247B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104463216A (en) * | 2014-12-15 | 2015-03-25 | 北京大学 | Eye movement pattern data automatic acquisition method based on computer vision |
| CN106846934A (en) * | 2017-02-09 | 2017-06-13 | 昆山库尔卡人工智能科技有限公司 | A kind of notice for children's early education robot recalls device |
| AU2020102426A4 (en) * | 2018-10-23 | 2020-11-05 | Sdip Holdings Pty Ltd | Collection of blepharometric data via a camera system |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7556377B2 (en) * | 2007-09-28 | 2009-07-07 | International Business Machines Corporation | System and method of detecting eye fixations using adaptive thresholds |
| US8808179B1 (en) * | 2012-08-06 | 2014-08-19 | James Z. Cinberg | Method and associated apparatus for detecting minor traumatic brain injury |
| CN105310703B (en) * | 2014-07-02 | 2018-01-19 | 北京邮电大学 | A kind of method based on user's pupil diameter data acquisition subjective satisfaction |
| CN106959749B (en) * | 2017-02-20 | 2019-11-29 | 浙江工业大学 | A kind of vision attention behavior cooperating type method for visualizing and system based on eye-tracking data |
| KR20200098524A (en) * | 2017-11-13 | 2020-08-20 | 뉴레이블 인크. | Brain-computer interface with adaptation for high speed, accuracy and intuitive user interaction |
| CN112380937B (en) * | 2020-11-04 | 2024-02-13 | 浙江工业大学 | Visual analysis method and system for intelligent classroom teaching driven by eye movement of mobile terminal |
-
2021
- 2021-06-10 CN CN202110650030.7A patent/CN113425247B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104463216A (en) * | 2014-12-15 | 2015-03-25 | 北京大学 | Eye movement pattern data automatic acquisition method based on computer vision |
| CN106846934A (en) * | 2017-02-09 | 2017-06-13 | 昆山库尔卡人工智能科技有限公司 | A kind of notice for children's early education robot recalls device |
| AU2020102426A4 (en) * | 2018-10-23 | 2020-11-05 | Sdip Holdings Pty Ltd | Collection of blepharometric data via a camera system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113425247A (en) | 2021-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10977435B2 (en) | Method, apparatus, and computer-readable medium for visualizing relationships between pairs of columns | |
| CN108399386A (en) | Information extracting method in pie chart and device | |
| US11435289B2 (en) | Optical distortion measuring apparatus and optical distortion measuring method, image processing system, electronic apparatus and display apparatus | |
| CN107885713B (en) | File format conversion method, device, equipment and storage medium | |
| CN113190781B (en) | Page layout method, device, equipment and storage medium | |
| CN107274442A (en) | A kind of image-recognizing method and device | |
| Pilar et al. | Representing flow patterns by using streamlines with glyphs | |
| CN112445693B (en) | Page update detection method, device, equipment and storage medium | |
| CN112990318A (en) | Continuous learning method, device, terminal and storage medium | |
| CN109389110A (en) | A kind of area determination method and device | |
| US10178149B2 (en) | Analysis for framework assessment | |
| Menges et al. | A visualization tool for eye tracking data analysis in the web | |
| CN113425247B (en) | Eye movement data visualization method, device and equipment | |
| CN108875901B (en) | Neural network training method and universal object detection method, device and system | |
| CN113191277A (en) | Table image region identification method and system based on entropy check | |
| JP6733984B2 (en) | Image analysis device | |
| US9171387B2 (en) | Data visualization system | |
| CN117252837A (en) | Data processing method and device for wafer test, medium and electronic equipment | |
| CN108280425A (en) | A kind of quick survey light implementation method based on screen following formula optical fingerprint sensor | |
| JP6344024B2 (en) | Read determination device, read determination method, and read determination program | |
| JP7424440B2 (en) | Computer programs, information processing methods and computers | |
| CN107402986B (en) | Visual display method and system for multi-dimensional data | |
| CN114037718A (en) | Early warning rule issuing method and device, electronic equipment and computer program product | |
| CN114359177A (en) | Image display method and device for panel to be detected, electronic equipment and storage medium | |
| CN112017177A (en) | Reference image determining method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |