WO2016033945A1 - Eye movement measurement method and system - Google Patents

Eye movement measurement method and system Download PDF

Info

Publication number
WO2016033945A1
WO2016033945A1 PCT/CN2015/072765 CN2015072765W WO2016033945A1 WO 2016033945 A1 WO2016033945 A1 WO 2016033945A1 CN 2015072765 W CN2015072765 W CN 2015072765W WO 2016033945 A1 WO2016033945 A1 WO 2016033945A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye movement
angle
eye
calculating
movement vector
Prior art date
Application number
PCT/CN2015/072765
Other languages
French (fr)
Chinese (zh)
Inventor
栗觅
吕胜富
王晓东
钟宁
Original Assignee
北京工业大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京工业大学 filed Critical 北京工业大学
Publication of WO2016033945A1 publication Critical patent/WO2016033945A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement

Definitions

  • the invention belongs to the technical field of diagnostic measurement, and in particular relates to a method and a system for measuring eye movement.
  • Saliency map model proposed in the field of computer vision can predict the gaze position when humans observe natural scenes, indicating that the state recognition based on eye movement is feasible.
  • Saliency map theory believes that attentional changes and rapid eye movements are determined by the most prominent local features of the visual, and because of the visual return suppression, attention can be moved from one of the most prominent positions to the next prominent position.
  • the Saliency map provides a control mechanism for dynamically locating eye movements, indicating that different modes exist for eye movements.
  • the eye movement mode is a trajectory diagram of eye movement and is a directed graph.
  • the measurement indicators describing the eye movement characteristics generally include the fixation point position, the fixation time, the number of fixations, the fixation frequency, the eye movement distance, and the like, and the eye movements are described from different angles by measuring the indicators.
  • the quantity index cannot describe the direction of eye movement and the degree of eye movement tilt, and cannot fully describe the eye movement mode.
  • the object of the present invention is to provide a method and a system for measuring eye movements, which measure the eye movement direction and the degree of eye movement tilt in the eye movement mode, and more fully describe the eye movement, and provide a new psychology related to eye movement. Research method.
  • the eye movement slope K i is calculated by calculating the tangent value of the horizontal eye movement angle ⁇ ' j .
  • the calculating the eye movement vector angle ⁇ i according to x i , y i and x i+1 , y i+1 comprises: step S21, calculating the eye movement acute angle ⁇ i by the following formula (1):
  • ⁇ i tan -1 (
  • step S22 the eye movement vector angle ⁇ i is calculated by the following formula (2):
  • the step of, according to the x i, y i and x i + 1, y i + 1 is calculated motion vector eye web of D i comprises: by the following equation (3) calculates the eye vector web D i:
  • horizontal eye angle ⁇ 'j comprises the step of: calculating by the following formula (4) horizontal eye angle ⁇ ' j:
  • a measurement system for eye movement comprising: a position acquisition unit 1 for acquiring position coordinates x i , y i of the current fixation point and the next one during eye movement a position coordinate x i+1 , y i+1 of the fixation point; an eye movement vector calculation unit 2 connected to the position acquisition unit 1 for position coordinates x i , y i and x i+ acquired according to the position acquisition unit 1 , y i+1 calculates an eye movement vector, including an eye movement vector angle ⁇ i and a calculation eye movement vector width D i ; and an eye movement slope calculation unit 3, connected to the position acquisition unit 1 for acquiring according to the position The position coordinates x i , y i and x i+1 , y i+1 acquired by the unit calculate the eye movement gradient, including the eye movement eye movement horizontal eye angle ⁇ ' j and the eye movement slope K i .
  • the eye movement vector calculation unit 2 performs an operation of calculating an eye movement vector angle ⁇ i : calculating an eye movement acute angle ⁇ i by the following formula (1):
  • ⁇ i tan -1 (
  • the eye movement vector angle ⁇ i is calculated by the following formula (2):
  • the eye movement vector calculation unit 2 calculates the eye movement vector width D i by the following formula (3):
  • the eye movement gradient calculating unit 3 performs an operation of calculating a horizontal eye movement angle ⁇ ' j and an eye movement slope K i : calculating a horizontal eye movement angle ⁇ ' j by the following formula (4):
  • the system further includes an eye movement pattern recognition unit 4 connected to the eye movement vector calculation unit 2 and the eye movement gradient calculation unit 3 for recognizing the eye movement according to the eye movement vector and the eye movement gradient value. mode.
  • the present invention provides a method and system for measuring eye movements, which are based on a multi-dimensional eye movement mode, by measuring and calculating an eye of a current gaze point to a next fixation point during eye movement.
  • Eye movement indicators such as motion vector angle ⁇ i , eye movement vector amplitude D i , horizontal eye movement angle ⁇ ′ j and/or eye movement slope K i accurately and comprehensively characterize eye movement direction and eye movement inclination in eye movement.
  • the degree makes up for the deficiency of the eye movement index in the prior art for the characterization of the eye movement pattern, enriches and verifies the prior art eye movement index system, and more fully describes the eye movement, providing psychology for eye movement related New research methods.
  • FIG. 1 is a schematic diagram of a multi-dimensional eye movement mode indicator in the prior art
  • FIG. 2 is a schematic flow chart of an eye movement measurement method according to a preferred embodiment of the present invention.
  • FIG. 3 is a schematic view of each eye movement index in the eye movement measurement method of the present invention.
  • FIG. 4 is a view showing an eye movement trajectory of the eye movement measuring method of the present invention in a text reading and a graphic reading mode
  • Figure 5 is a comparison diagram of eye movement indicators in the text reading and picture reading modes shown in Figure 4;
  • FIG. 6 is a comparison diagram of an eye movement index and a prior art eye movement index according to a preferred embodiment of the present invention.
  • Fig. 7 is a view showing the structure of an eye movement measuring system of the present invention.
  • FIG. 1 is a schematic diagram of a multi-dimensional eye movement mode indicator in the prior art.
  • an eye movement index for describing an eye movement feature generally includes a gaze point position, a gaze time, a gaze number, a gaze frequency, an eye movement distance, and the like, only from a dimension of space and a dimension of time.
  • the description of the eye movement but can not describe the direction of the eye movement and the degree of tilt of the eye movement, can not fully describe the movement of the eye.
  • FIG. 2 is a flow chart showing an eye movement measurement method according to a preferred embodiment of the present invention.
  • the eye movement measurement method of this embodiment includes the following steps:
  • step S1 the position coordinates x i , y i of the current fixation point i and the position coordinates x i+1 , y i+1 of the next fixation point i+1 are acquired during the eye movement.
  • step S2 the eye movement vector angle ⁇ i is calculated from x i , y i and x i+1 , y i+1 .
  • step S3 the eye movement vector width D i is calculated according to x i , y i and x i+1 , y i+1 .
  • step S4 the horizontal eye movement angle ⁇ ' j is calculated from x i , y i and x i+1 , y i+1 .
  • steps S2, S3, and S4 are not sequentially required, and the three steps can be freely combined, one of the indicators can be measured, or two or more of the indicators can be measured, and one of the measured ones is measured. Two or more indicators measure and characterize eye movements.
  • the method may further include:
  • step S4 is generally included.
  • the method may further include: generating a multi-dimensional eye movement mode including the position coordinates x i , y i of the current fixation point and the position information of the position coordinates x i+1 , y i+1 of the next fixation point.
  • the eye movement vector angle ⁇ i and the eye movement vector width D i may together constitute a variable describing the eye movement, that is, the eye movement vector, where the eye movement vector refers to the completion of the eye movement from the current position to the next time. Eye movement direction and eye movement step in one position. That is to say, the eye movement vector includes two attributes of the eye movement vector angle ⁇ i and the eye movement vector width D i , and the eye movement vector angle represents the eye movement direction of the eye movement vector, and the variation range of the eye movement vector angle is [0°, 360°];
  • the eye movement vector width represents the eye movement step or eye movement distance of the eye movement vector.
  • an eye movement vector including two attributes of the eye movement vector angle ⁇ i and the eye movement vector width D i may be used as an eye movement index, or an eye movement vector angle ⁇ i and eye movement may be used.
  • the vector image D i serves as two eye movement indicators.
  • step S2 shown in FIG. 2 may further include:
  • step S21 the eye movement acute angle ⁇ i is calculated by the following formula (1):
  • ⁇ i tan -1 (
  • step S22 the eye movement vector angle ⁇ i is calculated by the following formula (2):
  • step S3 shown in FIG. 2 includes:
  • the eye movement vector width D i is calculated by the following formula (3):
  • the horizontal eye movement angle ⁇ ' j and the eye movement slope K i in this embodiment can be used to describe the eye movement inclination of the eye movement, and the eye movement inclination here refers to the degree of eye movement inclination.
  • the eye movement vector angle can only indicate the eye movement direction, but cannot indicate the eye movement inclination.
  • the horizontal eye movement angle from the current fixation point position (i) to the next fixation point position (i+1) is ⁇ ' i
  • the horizontal eye movement angle varies by [0] °, 90°].
  • step S4 shown in FIG. 2 may further be:
  • the horizontal eye movement angle ⁇ ' j is calculated by the following formula (4):
  • the eye movement slope K i has a tangent correlation with the horizontal eye movement angle ⁇ ′ j , that is, the eye movement slope K i is calculated by the following formula:
  • Fig. 3 is a schematic view showing respective eye movement indexes in the eye movement measuring method of the present invention.
  • the movement of the eyeball from the fixation point i to the fixation point i+1 is characterized by measuring the eye movement indexes ⁇ i , D i , ⁇ ′ j , K i .
  • the eye movement vector angle ⁇ i represents the direction of the eye movement
  • the eye movement vector amplitude D i represents the eye movement step.
  • the eye movement vector angle ⁇ i is an acute angle.
  • the eye movement vector angle ⁇ i is an obtuse angle.
  • the eye movement vector angle ⁇ i is greater than 180° and less than 270°; in Fig. 3(d), the eye movement vector angle ⁇ i is greater than 270° and less than 360°. It can be concluded from the definition and example of the eye movement vector angle that the range of the eye movement vector angle ⁇ i is [0°, 360°].
  • Fig. 3(e) is the horizontal eye movement angle ⁇ ' j and the corresponding eye movement slope K i calculated in the case of the same eye movement as the example shown in Fig. 3(a).
  • the eye movement vector angle can represent the eye movement direction, it cannot represent the eye movement inclination, and the horizontal eye movement angle ⁇ ' j and the corresponding eye movement slope K i can be used to describe the eye movement inclination of the eye movement, that is, The degree of eye movement tilt.
  • Figure 3 (f) is the horizontal eye movement angle ⁇ ' j and the corresponding eye movement slope K i calculated in the same eye movement as shown in Figure 3 (b), the horizontal eye movement angle ⁇ ' j is an acute angle;
  • (g) is the horizontal eye movement angle ⁇ ' j calculated in the same eye movement as shown in Fig. 3(c) and the corresponding eye movement slope K i , and the horizontal eye movement angle ⁇ ' j is an acute angle;
  • Fig. 3 (h) The horizontal eye movement angle ⁇ ' j and the corresponding eye movement slope K i calculated in the case of the same eye movement as shown in Fig. 3(d), the horizontal eye movement angle ⁇ ' j is an acute angle. It can be seen that the horizontal eye movement angle ⁇ ' j varies by [0°, 90°].
  • FIG. 4 is a view showing an eye movement trajectory of the eye movement measuring method of the present invention in a text reading and a graphic reading mode, wherein FIG. 4(a) shows an eye movement trajectory diagram when the text is read in the embodiment, FIG. (b) shows an eye movement trajectory diagram when the figure is read in the present embodiment.
  • the eye movement vector angle ⁇ i and the eye movement vector width corresponding to 30 eye movements are calculated.
  • Table 1 shows various eye movement data in the text reading mode shown in Fig. 4(a).
  • the description of the eye movements shown in Fig. 4(a) can be quantified by Table 1.
  • Table 1 shows various eye movement data in the text reading mode shown in Fig. 4(a).
  • the description of the eye movements shown in Fig. 4(a) can be quantified by Table 1.
  • the eye movement vector angle ⁇ i is 5.91°
  • the eye movement vector width D i is 87.46
  • the horizontal eye movement angle ⁇ ′ j is 5.91°
  • the eye movement slope K i is 0.10.
  • the eye movement vector angle ⁇ i and the eye movement vector corresponding to 30 eye movements are calculated.
  • Table 2 shows various eye movement data in the graphic reading mode shown in Fig. 4(b).
  • the description of the eye movements shown in Fig. 4(b) can be quantified by Table 2.
  • Table 2 shows various eye movement data in the graphic reading mode shown in Fig. 4(b).
  • the description of the eye movements shown in Fig. 4(b) can be quantified by Table 2.
  • the eye movement vector angle ⁇ i is 85.26°
  • the eye movement vector width D i is 205.70
  • the horizontal eye movement angle ⁇ ′ j is 85.26°
  • the eye movement slope K i is 12.06.
  • FIG. 5 is a comparison diagram of eye movement indicators in the text reading and picture reading modes shown in FIG. 4, wherein the black bars represent the eye movement indicators ⁇ i , D i , ⁇ ′ j of the text reading shown in FIG. 4( a ).
  • the average value of K i and the white bar indicate the average value of the eye movement indexes ⁇ i , D i , ⁇ ′ j , and K i at the time of text reading shown in FIG. 4( b ).
  • Fig. 5(a) is a comparison diagram of the eye movement vector angle ⁇ i .
  • the average value of the eye movement vector angle when reading text is 135.39°, which is smaller than the average value of the eye movement vector angle when reading the picture.
  • the eye movement vector angle of the eye movement is larger than in the text reading mode.
  • Fig. 5(b) is a comparison diagram of the eye movement vector width D i . As shown in Fig. 5(b), the average value of the eye movement vector when reading the text is 126.21, and the average value of the eye movement vector when reading the picture is 163.32, it can be seen that in the picture reading mode, the eye movement vector of the eye movement is larger than that in the text reading mode.
  • Fig. 5(c) is a comparison diagram of the horizontal eye movement angle ⁇ ' j .
  • the average horizontal eye movement angle when reading the text is 6.04°
  • the average horizontal eye movement angle when reading the picture is shown.
  • the value is 30.52°. It can be seen that in the picture reading mode, the horizontal eye movement angle of the eye movement is larger than that in the text reading mode.
  • Figure 5 (d) is a comparison of the eye movement slope K i , as shown in Figure 5 (d), the average eye movement slope when reading text is 0.41, and the average eye movement slope when reading the picture is 7.22, visible In the picture reading mode, the eye movement slope of the eye movement is larger than in the text reading mode.
  • Text and pictures are two different ways of organizing information, so there are subtle differences in their eye movement patterns. This kind of subtle difference is difficult to use the accurate and comprehensive expression of existing eye movement indicators.
  • the use of the eye movement vector and the eye movement gradient to characterize the direction and the degree of the eye movement inclination can compensate for the insufficiency of the eye movement direction and the eye movement inclination in the eye movement mode in the prior art, thereby further Accurate and comprehensive description of eye movements.
  • Figure 6 is a comparison of eye movement indicators and prior art eye movement indicators in a preferred embodiment of the present invention.
  • the a column indicates the eye movement vector classification correct rate
  • the b column indicates the eye movement slope classification correct rate
  • c indicates the prior art column pupil diameter classification correct rate
  • d indicates the prior art column eye distance classification.
  • the correct rate, e represents the correct rate of column gaze time classification in the prior art
  • f represents the classification correct rate of column gaze times in the prior art.
  • the eye movement mode information of 34 test subjects reading 20 different texts and 20 different pictures is obtained using the eye movement device, and then using the support vector machine based on the present embodiment.
  • the eye movement indicators ⁇ i , D i , ⁇ ' j , K i and the eye movement indicators in the prior art classify the two reading modes of text and picture, and Fig. 6 is drawn based on the classification result.
  • the eye movement index-eye movement vector classification correct rate and the eye movement slope classification correct rate in this embodiment reach 83.27% and 85.32%, respectively, which is significantly higher than the existing eye movement index classification correct rate.
  • the pupil diameter is 70.94%
  • the eye movement distance is 69.54%
  • the fixation time is 57.79%
  • the number of fixations is 64.55%.
  • the measuring method of the eye movement in the present invention can more accurately and accurately represent the eye movement compared with the prior art, and provides more accurate data for subsequent diagnosis.
  • the inventive use of the eye movement vector angle ⁇ i , the eye movement vector amplitude D i , the horizontal eye movement angle ⁇ ′ j , the eye movement slope K i and the like accurately and comprehensively characterizes the eyeball.
  • the eye movement direction and the degree of eye movement tilt in the movement make up for the deficiency of the existing eye movement index for the eye movement pattern, enrich and develop the existing eye movement index system, and describe the eye movement more comprehensively and accurately.
  • Psychomedicine related to eye movement provides new research methods.
  • Fig. 7 is a view showing the structure of an eye movement measuring system of the present invention.
  • the eye movement measurement system of the present invention includes a position acquisition unit 1, an eye movement vector calculation unit 2, and an eye movement gradient calculation unit 3.
  • the position obtaining unit 1 is configured to acquire the position coordinates x i , y i of the current fixation point and the position coordinates x i+1 , y i+1 of the next fixation point during the eye movement, and then send to the eye movement vector calculation unit 2 And eye movement slope calculation unit 3.
  • the position acquisition unit 1 establishes an xy plane coordinate system in the eyeball view plane, so that the position coordinates of the current gaze point of the eyeball can be acquired in real time.
  • the eye movement vector calculation unit 2 is connected to the position acquisition unit 1 for the position coordinates x i , y i of the current fixation point i and the coordinate position x i+1 of the next fixation point i+1 according to the position acquisition unit.
  • y i+1 calculates the eye movement vector, that is, calculates the eye movement vector angle ⁇ i and calculates the eye movement vector width D i , respectively .
  • the operation of calculating the eye movement vector angle ⁇ i and calculating the eye movement vector width D i is consistent with that described in the foregoing method embodiment, that is, the eye movement acute angle ⁇ i is calculated by the following formula (1):
  • ⁇ i tan -1 (
  • the eye movement vector angle ⁇ i is calculated by the following formula (2):
  • the eye movement gradient calculation unit 3 is connected to the position acquisition unit 1 for the position coordinates x i , y i of the current gaze point i of the eyeball acquired according to the position acquisition unit and the coordinate position x i of the next fixation point i+1 +1 , y i+1 calculate the eye movement gradient, including calculating the horizontal eye movement angle ⁇ ' j and the eye movement slope K i , respectively .
  • the operation of calculating the horizontal eye angle ⁇ ' j and the eye movement slope k i is consistent with that described in the foregoing method embodiment, that is,
  • the horizontal eye movement angle ⁇ ' j is calculated by the following formula (4):
  • the eye movement measurement system of the present invention may further include an eye movement pattern recognition unit 4 connected to the eye movement vector calculation unit 2 and the eye movement gradient calculation unit 3 for using the eye movement vector and the eye movement
  • the slope value identifies the eye movement pattern. For example, it is possible to recognize whether the test subject's eyeball is currently in the text reading mode or the graphic reading mode based on the previously acquired eye movement vector angle ⁇ i , the eye movement vector width D i , the horizontal eye movement angle ⁇ ′ j , and the eye movement slope K i .
  • the tester is a normal person or a person with a mental illness.
  • the eye movement of a depressed patient is relatively slow or even demented in response to a visual object (such as a stimulus of a moving figure), and in response to the eye movement vector and the eye movement gradient of the present invention, the corresponding parameter values are compared.
  • a visual object such as a stimulus of a moving figure
  • the corresponding parameter values are compared.
  • Normal people are obviously small.
  • the eye movement of a mental mania patient usually exhibits an irregular eye movement in response to a visual object, that is, the eye is scattered and disordered, and does not exhibit a corresponding eye movement according to the stillness or motion of the visual object, and the reaction is in the present invention.
  • the corresponding parameter values will show obvious disorder than the normal person, that is, the parameters will increase or decrease irregularly.
  • the measuring method and the measuring system of the eye movement of the present invention pass the eye movement index such as the eye movement vector angle ⁇ i , the eye movement vector width D i , the horizontal eye movement angle ⁇ ′ j , the eye movement slope K i , and the like.
  • the measurement accurately and comprehensively characterizes the direction of eye movement and the degree of eye movement in eye movement, which makes up for the deficiency of eye movement index in the prior art, and enriches and proves the existing eye movement index system.
  • a more comprehensive and accurate description of eye movements provides a new research method for psychology related to eye movement.

Abstract

An eye movement measurement method and system; by means of acquiring the current focus point position coordinates x i and y i and the next focus point position coordinates x i+1 and y i+1 during the process of eye movement, said method calculates, on the basis of said coordinate values, the eye movement vector angle θi, the eye movement vector amplitude Di, the horizontal eye movement angle θ'i, and/or the eye movement slope Ki, and can thereby accurately and comprehensively indicate the direction and slope degree of eye movement, thus providing a new research method for psychological medicine associated with eye movement.

Description

一种眼球运动的测量方法和系统Method and system for measuring eye movement 技术领域Technical field
本发明属于诊断测量技术领域,具体涉及一种眼球运动的测量方法和系统。The invention belongs to the technical field of diagnostic measurement, and in particular relates to a method and a system for measuring eye movement.
背景技术Background technique
人类从外部世界获得的信息中有90%以上来自眼睛,心理学家很早就开始通过直接观察眼球运动对心理过程进行研究,认为眼球运动是视觉过程的直接反应,并且反映了多种人类认知活动,受到多种认知因素的影响,如眼球的运动与注意、记忆、推理、阅读等认知心理活动都有密切的关系。More than 90% of the information that humans receive from the outside world comes from the eyes. Psychologists have long studied the psychological process by directly observing eye movements. They believe that eye movement is a direct response of the visual process and reflects a variety of human recognition. Knowledge activities are influenced by a variety of cognitive factors, such as eye movements and cognitive, psychological activities such as attention, memory, reasoning, and reading.
有关阅读中眼动的研究最早可以追溯到19世纪末法国学者Lamare和Jaral以及Heuy的工作。此后,人们试图通过研究眼动中注视点的顺序和眼的跳动来了解阅读背后的认知过程。近20多年,由于心理语言学研究的深入和眼动技术的发展,研究者开始尝试把眼动作为人阅读过程的指示器。The study of eye movements in reading dates back to the work of French scholars Lamare and Jaral and Heuy at the end of the 19th century. Since then, people have tried to understand the cognitive process behind reading by studying the order of gaze points in the eye movements and the beating of the eyes. In the past 20 years, due to the deepening of psycholinguistic research and the development of eye-moving technology, researchers have begun to try to make eye movements an indicator of the human reading process.
人类行为识别是模式识别的一个重要应用,近年来对大脑认知状态的识别问题开展了大量的研究。例如计算机视觉领域所提出的Saliency map(突显地图)模型能够预测人类观察自然场景时的注视位置,说明基于眼动的状态识别具有可行性。Saliency map理论认为注意力的变化和快速眼动是由视觉最突显的局部特征决定的,同时由于视觉返回抑制,注意力可以从一个最突显位置向下一个仅次于它的突显位置移动。Saliency map提供了一种动态定位眼球运动的控制机制,说明对应不同的状态,眼动存在不同的模式。Human behavior recognition is an important application of pattern recognition. In recent years, a lot of research has been done on the recognition of brain cognitive status. For example, the Saliency map model proposed in the field of computer vision can predict the gaze position when humans observe natural scenes, indicating that the state recognition based on eye movement is feasible. Saliency map theory believes that attentional changes and rapid eye movements are determined by the most prominent local features of the visual, and because of the visual return suppression, attention can be moved from one of the most prominent positions to the next prominent position. The Saliency map provides a control mechanism for dynamically locating eye movements, indicating that different modes exist for eye movements.
眼动模式是眼球运动的轨迹图,是一种有向图。现有技术中,描述眼动特征的测量指标一般包括注视点位置、注视时间、注视次数、注视频率、眼动距离等,通过对这些指标的测量从不同角度描述眼球运动。但是,上述测 量指标不能描述眼球运动的方向和眼动倾斜程度,不能全面的描述眼动模式。The eye movement mode is a trajectory diagram of eye movement and is a directed graph. In the prior art, the measurement indicators describing the eye movement characteristics generally include the fixation point position, the fixation time, the number of fixations, the fixation frequency, the eye movement distance, and the like, and the eye movements are described from different angles by measuring the indicators. However, the above test The quantity index cannot describe the direction of eye movement and the degree of eye movement tilt, and cannot fully describe the eye movement mode.
发明内容Summary of the invention
本发明的目的是提供一种眼球运动的测量方法和系统,对眼动模式中眼动方向和眼动倾斜程度进行测量,更全面的描述眼球运动,为与眼球运动相关的心理医学提供了新的研究方法。The object of the present invention is to provide a method and a system for measuring eye movements, which measure the eye movement direction and the degree of eye movement tilt in the eye movement mode, and more fully describe the eye movement, and provide a new psychology related to eye movement. Research method.
根据本发明的一个方面,提供了一种眼球运动的测量方法,所述方法包括:获取眼球运动过程中当前注视点i的位置坐标xi、yi和下一个注视点i+1的位置坐标xi+1、yi+1,其中i=1,…,n,n>1;根据xi、yi和xi+1、yi+1计算眼动矢量角θi;根据xi、yi和xi+1、yi+1计算眼动矢量幅Di;以及根据xi、yi和xi+1、yi+1计算水平眼动角θ′jAccording to an aspect of the present invention, a method for measuring eye movement is provided, the method comprising: acquiring position coordinates x i , y i of a current fixation point i and position coordinates of a next fixation point i+1 during an eye movement x i + 1, y i + 1, where i = 1, ..., n, n>1; according to x i, y i and x i + 1, y i + 1 calculates the eye vector angle θ i; The x i , y i and x i+1 , y i+1 calculate the eye movement vector width D i ; and calculate the horizontal eye movement angle θ′ j according to x i , y i and x i+1 , y i+1 .
其中,通过计算水平眼动角θ′j的正切值来计算眼动斜率KiHere, the eye movement slope K i is calculated by calculating the tangent value of the horizontal eye movement angle θ' j .
优选的,所述根据xi、yi和xi+1、yi+1计算眼动矢量角θi的步骤包括:步骤S21,通过下式(1)计算眼动锐角αiPreferably, the calculating the eye movement vector angle θ i according to x i , y i and x i+1 , y i+1 comprises: step S21, calculating the eye movement acute angle α i by the following formula (1):
αi=tan-1(|(yi+1-yi)/(xi+1-xi)|),xi≠xi+1   (1);α i =tan -1 (|(y i+1 -y i )/(x i+1 -x i )|), x i ≠x i+1 (1);
步骤S22,通过下式(2)计算眼动矢量角θiIn step S22, the eye movement vector angle θ i is calculated by the following formula (2):
Figure PCTCN2015072765-appb-000001
Figure PCTCN2015072765-appb-000001
优选的,所述根据xi、yi和xi+1、yi+1计算眼动矢量幅Di的步骤包括:通过下式(3)计算眼动矢量幅DiPreferably the step of, according to the x i, y i and x i + 1, y i + 1 is calculated motion vector eye web of D i comprises: by the following equation (3) calculates the eye vector web D i:
Figure PCTCN2015072765-appb-000002
Figure PCTCN2015072765-appb-000002
优选的,所述根据xi、yi和xi+1、yi+1计算水平眼动角θ′j的步骤包括:通过下式(4)计算水平眼动角θ′jPreferably, according to the x i, y i and x i + 1, y i + 1 is calculated horizontal eye angle θ 'j comprises the step of: calculating by the following formula (4) horizontal eye angle θ' j:
Figure PCTCN2015072765-appb-000003
Figure PCTCN2015072765-appb-000003
根据本发明的另一方面,提供了一种眼球运动的测量系统,所述系统包括:位置获取单元1,用于在眼球运动过程中获取当前注视点的位置坐标xi、yi和下一个注视点的位置坐标xi+1、yi+1;眼动矢量计算单元2,连接到所述位置获取单元1,用于根据位置获取单元获取的位置坐标xi、yi和xi+1、yi+1计算眼动矢量,包括眼动矢量角θi和计算眼动矢量幅Di;以及眼动斜度计算单元3,连接到所述位置获取单元1,用于根据位置获取单元获取的位置坐标xi、yi和xi+1、yi+1计算眼动斜度,包括眼动眼动水平眼动角θ′j和眼动斜率KiAccording to another aspect of the present invention, there is provided a measurement system for eye movement, the system comprising: a position acquisition unit 1 for acquiring position coordinates x i , y i of the current fixation point and the next one during eye movement a position coordinate x i+1 , y i+1 of the fixation point; an eye movement vector calculation unit 2 connected to the position acquisition unit 1 for position coordinates x i , y i and x i+ acquired according to the position acquisition unit 1 , y i+1 calculates an eye movement vector, including an eye movement vector angle θ i and a calculation eye movement vector width D i ; and an eye movement slope calculation unit 3, connected to the position acquisition unit 1 for acquiring according to the position The position coordinates x i , y i and x i+1 , y i+1 acquired by the unit calculate the eye movement gradient, including the eye movement eye movement horizontal eye angle θ' j and the eye movement slope K i .
优选的,所述眼动矢量计算单元2执行下述操作来计算眼动矢量角θi:通过下式(1)计算眼动锐角αiPreferably, the eye movement vector calculation unit 2 performs an operation of calculating an eye movement vector angle θ i : calculating an eye movement acute angle α i by the following formula (1):
αi=tan-1(|(yi+1-yi)/(xi+1-xi)|),xi≠xi+1   (1);α i =tan -1 (|(y i+1 -y i )/(x i+1 -x i )|), x i ≠x i+1 (1);
通过下式(2)计算眼动矢量角θiThe eye movement vector angle θ i is calculated by the following formula (2):
Figure PCTCN2015072765-appb-000004
Figure PCTCN2015072765-appb-000004
优选的,所述眼动矢量计算单元2通过下式(3)计算眼动矢量幅DiPreferably, the eye movement vector calculation unit 2 calculates the eye movement vector width D i by the following formula (3):
Figure PCTCN2015072765-appb-000005
Figure PCTCN2015072765-appb-000005
优选的,所述眼动斜度计算单元3执行下述操作来计算水平眼动角θ′j和眼动斜率Ki:通过下式(4)计算水平眼动角θ′jPreferably, the eye movement gradient calculating unit 3 performs an operation of calculating a horizontal eye movement angle θ' j and an eye movement slope K i : calculating a horizontal eye movement angle θ' j by the following formula (4):
Figure PCTCN2015072765-appb-000006
Figure PCTCN2015072765-appb-000006
通过式Ki=tanθ′i计算眼动斜率KiBy the formula K i = tanθ 'i calculated eye slope K i.
可选的,所述系统还包括眼动模式识别单元4,连接到所述眼动矢量计算单元2和眼动斜度计算单元3,用于根据眼动矢量和眼动斜度数值识别眼动模式。Optionally, the system further includes an eye movement pattern recognition unit 4 connected to the eye movement vector calculation unit 2 and the eye movement gradient calculation unit 3 for recognizing the eye movement according to the eye movement vector and the eye movement gradient value. mode.
如上所述,本发明提供了一种眼球运动的测量方法和系统,所述方法和系统以多维眼动模式为基础,通过测量并计算得到眼球运动过程中当前注视点到下一个注视点的眼动矢量角θi、眼动矢量幅Di、水平眼动角θ′j和/或眼动斜率Ki等眼动指标,准确、全面的表征了眼球运动中的眼动方向和眼动倾斜程度,弥补了现有技术中的眼动指标对于眼动模式表征的不足,丰富和发证了现有技术的眼动指标体系,更全面的描述眼球运动,为与眼球运动相关的心理医学提供了新的研究方法。As described above, the present invention provides a method and system for measuring eye movements, which are based on a multi-dimensional eye movement mode, by measuring and calculating an eye of a current gaze point to a next fixation point during eye movement. Eye movement indicators such as motion vector angle θ i , eye movement vector amplitude D i , horizontal eye movement angle θ′ j and/or eye movement slope K i accurately and comprehensively characterize eye movement direction and eye movement inclination in eye movement The degree makes up for the deficiency of the eye movement index in the prior art for the characterization of the eye movement pattern, enriches and verifies the prior art eye movement index system, and more fully describes the eye movement, providing psychology for eye movement related New research methods.
附图说明DRAWINGS
图1是现有技术中多维眼动模式指标示意图;1 is a schematic diagram of a multi-dimensional eye movement mode indicator in the prior art;
图2是本发明优选实施例的眼球运动测量方法流程示意图;2 is a schematic flow chart of an eye movement measurement method according to a preferred embodiment of the present invention;
图3是本发明的眼球运动测量方法中各个眼动指标的示意图;3 is a schematic view of each eye movement index in the eye movement measurement method of the present invention;
图4显示了本发明的眼球运动测量方法在文本阅读和图形阅读模式下的眼动轨迹图;4 is a view showing an eye movement trajectory of the eye movement measuring method of the present invention in a text reading and a graphic reading mode;
图5是图4所示的文本阅读和图片阅读模式下的眼动指标对比图;Figure 5 is a comparison diagram of eye movement indicators in the text reading and picture reading modes shown in Figure 4;
图6是本发明优选实施例的眼动指标与现有技术的眼动指标对比图;6 is a comparison diagram of an eye movement index and a prior art eye movement index according to a preferred embodiment of the present invention;
图7显示了本发明的眼球运动测量系统的结构示意图。Fig. 7 is a view showing the structure of an eye movement measuring system of the present invention.
具体实施方法Specific implementation method
为使本发明的目的、技术方案和优点更加清楚明了,下面结合具体实施方式并参照附图,对本发明进一步详细说明。应该理解,这些描述只是示例 性的,而并非要限制本发明的范围。此外,在以下说明中,省略了对公知结构和技术的描述,以避免不必要地混淆本发明的概念。The present invention will be further described in detail below with reference to the specific embodiments thereof and the accompanying drawings. It should be understood that these descriptions are just examples. It is not intended to limit the scope of the invention. In addition, descriptions of well-known structures and techniques are omitted in the following description in order to avoid unnecessarily obscuring the inventive concept.
图1是现有技术中多维眼动模式指标示意图。FIG. 1 is a schematic diagram of a multi-dimensional eye movement mode indicator in the prior art.
如图1所示,现有技术中,用于描述眼动特征的眼动指标一般包括注视点位置、注视时间、注视次数、注视频率、眼动距离等,仅仅从空间的维度和时间的维度对眼球运动进行描述,而不能描述眼球运动的方向和眼动的倾斜程度,不能全面的描述眼球的运动。As shown in FIG. 1 , in the prior art, an eye movement index for describing an eye movement feature generally includes a gaze point position, a gaze time, a gaze number, a gaze frequency, an eye movement distance, and the like, only from a dimension of space and a dimension of time. The description of the eye movement, but can not describe the direction of the eye movement and the degree of tilt of the eye movement, can not fully describe the movement of the eye.
值得提出的是,其中对注视点位置的描述,通常建立二维坐标体系,测量X轴和Y轴的坐标,来描述注视点的位置信息。It is worth mentioning that, in the description of the position of the fixation point, a two-dimensional coordinate system is usually established, and the coordinates of the X-axis and the Y-axis are measured to describe the position information of the fixation point.
图2是本发明优选实施例的眼球运动测量方法流程示意图。2 is a flow chart showing an eye movement measurement method according to a preferred embodiment of the present invention.
如图2所示,本实施例的眼球运动测量方法包括如下步骤:As shown in FIG. 2, the eye movement measurement method of this embodiment includes the following steps:
步骤S1,获取眼球运动过程中当前注视点i的位置坐标xi、yi和下一个注视点i+1的位置坐标xi+1、yi+1In step S1, the position coordinates x i , y i of the current fixation point i and the position coordinates x i+1 , y i+1 of the next fixation point i+1 are acquired during the eye movement.
步骤S2,根据xi、yi和xi+1、yi+1计算眼动矢量角θiIn step S2, the eye movement vector angle θ i is calculated from x i , y i and x i+1 , y i+1 .
步骤S3,根据xi、yi和xi+1、yi+1计算眼动矢量幅DiIn step S3, the eye movement vector width D i is calculated according to x i , y i and x i+1 , y i+1 .
步骤S4,根据xi、yi和xi+1、yi+1计算水平眼动角θ′jIn step S4, the horizontal eye movement angle θ' j is calculated from x i , y i and x i+1 , y i+1 .
其中,所述步骤S2、S3、S4并无顺序要求,且三个步骤可进行自由组合,可测量其中的一个指标,也可测其中的两个或两个以上指标,通过所测量的一个、两个或两个以上的指标对眼球运动进行测量和表征。Wherein, the steps S2, S3, and S4 are not sequentially required, and the three steps can be freely combined, one of the indicators can be measured, or two or more of the indicators can be measured, and one of the measured ones is measured. Two or more indicators measure and characterize eye movements.
可选的,所述方法还可以包括:Optionally, the method may further include:
步骤S5,通过计算水平眼动角θ′j的正切值来计算眼动斜率Ki,即Ki=tanθ′iIn step S5, the eye movement slope K i , i.e., K i =tan θ' i , is calculated by calculating the tangent value of the horizontal eye movement angle θ' j .
当包括步骤S5时,通常包括步骤S4。When step S5 is included, step S4 is generally included.
另外,所述方法还可以包括:生成包含当前注视点的位置坐标xi、yi和下一个注视点的位置坐标xi+1、yi+1的位置信息的多维眼动模式。眼动模式中,眼动轨迹图是由n个注视点位置维度信息组成的有向图,i=1,…,n,n>1。 In addition, the method may further include: generating a multi-dimensional eye movement mode including the position coordinates x i , y i of the current fixation point and the position information of the position coordinates x i+1 , y i+1 of the next fixation point. In the eye movement mode, the eye movement trajectory map is a directed graph composed of n gaze point position dimension information, i=1, . . . , n, n>1.
本实施例中的是眼动矢量角θi和眼动矢量幅Di可以共同构成一个描述眼球运动的变量即眼动矢量,这里的眼动矢量指的是眼球运动完成一次从当前位置到下一个位置的眼动方向和眼动步幅。也就是说,眼动矢量包括眼动矢量角θi和眼动矢量幅Di两个属性,眼动矢量角表示眼动矢量的眼动方向,眼动矢量角的变化范围是[0°,360°];眼动矢量幅表示眼动矢量的眼动步幅或眼动距离。在具体运用的过程中,可以采用包含眼动矢量角θi和眼动矢量幅Di两个属性的眼动矢量作为一个眼动指标,或者,也可以采用眼动矢量角θi和眼动矢量幅Di作为两个眼动指标。In this embodiment, the eye movement vector angle θ i and the eye movement vector width D i may together constitute a variable describing the eye movement, that is, the eye movement vector, where the eye movement vector refers to the completion of the eye movement from the current position to the next time. Eye movement direction and eye movement step in one position. That is to say, the eye movement vector includes two attributes of the eye movement vector angle θ i and the eye movement vector width D i , and the eye movement vector angle represents the eye movement direction of the eye movement vector, and the variation range of the eye movement vector angle is [0°, 360°]; The eye movement vector width represents the eye movement step or eye movement distance of the eye movement vector. In the specific application process, an eye movement vector including two attributes of the eye movement vector angle θ i and the eye movement vector width D i may be used as an eye movement index, or an eye movement vector angle θ i and eye movement may be used. The vector image D i serves as two eye movement indicators.
优选的,图2所示步骤S2,进一步的可以包括:Preferably, step S2 shown in FIG. 2 may further include:
步骤S21,通过下式(1)计算眼动锐角αiIn step S21, the eye movement acute angle α i is calculated by the following formula (1):
αi=tan-1(|(yi+1-yi)/(xi+1-xi)|)xi≠xi+1   (1);α i =tan -1 (|(y i+1 -y i )/(x i+1 -x i )|)x i ≠x i+1 (1);
步骤S22,通过下式(2)计算眼动矢量角θiIn step S22, the eye movement vector angle θ i is calculated by the following formula (2):
Figure PCTCN2015072765-appb-000007
Figure PCTCN2015072765-appb-000007
优选的,图2中所示的步骤S3包括:Preferably, step S3 shown in FIG. 2 includes:
通过下式(3)计算眼动矢量幅DiThe eye movement vector width D i is calculated by the following formula (3):
Figure PCTCN2015072765-appb-000008
Figure PCTCN2015072765-appb-000008
本实施例中的水平眼动角θ′j和眼动斜率Ki都可以用来描述眼球运动的眼动斜度,这里的眼动斜度指的是眼动倾斜程度。眼动矢量角只能表示眼动方向,而不能表示眼动倾斜度,例如,眼动矢量角θi=175°的眼动倾斜度小于眼动矢量角θi=50°的眼动倾斜度,眼动斜度可以弥补这方面的不足。 The horizontal eye movement angle θ' j and the eye movement slope K i in this embodiment can be used to describe the eye movement inclination of the eye movement, and the eye movement inclination here refers to the degree of eye movement inclination. The eye movement vector angle can only indicate the eye movement direction, but cannot indicate the eye movement inclination. For example, the eye movement inclination angle of the eye movement vector angle θ i =175° is smaller than the eye movement inclination angle of the eye movement vector angle θ i =50°. Eye movement slope can make up for this deficiency.
从当前注视点位置(i)到下一个注视点位置(i+1)的水平眼动角为θ′i,眼动斜率为Ki=tanθ′i,水平眼动角的变化范围是[0°,90°]。The horizontal eye movement angle from the current fixation point position (i) to the next fixation point position (i+1) is θ' i , the eye movement slope is K i =tan θ′ i , and the horizontal eye movement angle varies by [0] °, 90°].
优选的,图2所示的步骤S4,进一步可以为:Preferably, step S4 shown in FIG. 2 may further be:
通过下式(4)计算水平眼动角θ′jThe horizontal eye movement angle θ' j is calculated by the following formula (4):
Figure PCTCN2015072765-appb-000009
Figure PCTCN2015072765-appb-000009
眼动斜率Ki的与水平眼动角θ′j具有正切相关关系,即眼动斜率Ki通过下式计算:The eye movement slope K i has a tangent correlation with the horizontal eye movement angle θ′ j , that is, the eye movement slope K i is calculated by the following formula:
Ki=tanθ′iK i = tan θ' i .
图3是本发明的眼球运动测量方法中各个眼动指标的示意图。Fig. 3 is a schematic view showing respective eye movement indexes in the eye movement measuring method of the present invention.
如图3所示,本发明的眼球运动测量方法中,通过测量眼动指标θi、Di、θ′j、Ki来表征眼球从注视点i到注视点i+1的运动。As shown in FIG. 3, in the eye movement measurement method of the present invention, the movement of the eyeball from the fixation point i to the fixation point i+1 is characterized by measuring the eye movement indexes θ i , D i , θ′ j , K i .
如图3(a)所示,从注视点i到注视点i+1的眼球运动过程中,眼动矢量角θi表征了眼动的方向,眼动矢量幅Di表征眼动的步幅,这里的眼动矢量角θi为锐角。As shown in Fig. 3(a), during the eye movement from the fixation point i to the fixation point i+1, the eye movement vector angle θ i represents the direction of the eye movement, and the eye movement vector amplitude D i represents the eye movement step. Here, the eye movement vector angle θ i is an acute angle.
在图3(b)的示例中,眼动矢量角θi为钝角。图3(c)中,眼动矢量角θi大于180°小于270°;图3(d)中,眼动矢量角θi大于270°小于360°。从眼动矢量角的定义和实例中可以得出,眼动矢量角θi的变化范围是[0°,360°]。In the example of Fig. 3(b), the eye movement vector angle θ i is an obtuse angle. In Fig. 3(c), the eye movement vector angle θ i is greater than 180° and less than 270°; in Fig. 3(d), the eye movement vector angle θ i is greater than 270° and less than 360°. It can be concluded from the definition and example of the eye movement vector angle that the range of the eye movement vector angle θ i is [0°, 360°].
参见图3(e),图3(e)为与图3(a)所示示例相同眼球运动情形下所计算的水平眼动角θ′j和相应的眼动斜率Ki。虽然眼动矢量角可以表征眼动方向,但不能表征眼动倾斜度,而水平眼动角θ′j和相应的眼动斜率Ki则都可以用来描述眼球运动的眼动斜度,即眼动倾斜程度。Referring to Fig. 3(e), Fig. 3(e) is the horizontal eye movement angle θ' j and the corresponding eye movement slope K i calculated in the case of the same eye movement as the example shown in Fig. 3(a). Although the eye movement vector angle can represent the eye movement direction, it cannot represent the eye movement inclination, and the horizontal eye movement angle θ' j and the corresponding eye movement slope K i can be used to describe the eye movement inclination of the eye movement, that is, The degree of eye movement tilt.
图3(f)为与图3(b)所示相同眼球运动情形下所计算的水平眼动角θ′j和相应的眼动斜率Ki,水平眼动角θ′j为锐角;图3(g)为与图3(c)所示相同眼球运动情形下所计算的水平眼动角θ′j和相应的眼动斜率Ki,水平眼动角θ′j为锐角;图3(h)为与图3(d)所示相同眼球运动情形下所计算的水平眼 动角θ′j和相应的眼动斜率Ki,水平眼动角θ′j为锐角。可见,水平眼动角θ′j变化范围是[0°,90°]。Figure 3 (f) is the horizontal eye movement angle θ' j and the corresponding eye movement slope K i calculated in the same eye movement as shown in Figure 3 (b), the horizontal eye movement angle θ' j is an acute angle; (g) is the horizontal eye movement angle θ' j calculated in the same eye movement as shown in Fig. 3(c) and the corresponding eye movement slope K i , and the horizontal eye movement angle θ' j is an acute angle; Fig. 3 (h) The horizontal eye movement angle θ' j and the corresponding eye movement slope K i calculated in the case of the same eye movement as shown in Fig. 3(d), the horizontal eye movement angle θ' j is an acute angle. It can be seen that the horizontal eye movement angle θ' j varies by [0°, 90°].
图4显示了本发明的眼球运动测量方法在文本阅读和图形阅读模式下的眼动轨迹图,其中,图4(a)所示为本实施例中文本阅读时的眼动轨迹图,图4(b)所示为本实施例中图形阅读时的眼动轨迹图。4 is a view showing an eye movement trajectory of the eye movement measuring method of the present invention in a text reading and a graphic reading mode, wherein FIG. 4(a) shows an eye movement trajectory diagram when the text is read in the embodiment, FIG. (b) shows an eye movement trajectory diagram when the figure is read in the present embodiment.
如图4(a)所示,通过对阅读文本信息时31个注视点的记录,采用本发明的眼动测量方法,计算了30个眼动对应的眼动矢量角θi、眼动矢量幅Di、水平眼动角θ′j和眼动斜率KiAs shown in FIG. 4(a), by recording the 31 gaze points when reading the text information, using the eye movement measurement method of the present invention, the eye movement vector angle θ i and the eye movement vector width corresponding to 30 eye movements are calculated. D i , horizontal eye movement angle θ' j and eye movement slope K i .
表1显示了图4(a)所示文本阅读模式下各种眼动数据。通过表1可以对图4(a)所示的眼动运动进行量化的描述。例如,从注视点1至注视点2,眼动矢量角θi为5.91°、眼动矢量幅Di为87.46、水平眼动角θ′j为5.91°和眼动斜率Ki为0.10。Table 1 shows various eye movement data in the text reading mode shown in Fig. 4(a). The description of the eye movements shown in Fig. 4(a) can be quantified by Table 1. For example, from the fixation point 1 to the fixation point 2, the eye movement vector angle θ i is 5.91°, the eye movement vector width D i is 87.46, the horizontal eye movement angle θ′ j is 5.91°, and the eye movement slope K i is 0.10.
如图4(b)所示,通过对阅读图片信息时31个注视点的记录,采用本发明对眼动的测量方法,计算了30个眼动对应的眼动矢量角θi、眼动矢量幅Di、水平眼动角θ′j和眼动斜率KiAs shown in FIG. 4(b), by recording the 31 gaze points when reading picture information, using the method for measuring eye movement of the present invention, the eye movement vector angle θ i and the eye movement vector corresponding to 30 eye movements are calculated. The amplitude D i , the horizontal eye movement angle θ' j and the eye movement slope K i .
表2显示了图4(b)所示图形阅读模式下的各种眼动数据。通过表2可以对图4(b)所示的眼动运动进行量化的描述。例如,从注视点10至注视点11,眼动矢量角θi为85.26°、眼动矢量幅Di为205.70、水平眼动角θ′j为85.26°、眼动斜率Ki为12.06。 Table 2 shows various eye movement data in the graphic reading mode shown in Fig. 4(b). The description of the eye movements shown in Fig. 4(b) can be quantified by Table 2. For example, from the fixation point 10 to the fixation point 11, the eye movement vector angle θ i is 85.26°, the eye movement vector width D i is 205.70, the horizontal eye movement angle θ′ j is 85.26°, and the eye movement slope K i is 12.06.
表1Table 1
Figure PCTCN2015072765-appb-000010
Figure PCTCN2015072765-appb-000010
表2Table 2
Figure PCTCN2015072765-appb-000011
Figure PCTCN2015072765-appb-000011
图5是图4所示的文本阅读和图片阅读模式下的眼动指标对比图,其中,黑色柱表示图4(a)所示的文本阅读时眼动指标θi、Di、θ′j、Ki的平均值,白色柱表示图4(b)所示的文本阅读时眼动指标θi、Di、θ′j、Ki的平均值。 5 is a comparison diagram of eye movement indicators in the text reading and picture reading modes shown in FIG. 4, wherein the black bars represent the eye movement indicators θ i , D i , θ′ j of the text reading shown in FIG. 4( a ). The average value of K i and the white bar indicate the average value of the eye movement indexes θ i , D i , θ′ j , and K i at the time of text reading shown in FIG. 4( b ).
图5(a)为眼动矢量角θi的比较图,如图5(a)所示,阅读文本时的眼动矢量角平均值为135.39°,小于阅读图片时的眼动矢量角平均值为171.33°,可见,在图片阅读模式下,眼球运动的眼动矢量角相比于文本阅读模式下更大。Fig. 5(a) is a comparison diagram of the eye movement vector angle θ i . As shown in Fig. 5(a), the average value of the eye movement vector angle when reading text is 135.39°, which is smaller than the average value of the eye movement vector angle when reading the picture. At 171.33°, it can be seen that in the picture reading mode, the eye movement vector angle of the eye movement is larger than in the text reading mode.
图5(b)为眼动矢量幅Di的比较图,如图5(b)所示,阅读文本时的眼动矢量幅平均值为126.21,而阅读图片时的眼动矢量幅平均值为163.32,可见,在图片阅读模式下,眼球运动的眼动矢量幅相比于文本阅读模式下更大。Fig. 5(b) is a comparison diagram of the eye movement vector width D i . As shown in Fig. 5(b), the average value of the eye movement vector when reading the text is 126.21, and the average value of the eye movement vector when reading the picture is 163.32, it can be seen that in the picture reading mode, the eye movement vector of the eye movement is larger than that in the text reading mode.
图5(c)为水平眼动角θ′j的比较图,如图5(c)所示,阅读文本时的水平眼动角平均值为6.04°,而阅读图片时的水平眼动角平均值为30.52°,可见,在图片阅读模式下,眼球运动的水平眼动角相比于文本阅读模式下更大。Fig. 5(c) is a comparison diagram of the horizontal eye movement angle θ' j . As shown in Fig. 5(c), the average horizontal eye movement angle when reading the text is 6.04°, and the average horizontal eye movement angle when reading the picture is shown. The value is 30.52°. It can be seen that in the picture reading mode, the horizontal eye movement angle of the eye movement is larger than that in the text reading mode.
图5(d)为眼动斜率Ki的比较图,如图5(d)所示,阅读文本时的眼动斜率平均值为0.41,而阅读图片时的眼动斜率平均值为7.22,可见,在图片阅读模式下,眼球运动的眼动斜率相比于文本阅读模式下更大。Figure 5 (d) is a comparison of the eye movement slope K i , as shown in Figure 5 (d), the average eye movement slope when reading text is 0.41, and the average eye movement slope when reading the picture is 7.22, visible In the picture reading mode, the eye movement slope of the eye movement is larger than in the text reading mode.
文本和图片是两种不同的信息组织方式,因此其眼动模式也相应的存在细微差异,这种细微差异难以使用现有的眼动指标准确、全面的表达。本发明中,开创性的使用眼动矢量和眼动斜度来表征方向和眼动倾斜程度,能够弥补现有技术中眼动模式下眼动方向和眼动倾斜度无法表征的不足,从而更加准确、全面的描述眼球运动。Text and pictures are two different ways of organizing information, so there are subtle differences in their eye movement patterns. This kind of subtle difference is difficult to use the accurate and comprehensive expression of existing eye movement indicators. In the present invention, the use of the eye movement vector and the eye movement gradient to characterize the direction and the degree of the eye movement inclination can compensate for the insufficiency of the eye movement direction and the eye movement inclination in the eye movement mode in the prior art, thereby further Accurate and comprehensive description of eye movements.
图6是本发明优选实施例的眼动指标与现有技术的眼动指标对比图。Figure 6 is a comparison of eye movement indicators and prior art eye movement indicators in a preferred embodiment of the present invention.
图6中,a柱表示眼动矢量分类正确率,b柱表示眼动斜率分类正确率,c表示现有技术中的柱瞳孔直径分类正确率,d表示现有技术中的柱眼动距离分类正确率,e表示现有技术中的柱注视时间分类正确率,f表示现有技术中的柱注视次数分类正确率。In Fig. 6, the a column indicates the eye movement vector classification correct rate, the b column indicates the eye movement slope classification correct rate, c indicates the prior art column pupil diameter classification correct rate, and d indicates the prior art column eye distance classification. The correct rate, e represents the correct rate of column gaze time classification in the prior art, and f represents the classification correct rate of column gaze times in the prior art.
在眼动指标的分类结果比较测试中,首先使用眼动设备获得34名接受测试人员的阅读20个不同文本和20个不同图片时的眼动模式信息,然后使用支持向量机基于本实施例的眼动指标θi、Di、θ′j、Ki和现有技术中的眼动指 标对于文本和图片两种阅读模式进行分类,根据分类结果绘制得到图6。In the comparison test of the classification results of the eye movement index, firstly, the eye movement mode information of 34 test subjects reading 20 different texts and 20 different pictures is obtained using the eye movement device, and then using the support vector machine based on the present embodiment. The eye movement indicators θ i , D i , θ' j , K i and the eye movement indicators in the prior art classify the two reading modes of text and picture, and Fig. 6 is drawn based on the classification result.
如图6所示,本实施例中的眼动指标——眼动矢量分类正确率和眼动斜率分类正确率分别达到了83.27%和85.32%,明显高于现有的眼动指标分类正确率(瞳孔直径为70.94%,眼动距离为69.54%,注视时间为57.79%,注视次数为64.55%)。As shown in FIG. 6, the eye movement index-eye movement vector classification correct rate and the eye movement slope classification correct rate in this embodiment reach 83.27% and 85.32%, respectively, which is significantly higher than the existing eye movement index classification correct rate. (The pupil diameter is 70.94%, the eye movement distance is 69.54%, the fixation time is 57.79%, and the number of fixations is 64.55%).
可见,本发明中眼球运动的测量方法与现有技术相比,能够更加客观、正确的表征眼球运动,为后续的诊断提供了更加准确的数据。It can be seen that the measuring method of the eye movement in the present invention can more accurately and accurately represent the eye movement compared with the prior art, and provides more accurate data for subsequent diagnosis.
通过上述比较可以看出,本发明开创性的使用眼动矢量角θi、眼动矢量幅Di、水平眼动角θ′j、眼动斜率Ki等指标,准确、全面的表征了眼球运动中的眼动方向和眼动倾斜程度,弥补了现有的眼动指标对于眼动模式表征的不足,丰富和发展了现有的眼动指标体系,更全面、准确的描述眼球运动,为与眼球运动相关的心理医学提供了新的研究方法。It can be seen from the above comparison that the inventive use of the eye movement vector angle θ i , the eye movement vector amplitude D i , the horizontal eye movement angle θ′ j , the eye movement slope K i and the like accurately and comprehensively characterizes the eyeball. The eye movement direction and the degree of eye movement tilt in the movement make up for the deficiency of the existing eye movement index for the eye movement pattern, enrich and develop the existing eye movement index system, and describe the eye movement more comprehensively and accurately. Psychomedicine related to eye movement provides new research methods.
图7显示了本发明的眼球运动测量系统的结构示意图。Fig. 7 is a view showing the structure of an eye movement measuring system of the present invention.
如图7所示,本发明的眼球运动测量系统包括位置获取单元1、眼动矢量计算单元2和眼动斜度计算单元3。As shown in FIG. 7, the eye movement measurement system of the present invention includes a position acquisition unit 1, an eye movement vector calculation unit 2, and an eye movement gradient calculation unit 3.
位置获取单元1用于在眼球运动过程中获取当前注视点的位置坐标xi、yi和下一个注视点的位置坐标xi+1、yi+1,进而发送给眼动矢量计算单元2和眼动斜度计算单元3。本发明的优选实施例中,位置获取单元1在眼球视野平面中建立x-y平面坐标体系,从而能够实时获取眼球当前注视点的位置坐标。The position obtaining unit 1 is configured to acquire the position coordinates x i , y i of the current fixation point and the position coordinates x i+1 , y i+1 of the next fixation point during the eye movement, and then send to the eye movement vector calculation unit 2 And eye movement slope calculation unit 3. In a preferred embodiment of the present invention, the position acquisition unit 1 establishes an xy plane coordinate system in the eyeball view plane, so that the position coordinates of the current gaze point of the eyeball can be acquired in real time.
眼动矢量计算单元2连接到所述位置获取单元1,用于根据位置获取单元获取的当前注视点i的位置坐标xi、yi和下一个注视点i+1的坐标位置xi+1、yi+1计算眼动矢量,即分别计算眼动矢量角θi和计算眼动矢量幅Di。这里,计算眼动矢量角θi和计算眼动矢量幅Di的操作与前述方法实施例描述的一致,即通过下式(1)计算眼动锐角αiThe eye movement vector calculation unit 2 is connected to the position acquisition unit 1 for the position coordinates x i , y i of the current fixation point i and the coordinate position x i+1 of the next fixation point i+1 according to the position acquisition unit. y i+1 calculates the eye movement vector, that is, calculates the eye movement vector angle θ i and calculates the eye movement vector width D i , respectively . Here, the operation of calculating the eye movement vector angle θ i and calculating the eye movement vector width D i is consistent with that described in the foregoing method embodiment, that is, the eye movement acute angle α i is calculated by the following formula (1):
αi=tan-1(|(yi+1-yi)/(xi+1-xi)|)xi≠xi+1   (1); α i =tan -1 (|(y i+1 -y i )/(x i+1 -x i )|)x i ≠x i+1 (1);
通过下式(2)计算眼动矢量角θiThe eye movement vector angle θ i is calculated by the following formula (2):
Figure PCTCN2015072765-appb-000012
Figure PCTCN2015072765-appb-000012
以及,通过下式(3)计算眼动矢量幅DiAnd, the eye movement vector width D i is calculated by the following formula (3):
Figure PCTCN2015072765-appb-000013
Figure PCTCN2015072765-appb-000013
眼动斜度计算单元3连接到所述位置获取单元1,用于根据位置获取单元获取的眼球当前注视点i的位置坐标xi、yi和下一个注视点i+1的坐标位置xi+1、yi+1计算眼动斜度,包括分别计算水平眼动角θ′j和眼动斜率Ki。这里,计算水平眼动角θ′j和眼动斜率ki的操作与前述方法实施例描述的一致,即The eye movement gradient calculation unit 3 is connected to the position acquisition unit 1 for the position coordinates x i , y i of the current gaze point i of the eyeball acquired according to the position acquisition unit and the coordinate position x i of the next fixation point i+1 +1 , y i+1 calculate the eye movement gradient, including calculating the horizontal eye movement angle θ' j and the eye movement slope K i , respectively . Here, the operation of calculating the horizontal eye angle θ' j and the eye movement slope k i is consistent with that described in the foregoing method embodiment, that is,
通过下式(4)计算水平眼动角θ′jThe horizontal eye movement angle θ' j is calculated by the following formula (4):
Figure PCTCN2015072765-appb-000014
Figure PCTCN2015072765-appb-000014
通过式Ki=tanθ′i计算眼动斜率KiBy the formula K i = tanθ 'i calculated eye slope K i.
可选的,本发明的眼球运动测量系统还可以包括眼动模式识别单元4,其连接到所述眼动矢量计算单元2和眼动斜度计算单元3,用于根据眼动矢量和眼动斜度数值识别眼动模式。例如,可以根据前面获取的眼动矢量角θi、眼动矢量幅Di、水平眼动角θ′j和眼动斜率Ki来识别测试者的眼球当前处于文本阅读模式还是图形阅读模式。Optionally, the eye movement measurement system of the present invention may further include an eye movement pattern recognition unit 4 connected to the eye movement vector calculation unit 2 and the eye movement gradient calculation unit 3 for using the eye movement vector and the eye movement The slope value identifies the eye movement pattern. For example, it is possible to recognize whether the test subject's eyeball is currently in the text reading mode or the graphic reading mode based on the previously acquired eye movement vector angle θ i , the eye movement vector width D i , the horizontal eye movement angle θ′ j , and the eye movement slope K i .
进一步,可以识别测试者是正常人还是具有精神疾病的人。例如,抑郁症患者的眼球运动对于视觉对象(例如运动的图形的刺激)的反应比较迟钝甚至痴呆,反应在本发明的眼动矢量和眼动斜度上,对应的各项参数值会比 正常人明显的小。又例如,精神狂躁症患者的眼球运动对于视觉对象的反应通常呈现无规律的眼动,即眼神散乱无序,不会根据视觉对象的静止或运动呈现出相应的眼球运动,反应在本发明的眼动矢量和眼动斜度上,对应的各项参数值会比正常人呈现明显的无序性,即各项参数呈现毫无规律的增大或减小。Further, it can be identified whether the tester is a normal person or a person with a mental illness. For example, the eye movement of a depressed patient is relatively slow or even demented in response to a visual object (such as a stimulus of a moving figure), and in response to the eye movement vector and the eye movement gradient of the present invention, the corresponding parameter values are compared. Normal people are obviously small. For example, the eye movement of a mental mania patient usually exhibits an irregular eye movement in response to a visual object, that is, the eye is scattered and disordered, and does not exhibit a corresponding eye movement according to the stillness or motion of the visual object, and the reaction is in the present invention. On the eye movement vector and the eye movement gradient, the corresponding parameter values will show obvious disorder than the normal person, that is, the parameters will increase or decrease irregularly.
如上所述,本发明的眼球运动的测量方法和测量系统,通过对眼动矢量角θi、眼动矢量幅Di、水平眼动角θ′j、眼动斜率Ki等眼动指标的测量,准确、全面的表征了眼球运动中的眼动方向和眼动倾斜程度,弥补了现有技术中眼动指标对于眼动模式表征的不足,丰富和发证了现有的眼动指标体系,更全面、准确的描述眼球运动,为与眼球运动相关的心理医学提供了新的研究方法。As described above, the measuring method and the measuring system of the eye movement of the present invention pass the eye movement index such as the eye movement vector angle θ i , the eye movement vector width D i , the horizontal eye movement angle θ′ j , the eye movement slope K i , and the like. The measurement accurately and comprehensively characterizes the direction of eye movement and the degree of eye movement in eye movement, which makes up for the deficiency of eye movement index in the prior art, and enriches and proves the existing eye movement index system. A more comprehensive and accurate description of eye movements provides a new research method for psychology related to eye movement.
应当理解的是,本发明的上述具体实施方式仅仅用于示例性说明或解释本发明的原理,而不构成对本发明的限制。因此,在不偏离本发明的精神和范围的情况下所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。此外,本发明所附权利要求旨在涵盖落入所附权利要求范围和边界、或者这种范围和边界的等同形式内的全部变化和修改例。 The above-described embodiments of the present invention are intended to be illustrative only and not to limit the invention. Therefore, any modifications, equivalent substitutions, improvements, etc., which are made without departing from the spirit and scope of the invention, are intended to be included within the scope of the invention. Rather, the scope of the appended claims is intended to cover all such modifications and modifications

Claims (10)

  1. 一种眼球运动的测量方法,其特征在于,所述方法包括:A method for measuring eye movement, characterized in that the method comprises:
    获取眼球运动过程中当前注视点i的位置坐标xi、yi和下一个注视点i+1的位置坐标xi+1、yi+1,其中i=1,…,n,n>1;Obtaining the position coordinates x i , y i of the current fixation point i and the position coordinates x i+1 , y i+1 of the next fixation point i+1 during the eye movement, where i=1,...,n,n>1 ;
    根据xi、yi和xi+1、yi+1计算眼动矢量角θiCalculating the eye movement vector angle θ i according to x i , y i and x i+1 , y i+1 ;
    根据xi、yi和xi+1、yi+1计算眼动矢量幅Di;以及Calculating the eye movement vector width D i according to x i , y i and x i+1 , y i+1 ;
    根据xi、yi和xi+1、yi+1计算水平眼动角θ′jThe horizontal eye movement angle θ' j is calculated from x i , y i and x i+1 , y i+1 .
  2. 根据权利要求1所述的测量方法,其特征在于,所述方法还包括:The measuring method according to claim 1, wherein the method further comprises:
    通过计算水平眼动角θ′j的正切值来计算眼动斜率KiThe eye movement slope K i is calculated by calculating the tangent value of the horizontal eye movement angle θ' j .
  3. 根据权利要求1所述的测量方法,其特征在于,所述根据xi、yi和xi+1、yi+1计算眼动矢量角θi的步骤包括:The measuring method according to claim 1, wherein the calculating the eye movement vector angle θ i according to x i , y i and x i+1 , y i+1 comprises:
    步骤S21,通过下式(1)计算眼动锐角αiIn step S21, the eye movement acute angle α i is calculated by the following formula (1):
    αi=tan-1(|(yi+1-yi)/(xi+1-xi)|),xi≠xi+1    (1);α i =tan -1 (|(y i+1 -y i )/(x i+1 -x i )|), x i ≠x i+1 (1);
    步骤S22,通过下式(2)计算眼动矢量角θiIn step S22, the eye movement vector angle θ i is calculated by the following formula (2):
    Figure PCTCN2015072765-appb-100001
    Figure PCTCN2015072765-appb-100001
  4. 根据权利要求1所述的测量方法,其特征在于,所述根据xi、yi和xi+1、yi+1计算眼动矢量幅Di的步骤包括:The measuring method according to claim 1, wherein the calculating the eye movement vector width D i according to x i , y i and x i+1 , y i+1 comprises:
    通过下式(3)计算眼动矢量幅DiThe eye movement vector width D i is calculated by the following formula (3):
    Figure PCTCN2015072765-appb-100002
    Figure PCTCN2015072765-appb-100002
  5. 根据权利要求1所述的测量方法,其特征在于,所述根据xi、yi和xi+1、yi+1计算水平眼动角θ′j的步骤包括:The measuring method according to claim 1, wherein the calculating the horizontal eye movement angle θ' j according to x i , y i and x i+1 , y i+1 comprises:
    通过下式(4)计算水平眼动角θ′jThe horizontal eye movement angle θ' j is calculated by the following formula (4):
    Figure PCTCN2015072765-appb-100003
    Figure PCTCN2015072765-appb-100003
  6. 一种眼球运动的测量系统,其特征在于,所述系统包括:A measurement system for eye movement, characterized in that the system comprises:
    位置获取单元(1),用于在眼球运动过程中获取当前注视点的位置坐标xi、yi和下一个注视点的位置坐标xi+1、yi+1a position obtaining unit (1) for acquiring position coordinates x i , y i of the current fixation point and position coordinates x i+1 , y i+1 of the next fixation point during the eye movement;
    眼动矢量计算单元(2),连接到所述位置获取单元(1),用于根据位置获取单元获取的位置坐标xi、yi和xi+1、yi+1计算眼动矢量,包括眼动矢量角θi和计算眼动矢量幅Di;以及An eye movement vector calculation unit (2) connected to the position acquisition unit (1) for calculating an eye movement vector according to the position coordinates x i , y i and x i+1 , y i+1 acquired by the position acquisition unit, Including the eye movement vector angle θ i and calculating the eye movement vector width D i ;
    眼动斜度计算单元(3),连接到所述位置获取单元(1),用于根据位置获取单元获取的位置坐标xi、yi和xi+1、yi+1计算眼动斜度,包括眼动眼动水平眼动角θ′j和眼动斜率KiAn eye movement gradient calculating unit (3) is connected to the position acquiring unit (1) for calculating an eye movement oblique according to the position coordinates x i , y i and x i+1 , y i+1 acquired by the position acquiring unit Degree, including eye movement eye movement horizontal eye angle θ' j and eye movement slope K i .
  7. 根据权利要求6所述的系统,其特征在于,所述眼动矢量计算单元(2)执行下述操作来计算眼动矢量角θiThe system according to claim 6, wherein said eye movement vector calculation unit (2) performs an operation of calculating an eye movement vector angle θ i :
    通过下式(1)计算眼动锐角αiThe eye movement acute angle α i is calculated by the following formula (1):
    αi=tan-1(|(yi+1-yi)/(xi+1-xi)|),xi≠xi+1    (1);α i =tan -1 (|(y i+1 -y i )/(x i+1 -x i )|), x i ≠x i+1 (1);
    通过下式(2)计算眼动矢量角θiThe eye movement vector angle θ i is calculated by the following formula (2):
    Figure PCTCN2015072765-appb-100004
    Figure PCTCN2015072765-appb-100004
  8. 根据权利要求6所述的系统,其特征在于,所述眼动矢量计算单元(2)通过下式(3)计算眼动矢量幅DiThe system according to claim 6, wherein said eye movement vector calculation unit (2) calculates an eye movement vector width D i by the following equation (3):
    Figure PCTCN2015072765-appb-100005
    Figure PCTCN2015072765-appb-100005
  9. 根据权利要求6所述的系统,其特征在于,所述眼动斜度计算单元(3)执行下述操作来计算水平眼动角θ′j和眼动斜率KiThe system according to claim 6, wherein said eye movement gradient calculating unit (3) performs an operation of calculating a horizontal eye movement angle θ' j and an eye movement slope K i :
    通过下式(4)计算水平眼动角θ′jThe horizontal eye movement angle θ' j is calculated by the following formula (4):
    Figure PCTCN2015072765-appb-100006
    Figure PCTCN2015072765-appb-100006
    通过式Ki=tanθ′i计算眼动斜率KiBy the formula K i = tanθ 'i calculated eye slope K i.
  10. 根据权利要求6至9中任一项所述的系统,其特征在于,所述系统还包括:The system of any of claims 6 to 9, wherein the system further comprises:
    眼动模式识别单元(4),连接到所述眼动矢量计算单元(2)和眼动斜度计算单元(3),用于根据眼动矢量和眼动斜度数值识别眼动模式。 The eye movement pattern recognition unit (4) is connected to the eye movement vector calculation unit (2) and the eye movement gradient calculation unit (3) for recognizing the eye movement pattern based on the eye movement vector and the eye movement gradient value.
PCT/CN2015/072765 2014-09-01 2015-02-11 Eye movement measurement method and system WO2016033945A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410440414.6A CN104146680A (en) 2014-09-01 2014-09-01 Eye movement measuring method and system
CN201410440414.6 2014-09-01

Publications (1)

Publication Number Publication Date
WO2016033945A1 true WO2016033945A1 (en) 2016-03-10

Family

ID=51872472

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/072765 WO2016033945A1 (en) 2014-09-01 2015-02-11 Eye movement measurement method and system

Country Status (2)

Country Link
CN (1) CN104146680A (en)
WO (1) WO2016033945A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9978145B2 (en) * 2014-12-16 2018-05-22 Koninklijke Philips N.V. Assessment of an attentional deficit
CN105700677A (en) * 2015-12-29 2016-06-22 努比亚技术有限公司 Mobile terminal and control method thereof
CN106445115A (en) * 2016-08-31 2017-02-22 中国人民解放军海军医学研究所 Eye movement data-based user help information automatic triggering apparatus and method
CN106691476B (en) * 2017-01-16 2019-12-13 清华大学 Image cognition psychoanalysis system based on eye movement characteristics
CN109567817B (en) * 2018-11-19 2023-12-12 北京育铭天下科技有限公司 Reading capability assessment method and system and auxiliary device thereof
CN112086196B (en) * 2020-09-16 2023-11-28 中国科学院自动化研究所 Method and system for multi-selective attention assessment and training
CN114707070A (en) * 2022-04-12 2022-07-05 华为技术有限公司 User behavior prediction method and related equipment thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4859050A (en) * 1986-04-04 1989-08-22 Applied Science Group, Inc. Method and system for generating a synchronous display of a visual presentation and the looking response of many viewers
US5517021A (en) * 1993-01-19 1996-05-14 The Research Foundation State University Of New York Apparatus and method for eye tracking interface
US20100119112A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Graphical representations for aggregated paths
CN102309366A (en) * 2011-07-21 2012-01-11 山东科技大学 Control system and control method for controlling upper prosthesis to move by using eye movement signals
CN102819403A (en) * 2012-08-28 2012-12-12 广东欧珀移动通信有限公司 Terminal equipment and man-machine interaction method thereof
CN103279969A (en) * 2013-05-08 2013-09-04 中国科学技术大学 Method for building three-dimensional virtual eye motion model with rich emotional expression capability

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4859050A (en) * 1986-04-04 1989-08-22 Applied Science Group, Inc. Method and system for generating a synchronous display of a visual presentation and the looking response of many viewers
US5517021A (en) * 1993-01-19 1996-05-14 The Research Foundation State University Of New York Apparatus and method for eye tracking interface
US20100119112A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Graphical representations for aggregated paths
CN102309366A (en) * 2011-07-21 2012-01-11 山东科技大学 Control system and control method for controlling upper prosthesis to move by using eye movement signals
CN102819403A (en) * 2012-08-28 2012-12-12 广东欧珀移动通信有限公司 Terminal equipment and man-machine interaction method thereof
CN103279969A (en) * 2013-05-08 2013-09-04 中国科学技术大学 Method for building three-dimensional virtual eye motion model with rich emotional expression capability

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
HALSZKA, J. ET AL.: "A Vector-Based, Multidimensional Scanpath Similarity Measure", PROCEEDINGS OF THE 2010 SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, 31 March 2010 (2010-03-31), pages 211, XP055102612, DOI: doi:10.1145/1743666.1743718 *

Also Published As

Publication number Publication date
CN104146680A (en) 2014-11-19

Similar Documents

Publication Publication Date Title
WO2016033945A1 (en) Eye movement measurement method and system
KR101535432B1 (en) Contents valuation system and contents valuating method using the system
Choi et al. Evaluation of fear using nonintrusive measurement of multimodal sensors
JP2015503414A (en) Apparatus and method for psychiatric evaluation
JP6863563B2 (en) Stress evaluation system
CN110650685B (en) Method for assessing psychophysiological state of human
KR20140041382A (en) Method for obtaining information about the psychophysiological state of a living being
CN108171437A (en) A kind of psychology vocational ability evaluation system
Cook et al. Towards automatic screening of typical and atypical behaviors in children with autism
Wallace et al. Contactless remote assessment of heart rate and respiration rate using video magnification
Campo et al. Digital image correlation for full-field time-resolved assessment of arterial stiffness
Kirchner et al. Real-time mri reveals unique insight into the full kinematics of eye movements
Peck et al. Event-related functional MRI investigation of vocal pitch variation
Renaud et al. Eye-tracking in immersive environments: A general methodology to analyze affordance-based interactions from oculomotor dynamics
TWI577338B (en) Based on the real-time image-based respiration rate measurement technology method
Jiang et al. Predicting individualized intelligence quotient scores using brainnetome-atlas based functional connectivity
JP2009279099A (en) Blinking kind identifying device, blinking kind identifying method, and blinking kind identifying program
WO2019008773A1 (en) Cognitive function determination method
van Alphen et al. In vivo intraoperative hypoglossal nerve stimulation for quantitative tongue motion analysis
Seeber Eye tracking
KR102565852B1 (en) Autism spectrum disorder evaluation method based on facial expression analysis
JP6821171B2 (en) Brain activity state quantification method and brain activity state measurement device
JP2020049005A (en) Impression evaluation system and impression evaluation method
Rihar et al. Sensory data fusion of pressure mattress and wireless inertial magnetic measurement units
Do et al. Measuring posture change to detect emotional conditions for workers: A scoping review

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15838841

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15838841

Country of ref document: EP

Kind code of ref document: A1