CN112137576A - Method and system for detecting observation and reading ability based on eye movement data - Google Patents

Method and system for detecting observation and reading ability based on eye movement data Download PDF

Info

Publication number
CN112137576A
CN112137576A CN202011020334.7A CN202011020334A CN112137576A CN 112137576 A CN112137576 A CN 112137576A CN 202011020334 A CN202011020334 A CN 202011020334A CN 112137576 A CN112137576 A CN 112137576A
Authority
CN
China
Prior art keywords
work
user
eyes
observation
reading ability
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011020334.7A
Other languages
Chinese (zh)
Other versions
CN112137576B (en
Inventor
王鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Squirrel Classroom Artificial Intelligence Technology Co Ltd
Original Assignee
Shanghai Squirrel Classroom Artificial Intelligence Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Squirrel Classroom Artificial Intelligence Technology Co Ltd filed Critical Shanghai Squirrel Classroom Artificial Intelligence Technology Co Ltd
Priority to CN202011020334.7A priority Critical patent/CN112137576B/en
Publication of CN112137576A publication Critical patent/CN112137576A/en
Application granted granted Critical
Publication of CN112137576B publication Critical patent/CN112137576B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Multimedia (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The application discloses a method and a system for detecting observational reading capacity based on eye movement data. The method comprises the following steps: sequentially displaying a plurality of works for a user to view on a display screen; in the process that the user views each work, collecting eye movement data corresponding to each work viewed by the user; determining the observation reading capability of the user according to the eye movement data; determining a preferable display mode of the works corresponding to the user according to the observation and reading capacity; and displaying the next work for the user according to the work preferred display mode corresponding to the user.

Description

基于眼动数据的观察阅读能力检测方法和系统Observation and reading ability detection method and system based on eye movement data

技术领域technical field

本发明涉及智能技术领域，特别涉及基于眼动数据的观察阅读能力检测方法和系统。The present invention relates to the field of intelligent technology, in particular to a method and system for detecting observation and reading ability based on eye movement data.

背景技术Background technique

对于一些有认知障碍的孩子，例如自闭症患者，这些孩子先天对知识的接收速度慢，他们的个性化特征对认知过程的影响更明显，例如有的孩子喜欢看画，有的孩子喜欢听音乐，有的孩子看画的时候，对尺寸较大的画更关注，有的孩子看画的时候，对尺寸较小的画更关注。如果能通过智能化的手段知道孩子喜欢看大尺寸画还是小尺寸画，那么将非常有利于教育结构对这些孩子采取个性化的、匹配性更高的教学方法。For some children with cognitive impairment, such as those with autism, these children are inherently slow in receiving knowledge, and their individualized characteristics have a more obvious impact on cognitive processes. For example, some children like to watch pictures, and some children Like listening to music, some children pay more attention to larger paintings when looking at paintings, and some children pay more attention to smaller paintings when looking at paintings. If it is possible to know whether children like to see large-scale paintings or small-scale paintings through intelligent means, it will be very beneficial for the educational structure to adopt personalized and more matching teaching methods for these children.

发明内容SUMMARY OF THE INVENTION

本申请提供了基于眼动数据的观察阅读能力检测方法和系统，用以智能分析用户的观察阅读能力，进而能按照用户所感兴趣的作品展示方式为用户展示作品。The present application provides an observation and reading ability detection method and system based on eye movement data, which is used to intelligently analyze a user's observation and reading ability, and then can display works for the user according to the display method of the works that the user is interested in.

本发明实施例提供了一种基于眼动数据的观察阅读能力检测方法，包括：The embodiment of the present invention provides an observation and reading ability detection method based on eye movement data, including:

在显示屏上依序显示供用户查看的多个作品；Display multiple works for the user to view in sequence on the display screen;

在所述用户查看每个作品的过程中，采集所述用户查看每个作品对应的眼动数据；During the process of viewing each work by the user, collecting eye movement data corresponding to each work viewed by the user;

根据所述眼动数据，确定所述用户的观察阅读能力；According to the eye movement data, determine the observation and reading ability of the user;

根据所述观察阅读能力，确定所述用户对应的作品优选显示方式；According to the observation and reading ability, determine the preferred display mode of the work corresponding to the user;

按照所述用户对应的作品优选显示方式，为所述用户显示下一个作品。According to the preferred display mode of the work corresponding to the user, the next work is displayed for the user.

在一个实施例中，所述每个作品中显示有随机分布的多个特征对象，每个特征对象为具有显著颜色的图案，所述图案的面积大于所述作品的面积的1/200、小于所述作品的面积的1/50；每个图画中特征对象的颜色均不相同；每个作品中除了所述多个特征对象，还显示有多个非特征对象，每个非特征对象为具有非显著颜色的图案；In one embodiment, a plurality of randomly distributed feature objects are displayed in each work, each feature object is a pattern with a distinct color, and the area of the pattern is greater than 1/200 of the area of the work and less than 1/50 of the area of the work; the color of the characteristic objects in each picture is different; in addition to the plurality of characteristic objects, each work also displays a plurality of non-characteristic objects, each non-characteristic object has Patterns of insignificant colors;

所述眼动数据包括双眼聚焦点的聚焦角度、双眼聚焦点的偏离角度和双眼聚焦点处特征对象的有无情况；The eye movement data includes the focusing angle of the focal point of both eyes, the deviation angle of the focal point of both eyes, and the presence or absence of the characteristic object at the focal point of both eyes;

所述根据所述眼动数据，确定所述用户的观察阅读能力，包括：根据所述用户查看每个作品对应的眼动数据，确定所述用户的观察阅读能力。The determining of the user's observation and reading ability according to the eye movement data includes: determining the user's observation and reading ability according to the eye movement data corresponding to each work viewed by the user.

在一个实施例中，所述根据所述用户查看每个作品对应的眼动数据，确定所述用户的观察阅读能力，包括步骤A1-A3：In one embodiment, determining the user's observation and reading ability according to the eye movement data corresponding to each work viewed by the user includes steps A1-A3:

步骤A1、针对第k个作品，执行如下步骤A11-A16：Step A1, for the kth work, perform the following steps A11-A16:

步骤A11、按照如下公式(1)计算双眼在第k个作品上的第i个聚焦点到两眼中间点的距离：Step A11, according to the following formula (1), calculate the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes:

Figure BDA0002700415280000021
Figure BDA0002700415280000021

其中，Hki表示所述双眼在第k个作品上的第i个聚焦点到两眼中间点的距离(图中的ED距离)；Y表示两眼间距(图中的BC距离)；βki表示所述双眼在第k个作品上的第i个聚焦点时的聚焦角度(图中的∠BEC)；γki表示所述双眼在第k个作品上的第i个聚焦点时的偏离角度(图中的∠CEF)；Among them, H ki represents the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes (ED distance in the figure); Y represents the distance between the two eyes (BC distance in the figure); β ki Represents the focus angle of the eyes at the i-th focus point on the k-th work (∠BEC in the figure); γ ki represents the deviation angle of the eyes at the i-th focus point on the k-th work (∠CEF in the figure);

步骤A12、按照如下公式(2)计算所述双眼在第k个作品上第i个聚焦点时的双眼视野角度(图中的∠EDA)；Step A12, according to the following formula (2), calculate the binocular visual field angle (∠EDA in the figure) when the eyes are at the i-th focus point on the k-th work;

Figure BDA0002700415280000022
Figure BDA0002700415280000022

其中，ηki表示所述双眼在第k个作品上的第i个聚焦点时的双眼视野角度(图中的∠EDA)；Wherein, n ki represents the binocular visual field angle (∠EDA in the figure) of the two eyes at the i-th focus point on the k-th work;

步骤A13、确定所述双眼在第k个作品上第i个聚焦点处是否有特征对象；Step A13, determine whether the eyes have a characteristic object at the i-th focus point on the k-th work;

步骤A14、按照如下公式(3)计算第k个作品对应的特征对象对视野的影响因子χk：Step A14, according to the following formula (3), calculate the influence factor χ k of the characteristic object corresponding to the kth work on the field of view:

Figure BDA0002700415280000031
Figure BDA0002700415280000031

其中，χk表示第k个作品对应的特征对象对视野的影响因子，Nk表示在第k个作品上，相应的双眼视野角度等于或大于预设角度的聚焦点的总数目；Fk表示在第k个作品上，所述Nk个聚焦点中有所述特征对象的聚焦点的总数目；Among them, χ k represents the influence factor of the feature object corresponding to the k th work on the visual field, N k represents the total number of focal points whose corresponding binocular visual field angle is equal to or greater than the preset angle on the k th work; F k represents On the kth work, the total number of focal points of the feature object in the N k focal points;

步骤A15、按照如下公式(4)计算第k个作品对应的视线距离对视野的影响因子

Figure BDA0002700415280000032
Step A15: Calculate the influence factor of the line-of-sight distance corresponding to the k-th work on the visual field according to the following formula (4)
Figure BDA0002700415280000032

Figure BDA0002700415280000033
Figure BDA0002700415280000033

其中，Hkj表示所述双眼在第k个作品上的第j个聚焦点到两眼中间点的距离，Hkj均为等于或大于预设距离，m为对应的上述距离等于或大于预设距离的所述聚焦点的总数目；n为所述双眼在第k个作品上的所有聚焦点的总数目；Wherein, H kj represents the distance from the jth focal point of the eyes on the kth work to the middle point of the two eyes, H kj is equal to or greater than the preset distance, m is the corresponding distance equal to or greater than the preset distance The total number of the focus points of the distance; n is the total number of all focus points on the k-th work of the eyes;

步骤A16、利用所述

Figure BDA0002700415280000034
对所述χk进行修正，第k个作品对应的修正后的特征对象对视野的影响因子χk’如下公式(5)和(6)：Step A16, using the
Figure BDA0002700415280000034
The χ k is modified, and the influence factor χ k ' of the corrected feature object corresponding to the kth work on the field of view is as follows in formulas (5) and (6):

其中，当

Figure BDA0002700415280000035
等于或大于预设因子阈值时，
Figure BDA0002700415280000036
Among them, when
Figure BDA0002700415280000035
equal to or greater than the preset factor threshold,
Figure BDA0002700415280000036

当

Figure BDA0002700415280000037
小于预设因子阈值时，
Figure BDA0002700415280000038
when
Figure BDA0002700415280000037
When less than the preset factor threshold,
Figure BDA0002700415280000038

步骤A2、针对其余的每个作品，均按照步骤A11-A16确定每个作品对应的修正后的特征对象对视野的影响因子；Step A2, for each of the remaining works, determine the influence factor of the modified feature object corresponding to each work on the field of view according to steps A11-A16;

步骤A3、计算所述多个作品对应的修正后的特征对象对视野的影响因子的平均值；将所述平均值作为所述用户的观察阅读能力指数来表征用户的观察阅读能力；所述用户的观察阅读能力指数越大，所述用户的观察阅读能力越强。Step A3, calculating the average value of the influence factors of the modified feature objects corresponding to the plurality of works on the visual field; using the average value as the user's observation and reading ability index to represent the user's observation and reading ability; the user's observation and reading ability; The larger the observational reading ability index of , the stronger the observational reading ability of the user.

在一个实施例中，所述根据所述观察阅读能力，确定所述用户对应的作品优选显示方式，包括：In one embodiment, determining the preferred display mode of the work corresponding to the user according to the observation and reading ability includes:

根据所述用户的观察阅读能力指数，确定所述用户对应的作品优选显示方式，其中：According to the user's observation and reading ability index, the preferred display mode of the work corresponding to the user is determined, wherein:

当所述用户的观察阅读能力指数等于或大于预设指数阈值时，确定所述用户对应的作品优选显示方式为以等于或大于预设面积的方式显示作品；When the user's observation and reading ability index is equal to or greater than the preset index threshold, it is determined that the preferred display mode of the work corresponding to the user is to display the work in a manner equal to or greater than the preset area;

当所述用户的观察阅读能力指数小于预设指数阈值时，确定所述用户对应的作品优选显示方式为以小于预设面积的方式显示作品。When the user's observation and reading ability index is smaller than the preset index threshold, it is determined that the preferred display mode of the work corresponding to the user is to display the work in a way smaller than the preset area.

一种基于眼动数据的观察阅读能力检测系统，包括：An observation and reading ability detection system based on eye movement data, comprising:

第一显示模块，用于在显示屏上依序显示供用户查看的多个作品；a first display module, used to sequentially display multiple works for the user to view on the display screen;

采集模块，用于在所述用户查看每个作品的过程中，采集所述用户查看每个作品对应的眼动数据；a collection module, configured to collect eye movement data corresponding to each work viewed by the user during the process of viewing each work by the user;

第一确定模块，用于根据所述眼动数据，确定所述用户的观察阅读能力；a first determining module, configured to determine the observation and reading ability of the user according to the eye movement data;

第二确定模块，用于根据所述观察阅读能力，确定所述用户对应的作品优选显示方式；The second determination module is used to determine the preferred display mode of the works corresponding to the user according to the observation and reading ability;

第二显示模块，用于按照所述用户对应的作品优选显示方式，为所述用户显示下一个作品。The second display module is configured to display the next work for the user according to the preferred display mode of the work corresponding to the user.

在一个实施例中，所述每个作品中显示有随机分布的多个特征对象，每个特征对象为具有显著颜色的图案，所述图案的面积大于所述作品的面积的1/200、小于所述作品的面积的1/50；每个图画中特征对象的颜色均不相同；每个作品中除了所述多个特征对象，还显示有多个非特征对象，每个非特征对象为具有非显著颜色的图案；In one embodiment, a plurality of randomly distributed feature objects are displayed in each work, each feature object is a pattern with a distinct color, and the area of the pattern is greater than 1/200 of the area of the work and less than 1/50 of the area of the work; the color of the characteristic objects in each picture is different; in addition to the plurality of characteristic objects, each work also displays a plurality of non-characteristic objects, each non-characteristic object has Patterns of insignificant colors;

所述眼动数据包括双眼聚焦点的聚焦角度、双眼聚焦点的偏离角度和双眼聚焦点处特征对象的有无情况；The eye movement data includes the focusing angle of the focal point of both eyes, the deviation angle of the focal point of both eyes, and the presence or absence of the characteristic object at the focal point of both eyes;

所述根据所述眼动数据，确定所述用户的观察阅读能力，包括：根据所述用户查看每个作品对应的眼动数据，确定所述用户的观察阅读能力。The determining of the user's observation and reading ability according to the eye movement data includes: determining the user's observation and reading ability according to the eye movement data corresponding to each work viewed by the user.

在一个实施例中，所述根据所述用户查看每个作品对应的眼动数据，确定所述用户的观察阅读能力，包括步骤A1-A3：In one embodiment, determining the user's observation and reading ability according to the eye movement data corresponding to each work viewed by the user includes steps A1-A3:

步骤A1、针对第k个作品，执行如下步骤A11-A16：Step A1, for the kth work, perform the following steps A11-A16:

步骤A11、按照如下公式(1)计算双眼在第k个作品上的第i个聚焦点到两眼中间点的距离：Step A11, according to the following formula (1), calculate the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes:

Figure BDA0002700415280000051
Figure BDA0002700415280000051

其中，Hki表示所述双眼在第k个作品上的第i个聚焦点到两眼中间点的距离(图中的ED距离)；Y表示两眼间距(图中的BC距离)；βki表示所述双眼在第k个作品上的第i个聚焦点时的聚焦角度(图中的∠BEC)；γki表示所述双眼在第k个作品上的第i个聚焦点时的偏离角度(图中的∠CEF)；Among them, H ki represents the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes (ED distance in the figure); Y represents the distance between the two eyes (BC distance in the figure); β ki Represents the focus angle of the eyes at the i-th focus point on the k-th work (∠BEC in the figure); γ ki represents the deviation angle of the eyes at the i-th focus point on the k-th work (∠CEF in the figure);

步骤A12、按照如下公式(2)计算所述双眼在第k个作品上第i个聚焦点时的双眼视野角度(图中的∠EDA)；Step A12, according to the following formula (2), calculate the binocular visual field angle (∠EDA in the figure) when the eyes are at the i-th focus point on the k-th work;

Figure BDA0002700415280000052
Figure BDA0002700415280000052

其中，ηki表示所述双眼在第k个作品上的第i个聚焦点时的双眼视野角度(图中的∠EDA)；Wherein, n ki represents the binocular visual field angle (∠EDA in the figure) of the two eyes at the i-th focus point on the k-th work;

步骤A13、确定所述双眼在第k个作品上第i个聚焦点处是否有特征对象；Step A13, determine whether the eyes have a characteristic object at the i-th focus point on the k-th work;

步骤A14、按照如下公式(3)计算第k个作品对应的特征对象对视野的影响因子χk：Step A14, according to the following formula (3), calculate the influence factor χ k of the characteristic object corresponding to the kth work on the field of view:

Figure BDA0002700415280000053
Figure BDA0002700415280000053

其中，χk表示第k个作品对应的特征对象对视野的影响因子，Nk表示在第k个作品上，相应的双眼视野角度等于或大于预设角度的聚焦点的总数目；Fk表示在第k个作品上，所述Nk个点中有所述特征对象的聚焦点的总数目；Among them, χ k represents the influence factor of the feature object corresponding to the k th work on the visual field, N k represents the total number of focal points whose corresponding binocular visual field angle is equal to or greater than the preset angle on the k th work; F k represents On the kth work, the total number of focus points of the feature object in the N k points;

步骤A15、按照如下公式(4)计算第k个作品对应的视线距离对视野的影响因子

Figure BDA0002700415280000061
Step A15: Calculate the influence factor of the line-of-sight distance corresponding to the k-th work on the visual field according to the following formula (4)
Figure BDA0002700415280000061

Figure BDA0002700415280000062
Figure BDA0002700415280000062

其中，Hkj表示所述双眼在第k个作品上的第j个聚焦点到两眼中间点的距离，Hkj均为等于或大于预设距离，m为对应的上述距离等于或大于预设距离的所述聚焦点的总数目；n为所述双眼在第k个作品上的所有聚焦点的总数目；Wherein, H kj represents the distance from the jth focal point of the eyes on the kth work to the middle point of the two eyes, H kj is equal to or greater than the preset distance, m is the corresponding distance equal to or greater than the preset distance The total number of the focus points of the distance; n is the total number of all focus points on the k-th work of the eyes;

步骤A16、利用所述

Figure BDA0002700415280000063
对所述χk进行修正，第k个作品对应的修正后的特征对象对视野的影响因子χk’如下公式(5)和(6)：Step A16, using the
Figure BDA0002700415280000063
The χ k is modified, and the influence factor χ k ' of the corrected feature object corresponding to the kth work on the field of view is as follows in formulas (5) and (6):

其中，当

Figure BDA0002700415280000064
等于或大于预设因子阈值时，
Figure BDA0002700415280000065
Among them, when
Figure BDA0002700415280000064
equal to or greater than the preset factor threshold,
Figure BDA0002700415280000065

当

Figure BDA0002700415280000066
小于预设因子阈值时，
Figure BDA0002700415280000067
when
Figure BDA0002700415280000066
When less than the preset factor threshold,
Figure BDA0002700415280000067

步骤A2、针对其余的每个作品，均按照步骤A11-A16确定每个作品对应的修正后的特征对象对视野的影响因子；Step A2, for each of the remaining works, determine the influence factor of the modified feature object corresponding to each work on the field of view according to steps A11-A16;

步骤A3、计算所述多个作品对应的修正后的特征对象对视野的影响因子的平均值；将所述平均值作为所述用户的观察阅读能力指数来表征用户的观察阅读能力；所述用户的观察阅读能力指数越大，所述用户的观察阅读能力越强。Step A3, calculating the average value of the influence factors of the modified feature objects corresponding to the plurality of works on the visual field; using the average value as the user's observation and reading ability index to represent the user's observation and reading ability; the user's observation and reading ability; The larger the observational reading ability index of , the stronger the observational reading ability of the user.

在一个实施例中，第二确定模块，还用于：In one embodiment, the second determining module is further configured to:

根据所述用户的观察阅读能力指数，确定所述用户对应的作品优选显示方式，其中：According to the user's observation and reading ability index, the preferred display mode of the work corresponding to the user is determined, wherein:

当所述用户的观察阅读能力指数等于或大于预设指数阈值时，确定所述用户对应的作品优选显示方式为以等于或大于预设面积的方式显示作品；When the user's observation and reading ability index is equal to or greater than the preset index threshold, it is determined that the preferred display mode of the work corresponding to the user is to display the work in a manner equal to or greater than the preset area;

当所述用户的观察阅读能力指数小于预设指数阈值时，确定所述用户对应的作品优选显示方式为以小于预设面积的方式显示作品。When the user's observation and reading ability index is smaller than the preset index threshold, it is determined that the preferred display mode of the work corresponding to the user is to display the work in a way smaller than the preset area.

本发明实施例提供的上述技术方案，智能分析了用户的观察阅读能力，进而分析出用户所感兴趣的作品展示方式，进而按照用户所感兴趣的作品展示方式为用户展示作品，本技术方案尤其对于自闭症孩童作用很大，能够分析出自闭症孩童对哪种作品的观察能力更强、更敏感，协助教育机构为自闭症孩童提供适合的作品，以提高自闭症孩童的知识接受速度。The above technical solution provided by the embodiment of the present invention intelligently analyzes the user's observation and reading ability, and then analyzes the display mode of works that the user is interested in, and then displays the works for the user according to the display mode of the work that the user is interested in. The role of autistic children is very important. It can analyze which works of autistic children have stronger and more sensitive observation ability, and assist educational institutions to provide suitable works for autistic children, so as to improve the speed of knowledge acceptance of autistic children.

附图说明Description of drawings

为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

图1为本申请公开的一种基于眼动数据的观察阅读能力检测方法的流程图；FIG. 1 is a flowchart of a method for detecting an observation and reading ability based on eye movement data disclosed in the present application;

图2为本申请公开的一种基于眼动数据的观察阅读能力检测方法的各类参数示意图。FIG. 2 is a schematic diagram of various parameters of an observation and reading ability detection method based on eye movement data disclosed in the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

本发明实施例公开一种基于眼动数据的观察阅读能力检测方法，如图1所示，包括步骤S1-S5：The embodiment of the present invention discloses an observation and reading ability detection method based on eye movement data, as shown in FIG. 1 , including steps S1-S5:

步骤S1、在显示屏上依序显示供用户查看的多个作品。Step S1, displaying a plurality of works for the user to view in sequence on the display screen.

其中，作品可以是图画，例如由多个图案组成的图画，图案的颜色可以多彩多样。Among them, the work can be a picture, such as a picture composed of multiple patterns, and the colors of the patterns can be colorful.

步骤S2、在用户查看每个作品的过程中，采集用户查看每个作品对应的眼动数据。Step S2 , in the process of the user viewing each work, collect eye movement data corresponding to each work viewed by the user.

步骤S3、根据眼动数据，确定用户的观察阅读能力。Step S3: Determine the observation and reading ability of the user according to the eye movement data.

步骤S4、根据观察阅读能力，确定用户对应的作品优选显示方式。Step S4, according to the observation and reading ability, determine the preferred display mode of the work corresponding to the user.

步骤S5、按照用户对应的作品优选显示方式，为用户显示下一个作品。Step S5: Display the next work for the user according to the preferred display mode of the work corresponding to the user.

在一个实施例中，每个作品中显示有随机分布的多个特征对象，每个特征对象为具有显著颜色的图案，图案的面积大于作品的面积的1/200、小于作品的面积的1/50；每个作品中除了多个特征对象之外，还显示有多个非特征对象，每个非特征对象为具有非显著颜色的图案；特征对象与非特征对象的图案可以不相同，也可以相同。In one embodiment, a plurality of randomly distributed feature objects are displayed in each work, each feature object is a pattern with a distinct color, and the area of the pattern is greater than 1/200 and less than 1/200 of the area of the work. 50; In addition to multiple characteristic objects, each work also displays multiple non-characteristic objects, and each non-characteristic object is a pattern with a non-conspicuous color; the pattern of the characteristic object and the non-characteristic object may be different, or same.

在用户查看每个作品的过程中，采集用户查看每个作品对应的眼动数据，眼动数据包括双眼聚焦点的聚焦角度、双眼聚焦点的偏离角度和双眼聚焦点处特征对象的有无情况；During the user's viewing of each work, the eye movement data corresponding to the user's viewing of each work is collected. The eye movement data includes the focus angle of the binocular focus point, the deviation angle of the binocular focus point, and the presence or absence of characteristic objects at the binocular focus point. ;

根据用户查看每个作品对应的眼动数据，确定用户的观察阅读能力。According to the eye movement data corresponding to each work viewed by the user, the observation and reading ability of the user is determined.

在一个实施例中，根据用户查看每个作品对应的眼动数据，确定用户的观察阅读能力，包括步骤A1-A3：In one embodiment, the observation and reading ability of the user is determined according to the eye movement data corresponding to each work viewed by the user, including steps A1-A3:

步骤A1、针对第k个作品，执行如下步骤A11-A16：Step A1, for the kth work, perform the following steps A11-A16:

步骤A11、按照如下公式(1)计算双眼在第k个作品上的第i个聚焦点到两眼中间点的距离：Step A11, according to the following formula (1), calculate the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes:

Figure BDA0002700415280000081
Figure BDA0002700415280000081

其中，Hki表示双眼在第k个作品上的第i个聚焦点到两眼中间点的距离(如图2中的ED距离，A为双眼平视时在第k个作品上的聚焦点，E为第i个聚焦点，AE所处位置即为显示屏上的作品，点D为两眼中间点，B为一只眼睛的中心点，C为另一只眼睛的中心点)；Y表示两眼间距(如图2中的BC距离)；βki表示双眼在第k个作品上的第i个聚焦点时的聚焦角度(如图2中的∠BEC)；γki表示双眼在第k个作品上的第i个聚焦点时的偏离角度(如图2中的∠CEF，EF与BC所在平面垂直)；Among them, H ki represents the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes (the ED distance in Figure 2, A is the focus point on the k-th work when both eyes are looking up, E is the i-th focus point, the position of AE is the work on the display screen, point D is the middle point of the two eyes, B is the center point of one eye, and C is the center point of the other eye); Y represents the two The distance between the eyes (BC distance in Figure 2); β ki represents the focus angle of the eyes at the i-th focus point on the k-th work (∠BEC in Figure 2); γ ki represents the eyes at the k-th The deviation angle of the i-th focal point on the work (∠CEF in Figure 2, EF is perpendicular to the plane where BC is located);

步骤A12、按照如下公式(2)计算双眼在第k个作品上第i个聚焦点时的双眼视野角度(如图2中的∠EDA)；Step A12, according to the following formula (2), calculate the binocular visual field angle (∠EDA in Figure 2) when both eyes are at the i-th focus point on the k-th work;

Figure BDA0002700415280000091
Figure BDA0002700415280000091

其中，ηki表示双眼在第k个作品上的第i个聚焦点时的双眼视野角度；Among them, η ki represents the binocular visual field angle when both eyes are at the i-th focus point on the k-th work;

步骤A13、确定双眼在第k个作品上第i个聚焦点处是否有特征对象；Step A13, determine whether both eyes have a characteristic object at the i-th focus point on the k-th work;

步骤A14、按照如下公式(3)计算第k个作品对应的特征对象对视野的影响因子χk：Step A14, according to the following formula (3), calculate the influence factor χ k of the characteristic object corresponding to the kth work on the field of view:

Figure BDA0002700415280000092
Figure BDA0002700415280000092

其中，χk表示第k个作品对应的特征对象对视野的影响因子，Nk表示在第k个作品上，相应的双眼视野角度等于或大于预设角度的聚焦点的总数目；Fk表示在第k个作品上，Nk个点中有特征对象的聚焦点的总数目；Among them, χ k represents the influence factor of the feature object corresponding to the k th work on the visual field, N k represents the total number of focal points whose corresponding binocular visual field angle is equal to or greater than the preset angle on the k th work; F k represents On the kth work, the total number of focal points with feature objects in N k points;

步骤A15、按照如下公式(4)计算第k个作品对应的视线距离对视野的影响因子

Figure BDA0002700415280000093
Step A15: Calculate the influence factor of the line-of-sight distance corresponding to the k-th work on the visual field according to the following formula (4)
Figure BDA0002700415280000093

Figure BDA0002700415280000094
Figure BDA0002700415280000094

其中，Hkj表示双眼在第k个作品上的第j个聚焦点到两眼中间点的距离，Hkj均为等于或大于预设距离，m为对应的上述距离等于或大于预设距离的聚焦点的总数目；n为双眼在第k个作品上的所有聚焦点的总数目；Among them, H kj represents the distance from the j-th focus point of the eyes on the k-th work to the middle point of the two eyes, H kj is equal to or greater than the preset distance, and m is the corresponding distance equal to or greater than the preset distance. The total number of focus points; n is the total number of all focus points of both eyes on the kth work;

步骤A16、利用

Figure BDA0002700415280000095
对χk进行修正，第k个作品对应的修正后的特征对象对视野的影响因子χk’如下公式(5)和(6)：Step A16, use
Figure BDA0002700415280000095
Correcting χ k , the influence factor χ k ' of the corrected feature object corresponding to the kth work on the field of view is as follows: formulas (5) and (6):

其中，当

Figure BDA0002700415280000101
等于或大于预设因子阈值时，
Figure BDA0002700415280000102
Among them, when
Figure BDA0002700415280000101
equal to or greater than the preset factor threshold,
Figure BDA0002700415280000102

当

Figure BDA0002700415280000103
小于预设因子阈值时，
Figure BDA0002700415280000104
when
Figure BDA0002700415280000103
When less than the preset factor threshold,
Figure BDA0002700415280000104

步骤A2、针对其余的每个作品，均按照步骤A11-A16确定每个作品对应的修正后的特征对象对视野的影响因子；Step A2, for each of the remaining works, determine the influence factor of the modified feature object corresponding to each work on the field of view according to steps A11-A16;

步骤A3、计算多个作品对应的修正后的特征对象对视野的影响因子的平均值；将平均值作为用户的观察阅读能力指数来表征用户的观察阅读能力；用户的观察阅读能力指数越大，用户的观察阅读能力越强。Step A3: Calculate the average value of the influence factors of the modified feature objects corresponding to the multiple works on the visual field; take the average value as the user's observation and reading ability index to represent the user's observation and reading ability; the larger the user's observation and reading ability index, the greater the The user's observation and reading ability is stronger.

在一个实施例中，根据观察阅读能力，确定用户对应的作品优选显示方式，包括：In one embodiment, according to the observation and reading ability, the preferred display mode of the work corresponding to the user is determined, including:

根据用户的观察阅读能力指数，确定用户对应的作品优选显示方式，其中：According to the user's observation and reading ability index, the preferred display mode of the user's corresponding works is determined, wherein:

当用户的观察阅读能力指数等于或大于预设指数阈值时，确定用户对应的作品优选显示方式为以等于或大于预设面积的方式显示作品；即，此种情况说明，用户例如自闭症孩童对大幅作品的观察能力更强、更敏感，适合给该用户提供大幅作品，以提高该用户的知识接受速度。When the user's observation and reading ability index is equal to or greater than the preset index threshold, it is determined that the preferred display mode of the user's corresponding works is to display the works in a manner equal to or greater than the preset area; that is, this situation indicates that the user is, for example, an autistic child. The ability to observe large-scale works is stronger and more sensitive, and it is suitable to provide large-scale works to the user to improve the user's knowledge acceptance speed.

当用户的观察阅读能力指数小于预设指数阈值时，确定用户对应的作品优选显示方式为以小于预设面积的方式显示作品；即，此种情况说明，用户例如自闭症孩童对小幅作品的观察能力更强、更敏感，适合给该用户提供小幅作品，以提高该用户的知识接受速度。其中，上述预设面积可以人为设置。When the user's observation and reading ability index is less than the preset index threshold, it is determined that the preferred display mode of the user's corresponding work is to display the work in a way smaller than the preset area; that is, this situation indicates that the user, such as an autistic child, has no interest in small-scale works. The observation ability is stronger and more sensitive, and it is suitable to provide the user with small works to improve the user's knowledge acceptance speed. Wherein, the above-mentioned preset area can be set manually.

本发明实施例提供的上述技术方案，智能分析了用户的观察阅读能力，进而分析出用户所感兴趣的作品展示方式，进而按照用户所感兴趣的作品展示方式为用户展示作品，本技术方案尤其对于自闭症孩童作用很大，能够分析出自闭症孩童对哪种作品的观察能力更强、更敏感，协助教育机构为自闭症孩童提供适合的作品，以提高自闭症孩童的知识接受速度。The above technical solution provided by the embodiment of the present invention intelligently analyzes the user's observation and reading ability, and then analyzes the display mode of works that the user is interested in, and then displays the works for the user according to the display mode of the work that the user is interested in. The role of autistic children is very important. It can analyze which works of autistic children have stronger and more sensitive observation ability, and assist educational institutions to provide suitable works for autistic children, so as to improve the speed of knowledge acceptance of autistic children.

对所公开的实施例的上述说明，使本领域专业技术人员能够实现或使用本申请。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的，本文中所定义的一般原理可以在不脱离本申请的精神或范围的情况下，在其它实施例中实现。因此，本申请将不会被限制于本文所示的这些实施例，而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments enables any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, this application is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (8)

1.一种基于眼动数据的观察阅读能力检测方法，其特征在于，包括：1. an observation and reading ability detection method based on eye movement data, is characterized in that, comprises: 在显示屏上依序显示供用户查看的多个作品；Display multiple works for the user to view in sequence on the display screen; 在所述用户查看每个作品的过程中，采集所述用户查看每个作品对应的眼动数据；During the process of viewing each work by the user, collecting eye movement data corresponding to each work viewed by the user; 根据所述眼动数据，确定所述用户的观察阅读能力；According to the eye movement data, determine the observation and reading ability of the user; 根据所述观察阅读能力，确定所述用户对应的作品优选显示方式；According to the observation and reading ability, determine the preferred display mode of the work corresponding to the user; 按照所述用户对应的作品优选显示方式，为所述用户显示下一个作品。According to the preferred display mode of the work corresponding to the user, the next work is displayed for the user. 2.如权利要求1所述的方法，其特征在于，2. The method of claim 1, wherein 所述每个作品中显示有随机分布的多个特征对象，每个特征对象为具有显著颜色的图案，所述图案的面积大于所述作品的面积的1/200、小于所述作品的面积的1/50；每个图画中特征对象的颜色均不相同；每个作品中除了所述多个特征对象，还显示有多个非特征对象，每个非特征对象为具有非显著颜色的图案；A plurality of randomly distributed feature objects are displayed in each work, and each feature object is a pattern with a distinct color, and the area of the pattern is greater than 1/200 of the area of the work and less than 1/200 of the area of the work. 1/50; The color of the characteristic objects in each picture is different; in addition to the plurality of characteristic objects, each work also displays a plurality of non-characteristic objects, each non-characteristic object is a pattern with a non-conspicuous color; 所述眼动数据包括双眼聚焦点的聚焦角度、双眼聚焦点的偏离角度和双眼聚焦点处特征对象的有无情况；The eye movement data includes the focusing angle of the focal point of both eyes, the deviation angle of the focal point of both eyes, and the presence or absence of the characteristic object at the focal point of both eyes; 所述根据所述眼动数据，确定所述用户的观察阅读能力，包括：根据所述用户查看每个作品对应的眼动数据，确定所述用户的观察阅读能力。The determining of the user's observation and reading ability according to the eye movement data includes: determining the user's observation and reading ability according to the eye movement data corresponding to each work viewed by the user. 3.如权利要求2所述的方法，其特征在于，3. The method of claim 2, wherein 所述根据所述用户查看每个作品对应的眼动数据，确定所述用户的观察阅读能力，包括步骤A1-A3：According to the eye movement data corresponding to each work viewed by the user, the observation and reading ability of the user is determined, including steps A1-A3: 步骤A1、针对第k个作品，执行如下步骤A11-A16：Step A1, for the kth work, perform the following steps A11-A16: 步骤A11、按照如下公式(1)计算双眼在第k个作品上的第i个聚焦点到两眼中间点的距离：Step A11, according to the following formula (1), calculate the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes:
Figure FDA0002700415270000011
Figure FDA0002700415270000011
 其中，Hki表示所述双眼在第k个作品上的第i个聚焦点到两眼中间点的距离(图中的ED距离)；Y表示两眼间距(图中的BC距离)；βki表示所述双眼在第k个作品上的第i个聚焦点时的聚焦角度(图中的∠BEC)；γki表示所述双眼在第k个作品上的第i个聚焦点时的偏离角度(图中的∠CEF)；Among them, H ki represents the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes (ED distance in the figure); Y represents the distance between the two eyes (BC distance in the figure); β ki Represents the focus angle of the eyes at the i-th focus point on the k-th work (∠BEC in the figure); γ ki represents the deviation angle of the eyes at the i-th focus point on the k-th work (∠CEF in the figure); 步骤A12、按照如下公式(2)计算所述双眼在第k个作品上第i个聚焦点时的双眼视野角度(图中的∠EDA)；Step A12, according to the following formula (2), calculate the binocular visual field angle (∠EDA in the figure) when the eyes are at the i-th focus point on the k-th work;
Figure FDA0002700415270000021
Figure FDA0002700415270000021
 其中，ηki表示所述双眼在第k个作品上的第i个聚焦点时的双眼视野角度(图中的∠EDA)；Wherein, n ki represents the binocular visual field angle (∠EDA in the figure) of the two eyes at the i-th focus point on the k-th work; 步骤A13、确定所述双眼在第k个作品上第i个聚焦点处是否有特征对象；Step A13, determine whether the eyes have a characteristic object at the i-th focus point on the k-th work; 步骤A14、按照如下公式(3)计算第k个作品对应的特征对象对视野的影响因子χk：Step A14, according to the following formula (3), calculate the influence factor χ k of the characteristic object corresponding to the kth work on the field of view:
Figure FDA0002700415270000022
Figure FDA0002700415270000022
 其中，χk表示第k个作品对应的特征对象对视野的影响因子，Nk表示在第k个作品上，相应的双眼视野角度等于或大于预设角度的聚焦点的总数目；Fk表示在第k个作品上，所述Nk个聚焦点中有所述特征对象的聚焦点的总数目；Among them, χ k represents the influence factor of the feature object corresponding to the k th work on the visual field, N k represents the total number of focal points whose corresponding binocular visual field angle is equal to or greater than the preset angle on the k th work; F k represents On the kth work, the total number of focal points of the feature object in the N k focal points; 步骤A15、按照如下公式(4)计算第k个作品对应的视线距离对视野的影响因子
Figure FDA0002700415270000023
Step A15: Calculate the influence factor of the line-of-sight distance corresponding to the k-th work on the visual field according to the following formula (4)
Figure FDA0002700415270000023
Figure FDA0002700415270000024
Figure FDA0002700415270000024
 其中，Hkj表示所述双眼在第k个作品上的第j个聚焦点到两眼中间点的距离，Hkj均为等于或大于预设距离，m为对应的上述距离等于或大于预设距离的所述聚焦点的总数目；n为所述双眼在第k个作品上的所有聚焦点的总数目；Wherein, H kj represents the distance from the jth focal point of the eyes on the kth work to the middle point of the two eyes, H kj is equal to or greater than the preset distance, m is the corresponding distance equal to or greater than the preset distance The total number of the focus points of the distance; n is the total number of all focus points on the k-th work of the eyes; 步骤A16、利用所述
Figure FDA0002700415270000031
对所述χk进行修正，第k个作品对应的修正后的特征对象对视野的影响因子χk’如下公式(5)和(6)：Step A16, using the
Figure FDA0002700415270000031
The χ k is modified, and the influence factor χ k ' of the corrected feature object corresponding to the kth work on the field of view is as follows in formulas (5) and (6): 其中，当
Figure FDA0002700415270000032
等于或大于预设因子阈值时，
Figure FDA0002700415270000033
Among them, when
Figure FDA0002700415270000032
equal to or greater than the preset factor threshold,
Figure FDA0002700415270000033
 当
Figure FDA0002700415270000034
小于预设因子阈值时，
Figure FDA0002700415270000035
when
Figure FDA0002700415270000034
When less than the preset factor threshold,
Figure FDA0002700415270000035
 步骤A2、针对其余的每个作品，均按照步骤A11-A16确定每个作品对应的修正后的特征对象对视野的影响因子；Step A2, for each of the remaining works, determine the influence factor of the modified feature object corresponding to each work on the field of view according to steps A11-A16; 步骤A3、计算所述多个作品对应的修正后的特征对象对视野的影响因子的平均值；将所述平均值作为所述用户的观察阅读能力指数来表征用户的观察阅读能力；所述用户的观察阅读能力指数越大，所述用户的观察阅读能力越强。Step A3, calculating the average value of the influence factors of the modified feature objects corresponding to the plurality of works on the visual field; using the average value as the user's observation and reading ability index to represent the user's observation and reading ability; the user's observation and reading ability; The larger the observational reading ability index of , the stronger the observational reading ability of the user. 4.如权利要求3所述的方法，其特征在于，所述根据所述观察阅读能力，确定所述用户对应的作品优选显示方式，包括：4. The method according to claim 3, wherein the determining, according to the observation and reading ability, the preferred display mode of the work corresponding to the user, comprising: 根据所述用户的观察阅读能力指数，确定所述用户对应的作品优选显示方式，其中：According to the user's observation and reading ability index, the preferred display mode of the work corresponding to the user is determined, wherein: 当所述用户的观察阅读能力指数等于或大于预设指数阈值时，确定所述用户对应的作品优选显示方式为以等于或大于预设面积的方式显示作品；When the user's observation and reading ability index is equal to or greater than the preset index threshold, it is determined that the preferred display mode of the work corresponding to the user is to display the work in a manner equal to or greater than the preset area; 当所述用户的观察阅读能力指数小于预设指数阈值时，确定所述用户对应的作品优选显示方式为以小于预设面积的方式显示作品。When the user's observation and reading ability index is smaller than the preset index threshold, it is determined that the preferred display mode of the work corresponding to the user is to display the work in a way smaller than the preset area. 5.一种基于眼动数据的观察阅读能力检测系统，其特征在于，包括：5. An observation and reading ability detection system based on eye movement data is characterized in that, comprising: 第一显示模块，用于在显示屏上依序显示供用户查看的多个作品；a first display module, used to sequentially display multiple works for the user to view on the display screen; 采集模块，用于在所述用户查看每个作品的过程中，采集所述用户查看每个作品对应的眼动数据；a collection module, configured to collect eye movement data corresponding to each work viewed by the user during the process of viewing each work by the user; 第一确定模块，用于根据所述眼动数据，确定所述用户的观察阅读能力；a first determining module, configured to determine the observation and reading ability of the user according to the eye movement data; 第二确定模块，用于根据所述观察阅读能力，确定所述用户对应的作品优选显示方式；The second determination module is used to determine the preferred display mode of the works corresponding to the user according to the observation and reading ability; 第二显示模块，用于按照所述用户对应的作品优选显示方式，为所述用户显示下一个作品。The second display module is configured to display the next work for the user according to the preferred display mode of the work corresponding to the user. 6.如权利要求5所述的系统，其特征在于，6. The system of claim 5, wherein: 所述每个作品中显示有随机分布的多个特征对象，每个特征对象为具有显著颜色的图案，所述图案的面积大于所述作品的面积的1/200、小于所述作品的面积的1/50；每个图画中特征对象的颜色均不相同；每个作品中除了所述多个特征对象，还显示有多个非特征对象，每个非特征对象为具有非显著颜色的图案；A plurality of randomly distributed feature objects are displayed in each work, and each feature object is a pattern with a distinct color, and the area of the pattern is greater than 1/200 of the area of the work and less than 1/200 of the area of the work. 1/50; The color of the characteristic objects in each picture is different; in addition to the plurality of characteristic objects, each work also displays a plurality of non-characteristic objects, each non-characteristic object is a pattern with a non-conspicuous color; 所述眼动数据包括双眼聚焦点的聚焦角度、双眼聚焦点的偏离角度和双眼聚焦点处特征对象的有无情况；The eye movement data includes the focusing angle of the focal point of both eyes, the deviation angle of the focal point of both eyes, and the presence or absence of the characteristic object at the focal point of both eyes; 所述根据所述眼动数据，确定所述用户的观察阅读能力，包括：根据所述用户查看每个作品对应的眼动数据，确定所述用户的观察阅读能力。The determining of the user's observation and reading ability according to the eye movement data includes: determining the user's observation and reading ability according to the eye movement data corresponding to each work viewed by the user. 7.如权利要求6所述的系统，其特征在于，7. The system of claim 6, wherein 所述根据所述用户查看每个作品对应的眼动数据，确定所述用户的观察阅读能力，包括步骤A1-A3：According to the eye movement data corresponding to each work viewed by the user, the observation and reading ability of the user is determined, including steps A1-A3: 步骤A1、针对第k个作品，执行如下步骤A11-A16：Step A1, for the kth work, perform the following steps A11-A16: 步骤A11、按照如下公式(1)计算双眼在第k个作品上的第i个聚焦点到两眼中间点的距离：Step A11, according to the following formula (1), calculate the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes:
Figure FDA0002700415270000041
Figure FDA0002700415270000041
 其中，Hki表示所述双眼在第k个作品上的第i个聚焦点到两眼中间点的距离(图中的ED距离)；Y表示两眼间距(图中的BC距离)；βki表示所述双眼在第k个作品上的第i个聚焦点时的聚焦角度(图中的∠BEC)；γki表示所述双眼在第k个作品上的第i个聚焦点时的偏离角度(图中的∠CEF)；Among them, H ki represents the distance from the i-th focus point of the eyes on the k-th work to the middle point of the two eyes (ED distance in the figure); Y represents the distance between the two eyes (BC distance in the figure); β ki Represents the focus angle of the eyes at the i-th focus point on the k-th work (∠BEC in the figure); γ ki represents the deviation angle of the eyes at the i-th focus point on the k-th work (∠CEF in the figure); 步骤A12、按照如下公式(2)计算所述双眼在第k个作品上第i个聚焦点时的双眼视野角度(图中的∠EDA)；Step A12, according to the following formula (2), calculate the binocular visual field angle (∠EDA in the figure) when the eyes are at the i-th focus point on the k-th work;
Figure FDA0002700415270000051
Figure FDA0002700415270000051
 其中，ηki表示所述双眼在第k个作品上的第i个聚焦点时的双眼视野角度(图中的∠EDA)；Wherein, n ki represents the binocular visual field angle (∠EDA in the figure) of the two eyes at the i-th focus point on the k-th work; 步骤A13、确定所述双眼在第k个作品上第i个聚焦点处是否有特征对象；Step A13, determine whether the eyes have a characteristic object at the i-th focus point on the k-th work; 步骤A14、按照如下公式(3)计算第k个作品对应的特征对象对视野的影响因子χk：Step A14, according to the following formula (3), calculate the influence factor χ k of the characteristic object corresponding to the kth work on the field of view:
Figure FDA0002700415270000052
Figure FDA0002700415270000052
 其中，χk表示第k个作品对应的特征对象对视野的影响因子，Nk表示在第k个作品上，相应的双眼视野角度等于或大于预设角度的聚焦点的总数目；Fk表示在第k个作品上，所述Nk个点中有所述特征对象的聚焦点的总数目；Among them, χ k represents the influence factor of the feature object corresponding to the k th work on the visual field, N k represents the total number of focal points whose corresponding binocular visual field angle is equal to or greater than the preset angle on the k th work; F k represents On the kth work, the total number of focus points of the feature object in the N k points; 步骤A15、按照如下公式(4)计算第k个作品对应的视线距离对视野的影响因子
Figure FDA0002700415270000053
Step A15: Calculate the influence factor of the line-of-sight distance corresponding to the k-th work on the visual field according to the following formula (4)
Figure FDA0002700415270000053
Figure FDA0002700415270000054
Figure FDA0002700415270000054
 其中，Hkj表示所述双眼在第k个作品上的第j个聚焦点到两眼中间点的距离，Hkj均为等于或大于预设距离，m为对应的上述距离等于或大于预设距离的所述聚焦点的总数目；n为所述双眼在第k个作品上的所有聚焦点的总数目；Wherein, H kj represents the distance from the jth focal point of the eyes on the kth work to the middle point of the two eyes, H kj is equal to or greater than the preset distance, m is the corresponding distance equal to or greater than the preset distance The total number of the focus points of the distance; n is the total number of all focus points on the k-th work of the eyes; 步骤A16、利用所述
Figure FDA0002700415270000055
对所述χk进行修正，第k个作品对应的修正后的特征对象对视野的影响因子χk’如下公式(5)和(6)：Step A16, using the
Figure FDA0002700415270000055
The χ k is modified, and the influence factor χ k ' of the corrected feature object corresponding to the kth work on the field of view is as follows in formulas (5) and (6): 其中，当
Figure FDA0002700415270000056
等于或大于预设因子阈值时，
Figure FDA0002700415270000057
Among them, when
Figure FDA0002700415270000056
equal to or greater than the preset factor threshold,
Figure FDA0002700415270000057
 当
Figure FDA0002700415270000061
小于预设因子阈值时，
Figure FDA0002700415270000062
when
Figure FDA0002700415270000061
When less than the preset factor threshold,
Figure FDA0002700415270000062
 步骤A2、针对其余的每个作品，均按照步骤A11-A16确定每个作品对应的修正后的特征对象对视野的影响因子；Step A2, for each of the remaining works, determine the influence factor of the modified feature object corresponding to each work on the field of view according to steps A11-A16; 步骤A3、计算所述多个作品对应的修正后的特征对象对视野的影响因子的平均值；将所述平均值作为所述用户的观察阅读能力指数来表征用户的观察阅读能力；所述用户的观察阅读能力指数越大，所述用户的观察阅读能力越强。Step A3, calculating the average value of the influence factors of the modified feature objects corresponding to the plurality of works on the visual field; using the average value as the user's observation and reading ability index to represent the user's observation and reading ability; the user's observation and reading ability; The larger the observational reading ability index of , the stronger the observational reading ability of the user. 8.如权利要求7所述的系统，其特征在于，第二确定模块，还用于：8. The system of claim 7, wherein the second determining module is further configured to: 根据所述用户的观察阅读能力指数，确定所述用户对应的作品优选显示方式，其中：According to the user's observation and reading ability index, the preferred display mode of the work corresponding to the user is determined, wherein: 当所述用户的观察阅读能力指数等于或大于预设指数阈值时，确定所述用户对应的作品优选显示方式为以等于或大于预设面积的方式显示作品；When the user's observation and reading ability index is equal to or greater than the preset index threshold, it is determined that the preferred display mode of the work corresponding to the user is to display the work in a manner equal to or greater than the preset area; 当所述用户的观察阅读能力指数小于预设指数阈值时，确定所述用户对应的作品优选显示方式为以小于预设面积的方式显示作品。When the user's observation and reading ability index is smaller than the preset index threshold, it is determined that the preferred display mode of the work corresponding to the user is to display the work in a way smaller than the preset area.
CN202011020334.7A 2020-09-24 2020-09-24 Method and system for detecting observation and reading ability based on eye movement data Active CN112137576B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011020334.7A CN112137576B (en) 2020-09-24 2020-09-24 Method and system for detecting observation and reading ability based on eye movement data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011020334.7A CN112137576B (en) 2020-09-24 2020-09-24 Method and system for detecting observation and reading ability based on eye movement data

Publications (2)

Publication Number Publication Date
CN112137576A true CN112137576A (en) 2020-12-29
CN112137576B CN112137576B (en) 2021-07-09

Family

ID=73896891

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011020334.7A Active CN112137576B (en) 2020-09-24 2020-09-24 Method and system for detecting observation and reading ability based on eye movement data

Country Status (1)

Country Link
CN (1) CN112137576B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150213634A1 (en) * 2013-01-28 2015-07-30 Amit V. KARMARKAR Method and system of modifying text content presentation settings as determined by user states based on user eye metric data
CN106293045A (en) * 2015-06-30 2017-01-04 北京智谷睿拓技术服务有限公司 Display control method, display control unit and subscriber equipment
CN106843500A (en) * 2017-02-27 2017-06-13 南通大学 Human-subject test rehabilitation training system based on the dynamic tracer technique of eye
CN106897363A (en) * 2017-01-11 2017-06-27 同济大学 The text for moving tracking based on eye recommends method
CN108471486A (en) * 2018-03-09 2018-08-31 浙江工业大学 A kind of intelligent reading operations method and device suitable for electronic viewing aid

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150213634A1 (en) * 2013-01-28 2015-07-30 Amit V. KARMARKAR Method and system of modifying text content presentation settings as determined by user states based on user eye metric data
CN106293045A (en) * 2015-06-30 2017-01-04 北京智谷睿拓技术服务有限公司 Display control method, display control unit and subscriber equipment
CN106897363A (en) * 2017-01-11 2017-06-27 同济大学 The text for moving tracking based on eye recommends method
CN106843500A (en) * 2017-02-27 2017-06-13 南通大学 Human-subject test rehabilitation training system based on the dynamic tracer technique of eye
CN108471486A (en) * 2018-03-09 2018-08-31 浙江工业大学 A kind of intelligent reading operations method and device suitable for electronic viewing aid

Also Published As

Publication number Publication date
CN112137576B (en) 2021-07-09

Similar Documents

Publication Publication Date Title
JP6892558B2 (en) Theological assistance method and the theological assistance system that adopts the method
CN107292778A (en) A kind of cloud classroom learning evaluation method and its device based on cognitive emotion perception
CN109799073B (en) Optical distortion measuring device and method, image processing system, electronic equipment and display equipment
CN103313080A (en) Control apparatus, electronic device, control method, and program
Abdulkader et al. Optimizing student engagement in edge-based online learning with advanced analytics
CN108960261A (en) A kind of obvious object detection method based on attention mechanism
CN110414380A (en) A student behavior detection method based on target detection
CN106548169A (en) Fuzzy literal Enhancement Method and device based on deep neural network
CN105763829A (en) Image processing method and electronic device
CN107392890A (en) A kind of FPC copper line surfaces oxidation defect detection method and its detecting system
CN115661628A (en) A Fish Detection Method Based on Improved YOLOv5S Model
CN111126143A (en) Deep learning-based exercise judgment guidance method and system
Hamid et al. LSM: perceptually accurate line segment merging
CN116311060A (en) Automatic evaluation method and system for classroom learning input degree of students based on computer vision
CN111126330A (en) A method for locating the center of the pupil membrane and a method for detecting the fatigue degree of students listening to a lecture
CN116433431A (en) Teacher teaching state automatic evaluation method and system based on image processing technology
CN106530410A (en) Automobile assembly demonstration system based on augmented reality technology
CN112137576A (en) Method and system for detecting observation and reading ability based on eye movement data
CN108876677A (en) Assessment on teaching effect method and robot system based on big data and artificial intelligence
CN209879796U (en) Learning system based on artificial intelligence
CN107748621A (en) A kind of intelligent interaction robot
CN110941733A (en) Integrated interface information multiple fusion display method
CN113702377B (en) Glucose degree nondestructive testing method based on deep learning
CN102903066A (en) System and method for displaying growth recording and quality early warning based on different terminals
Goodall An evaluation of visual and textual network analysis tools

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PP01 Preservation of patent right

Effective date of registration: 20221020

Granted publication date: 20210709

PP01 Preservation of patent right
PD01 Discharge of preservation of patent

Date of cancellation: 20241020

Granted publication date: 20210709

PD01 Discharge of preservation of patent