JP2016114684A - Degree-of-comprehension estimation system, degree-of-comprehension estimation method, and degree-of-comprehension estimation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To estimate a part of a lecture which participants should understand but to which the participants could presumably not be fully attentive.SOLUTION: In a degree-of-comprehension estimation system 10, a line-of-sight information acquisition feature unit 102 acquires line-of-sight information of each of participants, who are receiving the contents of a lecture, at every certain timing. A directional consistency estimation feature unit 103 uses line-of-sight coordinates contained in the line-of-sight information, measurement times of the line-of-sight coordinates, and switching times t, at which slides s of the contents of the lecture are switched, to calculate line-of-sight moving directions νand νobserved before and after the slides s are switched, and determines each participant's degree of comprehension for the slides s on the basis of the line-of-sight moving directions νand νobserved before and after the switching and the sliding direction νof the slides s.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for estimating an understanding level of a student who is viewing a lecture.

  Traditionally, in primary schools, teachers and students face classes in the classroom. At this time, as shown in Non-Patent Document 1, the teacher adjusts the progress of the class while observing the students and asking questions to the students while determining the degree of understanding and concentration of the students. ing. In addition, students can deepen their understanding of the class by asking the teacher questions about the lack of understanding during the class.

  However, in lectures such as e-learning conducted over the Internet in recent years, since there is no teacher who observes the state of the students, as shown in Non-Patent Document 2, the students cannot ask questions about the lectures and go to the lectures. It has been reported that understanding of lectures cannot be deepened sufficiently due to a decline in the degree of concentration.

  In order to solve this problem, a method for estimating the level of understanding of the students in the lecture and a method for providing appropriate review materials according to the estimated level of understanding of the students have been proposed. In this regard, in Non-Patent Document 3, the concentration of the student is estimated using the measured brain waves of the student, and the part where the degree of concentration is low is assumed to be insufficiently understood. A method is proposed.

Yoshizaki, “Teacher's Decision Making in the Course Implementation Process”, Japan Educational Technology Journal, Vol.8, 1983, p.61-p.70 Shigeta and 3 others, “Estimation of learner's subjective difficulty by measuring eyeball mobility for English listening electronic teaching materials”, IEEJ Transactions C, Vol. 131, No. 4, 2011, p.800-807 D. Szafir, 1 other, “ARTFul: Adaptive Review Technology for Flipped Learning”, CHI 2013: Changing Perspectives, Paris, France, p.1001-1010

  However, as described in Non-Patent Document 3, the student does not always concentrate on the part of the lecture content that already has knowledge. On the other hand, there is a possibility of attending the lecture with high concentration for the part of the lecture content that you are trying to understand, that is, the part that you do not have enough knowledge. For this reason, there are cases where the estimation accuracy of the portion to be reviewed for the lecture is low from the concentration level during the lecture.

  On the other hand, as Non-Patent Document 3 suggests, the student determines whether or not to read the digital teaching materials displayed during the lecture according to the level of knowledge he already has. Conceivable. In other words, the part of the digital teaching material that the student has read carefully is the part that the student does not have enough knowledge, and is necessary for the student to understand the lecture. At this time, the progress of the lecture may be faster than the speed at which the student understands the lecture, and the lecture may proceed to the next before the student finishes reading the part being lectured.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to estimate a part of the lecture that is considered to have been insufficiently read although the student needs to understand.

  In order to solve the above problems, the understanding level estimation device according to claim 1 is included in the line-of-sight information, an acquisition unit that acquires line-of-sight information of a student who is taking lecture content and stores the line-of-sight information in a storage unit Using the line-of-sight coordinates, the measurement time of the line-of-sight coordinates, and the switching time at which the slide of the lecture content is slid and switched, the line-of-sight movement direction before and after switching the slide is calculated, and the line-of-sight movement before and after the switching And determining means for determining the degree of understanding of the student with respect to the slide based on the direction and the slide direction of the slide.

  The understanding level estimation device according to claim 2 is the understanding level estimation device according to claim 1, wherein the determination unit is configured to understand the student based on an angle formed by the line-of-sight movement direction before and after the switching with respect to the sliding direction. The gist is to determine the degree.

  The understanding level estimation device according to claim 3 is the understanding level estimation device according to claim 1 or 2, wherein the determination unit calculates an angle formed by the line-of-sight movement direction before and after the switching with respect to the sliding direction, The gist is to determine that the degree of understanding of the student is low when the cosine value of one corner and the cosine value of the other corner are different.

  The understanding level estimation device according to claim 4 is the understanding level estimation device according to any one of claims 1 to 3, wherein each slide of the lecture content slides in a direction different from the line-of-sight movement direction before switching. The gist of the invention is to further include a processing means for processing the lecture content so as to be switched.

  The understanding level estimation device according to claim 5 is the understanding level estimation device according to claim 4, wherein the processing means processes the lecture content so that a slide speed immediately before the end of switching is slower than immediately after the start of switching. The gist is to do.

  The understanding level estimation method according to claim 6 is an understanding level estimation method performed by an understanding level estimation device, wherein the understanding level estimation device acquires line-of-sight information of a student who is attending a lecture content and stores it in a storage unit. Using the acquisition step, the line-of-sight coordinates included in the line-of-sight information, the measurement time of the line-of-sight coordinates, and the switching time when the slide of the lecture content is slid and switched, the line-of-sight movement direction before and after switching the slide And determining the degree of understanding of the student with respect to the slide based on the line-of-sight movement direction before and after the switching and the slide direction of the slide.

  The gist of the understanding level estimation program according to claim 7 is to cause a computer to function as the understanding level estimation device according to any one of claims 1 to 5.

  According to the present invention, it is possible to estimate a portion of a lecture that is considered to have not been read thoroughly even though the student needs to understand.

It is a figure which shows the structure of an understanding level estimation system. It is a figure which shows the process sequence of an understanding level estimation method. It is a figure which shows the example of data of content DB. It is a figure which shows the example of data of eyes | visual_axis information DB. It is a figure which shows the example of data of slide information DB.

  Hereinafter, an embodiment for carrying out the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing a configuration of an understanding level estimation system according to the present embodiment. The understanding level estimation system 1 includes an understanding level estimation device 10 that estimates a student's level of understanding of a lecture, and a client terminal 30 that the student uses when taking the class. The understanding level estimation device 10 and the client terminal 30 are connected to be able to communicate with each other.

  Next, functions of the understanding level estimation device 10 will be described. The understanding level estimation device 10 includes a content processing function unit 101, a line-of-sight information acquisition function unit 102, a direction coincidence degree estimation function unit 103, a content DB 104, a line-of-sight information DB 105, and a slide information DB 106. The

  The content processing function unit 101 acquires the lecture content requested from the client terminal 30 from the content DB 104, and adds a function of switching while sliding the slide (slide screen, slide page) of the lecture content in a predetermined direction. It is configured.

  The line-of-sight information acquisition function unit 102 is configured to acquire the line-of-sight information (line-of-sight coordinates, measurement time) of a student measured at a predetermined timing by the client terminal 30 and store it in the line-of-sight information DB 105.

  The direction coincidence estimation function unit 103 acquires the slide switching time transmitted from the client terminal 30, and uses the switching time and the line-of-sight information (line-of-sight coordinates, measurement time) to determine the line-of-sight movement direction before and after switching. Calculate and estimate (determine) the level of understanding of the student with respect to the slide based on the line-of-sight movement direction and the slide direction (predetermined direction) before and after the switching, and information on the slide with a low level of understanding in the slide information DB 106 Configured to store.

  Next, functions of the client terminal 30 will be described. The client terminal 30 includes a content request function unit 301, a content reception function unit 302, a line-of-sight information transmission function unit 303, and a switching timing notification function unit 304.

  The content request function unit 301 is configured to request the understanding level estimation device 10 for lecture content specified by the student. The content reception function unit 302 is configured to acquire the lecture content transmitted from the comprehension estimation device 10 in response to the request and reproduce it with a monitor or a microphone.

  The gaze information transmission function unit 303 measures the gaze position (horizontal-vertical position) of the student with respect to the slide of the lecture content being reproduced as gaze coordinates, and transmits the gaze coordinates and the measurement time to the understanding level estimation device 10. It is configured as follows. The switching timing notification function unit 304 is configured to notify the understanding level estimation device 10 of the switching time when the slide of the lecture content is switched.

  The understanding level estimation device 10 and the client terminal 30 can be realized by a computer (for example, a server or a personal computer) having a calculation function such as a CPU and a storage function such as a memory. It is also possible to create an understanding level estimation program for causing a computer to function as the understanding level estimation device 10 and a storage medium for the understanding level estimation program.

  Next, an understanding level estimation method performed by the understanding level estimation system 1 will be described. FIG. 2 is a diagram illustrating a processing sequence of the understanding level estimation method.

First, in step S1, the content request function unit 301, based on the student specified operation, requesting the transmission of the lecture contents C _A related lecture A the understanding level estimation device 10.

Next, in step S2, the contents processing function unit 101, when receiving the transmission request of the lecture contents _{C A} from the client terminal 30, acquires the lecture content _{C A} from the content DB 104. FIG. 3 is a diagram illustrating an example of data in the content DB 104. The content DB 104 stores a plurality of lecture contents, and includes a lecture ID column and a lecture content column. The lecture ID column stores an ID that can uniquely identify the lecture content. Lecture content is stored in the lecture content column. Lecture content is digital teaching material data composed of one or more slides and audio data for explaining the contents of the slides.

Next, in step S3, the contents processing function unit 101, lecture for performing slide display when switching each slide s content C _A, the sliding direction [nu _{s ([nu s} is the unit vector of the slide s, vector representation " → is omitted). Specifically, one or more gaze movement directions ν _u (ν _u is a unit vector, vector display “→” is omitted) in which the student moves the gaze in the slide, and the gaze movement direction ν _u One direction opposite to any of the directions is defined as a sliding direction ν _s .

For example, using the “indexing of digital archives using image search” technology (Kawashima, 05-01045, p.486-p.491), the direction in which the text and bullets in the slide are read and written is the direction of the eye movement ν Estimated as _u . For example, if the text or bullets in a slide are configured to read from left to right and from top to bottom, students can read the slide from left to right or from top It is thought that the line of sight is moved downward. In this case, the line-of-sight movement direction ν _u is a horizontal direction from left to right and a vertical direction from top to bottom. Therefore, at this time, the slide direction ν _s is set to the horizontal direction from right to left or the vertical direction from bottom to top. In addition, since it is thought that the structure of a general slide maintains consistency, it is sufficient to estimate the line-of-sight movement direction ν _u for a certain slide. If the configuration of the slide when no maintaining consistency may be determined sliding direction [nu _s for each slide, are unified to any sliding direction [nu _s determined for one slide Also good.

Next, in step S4, the contents processing function section 101, for each slide lecture content C _A, imparting effect as switched while sliding in the sliding direction [nu _s upon switching slide. At this time, for example, an effect is given to the slide such that the last portion of the sentence, such as the last part of the sentence, which is considered to be read last is displayed on the client terminal for as long as possible. For example, in general slides, sentences and the like are often described from the upper left to the lower right, so that the lower right of the slide is displayed as long as possible.

Next, in step S5, the content processing function unit 101 transmits the processed lecture content _{C A} 'in step S4 to the client terminal 30.

Thereafter, in step S6, the content reception function unit 302 receives the lecture content C _A ′ from the understanding level estimation device 10, and then starts reproduction on the client terminal. The lecture content C _A ′ is switched while the slides slide at a predetermined timing according to the progress of the lecture and the last of the sentence is displayed for a long time by the processing performed in step S4. . For example, the slide speed immediately before the end of switching is controlled to be slower than immediately after the start of slide switching.

Subsequently, in step S7, the line-of-sight information transmission function unit 303 measures the line-of-sight coordinates (horizontal-vertical coordinates) of the student who is taking the lecture content C _A ′ at regular timings, and the line-of-sight coordinates and the measurement time Is transmitted to the understanding level estimation device 10. For example, the eye-gaze coordinate value of the student is measured at an interval of m seconds (m is a positive real number) using an existing eye movement measuring device, and the eye-gaze coordinate value and the measurement time are transmitted each time it is measured.

Thereafter, in step S <b> 8, the line-of-sight information acquisition function unit 102 receives the line-of-sight coordinates and measurement time of the student who is attending the lecture content C _A ′ from the client terminal 30, and stores them in the line-of-sight information DB 105. FIG. 4 is a diagram illustrating an example of data in the line-of-sight information DB 105. The line-of-sight information DB 105 stores the line-of-sight information of the student, and includes a lecture ID column, a measurement time column, and a line-of-sight coordinate column. In FIG. 4, student lecture contents C ₁ are moving sight from left to right in m seconds from 1:25.

In step S9, when the slide s is switched during the reproduction of the lecture content C _A ′, the switching timing notification function unit 304 notifies the understanding level estimation device 10 of the switching time t of the slide s.

  Thereafter, in step S10, the direction coincidence degree estimation function unit 103 uses the slide direction of the slide s and the direction of movement of the student's line of sight before and after switching the slide s to determine the student's level of understanding of the slide s. presume. Here, when the slide moves while browsing the lecture content, the human eye naturally uses the characteristic of following the slide (it is easy to follow moving objects). In step S3, by moving the slide in the direction opposite to the direction of the student's line of sight when viewing the slide, it becomes easier to detect that the line of sight changes as the slide moves, and can be read thoroughly. Identify the missing slides. This will be described in detail below.

When the switching time t of the slide s is received from the client terminal 30, first, the attendance immediately before the switching time t is performed using the switching time t of the slide s and the line-of-sight information (gaze coordinates, measurement time) of the line-of-sight information DB 105. The user's gaze movement direction ν _b (vector display “→” is omitted) and the student's gaze movement direction ν _a (vector display “→” is omitted) immediately after the switching time t are estimated. For example, the line-of-sight coordinates (x ₀ , y ₀ ) closest to “switching time t−predetermined time T ₁ (T ₁ is a positive real number)” and the line-of-sight coordinates (x ₁ , y ₁ ) and the line-of-sight coordinates (x ₂ , y ₂ ) at the time closest to “switching time t + predetermined time T ₂ (T ₂ is a positive real number)” are obtained from the line-of-sight information DB 105 and the line-of-sight movement direction ν _b = (X ₁ −x ₀ , y ₁ −y ₀ ), the line-of-sight movement direction ν _a = (x ₂ −x ₁ , y ₂ −y ₁ ) is calculated.

Subsequently, in the slide s, two vectors (ν _b , ν _a ) for the slide direction ν _s are calculated from the two line-of-sight movement directions ν _b , ν _a and the slide direction ν _s determined in step S3. The formed angles θ ₁ and θ ₂ are respectively calculated. If the formed angles θ ₁ and θ ₂ are equal to or smaller than a predetermined threshold, the student determines that the slide s has not been read thoroughly, and stores information on the slide s in the slide information DB 106.

For example, the cosine cos [theta] ₁ of the angle theta ₁ between the slide direction [nu _s and eye movement direction _{ν b (0 ° ≦ θ 1} ≦ 180 °) calculated from equation (1). Similarly, the cosine cos [theta] ₂ of the angle theta ₂ between the sliding direction [nu _s and eye movement direction _{ν a (0 ° ≦ θ 2} ≦ 180 °) calculated from equation (2).

For example, −1 ≦ cos θ ₁ ≦ M ₁ (M ₁ is a real number satisfying −1 ≦ M ₁ ≦ 0) and 0 ≦ cos θ ₂ ≦ M ₂ (M ₂ is a real number satisfying 0 ≦ M ₂ ≦ 1). ), The student's gaze direction before and after the switching of the slide s does not match (the opposite direction), so the student moves the gaze direction left and right or up and down several times to change the gaze direction, There is a possibility that the last part of the slide s is reread. Therefore, in such a case, it is estimated that the student's level of understanding of the slide s is low (the student's understanding is insufficient), and the slide number of the slide s is stored in the slide information DB 106. FIG. 5 is a diagram illustrating an example of data in the slide information DB 106. The slide information DB 106 includes a lecture ID column and a slide column. The slide column stores the slide number of the slide.

In addition, the understanding level of the students may be estimated based on the angles θ ₁ and θ _{2 that} are simply formed. Specifically, since it is considered that “the line-of-sight movement direction has changed due to the switching of the slide → the slide has been switched without being fully read → the degree of understanding is low”, one angle θ ₁ Is less than 90 ° (sliding direction and vector direction are opposite) and the other angle θ ₂ is smaller than 90 ° (sliding direction and vector direction are the same) Estimated.

  In this embodiment, an example has been described in which each slide of lecture content is slid in the direction opposite to the line-of-sight movement direction before switching. However, if it can be detected that the line-of-sight direction changes as the slide moves. Therefore, the slide may be slid in a direction different from the line-of-sight movement direction before switching, that is, in an arbitrary direction other than the same direction as the line-of-sight movement direction before switching.

According to the present embodiment, the understanding level estimation device 10 acquires the line-of-sight information of students who are taking lecture content, the line-of-sight coordinates included in the line-of-sight information, the measurement time of the line-of-sight coordinates, and the lecture content. Using the switching time t when the slide s is slid and switched, the line-of-sight movement directions ν _b and ν _a before and after the switching of the slide s are calculated, respectively, and the line-of-sight movement directions ν _b and ν _a before and after the switching are calculated. Since the student's level of understanding of the slide s is determined based on the slide direction ν _s of the slide s, it is considered that the part of the lecture was not fully read despite the necessity for the student to understand Can be estimated. Thereby, as a result, the estimation accuracy of the student's understanding level for the lecture can be improved.

DESCRIPTION OF SYMBOLS 1 ... Comprehension degree estimation system 10 ... Comprehension degree estimation apparatus 101 ... Content processing function part 102 ... Gaze information acquisition function part 103 ... Direction matching degree estimation function part 104 ... Content DB
105 ... Gaze information DB
106 ... slide information DB
DESCRIPTION OF SYMBOLS 30 ... Client terminal 301 ... Content request function part 302 ... Content reception function part 303 ... Gaze information transmission function part 304 ... Switching timing notification function part S1-S10 ... Step

Claims (7)

An acquisition means for acquiring gaze information of a student who is taking lecture content and storing it in a storage means;
Using the line-of-sight coordinates included in the line-of-sight information, the measurement time of the line-of-sight coordinates, and the switching time when the slide of the lecture content has been slid and switched, respectively calculate the line-of-sight movement direction before and after switching the slide, Determining means for determining the level of understanding of the student with respect to the slide based on the line-of-sight movement direction before and after the switching and the slide direction of the slide;
A comprehension level estimation device characterized by comprising: The determining means includes
The comprehension level estimation apparatus according to claim 1, wherein the comprehension level of the student is determined based on an angle formed by a gaze movement direction before and after the switching with respect to the slide direction. The determining means includes
When the angle formed by the line-of-sight movement direction before and after the switching with respect to the sliding direction is calculated, and the sign of the cosine value of one angle and the cosine value of the other angle are different, the understanding level of the student is low The understanding level estimation device according to claim 1, wherein the understanding level estimation device is determined.   4. The processing unit according to claim 1, further comprising processing means for processing the lecture content so that each slide of the lecture content is switched while sliding in a direction different from the line-of-sight movement direction before switching. Understanding level estimation device. The processing means includes
5. The comprehension level estimation apparatus according to claim 4, wherein the lecture content is processed so that a slide speed immediately before the end of switching is slower than immediately after the start of switching. In the understanding level estimation method performed by the understanding level estimation device,
The understanding level estimation device comprises:
An acquisition step of acquiring gaze information of a student who is taking lecture content and storing it in a storage means;
Using the line-of-sight coordinates included in the line-of-sight information, the measurement time of the line-of-sight coordinates, and the switching time when the slide of the lecture content has been slid and switched, respectively calculate the line-of-sight movement direction before and after switching the slide, A determination step for determining the degree of understanding of the student with respect to the slide based on the line-of-sight movement direction before and after the switching and the slide direction of the slide;
A comprehension level estimation method characterized by comprising:   6. An understanding level estimation program for causing a computer to function as the understanding level estimation apparatus according to claim 1.

Images