JP6832410B1 - Learning effect estimation device, learning effect estimation method, program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a learning effect estimation device capable of estimating a learning effect of a user by reflecting various aspects of a mechanism by which a human understands things. SOLUTION: A model storage unit that stores a model that receives learning data that is data of a user's learning result to which a category according to a learning purpose is assigned and generates a correct answer probability for each category of the user based on the learning data. A correct answer probability generator that inputs training data into the model and generates correct answer probabilities for each category, a correct answer probability database that accumulates time-series data of correct answer probabilities for each user, and an estimation of the learning effect of a predetermined user. The degree of comprehension based on the correct answer probability in the range data of a predetermined user and the degree of reliability that becomes smaller as the fluctuation of the time-series data of the degree of comprehension becomes larger by acquiring the range data which is the data that specifies the range of the category for Includes a comprehension reliability generator that generates and outputs the data in association with the category. [Selection diagram] Fig. 1

Description

The present invention relates to a learning effect estimation device for estimating a user's learning effect, a learning effect estimation method, and a program.

An online learning system (Patent Document 1) that can automatically form a learning plan based on the measurement of academic ability effect and perform the learning online is known.

The online learning system of Patent Document 1 includes a plurality of learner terminals connected to an online learning server via the Internet. The online learning server provides the request terminal with problems for measuring the learning effect of the subject requested in response to the request from each learner terminal as a problem divided into multiple measurement items and units of the measurement field for each item. To do. When the answer to the question answered by the learner is sent to the server from the terminal provided with the question, the server scores the answer for each measurement field in the measurement item, and also measures each measurement item and all measurements in each item. For each field, the scoring result is converted into a multi-level evaluation value and the evaluation value is presented to the learner terminal. Based on this evaluation value, the server presents to the learner terminal the content of each field to be learned and the time to be learned in the learning text of the subject provided by the online learning server for each measurement field in each measurement item. ..

According to the online learning system of Patent Document 1, it is possible to present the user's achievement level to the learner terminal as an evaluation value for a plurality of measurement fields in a plurality of measurement items in which the entire range of subjects taken from the server is divided. .. Further, based on the evaluation value, the unit content to be learned on the text provided from the online learning server to the terminal for each measurement field and the time required for the unit content can be presented to the learner terminal.

Japanese Unexamined Patent Publication No. 2012-208143

The online learning system of Patent Document 1 merely replaces the scoring results of the questions given for measuring the learning effect with evaluation values, and does not reflect various aspects of the mechanism by which humans understand things.

Therefore, the present invention provides a learning effect estimation device capable of estimating a user's learning effect by reflecting various aspects of a mechanism by which a human understands things.

The learning effect estimation device of the present invention includes a model storage unit, a correct answer probability generation unit, a correct answer probability database, and a comprehension reliability generation unit.

The model storage unit takes learning data, which is data of the learning result of the user to which categories for each learning purpose are assigned, as input, and stores a model that generates a correct answer probability for each category of the user based on the learning data. The correct answer probability generation unit inputs learning data into the model and generates correct answer probabilities for each category. The correct answer probability database accumulates time series data of correct answer probabilities for each user. The comprehension reliability generation unit acquires range data, which is data that specifies a range of categories for estimating the learning effect of a predetermined user, and understands the comprehension level based on the correct answer probability in the range data of the predetermined user. The reliability that becomes smaller as the fluctuation of the time series data of the degree becomes larger is generated, and is output in association with the category.

According to the learning effect estimation device of the present invention, the learning effect of the user can be estimated by reflecting various aspects of the mechanism by which humans understand things.

The block diagram which shows the structure of the learning effect estimation apparatus of Example 1. FIG. The flowchart which shows the operation of the learning effect estimation apparatus of Example 1. The figure explaining the type of learning data. The figure which shows the example of the correlation of a category. The figure which shows the example which the correct answer probability of a correlation category fluctuates at the same time. The figure which shows the example of the precedent succession relation of a category. The figure which shows the example of the category specified for learning data (content). An example of time-series data of correct answer probability (understanding) is shown, FIG. 8A shows an example in which fluctuation is large, and FIGS. 8B and 8C show an example in which fluctuation is small. The figure which shows the example of the category set and the target category. The figure explaining the example of the case classification based on the degree of understanding and the degree of reliability. The figure which shows the functional structure example of a computer.

Hereinafter, embodiments of the present invention will be described in detail. The components having the same function are given the same number, and duplicate description is omitted.

Hereinafter, the configuration of the learning effect estimation device of the first embodiment will be described with reference to FIG. As shown in the figure, the learning effect estimation device 1 of this embodiment includes a learning data acquisition unit 11, a correct answer probability generation unit 12, a model storage unit 12A, a correct answer probability database 12B, and a range data acquisition unit 13. , Understanding degree reliability generation unit 14 and recommendation generation unit 15. As shown by the broken line in the figure, the recommendation generation unit 15 is not an indispensable constituent requirement and may be omitted in some cases.

Hereinafter, detailed operations of each configuration requirement will be described with reference to FIGS. 2 and later.

<Learning data acquisition unit 11>
The learning data acquisition unit 11 acquires the learning data (S11). The learning data is data on the learning result and learning situation when the user learns the content, and the content and the learning data are pre-allocated to categories according to the learning purpose (hereinafter, simply referred to as categories).

[Content, learning data]
As shown in FIG. 3, the content may be provided with two types, curriculum and adaptive. The curriculum can include, for example, scenarios, exercises, and so on. Adaptives can include, for example, exercises.

A scenario refers to a type of content (teaching material) that acquires knowledge in a format other than problem exercises, such as reading, listening, referring to a figure, or watching a video. The learning data of the scenario is typically data (flag) indicating the learning result such as the completion of reading, listening, and viewing of the scenario, and data indicating the learning status such as the date and time and place where the learning was performed. In addition to this, the number and frequency of reading comprehension, listening, and browsing of the scenario may be used as the learning data of the scenario.

An exercise is typically a basic example that is inserted between or after a scenario and asks for comprehension of the previous scenario. The learning data of the exercise is typically data showing the learning result such as the implementation of the exercise, the number of executions, the frequency, the correctness, the correct answer rate, the score, and the content of the incorrect answer, and the date and time and place where the learning was performed. It is data showing the learning situation.

Exercises typically mean a group of questions that are given in a test format. The learning data of the exercise is typically data showing the learning result such as the implementation of the exercise, the number of times of the exercise, the frequency, the correctness, the correct answer rate, the score, the content of the incorrect answer, and the date and time when the learning was performed. It is data showing the learning situation such as the place. In addition, the grade data of the mock exam may be used as the learning data of the exercise.

[category]
The category indicates a learning purpose in which the learning content of the user is subdivided and defined. For example, "can solve linear equations" may be defined as category 01, "can solve simultaneous equations" may be defined as category 02, and so on. In addition, the above can be further subdivided into, for example, "a linear equation can be solved using a transposition", "a linear equation with parentheses can be solved", and "a linear equation including fractions and decimals in coefficients". You may define a category such as "can solve".

The correct answer probabilities (or comprehensions) of the two categories may be more closely related in some cases. For example, when the correct answer probability (or comprehension) for the basic properties of trigonometric functions sinθ and cosθ is high, the correct answer probability (or comprehension) for the basic properties of the same trigonometric function tanθ is high. Although there is a tendency, it can be said that these are closely related. FIG. 4 shows an example of category correlation. In the example of the figure, category 01 is strongly correlated with category 02 and category 03. Also, although not as much as categories 02 and 03, category 04 is weakly correlated with category 01. Further, category 05 is uncorrelated with category 01. For example, when the user is learning category 01, the probability of correct answer (or the degree of comprehension) of category 01 naturally changes according to the learning result. At this time, even if the categories 02, 03, 04 are unlearned, since there is a correlation with the category 01, the correct answer probability (or the degree of understanding) of the categories 02, 03, 04 also depends on the learning result of the category 01. fluctuate. At this time, the correct answer probability (or comprehension level) of category 05, which is uncorrelated with category 01, does not change.

For example, as illustrated in FIG. 5, when the correct answer probability of category 01 increases by 0.20 by learning category 01, the correct answer probability of categories 02 and 03 that strongly correlate with category 01 increases by 0.10, and category 01 It is conceivable that the probability of correct answer in category 04, which is weakly correlated with, increases by 0.05.

[Category predecessor / successor relationship]
Preceding and succeeding relationships may be defined between categories. The predecessor / successor relationship is a parameter that defines the recommended learning order of the category. More specifically, the preceding-successor relationship is a weighting parameter defined so that when a certain category is learned in advance, the learning effect of the category to be learned subsequently becomes high. For example, in the above example, when the category "basic properties of sinθ and cosθ" is pre-learned, if the category "basic properties of tanθ" is selected as the subsequent category, the learning effect is expected to be high.

For example, in the example of FIG. 6, when the category 01 precedes, it is expected that the learning effect will be enhanced if the category 02 having the weighting parameter = 0.8 is selected as the succeeding category. Similarly, when category 02 precedes, it is expected that the learning effect will be enhanced if category 03 having a weighting parameter = 0.8 is selected as the succeeding category. In addition, in FIG. 6, in all the categories, the relation between the categories may be defined as a continuous value representing the relation of all learning including the order.

[Number of categories specified for content]
At least one category is assigned to each content. Two or more categories may be assigned to the content. In the example of FIG. 7, the content _0101 is assigned categories 01 and 02, the content _0102 is assigned category 01, and the content _0201 is assigned categories 02, 03, 04, respectively.

<Model storage unit 12A>
The model storage unit 12A stores a model (DKT model) that takes learning data as input and generates a correct answer probability for each category of the user based on the learning data.

[DKT model]
DKT is an abbreviation for Deep Knowledge Tracing. Deep Knowledge Tracing is a technology that uses neural networks (Deep Learning) to model the mechanism by which learners (users) acquire knowledge.

The DKT model is optimized by supervised learning using a large amount of training data collected. Generally, training data includes a set of a vector and a label, but in the case of the DKT model of this embodiment, training data (including both curriculum and adaptive data) as a vector, exercises in the corresponding category as a label, and exercises in the corresponding category as a label. It is possible to use the correct answer rate of the mock exam question, the correct answer rate that the educator judges and labels the corresponding category, and the like. Since the correlation between categories is learned by the DKT model, the correct answer probability of all categories of the subject is estimated even if only the learning data of some categories of the subject in the DKT model is input. Is output.

<Correct answer probability generation unit 12>
The correct answer probability generation unit 12 inputs the learning data into the DKT model and generates the correct answer probability for each category (S12).

<Correct answer probability database 12B>
The correct answer probability database 12B accumulates the time series data of the correct answer probability generated in step S12 for each user and each category. 8A, 8B, and 8C show examples of time-series data of correct answer probability (understanding). FIG. 8A shows an example in which the fluctuation is large. The horizontal axis of the graph may be the number of questions (denoted as a question) or the number of days (denoted as DAY). The vertical axis of the graph is the correct answer probability (or the degree of comprehension described later). In FIG. 8A, for example, by working on learning the curriculum up to Q4 or DAY4 and sequentially inputting the learning data up to Q4 or DAY4 into the DKT model, the correct answer probability temporarily increased, but Q5 or DAY4 As a result of starting adaptive learning from DAY5, the correct answer rate of the exercise is not good, and it corresponds to the case where the correct answer probability temporarily decreases by sequentially inputting the learning data of Q5 or DAY5 or later into the DKT model. To do. In FIG. 8B, for example, Q1 to Q8 or DAY1 to DAY8 are continuously tackled for adaptive learning, and the correct answer probability gradually increases by inputting sequential learning data into the DKT model. Applicable. In FIG. 8C, for example, by working on learning the curriculum up to Q2 or DAY2 and sequentially inputting the learning data up to Q2 or DAY2 into the DKT model, the correct answer probability gradually increases, and from Q3 or DAY3. This is the case where the correct answer probability gradually increases by working on adaptive learning and sequentially inputting the learning data into the DKT model.

<Range data acquisition unit 13>
The range data acquisition unit 13 acquires range data, which is data for designating a range of categories for estimating the learning effect of a predetermined user (S13). For example, when a predetermined user wants to estimate the learning effect of the question range of the mid-term and final exams of the school, the user reads the question range specified in the mid-term and final exams into categories, and all the read categories are range data. Specify (input) as. In addition, when a predetermined user wants to estimate the learning effect of mathematics for high school examination, the user specifies (inputs) all the categories of mathematics to be learned from the first grade to the third grade of junior high school as range data.

Regarding the acquisition of range data, a predetermined user inputs data such as the number of pages of a textbook and a unit name into the range data acquisition unit 13, and the range data acquisition unit 13 reads these data into categories and reads the range data. You may get it.

<Understanding reliability generation unit 14>
The comprehension reliability generation unit 14 acquires the range data in step S13, and the comprehension level based on the correct answer probability (for example, the latest data) in the range data of a predetermined user and the time series data of the comprehension level fluctuate greatly. A reliability that is a small value is generated and output in association with the category (S14). For example, the comprehension reliability generation unit 14 may output the latest correct answer probability of each category in the range data as the comprehension level of each category. Further, for example, if the correct answer probability is equal to or less than a certain value, the comprehension reliability generation unit 14 may consider that the user does not understand the corresponding category and set the comprehension level to 0. Further, for example, if the correct answer probability exceeds a certain value, the comprehension reliability generation unit 14 may use a value corrected by multiplying the correct answer probability by α and subtracting β as the comprehension degree.

Since the comprehension reliability generation unit 14 considers fluctuations in the comprehension time-series data, when the number of comprehension time-series data is less than a predetermined threshold value, the comprehension reliability is set to a predetermined value (with a small value). It is also possible to set (preferably). In addition, when the comprehension level is low enough to be considered that learning has not started (unlearned) in the corresponding category and related categories, that is, when the comprehension level is less than a preset threshold value (preferably a small value). Can also set the reliability to a predetermined value (preferably a small value) even if the degree of understanding is stable.

Comprehension may be generated and output based on a definition different from the above. For example, consider the case where a category belongs to any category set and it is defined that one target category exists in each category set.

For example, as shown in FIG. 9, it is assumed that categories 01, 02, 03 belong to the first category set 5-1 and categories 04, 05 belong to the second category set 5-2, and the first category. The target category of the set 5-1 is category 03, and the target category of the second category set 5-2 is category 05. For example, if multiple units (for example, vector and complex number units) are included in the test range of the regular exam, the categories of each unit are included in each category set, and each category set corresponding to each unit is included. On the other hand, it is preferable to set a target category.

In this case, the comprehension reliability generation unit 14 generates the correct answer probability of the target category included in the range data as the comprehension level of the corresponding category set as a whole, and trusts the entire category set based on the comprehension level of the entire category set. It is preferable to generate a degree.

Further, two or more target categories may exist in one category set, and in that case, the average value of the correct answer probabilities of the two or more target categories may be used as the degree of understanding of the entire category set.

<Recommendation generation unit 15>
The recommendation generation unit 15 belongs to at least one of the cases according to the magnitude relationship between the comprehension level and the predetermined first threshold value and the magnitude relationship between the reliability level and the predetermined second threshold value. The category is generated and output as a recommendation, which is information that is a recommended target for the next learning of a predetermined user (S15).

For example, as shown in FIG. 10, when the comprehension level exceeds the first threshold value T ₁ and the reliability exceeds the second threshold value T ₂ (1), the comprehension level exceeds the first threshold value T ₁ . When it exceeds and the reliability is _{equal to or less than the second threshold T 2} (2), when the degree of understanding is equal to or less than _{the first threshold T 1 and the reliability exceeds the second threshold T 2} (3). ), It is preferable to classify the cases into four patterns, _{that is, the degree of understanding is 1} or less of the first threshold value T 1 and the degree of reliability is _{2 or less of the second threshold value (4).} In the figure, comprehension> T ₁ is comprehension ≥ T ₁ , comprehension ≤ T ₁ is comprehension <T ₁ , reliability> T ₂ is reliability ≥ T ₂ , and reliability ≤ T ₂ is trust. The same case can be divided by setting degree <T _2.

In case 1 in the example of the figure, the user's understanding level in the corresponding category exceeds the preset level (T ₁ , for example, T ₁ = 0.90), and the reliability level in the corresponding category is also set in advance (T). ₂ , for example, when T ₂ = 0.90) is exceeded. A high degree of understanding means that the probability of correct answer of the user in the corresponding category is high, and a high degree of reliability means that the fluctuation of the time series data of the degree of understanding is small as illustrated in FIG. 8B. .. Therefore, it is highly possible that the user has a high degree of proficiency to the extent that he / she can stably obtain a high score in the corresponding category, and that the user's learning is sufficient.

In case 2 in the example of the figure, although the user's understanding level in _{the corresponding category exceeds the preset level (T 1} ), the reliability level in the corresponding category is lower than the _{preset level (T 2).} This is the case. Typically, the most recent learning data in the relevant category marked a high correct answer probability, but looking at the time-series data of past comprehension levels in the relevant category, there are times when the correct answer probability is low and there are large fluctuations. Conceivable.

In case 3 in the example of the figure, the user's understanding level in _{the corresponding category is below the preset level (T 1} ), while the reliability level in the corresponding category exceeds the _{preset level (T 2).} This is the case. Typically, by advancing the learning of another category related to the relevant category, the degree of understanding of the relevant category increases to some extent, and if it is more stable, by advancing the learning of the relevant category, the understanding of the relevant category is achieved. It is possible that the degree is stable. In such a case, in order to further improve the understanding level, it is necessary to proceed with the learning of the corresponding category and stably mark a high score.

In the example of the figure, case 4 is a case where the user's understanding level in the corresponding category is _{below the preset level (T 1} ) and the reliability in the corresponding category is also below the _{preset level (T 2).} is there. Typically, when the degree of understanding is so low that it is considered that learning has not started (unlearned) in the corresponding category and the related category, the reliability may be set to a predetermined small value. Further, as illustrated in FIG. 8A, curriculum learning has progressed to some extent, and the score has decreased in the latest adaptive learning, so that the latest comprehension level has greatly decreased, and the time-series data of the comprehension level has fluctuated. It may be large (that is, low reliability).

For example, the recommendation generation unit 15 may generate and output a recommendation that is information that is a recommended target for the next learning of the corresponding user in the category corresponding to the case 4. For example, the recommendation generation unit 15 sets a recommendation as a target that most recommends the category corresponding to case 4, a target that secondly recommends the category corresponding to case 3, and a target that recommends the category corresponding to case 2 third. It may be generated and output.

Not limited to the above example, the recommendation generation unit 15 may generate recommendations based on various criteria. For example, the recommendation generation unit 15 may generate and output a recommendation as a target that recommends a category whose understanding level is close to 0.5 in the range data. Further, for example, the recommendation generation unit 15 generates a recommendation as a target for recommending a category having questions that are consecutively wrong answers N times (N is an arbitrary integer of 2 or more) in the latest learning data. May be output.

Further, when the degree of understanding and reliability of the preceding category exceeds a predetermined threshold value (1), the recommendation generation unit 15 learns the succeeding category based on the predetermined preceding / succeeding relationship (see the example of FIG. 6) next time. When the degree of understanding of the succeeding category based on the predetermined precedent-successor relationship is less than or equal to the predetermined threshold value and the reliability exceeds the predetermined threshold value (3), the preceding category is recommended for the next learning. As a target, a recommendation may be generated and output.

For example, in the category set shown in FIG. 9, when the comprehension level and the reliability level of the preceding category 01 correspond to case 1, a recommendation is generated with the succeeding category 02 as the recommended target for the next learning, and the subsequent category 02 is generated. When the comprehension level and the reliability level correspond to the case 3, the recommendation may be generated and output with the preceding category 01 as the recommended target for the next learning.

By operating the recommendation generation unit 15 based on the preceding / succeeding relationship, it is possible to prevent the category that is far from the previously learned category as the recommended target for the next learning.

Further, for example, as shown in FIG. 9, when a category set and a target category are set and a plurality of category sets are included in the range data, the recommendation generation unit 15 has a predetermined probability of a plurality of category sets. Generates a flag that specifies the unlearned category set, and generates and outputs a recommendation that is information that is the recommended target for the next learning of a predetermined user for any category in the category set specified by the flag. You may.

The recommendation generation unit 15 may generate a recommendation by using a plurality of the above-mentioned recommendation generation rules in combination.

Further, the recommendation generation unit 15 predicts the learning end date from the comprehension and reliability of each category in the range data, determines whether or not the predicted learning end date is in time for the preset deadline, and determines whether or not the predicted learning end date is in time. The determination result may be output as the progress. For the progress, for example, the change in the comprehension in the future is estimated from the time-series data of the comprehension generated by the comprehension reliability generation unit 14, and the threshold value for which the comprehension is preset is set by the preset deadline. It may be used as an index indicating whether or not it is estimated to exceed.

According to the learning effect estimation device 1 of this embodiment, two parameters, comprehension and reliability, are defined based on the correct answer probability generated by using the DKT model using the neural network (Deep Learning). Based on these two parameters, the learning effect of the user can be estimated by reflecting various aspects of the mechanism by which humans understand things.

<Supplement>
The device of the present invention is, for example, as a single hardware entity, an acquisition unit to which a keyboard or the like can be connected, an output unit to which a liquid crystal display or the like can be connected, and a communication device (for example, a communication cable) capable of communicating outside the hardware entity. Communication unit to which can be connected, CPU (Central Processing Unit, cache memory, registers, etc.), RAM or ROM as memory, external storage device as hard hardware, and acquisition unit, output unit, communication unit of these , CPU, RAM, ROM, has a connecting bus so that data can be exchanged between external storage devices. Further, if necessary, a device (drive) or the like capable of reading and writing a recording medium such as a CD-ROM may be provided in the hardware entity. A general-purpose computer or the like is a physical entity equipped with such hardware resources.

The external storage device of the hardware entity stores the program required to realize the above-mentioned functions and the data required for processing this program (not limited to the external storage device, for example, reading a program). It may be stored in a ROM, which is a dedicated storage device). Further, the data obtained by the processing of these programs is appropriately stored in a RAM, an external storage device, or the like.

In the hardware entity, each program stored in the external storage device (or ROM, etc.) and the data necessary for processing each program are read into the memory as needed, and are appropriately interpreted, executed, and processed by the CPU. .. As a result, the CPU realizes a predetermined function (each configuration requirement represented by the above, ... Department, ... means, etc.).

The present invention is not limited to the above-described embodiment, and can be appropriately modified without departing from the spirit of the present invention. Further, the processes described in the above-described embodiment are not only executed in chronological order according to the order described, but may also be executed in parallel or individually depending on the processing capacity of the device that executes the processes or if necessary. ..

As described above, when the processing function in the hardware entity (device of the present invention) described in the above embodiment is realized by a computer, the processing content of the function that the hardware entity should have is described by a program. Then, by executing this program on the computer, the processing function in the hardware entity is realized on the computer.

The various processes described above can be performed by causing the recording unit 10020 of the computer shown in FIG. 11 to read a program for executing each step of the above method and operating the control unit 10010, the acquisition unit 10030, the output unit 10040, and the like. ..

The program describing the processing content can be recorded on a computer-readable recording medium. The computer-readable recording medium may be, for example, a magnetic recording device, an optical disk, a photomagnetic recording medium, a semiconductor memory, or the like. Specifically, for example, a hard disk device, a flexible disk, a magnetic tape, or the like as a magnetic recording device is used as an optical disk, and a DVD (Digital Versatile Disc), a DVD-RAM (Random Access Memory), or a CD-ROM (Compact Disc Read Only) is used as an optical disk. Memory), CD-R (Recordable) / RW (ReWritable), etc., MO (Magneto-Optical disc), etc. as a magneto-optical recording medium, EEPROM (Electrically Erasable and Programmable-Read Only Memory), etc. as a semiconductor memory Can be used.

In addition, the distribution of this program is performed, for example, by selling, transferring, renting, or the like a portable recording medium such as a DVD or CD-ROM on which the program is recorded. Further, the program may be stored in the storage device of the server computer, and the program may be distributed by transferring the program from the server computer to another computer via a network.

A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. Then, when the process is executed, the computer reads the program stored in its own recording medium and executes the process according to the read program. Further, as another execution form of this program, a computer may read the program directly from a portable recording medium and execute processing according to the program, and further, the program is transferred from the server computer to this computer. It is also possible to execute the process according to the received program one by one each time. Further, the above-mentioned processing is executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by the execution instruction and the result acquisition without transferring the program from the server computer to this computer. May be. The program in this embodiment includes information used for processing by a computer and equivalent to the program (data that is not a direct command to the computer but has a property of defining the processing of the computer, etc.).

Further, in this form, the hardware entity is configured by executing a predetermined program on the computer, but at least a part of these processing contents may be realized in terms of hardware.

Claims (12)

A model storage unit that stores learning data that is data of learning results of a user to which a category for each learning purpose is assigned, and stores a model that generates a correct answer probability for each category of the user based on the learning data. ,
A correct answer probability generation unit that inputs the learning data into the model and generates the correct answer probability for each of the categories.
A correct answer probability database that accumulates time-series data of the correct answer probability for each user, and
Acquire range data, which is data that specifies the range of the category for estimating the learning effect of the predetermined user, and obtain the understanding level based on the correct answer probability in the range data of the predetermined user and the understanding level. Generate a reliability that becomes smaller as the fluctuation of time series data increases.
A learning effect estimation device including a comprehension reliability generator that outputs in association with the category. The learning effect estimation device according to claim 1.
Among the cases according to the magnitude relationship between the degree of understanding and the predetermined first threshold value and the magnitude relationship between the reliability and the predetermined second threshold value, the categories belonging to at least one of the cases are classified.
A learning effect estimation device including a recommendation generation unit that generates and outputs recommendations that are recommended target information for the next learning of the predetermined user. The learning effect estimation device according to claim 1.
A learning effect estimator that includes a recommendation generator that generates and outputs progress. The learning effect estimation device according to claim 1.
It is assumed that the category belongs to at least one category set, and that each of the category sets has one or more target categories.
The comprehension reliability generation unit
A learning effect in which the correct answer probability of the target category included in the range data is generated as the comprehension level of the entire category set corresponding to the target category, and the reliability of the entire category set is generated based on the comprehension level of the entire category set. Estimator. The learning effect estimation device according to claim 1.
The range data is
A learning effect estimation device that is acquired based on the category input by the user, or is acquired based on the converted data by converting the data input by the user into the category. The learning effect estimation device according to claim 2.
The recommendation generation unit
A learning effect estimation device that generates the recommendation based on a preceding / succeeding relationship that is a parameter that defines a recommended learning order of a predetermined category. The learning effect estimation device according to claim 4.
When a plurality of the category sets are included in the range data, the unlearned category set among the plurality of the category sets is designated with a predetermined probability, and any category in the designated category set is specified. A learning effect estimation device including a recommendation generation unit that generates and outputs a recommendation that is information that is a recommended target for the next learning of the predetermined user. A learning effect estimation method in which the learning effect estimation device executes each step.
A step of storing a model in which learning data, which is data of a learning result of a user to which a category according to a learning purpose is assigned, is input, and a model for generating a correct answer probability for each category of the user based on the learning data is stored.
A step of inputting the learning data into the model to generate the correct answer probability for each category, and
A step of accumulating time-series data of the correct answer probability for each user,
Acquire range data, which is data that specifies the range of the category for estimating the learning effect of the predetermined user, and obtain the understanding level based on the correct answer probability in the range data of the predetermined user and the understanding level. Generate a reliability that becomes smaller as the fluctuation of time series data increases.
A learning effect estimation method including a step of outputting in association with the category. The learning effect estimation method according to claim 8.
Among the cases according to the magnitude relationship between the degree of understanding and the predetermined first threshold value and the magnitude relationship between the reliability and the predetermined second threshold value, the categories belonging to at least one of the cases are classified.
A learning effect estimation method including a step of generating and outputting a recommendation which is information that is a recommended target for the next learning of the predetermined user. The learning effect estimation method according to claim 8.
It is assumed that the category belongs to at least one category set, and that each of the category sets has one or more target categories.
A learning effect in which the correct answer probability of the target category included in the range data is generated as the comprehension level of the entire category set corresponding to the target category, and the reliability of the entire category set is generated based on the comprehension level of the entire category set. Estimating method. The learning effect estimation method according to claim 10.
When a plurality of the category sets are included in the range data, the unlearned category set among the plurality of the category sets is designated with a predetermined probability, and any category in the designated category set is specified. A learning effect estimation method including a step of generating and outputting a recommendation which is information that is a recommended target for the next learning of the predetermined user. A program that causes a computer to function as the learning effect estimation device according to any one of claims 1 to 7.

Images