CN112116092A - Interpretable knowledge level tracking method, system and storage medium - Google Patents
Interpretable knowledge level tracking method, system and storage medium Download PDFInfo
- Publication number
- CN112116092A CN112116092A CN202010801341.4A CN202010801341A CN112116092A CN 112116092 A CN112116092 A CN 112116092A CN 202010801341 A CN202010801341 A CN 202010801341A CN 112116092 A CN112116092 A CN 112116092A
- Authority
- CN
- China
- Prior art keywords
- knowledge
- information
- exercise
- interpretable
- vector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/02—Knowledge representation; Symbolic representation
- G06N5/022—Knowledge engineering; Knowledge acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses an interpretable knowledge level tracking method, an interpretable knowledge level tracking system and a storage medium, wherein the method comprises the following steps: constructing an interpretable knowledge tracking model; performing the following steps on the model: distinguishing embedded knowledge point information, exercise text information and exercise answer record information corresponding to the exercise text information; calculating according to the knowledge point information to obtain a key vector; updating the knowledge level of the knowledge point at the previous moment according to the key vector and the exercise answer record information to obtain the knowledge level at the current moment; calculating to obtain a value vector according to the key vector and the knowledge level of the current moment; and predicting answer information of the exercise text information according to the knowledge point information, the value vector and the exercise answer record information through a multi-dimensional project reaction network block. The method can be effectively applied to online large-scale learning knowledge level state tracking scenes. The method can be applied to the technical field of data mining.
Description
Technical Field
The invention relates to the technical field of data mining, in particular to an interpretable knowledge level tracking method, an interpretable knowledge level tracking system and a storage medium.
Background
Interpretation of terms:
and (3) CTT: classic Test Theory, which regards the student's problem solving ability as a linear fit of learning knowledge level plus noise. It makes a huge contribution to the practice of educational measures.
BKT, Bayesian Knowledge tracking.
DKT, Deep Knowledge training, Deep learning Knowledge level assessment.
DKVMN, Dynamic Key-Value Memory Networks, DKVMN model.
Due to the explosive growth of data of online education resources, on one hand, more autonomous knowledge construction support is provided for online learners, and on the other hand, the learning efficiency and the learning effect of the online learners are seriously influenced by the emergent information lost problems. The knowledge level of the learner is tracked in real time, and effective help can be provided for reasonably optimizing the learning schedule of the learner, scheduling the learning enthusiasm of the students, assisting the teacher in improving the teaching efficiency and the like.
The knowledge level assessment method mainly includes the steps of recording problem solving information of online learners through an online learning system and assessing the problem solving ability of students in real time by using a technical means. In the existing knowledge level assessment model, the method based on the deep learning method achieves better effect than the traditional psychological measurement or machine learning method, but the prediction based on the deep learning model does not have good resolution compared with the traditional method, so that the further application in education is inconvenient. The multidimensional project reflection theory is a project testing method developed from a single-dimensional project theory, the parameter representation and the model prediction have good resolvability, but the parameter estimation of the model and the project marking need the participation of a large number of field experts, so that the method is not suitable for online large-scale learning knowledge level state tracking.
Disclosure of Invention
To solve one of the above technical problems, the present invention aims to: an interpretable knowledge level tracking method, system, and storage medium are provided, which can be effectively applied to an online large-scale learning knowledge level state tracking scenario.
In a first aspect, an embodiment of the present invention provides:
an interpretable knowledge level tracking method, comprising the steps of:
constructing an interpretable knowledge tracking model;
performing the following steps on the interpretable knowledge tracking model:
distinguishing embedded knowledge point information, exercise text information and exercise answer record information corresponding to the exercise text information;
calculating according to the knowledge point information to obtain a key vector;
updating the knowledge level of the knowledge point at the previous moment according to the key vector and the exercise answer record information to obtain the knowledge level at the current moment;
calculating to obtain a value vector according to the key vector and the knowledge level of the current moment;
and predicting answer information of the exercise text information according to the knowledge point information, the value vector and the exercise answer record information through a multi-dimensional project reaction network block.
Further, the knowledge point information includes current knowledge point information and adjacent knowledge point information of the exercise text information, and the embedding knowledge point information includes:
respectively converting the current knowledge point information and the adjacent knowledge point information into feature description vectors;
respectively constructing an embedded dimension reduction matrix of the feature description vector;
carrying out dimension reduction processing on the feature description vector through the embedded dimension reduction matrix;
and embedding the feature description vector subjected to dimension reduction.
Further, the embedding problem text information includes:
acquiring language types of the exercise text information, wherein the language types comprise natural languages and programming languages;
when the language type of the exercise text information is natural language, a first type conversion model is adopted to convert the exercise text information into word vectors;
when the language type of the exercise text information is a programming language, a second type conversion model is adopted to convert the exercise text information into word vectors;
and embedding the word vectors by adopting a three-way GRU (generalized regression Unit) cyclic neural network.
Further, the embedding of the exercise answer record information corresponding to the exercise text information includes:
converting the exercise answer record information into a single-valued vector with a preset dimension;
and carrying out embedding processing on the single-value vector.
Further, the calculating to obtain the key vector according to the knowledge point information includes:
embedding a key memory matrix;
calculating to obtain a current knowledge point key vector according to the current knowledge point information and the key memory matrix;
and calculating to obtain key vectors of the adjacent knowledge points according to the information of the adjacent knowledge points and the key memory matrix.
Further, the updating the knowledge level of the knowledge point at the previous moment according to the key vector and the exercise answer record information to obtain the knowledge level of the current moment includes:
performing first fusion processing on the exercise text information and the exercise answer record information;
acquiring a knowledge graph structure to which the exercise text information belongs;
performing second fusion processing on the current knowledge point information and the adjacent knowledge point information according to the information subjected to the first fusion processing and the knowledge graph structure to which the exercise text information belongs to obtain a fusion feature description vector;
and updating the knowledge level of the knowledge point at the previous moment according to the fusion feature description vector, the current knowledge point key vector and the adjacent knowledge point key vector to obtain the knowledge level at the current moment.
Further, after the step of constructing the interpretable knowledge tracking model, the method further comprises the following steps:
and optimizing an objective function of the interpretable knowledge tracking model by adopting a random gradient descent method.
In a second aspect, an embodiment of the present invention provides:
an interpretable knowledge level tracking system, comprising:
a construction unit for constructing an interpretable knowledge tracking model;
wherein the interpretable knowledge tracking model comprises:
the embedded distinguishing processing module is used for distinguishing embedded knowledge point information, exercise text information and exercise answer record information corresponding to the exercise text information;
the knowledge level interpretable query module is used for calculating to obtain a key vector according to the knowledge point information; calculating to obtain a value vector according to the key vector and the knowledge level of the current moment;
the knowledge level interpretable updating module is used for updating the knowledge level of the knowledge point at the previous moment according to the key vector and the exercise answer record information to obtain the knowledge level at the current moment;
and the interpretable exercise score prediction module is used for predicting the predicted answer information of the exercise text information according to the knowledge point information, the value vector and the exercise answer record information through the multidimensional project response network block.
In a third aspect, an embodiment of the present invention provides:
an interpretable knowledge level tracking system, comprising:
at least one memory for storing a program;
at least one processor configured to load the program to perform the interpretable knowledge level tracking method of the embodiment of the first aspect.
In a fourth aspect, an embodiment of the present invention provides:
a storage medium having stored therein processor-executable instructions for implementing the interpretable knowledge level tracking method of the first aspect embodiment when executed by a processor.
The invention has the beneficial effects that: the invention divides and embeds knowledge point information, exercise text information and exercise answer record information corresponding to the exercise text information in the interpretable knowledge tracking model after constructing the interpretable knowledge tracking model, calculates key vectors of the knowledge point information, updates the knowledge level at the previous moment of the knowledge point according to the key vectors and the exercise answer record information to obtain the knowledge level at the current moment, calculates value vectors according to the key vectors and the knowledge level at the current moment, predicts the predicted answer information of the exercise text information according to the knowledge point information, the value vectors and the exercise answer record information through a multi-dimensional project reaction network block, and leads the interpretable knowledge tracking model to have no need of participation of a large number of domain experts by utilizing the good parameter representation mode, the analytically predicted output and the universal approximation characteristic of the multi-dimensional project reaction network block, the method can be effectively applied to online large-scale learning knowledge level state tracking scenes.
Drawings
FIG. 1 is a flow diagram of data processing for interpreting a knowledge tracking model in accordance with one embodiment of the present invention;
FIG. 2 is a schematic diagram of a structure of an interpretable knowledge tracking model according to an embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the figures and the specific embodiments. The step numbers in the following embodiments are provided only for convenience of illustration, the order between the steps is not limited at all, and the execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art.
In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.
The embodiment of the invention provides an interpretable knowledge level tracking method, which can be applied to a server, and the server can interact with a plurality of learning terminals.
Before the explanation of the specific embodiments, the following symbols are defined, and the specific contents are shown in table 1:
TABLE 1
Next, the following explanation is made:
assume that in a learning education system, a course has S {.., S {.i,. } the students study, and the course has Q practice problems. The knowledge points of the course can be regarded as a graph G ═ V, E with a structure, and V represents a knowledge point setCertain dependency relationship exists between the knowledge pointsAnd these knowledge points can be further abstracted to N1Knowledge concept
For a specific student s'iHis problem record can be represented as a sequence set seq (s'i)={(c1,q1,r1),...,(ct,qt,rt),...,(cT,qT,rT) Is of s'i∈S、qtE.g. Q, at the same time (c)t,qt,rt) Representing a set of points of associated knowledge ctProblem qtGiven answer r by the student at time step tt. Exercise question qtRepresented by a set of sequences whose elements are each word from the text content of the problem, can be written asIn the present embodiment, answers to the problem rtIs a Boolean value, which is used to indicate whether the corresponding problem question is right or wrong.
Further, in the present embodiment, it is assumed that each student has a knowledge level varying with time for each knowledge point in each step t, and the rule of updating this knowledge level with time is as follows:
when a student answers a problem, the associated set of knowledge points ctEach knowledge point of the set of knowledge pointsAnd adjacentSet of knowledge points NtThe knowledge level is updated.
Thus, each student problem score prediction method can be described as:
given the exercise material and records within a learning time step 1 to T, the knowledge level of each knowledge point of the learner can be updated by constructing a knowledge level assessment model, using the exercise records to predict the exercise q to be done nextT+1Answer r of (1)T+1。
In view of the above explanation, the implementation process of the present embodiment includes the following steps:
s1, constructing an interpretable knowledge tracking model; the interpretable knowledge tracking model is the knowledge level assessment model, and the specific structure of the interpretable knowledge tracking model is shown in fig. 2. The interpretable knowledge tracking model of the present embodiment differs from existing neural network models in that: the distinguishing embedding is carried out in the model input stage to provide a basis for subsequent model interpretability.
Specifically, the steps shown in fig. 1 are performed on the interpretable knowledge tracking model of step S1:
s21, distinguishing embedded knowledge point information, exercise text information and exercise answer record information corresponding to the exercise text information; this step is carried out with N1Concept of individual knowledgeAnd different embedding is carried out on the different knowledge points for classification basis.
In some embodiments, the knowledge point information includes current knowledge point information and neighboring knowledge point information of the problem text information.
Wherein the embedding knowledge point information includes:
respectively converting the current knowledge point information and the adjacent knowledge point information into feature description vectors;
the method comprises the following specific steps:
set c of current knowledge point informationtConversion to N1Individual knowledge concept feature description vectorWhereinThe elements of the vectorIf it is coincident withAnd isOtherwise
Set N of adjacent knowledge point informationtConversion to N1Description vector of each knowledge characteristicWherein the content of the first and second substances,the elements of the vectorIf it is coincident withAnd isOtherwise
Since the above-constructed knowledge point feature description vectors are too sparse and high dimensional, dimension reduction processing is required. In this embodiment, the embedded dimension reduction matrix of the feature description vector is respectively constructed; and carrying out dimension reduction processing on the feature description vector by embedding a dimension reduction matrix.
Specifically, the process of this step is as follows:
aiming at the feature description vector of the knowledge point contained in the current knowledge point, an embedded dimension reduction matrix is constructedHandleReducing vitaminThe process is shown in equation 1, equation 2, and equation 3:
Aiming at the feature description vectors of adjacent knowledge points, an embedded dimension reduction matrix is constructedHandleReducing vitamin
The process is shown in equation 4 and equation 5:
and finally, embedding the feature description vector subjected to dimension reduction.
The embedding of the exercise answer record information corresponding to the exercise text information comprises:
converting the exercise answer record information into a single-valued vector with a preset dimension; and then embedding the single-value vector. For example, assuming that the current time step for a student to answer is t, the answer is recorded as (c)t,qt,rt) Then, the exercise answer record is converted into dimension d2The transformation process of the single-valued vector of (2) can be as shown in equation 6:
the embedded problem text information comprises:
acquiring language types of the exercise text information, wherein the language types comprise natural languages and programming languages;
when the language type of the exercise text information is natural language, a first type conversion model is adopted to convert the exercise text information into word vectors; the first class transformation model may be word2 vec.
When the language type of the exercise text information is a programming language, a second type conversion model is adopted to convert the exercise text information into word vectors; the second class conversion model may be code2 vec. In the step, the statement block is taken as a unit, and the exercise text information is converted into word vectors.
After the word vector is obtained, a three-way (tri-directional) GRU recurrent neural network is adopted to carry out embedding processing on the word vector. Specifically, a three-way (tri-directional) GRU recurrent neural network is adopted to carry out embedding processing on the exercise text information. The front bidirectional (bidirectional) GRU recurrent neural network is mainly used for learning the time-space dependence of text contents, and the rear unidirectional (uni-directional) GRU recurrent neural network is mainly used for coding learned information to obtain global embedded representation of the text contents of exercise contents.
Specifically, the process of learning text spatio-temporal dependence information based on the bidirectional GRU recurrent neural network is as follows:
the working flow of the cyclic unit of the bidirectional GRU cyclic neural network for learning the spatiotemporal information of the text content of the exercise is described in the following formula 7:
wherein the content of the first and second substances,input weight matrixCyclic network weightsAnd bias weightAre all parameters that need to be trained in the network block.
In the embodiment, because the bidirectional cyclic neural network is adopted, the word vector hidden state in the forward direction is recorded asThe word vector hidden state in the backward direction is expressed asAfter the processing of formula 7, the hidden states of all word vectors in the forward and backward directions can be obtained, and in order to construct the embedded representation of the global problem text content, the obtained hidden state vectors need to be fused, and the embodiment adopts average fusion processing, that is, the average fusion processing is adopted, that is, the hidden state vectors are subjected to forward and backward hidden states
Since the content in the problem text contains different vocabularies, such as natural language, programming language, etc., in different semantic spaces, it needs to perform weighting and equivalent processing, and this embodiment uses the attention mechanism and current knowledge embedding pairThe processing is carried out, and the operation formula is shown as formula 8:
The problem text global embedding encoder based on the GRU recurrent neural network comprises the following specific processes:
after a fused word vector hidden state sequence is obtainedAdopting a unidirectional GRU recurrent neural network as a global exercise text for the sequenceThe content embedding represents an encoder, and the processing procedure is shown as formula 9:
wherein GRU (. cndot.,) represents a recurrent neural network, the parameters of which are respectively an input sequence and a parameter list to be trained, the internal structure of which is the same as that of formula 7, and a weight matrix is simultaneously inputCyclic network weightsAnd bias weightAre all parameters that need to be trained in the network block.
Since the above-constructed model requires a memory matrix to store and track the hidden states of the learner's knowledge level, existing knowledge hidden states lack interpretable parametric representations. Therefore, the embodiment proposes a knowledge level parameter memory matrix with definite meaning, which includes a key memory matrix for providing knowledge point component query and a value memory matrix for recording hidden state of knowledge level, and also provides a method for matching knowledge level interpretable query and knowledge level interpretable update, and the process is as follows:
s22, calculating according to the knowledge point information to obtain a key vector; the key vectors include a current knowledge point key vector and an adjacent knowledge point key vector.
In some embodiments, this step is specifically as follows:
embedding a key memory matrix; the key memory matrix has the performance of storing long-term stable knowledge.
Calculating to obtain a current knowledge point key vector according to the current knowledge point information and the key memory matrix;
and calculating to obtain key vectors of the adjacent knowledge points according to the information of the adjacent knowledge points and the key memory matrix.
In particular, one dimension d may be taken3×N1The matrix is a key memory matrix that has the capability of storing long-term stable knowledge, denoted as K. The knowledge point component information of each problem can be inquired from the key memory matrix through specific operation, the inquired vector is called key vector, and its meaning is the influence weight of the related knowledge point of the problem to the knowledge level, including the current knowledge point key vector betatAnd neighboring knowledge point key vector gammat. Assuming that the current time step is t, the answer is recorded as (c)t,qt,rt) About problem qtKnowledge point set ctAnd its neighboring knowledge points NtThe key vectors of (a) can be obtained by the operation of equation 10:
S23, updating the knowledge level of the knowledge point at the previous moment according to the key vector and the exercise answer record information to obtain the knowledge level at the current moment;
in some embodiments, this step may be implemented by:
performing first fusion processing on the exercise text information and the exercise answer record information; the first fusion process refers to the information aggregation stage.
Acquiring a knowledge graph structure to which the exercise text information belongs;
performing second fusion processing on the current knowledge point information and the adjacent knowledge point information according to the information subjected to the first fusion processing and the knowledge graph structure to which the exercise text information belongs to obtain a fusion feature description vector; the second fusion process refers to a value update phase.
And updating the knowledge level of the knowledge point at the previous moment according to the fusion feature description vector, the current knowledge point key vector and the adjacent knowledge point key vector to obtain the knowledge level at the current moment.
Specifically, the knowledge level updating of the step mainly plays a role in tracking and updating the knowledge level of the learner. Assuming the current time step is t, the question answer record information is (c)t,qt,rt) As shown in FIG. 2, the knowledge level update network block of this step will update the value-memory matrix from the previous time step vt-1Updating to the current knowledge level state vtAnd a time sequence memory function is provided for subsequent knowledge level tracking and exercise score prediction. Updating the content of the network block by the knowledge level mainly comprises two processes: an information aggregation phase and a value update phase.
The specific process of the information aggregation stage is as follows:
assuming the current time step is t, the question answer record information is (c)t,qt,rt) First, the embedded representation x of the text information content of the problemtRelative answer r to the exercise text informationt ECarrying out polymerization by using the formula 11:
then, the knowledge point information c corresponding to the exercisetAnd its adjacent knowledge points NtBased on information aggregation phase acquisitionFurther fusing the knowledge point diagram structure related to the course to obtain a fused feature vectorThe fusion can be realized by formula 12, formula 13 and formula 14:
wherein the content of the first and second substances,fneighboris a fully-connected neural network function that is used to decide how current knowledge point set information is passed to neighboring knowledge point sets.
Obtaining a fused feature vectorThen, updating the knowledge level, and combining the queried current knowledge point key vector beta through a unidirectional GRU recurrent neural network suitable for the problem scenetAnd neighboring knowledge point key vector gammatThe state of knowledge level of the trainee is updated, and the updating operation process is shown as formula 15:
wherein, Vt jIs a value memory matrix VtThe vector of the j-th column of the image,andbelonging to the weight parameters to be trained in the network block.
S24, calculating to obtain a value vector according to the key vector and the knowledge level of the current moment; this step is in accordance with current knowledgeAnd calculating the key vector of the identification point information and the knowledge level of the previous moment to obtain a value vector. Which is to track the level of knowledge of the student. In particular, with a d4×N1The memory matrix of (a) represents the hidden state of the trainee's knowledge level and is recorded as a value memory matrix V. Assuming that the current time step is t, the answer is recorded as (c)t,qt) When the learner predicts the exercise result, it needs to search out the knowledge level vector associated with the exercise knowledge point from the value memory matrix V, called value vector, and record it as value vectorThe query process is shown in equation 16:
wherein, softmax (·, ·) represents a vector-wise part connected with softmax neural network, the first parameter is network input, and the second parameter is a weight parameter which needs training for the network.
After the embedding, querying and updating of the knowledge points are completed, step S25 is executed to perform answer prediction.
And S25, predicting answer information of the exercise text information according to the knowledge point information, the value vector and the exercise answer record information through the multi-dimensional project reaction network block.
Specifically, in this step, after the knowledge level state of the student is obtained, the answer condition of the student to the problem needs to be predicted. The method combines the good analytic performance of the multidimensional project reaction theory and the universal approaching property of the neural network capable of being programmed in a micro mode, and is suitable for large-scale online student exercise solvability performance prediction.
Specifically, the parameters of the multidimensional project reaction theory model are estimated by using a micro-programming method, and the model is shown as formula 17:
wherein the content of the first and second substances,showing the mastery of the knowledge concept by the trainee at time step t,a value representing the influence of the mastery conditions on student answer conditions, dnIndicating the difficulty of the problem, cnGuess coefficients representing answers, cθThe presetter is used for controlling the student ability value range.
The multi-dimensional project reaction theory model parameters are solved by combining the multi-dimensional project reaction theory and a micro-programming method.
First, in estimating the ability of a student, the parameter θ is mainly solvedtAnd alphatWherein, the multidimensional project reaction network block is also called multidimensional project reaction theoretical model, and the multidimensional project reaction network block takes knowledge level V of the studentt jAnd problem text content xtKey vector beta of current problem knowledge pointtAs an input, a micro-programmable method is used to obtain the desired parameter estimation, and the process can be described as the following formula 18:
when evaluating the difficulty parameter of the exercise, the key vector beta of the knowledge point is usedtAnd embedding x of problem text contenttImplementing the parameter c for the input of a network block using a microprogrammable methodn、dnSolution of (2), it is specificThe process is shown in equation 19:
therefore, the achievement prediction output module is constructed completely,for the result prediction output of the exercises, the model has good parameter representation and resolvable result prediction output and an efficient parameter solving method through the statements, can be applied to tracking and evaluating the knowledge level of large-scale students on line, and realizes the interpretable prediction output of the scores of the students.
Before the above model is applied specifically, in some embodiments, the objective function of the interpretable knowledge tracking model is optimized by a stochastic gradient descent method.
Specifically, the model of the present embodiment is an end-to-end, fully differentiable neural network model, and therefore, the parameters that need to be trained include: exercise text embeddedPart of the key-value pair query processKnowledge level updating network blocksMultidimensional item reflects { W of a network block*,b*}. During the t-th time step, the model of this embodiment answers question qtGive aPredictive answersThe actual answer made by the student is recorded as a case rt. The aim of the model training is to adjust the above parameters based on the observed sequence s'i={(c1,q1,r1),(c2,q2,r2),...,(cT,qT,rT) To minimize the objective function equation 20:
since the model is fully differentiable, the objective function is optimized by the stochastic gradient descent algorithm, so that the training of the model is completed.
In summary, the embodiment of the invention utilizes the good parameter representation mode, the analytically predictable output and the universal approximation characteristic of the multidimensional project response network block, so that the constructed interpretable knowledge tracking model can be effectively applied to the online large-scale learning knowledge level state tracking scene without the participation of a large number of field experts.
An embodiment of the present invention provides an interpretable knowledge level tracking system, including:
a construction unit for constructing an interpretable knowledge tracking model;
wherein, as shown in fig. 2, the interpretable knowledge tracking model comprises:
the embedded distinguishing processing module is used for distinguishing embedded knowledge point information, exercise text information and exercise answer record information corresponding to the exercise text information;
the knowledge level interpretable query module is used for calculating to obtain a key vector according to the knowledge point information; calculating to obtain a value vector according to the key vector and the knowledge level of the current moment;
the knowledge level interpretable updating module is used for updating the knowledge level of the knowledge point at the previous moment according to the key vector and the exercise answer record information to obtain the knowledge level at the current moment;
and the interpretable exercise score prediction module is used for predicting the predicted answer information of the exercise text information according to the knowledge point information, the value vector and the exercise answer record information through the multidimensional project response network block.
The content of the embodiment of the method of the invention is all applicable to the embodiment of the system, the function of the embodiment of the system is the same as the embodiment of the method, and the beneficial effect achieved by the embodiment of the system is the same as the beneficial effect achieved by the method.
An embodiment of the present invention provides an interpretable knowledge level tracking system, including:
at least one memory for storing a program;
at least one processor configured to load the program to perform the interpretable knowledge level tracking method of the embodiment of the first aspect.
The content of the embodiment of the method of the invention is all applicable to the embodiment of the system, the function of the embodiment of the system is the same as the embodiment of the method, and the beneficial effect achieved by the embodiment of the system is the same as the beneficial effect achieved by the method.
Furthermore, a storage medium is provided, in which processor-executable instructions are stored, which when executed by a processor are used to implement the interpretable knowledge level tracking method of an embodiment of the first aspect.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. An interpretable knowledge level tracking method, comprising the steps of:
constructing an interpretable knowledge tracking model;
performing the following steps on the interpretable knowledge tracking model:
distinguishing embedded knowledge point information, exercise text information and exercise answer record information corresponding to the exercise text information;
calculating according to the knowledge point information to obtain a key vector;
updating the knowledge level of the knowledge point at the previous moment according to the key vector and the exercise answer record information to obtain the knowledge level at the current moment;
calculating to obtain a value vector according to the key vector and the knowledge level of the current moment;
and predicting answer information of the exercise text information according to the knowledge point information, the value vector and the exercise answer record information through a multi-dimensional project reaction network block.
2. An interpretable knowledge level tracking method according to claim 1, wherein the knowledge point information includes current knowledge point information and adjacent knowledge point information of the problem text information, and the embedded knowledge point information includes:
respectively converting the current knowledge point information and the adjacent knowledge point information into feature description vectors;
respectively constructing an embedded dimension reduction matrix of the feature description vector;
carrying out dimension reduction processing on the feature description vector through the embedded dimension reduction matrix;
and embedding the feature description vector subjected to dimension reduction.
3. The method of claim 1, wherein said embedding problem text information comprises:
acquiring language types of the exercise text information, wherein the language types comprise natural languages and programming languages;
when the language type of the exercise text information is natural language, a first type conversion model is adopted to convert the exercise text information into word vectors;
when the language type of the exercise text information is a programming language, a second type conversion model is adopted to convert the exercise text information into word vectors;
and embedding the word vectors by adopting a three-way GRU (generalized regression Unit) cyclic neural network.
4. An interpretable knowledge level tracking method according to claim 1, wherein embedding problem answer record information corresponding to the problem text information includes:
converting the exercise answer record information into a single-valued vector with a preset dimension;
and carrying out embedding processing on the single-value vector.
5. An interpretable knowledge level tracking method according to claim 2, wherein the calculating a key vector from the knowledge point information comprises:
embedding a key memory matrix;
calculating to obtain a current knowledge point key vector according to the current knowledge point information and the key memory matrix;
and calculating to obtain key vectors of the adjacent knowledge points according to the information of the adjacent knowledge points and the key memory matrix.
6. An interpretable knowledge level tracking method according to claim 5, wherein the updating the knowledge level at the previous time of the knowledge point according to the key vector and the exercise answer record information to obtain the knowledge level at the current time comprises:
performing first fusion processing on the exercise text information and the exercise answer record information;
acquiring a knowledge graph structure to which the exercise text information belongs;
performing second fusion processing on the current knowledge point information and the adjacent knowledge point information according to the information subjected to the first fusion processing and the knowledge graph structure to which the exercise text information belongs to obtain a fusion feature description vector;
and updating the knowledge level of the knowledge point at the previous moment according to the fusion feature description vector, the current knowledge point key vector and the adjacent knowledge point key vector to obtain the knowledge level at the current moment.
7. The interpretable knowledge level tracking method of claim 1, further comprising, after the step of constructing an interpretable knowledge tracking model, the steps of:
and optimizing an objective function of the interpretable knowledge tracking model by adopting a random gradient descent method.
8. An interpretable knowledge level tracking system, comprising:
a construction unit for constructing an interpretable knowledge tracking model;
wherein the interpretable knowledge tracking model comprises:
the embedded distinguishing processing module is used for distinguishing embedded knowledge point information, exercise text information and exercise answer record information corresponding to the exercise text information;
the knowledge level interpretable query module is used for calculating to obtain a key vector according to the knowledge point information; calculating to obtain a value vector according to the key vector and the knowledge level of the current moment;
the knowledge level interpretable updating module is used for updating the knowledge level of the knowledge point at the previous moment according to the key vector and the exercise answer record information to obtain the knowledge level at the current moment;
and the interpretable exercise score prediction module is used for predicting the predicted answer information of the exercise text information according to the knowledge point information, the value vector and the exercise answer record information through the multidimensional project response network block.
9. An interpretable knowledge level tracking system, comprising:
at least one memory for storing a program;
at least one processor configured to load the program to perform the interpretable knowledge level tracking method of any one of claims 1-7.
10. A storage medium having stored therein processor-executable instructions for implementing the interpretable knowledge level tracking method of any one of claims 1-7 when executed by a processor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010801341.4A CN112116092B (en) | 2020-08-11 | 2020-08-11 | Interpretable knowledge level tracking method, system and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010801341.4A CN112116092B (en) | 2020-08-11 | 2020-08-11 | Interpretable knowledge level tracking method, system and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112116092A true CN112116092A (en) | 2020-12-22 |
CN112116092B CN112116092B (en) | 2022-03-25 |
Family
ID=73803985
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010801341.4A Active CN112116092B (en) | 2020-08-11 | 2020-08-11 | Interpretable knowledge level tracking method, system and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112116092B (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112766513A (en) * | 2021-01-29 | 2021-05-07 | 华中师范大学 | Knowledge tracking method and system with memory cooperation |
CN112818100A (en) * | 2021-01-29 | 2021-05-18 | 华中师范大学 | Knowledge tracking method and system fusing question difficulty |
CN113239699A (en) * | 2021-04-15 | 2021-08-10 | 北京师范大学 | Depth knowledge tracking method and system integrating multiple features |
CN113724110A (en) * | 2021-08-27 | 2021-11-30 | 中国海洋大学 | Interpretable depth knowledge tracking method and system and application thereof |
CN114155124A (en) * | 2022-02-07 | 2022-03-08 | 山东建筑大学 | Test question resource recommendation method and system |
CN114417164A (en) * | 2022-01-24 | 2022-04-29 | 湖南大学 | User knowledge state tracking method and device and storage medium |
CN114911975A (en) * | 2022-05-05 | 2022-08-16 | 金华航大北斗应用技术有限公司 | Knowledge tracking method based on graph attention network |
CN116306773A (en) * | 2022-09-13 | 2023-06-23 | 西湖大学 | Interpretable neural network dimension reduction analysis system |
CN116578694A (en) * | 2023-04-21 | 2023-08-11 | 华南师范大学 | Disentangled knowledge tracking method, system, device and medium |
CN114417164B (en) * | 2022-01-24 | 2024-07-02 | 湖南大学 | Tracking method, device and storage medium for user knowledge state |
Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140272914A1 (en) * | 2013-03-15 | 2014-09-18 | William Marsh Rice University | Sparse Factor Analysis for Learning Analytics and Content Analytics |
CN107025219A (en) * | 2017-04-19 | 2017-08-08 | 厦门大学 | A kind of word insertion method for expressing based on internal Semantic hierarchy |
CN107067849A (en) * | 2017-04-21 | 2017-08-18 | 杭州博世数据网络有限公司 | Parent's end system based on cloud teaching platform |
CN107545146A (en) * | 2017-09-08 | 2018-01-05 | 北京辅仁淑凡软件科技有限公司 | A kind of Psychological Evaluation method that can adaptively set a question |
CN107729497A (en) * | 2017-10-20 | 2018-02-23 | 同济大学 | A kind of word insert depth learning method of knowledge based collection of illustrative plates |
CN107729987A (en) * | 2017-09-19 | 2018-02-23 | 东华大学 | The automatic describing method of night vision image based on depth convolution loop neutral net |
CN108920705A (en) * | 2018-07-19 | 2018-11-30 | 深圳习习网络科技有限公司 | A kind of coding method of knowledge point identification and device |
CN109598995A (en) * | 2019-01-08 | 2019-04-09 | 上海健坤教育科技有限公司 | Intelligent tutoring system based on Bayes's knowledge trace model |
CN110297817A (en) * | 2019-06-25 | 2019-10-01 | 哈尔滨工业大学 | A method of the structure of knowledge is constructed based on personalized Bayes's knowledge tracing model |
CN110377707A (en) * | 2019-07-25 | 2019-10-25 | 中国科学技术大学 | Cognitive diagnosis method based on depth item response theory |
CN110378818A (en) * | 2019-07-22 | 2019-10-25 | 广西大学 | Personalized exercise recommended method, system and medium based on difficulty |
CN110428010A (en) * | 2019-08-05 | 2019-11-08 | 中国科学技术大学 | Knowledge method for tracing |
CN110704732A (en) * | 2019-09-19 | 2020-01-17 | 广州大学 | Cognitive diagnosis-based time-sequence problem recommendation method |
CN110930274A (en) * | 2019-12-02 | 2020-03-27 | 中山大学 | Practice effect evaluation and learning path recommendation system and method based on cognitive diagnosis |
CN110941723A (en) * | 2019-11-18 | 2020-03-31 | 广东宜学通教育科技有限公司 | Method, system and storage medium for constructing knowledge graph |
CN110991645A (en) * | 2019-11-18 | 2020-04-10 | 广东宜学通教育科技有限公司 | Self-adaptive learning method, system and storage medium based on knowledge model |
CN111159419A (en) * | 2019-12-09 | 2020-05-15 | 浙江师范大学 | Knowledge tracking data processing method, system and storage medium based on graph convolution |
CN111461442A (en) * | 2020-04-07 | 2020-07-28 | 中国科学技术大学 | Knowledge tracking method and system based on federal learning |
CN111475645A (en) * | 2020-03-17 | 2020-07-31 | 平安国际智慧城市科技股份有限公司 | Knowledge point marking method and device and computer readable storage medium |
-
2020
- 2020-08-11 CN CN202010801341.4A patent/CN112116092B/en active Active
Patent Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140272914A1 (en) * | 2013-03-15 | 2014-09-18 | William Marsh Rice University | Sparse Factor Analysis for Learning Analytics and Content Analytics |
CN107025219A (en) * | 2017-04-19 | 2017-08-08 | 厦门大学 | A kind of word insertion method for expressing based on internal Semantic hierarchy |
CN107067849A (en) * | 2017-04-21 | 2017-08-18 | 杭州博世数据网络有限公司 | Parent's end system based on cloud teaching platform |
CN107545146A (en) * | 2017-09-08 | 2018-01-05 | 北京辅仁淑凡软件科技有限公司 | A kind of Psychological Evaluation method that can adaptively set a question |
CN107729987A (en) * | 2017-09-19 | 2018-02-23 | 东华大学 | The automatic describing method of night vision image based on depth convolution loop neutral net |
CN107729497A (en) * | 2017-10-20 | 2018-02-23 | 同济大学 | A kind of word insert depth learning method of knowledge based collection of illustrative plates |
CN108920705A (en) * | 2018-07-19 | 2018-11-30 | 深圳习习网络科技有限公司 | A kind of coding method of knowledge point identification and device |
CN109598995A (en) * | 2019-01-08 | 2019-04-09 | 上海健坤教育科技有限公司 | Intelligent tutoring system based on Bayes's knowledge trace model |
CN110297817A (en) * | 2019-06-25 | 2019-10-01 | 哈尔滨工业大学 | A method of the structure of knowledge is constructed based on personalized Bayes's knowledge tracing model |
CN110378818A (en) * | 2019-07-22 | 2019-10-25 | 广西大学 | Personalized exercise recommended method, system and medium based on difficulty |
CN110377707A (en) * | 2019-07-25 | 2019-10-25 | 中国科学技术大学 | Cognitive diagnosis method based on depth item response theory |
CN110428010A (en) * | 2019-08-05 | 2019-11-08 | 中国科学技术大学 | Knowledge method for tracing |
CN110704732A (en) * | 2019-09-19 | 2020-01-17 | 广州大学 | Cognitive diagnosis-based time-sequence problem recommendation method |
CN110941723A (en) * | 2019-11-18 | 2020-03-31 | 广东宜学通教育科技有限公司 | Method, system and storage medium for constructing knowledge graph |
CN110991645A (en) * | 2019-11-18 | 2020-04-10 | 广东宜学通教育科技有限公司 | Self-adaptive learning method, system and storage medium based on knowledge model |
CN110930274A (en) * | 2019-12-02 | 2020-03-27 | 中山大学 | Practice effect evaluation and learning path recommendation system and method based on cognitive diagnosis |
CN111159419A (en) * | 2019-12-09 | 2020-05-15 | 浙江师范大学 | Knowledge tracking data processing method, system and storage medium based on graph convolution |
CN111475645A (en) * | 2020-03-17 | 2020-07-31 | 平安国际智慧城市科技股份有限公司 | Knowledge point marking method and device and computer readable storage medium |
CN111461442A (en) * | 2020-04-07 | 2020-07-28 | 中国科学技术大学 | Knowledge tracking method and system based on federal learning |
Non-Patent Citations (3)
Title |
---|
DONG LIU ET AL: "Deep Knowledge Tracking based on Attention Mechanism for Student Performance Prediction", 《2020 IEEE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND EDUCATIONAL 》 * |
刘恒宇等: "知识追踪综述", 《华东师范大学学报(自然科学版)》 * |
王鹏等: "多维项目反应理论补偿性模型参数估计:基于广义回归神经网络集合", 《心理学探新》 * |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112766513A (en) * | 2021-01-29 | 2021-05-07 | 华中师范大学 | Knowledge tracking method and system with memory cooperation |
CN112818100A (en) * | 2021-01-29 | 2021-05-18 | 华中师范大学 | Knowledge tracking method and system fusing question difficulty |
CN112766513B (en) * | 2021-01-29 | 2024-05-07 | 华中师范大学 | Knowledge tracking method and system for memory collaboration |
CN112818100B (en) * | 2021-01-29 | 2023-12-22 | 华中师范大学 | Knowledge tracking method and system for integrating question difficulty |
CN113239699A (en) * | 2021-04-15 | 2021-08-10 | 北京师范大学 | Depth knowledge tracking method and system integrating multiple features |
CN113239699B (en) * | 2021-04-15 | 2023-11-07 | 北京师范大学 | Depth knowledge tracking method and system integrating multiple features |
CN113724110A (en) * | 2021-08-27 | 2021-11-30 | 中国海洋大学 | Interpretable depth knowledge tracking method and system and application thereof |
CN114417164B (en) * | 2022-01-24 | 2024-07-02 | 湖南大学 | Tracking method, device and storage medium for user knowledge state |
CN114417164A (en) * | 2022-01-24 | 2022-04-29 | 湖南大学 | User knowledge state tracking method and device and storage medium |
CN114155124B (en) * | 2022-02-07 | 2022-07-12 | 山东建筑大学 | Test question resource recommendation method and system |
CN114155124A (en) * | 2022-02-07 | 2022-03-08 | 山东建筑大学 | Test question resource recommendation method and system |
CN114911975A (en) * | 2022-05-05 | 2022-08-16 | 金华航大北斗应用技术有限公司 | Knowledge tracking method based on graph attention network |
CN114911975B (en) * | 2022-05-05 | 2024-04-05 | 金华航大北斗应用技术有限公司 | Knowledge tracking method based on graph attention network |
CN116306773A (en) * | 2022-09-13 | 2023-06-23 | 西湖大学 | Interpretable neural network dimension reduction analysis system |
CN116306773B (en) * | 2022-09-13 | 2024-03-26 | 西湖大学 | Interpretable neural network high-dimensional data dimension reduction analysis system |
CN116578694B (en) * | 2023-04-21 | 2024-01-09 | 华南师范大学 | Disentangled knowledge tracking method, system, device and medium |
CN116578694A (en) * | 2023-04-21 | 2023-08-11 | 华南师范大学 | Disentangled knowledge tracking method, system, device and medium |
Also Published As
Publication number | Publication date |
---|---|
CN112116092B (en) | 2022-03-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112116092B (en) | Interpretable knowledge level tracking method, system and storage medium | |
Chen et al. | Prerequisite-driven deep knowledge tracing | |
CN110264091B (en) | Student Cognitive Diagnosis Method | |
CN110428010B (en) | Knowledge tracking method | |
Wang et al. | Deep hierarchical knowledge tracing | |
CN110941723A (en) | Method, system and storage medium for constructing knowledge graph | |
CN111695779A (en) | Knowledge tracking method, knowledge tracking device and storage medium | |
CN113360635B (en) | Intelligent teaching method and system based on self-attention and pre-training mechanism | |
CN115545160B (en) | Knowledge tracking method and system for multi-learning behavior collaboration | |
CN112506945B (en) | Self-adaptive learning guiding method and system based on knowledge graph | |
Lu et al. | CMKT: Concept map driven knowledge tracing | |
CN108228674A (en) | A kind of information processing method and device based on DKT | |
CN114021722A (en) | Attention knowledge tracking method integrating cognitive portrayal | |
CN115545155A (en) | Multi-level intelligent cognitive tracking method and system, storage medium and terminal | |
Duan | Automatic generation and evolution of personalized curriculum based on genetic algorithm | |
CN116136870A (en) | Intelligent social conversation method and conversation system based on enhanced entity representation | |
CN115238036A (en) | Cognitive diagnosis method and device based on graph attention network and text information | |
CN115310520A (en) | Multi-feature-fused depth knowledge tracking method and exercise recommendation method | |
CN113591988B (en) | Knowledge cognitive structure analysis method, system, computer equipment, medium and terminal | |
CN114676903A (en) | Online prediction method and system based on time perception and cognitive diagnosis | |
Dai et al. | Knowledge tracing: A review of available technologies | |
CN118020097A (en) | Method and apparatus for prerequisite relationship discovery for concepts of multiple courses | |
CN112785039B (en) | Prediction method and related device for answer score rate of test questions | |
CN114707775A (en) | Knowledge tracking model training method, tracking method, device, equipment and medium | |
Zhou | Research on teaching resource recommendation algorithm based on deep learning and cognitive diagnosis |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |