CN111311055A - User capacity evaluation method and device and storage medium - Google Patents
User capacity evaluation method and device and storage medium Download PDFInfo
- Publication number
- CN111311055A CN111311055A CN201911373721.6A CN201911373721A CN111311055A CN 111311055 A CN111311055 A CN 111311055A CN 201911373721 A CN201911373721 A CN 201911373721A CN 111311055 A CN111311055 A CN 111311055A
- Authority
- CN
- China
- Prior art keywords
- value
- user
- ability
- current
- answering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
Abstract
The application provides a method and a device for evaluating user capacity and a storage medium. The method comprises the following steps: selecting test questions with the difficulty values matched with the current capability values of the users from the test question library; pushing the test questions to the user; acquiring the answering time and answering results of the test questions answered by the user; and adjusting the current ability value according to the time spent on answering and the answering result to obtain the ability value adjusted by the user. In the process of testing and evaluating the ability of the user, the time spent on answering the test questions by the user is also taken into consideration, so that the ability of the user is comprehensively evaluated in a multi-dimensional manner through the time spent on answering and the answering results, and the real ability of the user can be evaluated.
Description
Technical Field
The present application relates to the field, and in particular, to a method and an apparatus for evaluating user capabilities, and a storage medium.
Background
With the development of science and technology, the learning mode of people also changes from the paper learning to the electronic learning. On an electronic platform, in order to find a learning course suitable for a user better and faster, the user usually tests the self ability first, and selects a learning product and a learning mode matched with the self ability according to the ability test result, so that the learning efficiency can be greatly improved.
In the current capability test, the capability of the user is usually evaluated according to the answer result of the user to the test question, namely, whether the answer of the user is correct or not is considered, but the standard of the capability measurement is not comprehensive enough, and the true capability of the user is difficult to evaluate.
Disclosure of Invention
An object of the embodiments of the present application is to provide a method, an apparatus, and a storage medium for evaluating user ability, so as to achieve evaluation of a true ability of a user.
In a first aspect, an embodiment of the present application provides a method for evaluating user capability, where the method includes:
selecting test questions with the difficulty values matched with the current capability values of the users from the test question library; pushing the test questions to the user; acquiring the time consumed by the user to answer the test question and the answering result; and adjusting the current ability value according to the response time and the response result to obtain the adjusted ability value of the user.
In the embodiment of the application, in the process of testing and evaluating the ability of the user, the time spent on answering the test questions by the user is also taken into consideration, so that the ability of the user can be comprehensively evaluated in multiple dimensions through the time spent on answering and the answering result, and the real ability of the user can be evaluated.
With reference to the first aspect, in a first possible implementation manner, the adjusting the current ability value according to the response time and the response result to obtain the current ability value adjusted by the user includes:
processing the answer result by using a preset IRT model to obtain a first ability adjustment value of the user, and processing the answer time and the current ability value by using a preset relation function of time consumption and ability to obtain a second ability adjustment value of the user; and determining the adjusted capacity value according to the current capacity value, the first capacity adjustment value and the second capacity adjustment value.
In the embodiment of the application, because the IRT model can accurately evaluate the difference between the difficulty of the test question and the capability of the user, the first capability adjustment value can be accurately determined through the IRT model. In addition, since the relationship function can reflect the relationship between the response time and the current ability value, the second ability adjustment value corresponding to the response time can be accurately determined through the relationship function. Therefore, by accurately determining the first capability adjustment value and the second capability adjustment value, the capability of the user can be accurately adjusted.
With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, processing the response time and the current ability value by using a preset time-to-ability relationship function to obtain a second ability adjustment value of the user includes:
determining the relevance of the response time and the current difficulty based on the current capacity value and the response time; and processing the answering time, the correlation degree, the average value of all preset answering times of the test questions and the standard deviation of all the answering times by using the relation function to obtain the second capacity adjustment value.
In the embodiment of the present application, in the process of measuring the second capability adjustment value, by taking the average value and the standard deviation of all the responses into account, there is an explicit reference for measuring the second capability adjustment value, so as to determine the second capability adjustment value more accurately.
With reference to the second possible implementation manner of the first aspect, in a third possible implementation manner, determining a correlation between the response time and the current difficulty based on the current capability value and the response time includes:
calculating the current capability value and the response time by utilizing a preset Pearson correlation function, and determining the correlation;
wherein the Pearson correlation function is:
x represents the time spent answering, and y represents the current ability value.
In the embodiment of the application, the correlation between the current capacity value and the response time is determined by the pearson correlation function, so that the current capacity value is also taken into account in the process of determining the second capacity adjustment value, and the second capacity adjustment value is determined more accurately.
With reference to the first aspect, in a fourth possible implementation manner, after obtaining the current ability value adjusted by the user, the method further includes:
determining the current ability value, the adjusted ability value and the standard deviation of all the history ability values of the user; judging whether the standard deviation is smaller than a preset value or not; if so, ending the evaluation of the user capability; and if not, continuously evaluating the capability of the user by using the test questions selected from the test question library and having the difficulty values of the test questions matched with the adjusted capability values.
In the embodiment of the application, whether convergence occurs in the evaluation of the user capability can be judged by judging whether the standard deviation is smaller than the preset value, and if the convergence occurs, the evaluation of the user capability tends to be stable, so that the user capability can be accurately evaluated.
With reference to the first aspect, in a fifth possible implementation manner, the step of determining the difficulty value of the test question includes:
and calculating all answer results obtained by answering the test questions in history by using a maximum likelihood estimation method, and determining the difficulty value of the test questions.
In the embodiment of the application, the difficulty value of the test question can be objectively and accurately determined through all the answer results obtained by answering the test question in the history.
In a second aspect, an embodiment of the present application provides an apparatus for evaluating user ability, where the apparatus includes:
the test question selecting and pushing module is used for selecting test questions with the difficulty values matched with the current capability values of the users from the test question library; pushing the test questions to the user;
the user ability adjusting module is used for acquiring the response consumption time and response results of the test questions when the user responses; and adjusting the current ability value according to the response time and the response result to obtain the ability value adjusted by the user.
With reference to the second aspect, in a first possible implementation manner,
the user capacity adjusting module is used for processing the answer result by utilizing a preset IRT model to obtain a first capacity adjusting value of the user, and processing the answer time and the current capacity value by utilizing a preset relation function of time consumption and capacity to obtain a second capacity adjusting value of the user; and determining the adjusted capacity value according to the current capacity value, the first capacity adjustment value and the second capacity adjustment value.
With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner,
the user ability adjusting module is used for determining the correlation degree between the response time and the current difficulty based on the current ability value and the response time; and processing the answering time, the correlation degree, the average value of all preset answering times of the test questions and the standard deviation of all the answering times by using the relation function to obtain the second capacity adjustment value.
With reference to the second possible implementation manner of the second aspect, in a third possible implementation manner, the user ability adjustment module is configured to determine the correlation degree by using a preset pearson correlation function to calculate the current ability value and the response time;
wherein the Pearson correlation function is:
x represents the time spent answering, and y represents the current ability value.
With reference to the second aspect, in a fourth possible implementation manner, after the user ability adjustment module obtains the current ability value adjusted by the user, the user ability adjustment module is further configured to determine the current ability value, the adjusted ability value, and standard deviations of all historical ability values of the user; judging whether the standard deviation is smaller than a preset value or not; if so, ending the evaluation of the user capability; and if not, continuously evaluating the capability of the user by using the test questions selected from the test question library and having the difficulty values of the test questions matched with the adjusted capability values.
With reference to the second aspect, in a fifth possible implementation manner, the user ability adjustment module is further configured to calculate all answer results obtained by answering the test questions in history by using a maximum likelihood estimation method, and determine a difficulty value of the test questions.
In a third aspect, the present application provides a computer-readable storage medium having a computer-executable non-volatile program code, where the program code causes the computer to perform the method for evaluating user ability according to the first aspect and any possible implementation manner of the first aspect.
Drawings
To more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a flowchart of a method for evaluating user ability according to an embodiment of the present disclosure;
fig. 2 is a functional curve diagram of an IRT model in the method for evaluating user ability according to the embodiment of the present application;
fig. 3 is a block diagram of an electronic device according to an embodiment of the present disclosure;
fig. 4 is a block diagram of a device for evaluating user ability according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
Referring to fig. 1, an embodiment of the present application provides a method for evaluating user ability, which may be performed by an electronic device, where the electronic device may be a terminal or a server, where the terminal may be a Personal Computer (PC), a tablet computer, an intelligent mobile phone, a Personal Digital Assistant (PDA), or the like; the server may be a web server, a database server, a cloud server, or a server assembly composed of a plurality of sub servers, etc.
Specifically, the method for evaluating the user ability may include: step S100, step S200, step S300, and step S400.
Step S100: and selecting the test questions with the difficulty values matched with the current capability value of the user from the test question library.
Step S200: and pushing the selected test questions to the user.
Step S300: and acquiring the time consumed by the user to answer the test question and the answering result.
Step S400: and adjusting the current ability value of the user according to the time spent on answering and the answering result to obtain the adjusted ability value of the user.
The flow of the user ability evaluation method will be described in detail below.
In this embodiment, before performing step S100, the electronic device may determine the difficulty value of the test question. As an example of determining the difficulty value of the test question, the electronic device may calculate the difficulty value of each test question to be placed in the test question library in advance. Then, in the process of executing step S100, the electronic device may directly obtain the difficulty value of each test question to be matched, so as to cooperate with the execution of step S100. As another exemplary way to determine the difficulty values of the test questions, the electronic device may first put each test question into the test question library, and then during the process of executing step S100 to select the matched test question, the electronic device may dynamically calculate the difficulty value of each test question to be matched, so as to cooperate with the execution of step S100.
It can be understood that, since the electronic device calculates the difficulty value of each test question in substantially the same manner, for the sake of understanding, the following description will discuss two ways of calculating the difficulty value of a certain test question.
As a first exemplary manner, the electronic device records in advance the answer results obtained by each user answering the test question in the history, so that the electronic device can calculate all the answer results obtained by answering the test question in the history by using a preset maximum likelihood estimation method, thereby determining the difficulty value of the test question.
Specifically, the electronic device may first classify all the response results into two categories, for example, all the results that are correct in response are labeled as 1, and all the results that are incorrect in response are labeled as 0, so that the obtained response results are classified into two categories, namely 0 and 1. Then, the electronic device may put the answer results divided into two categories into a function preset by the maximum likelihood estimation method, where the function is shown in the following formula 1:
in formula (1), yiResults of responses expressed as 0 or 1, and a total of m, piA function representing the IRT model.
In this embodiment, the function of the IRT model may be shown as the following formula 2:
the curve shown in the formula (2) can be as shown in fig. 2, and the formula (2) is described in conjunction with fig. 2, where d is a constant 1.702, a in the formula (2)iDivision values representing test questions, biDifficulty value, c, representing test questioniGuess value representing test question, theta representing ability value of user, pi(θ) represents a probability value of the test question being answered.
The discrimination value indicates whether the test questions can discriminate the answer results (for example, the answer results are scores) of the users, the discrimination value can affect the slope of the middle portion of the curve shown in fig. 2, and if the slope is smaller, the test questions are difficult to discriminate the answer results of the users. The difficulty value of the test question affects the displacement of the curve shown in fig. 2 in the direction of the horizontal axis, and the greater the difficulty value of the test question is, the higher the ability value of the user is required for the user to answer to obtain a better answer result. The guess value represents the probability that the user can correct the test question even if the user does not have a little prior experience knowledge, for example, a guess value of 0.25 indicates that the test question has a probability of 0.25.
Furthermore, combining the formula (1) and the formula (2) and the answer results divided into two categories, the electronic device can calculate the difficulty value of the test question in an iterative manner.
For example, the electronic device may preset the probability value of the answered pair of test questions to be 0.5, and the probability value of the answered pair of test questions to be a fixed value. Then, the electronic device estimates the division value of the test question, the guess value of the test question and the ability value of the user. Thus, the electronic device can determine the difficulty value of the test question by combining the formula (2) and the formula (1) based on the estimated values and the preset fixed value. Then, the electronic device continues to estimate the discrimination values of the test questions and the guess values of the test questions, and can derive and determine the ability value of the user by using the estimated values, the determined values and the preset fixed values. Then, the electronic device estimates the division value of the test question again, and continues to derive and determine the guessed value of the test question by using the estimated value, the determined value and a preset fixed value. Then, the electronic device further uses all the determined values and the preset fixed value to derive and determine the division index value of the test question. On the basis of determining the division value of the test question, the guess value of the test question and the capability value of the user, the electronic equipment can adjust the division value of the test question, the guess value of the test question and the capability value of the user, and then obtains the division value of the newly estimated test question, the guess value of the test question and the capability value of the user, so that the electronic equipment can repeat the process to perform iterative computation. And when the iteration is carried out until the difficulty value of the test questions and the change of the discrimination values of the test questions tend to be stable, the electronic equipment stops the iteration, and finally the difficulty value of the test questions and the discrimination values of the test questions are determined by iteration to serve as final calculation results.
Further, to ensure that the test questions in the test question bank can be easily evaluated by the user, the difficulty of the test questions in the test question bank cannot be too large or too small, and the discrimination value cannot be too large or too small. Therefore, the electronic device can judge whether the difficulty value of the finally determined test question is within the preset difficulty range and judge whether the discrimination value of the finally determined test question is within the preset discrimination range. If the test questions are in the same place, the difficulty of the test questions is proper and the discrimination is also proper, so that the test questions can be added into a test question library; otherwise, the test question is discarded, and the difficulty value and the division value of the next test question are calculated continuously.
It can be understood that, when the test question bank needs to be updated, the test questions to be updated in the test question bank can also be processed by the above procedure, so as to implement dynamic update of the test question bank.
As a first exemplary manner, the electronic device may add all the test questions to the test question library in advance, and when calculating the difficulty value of the test question by performing step S200, the electronic device may calculate the difficulty value and the division value of each test question to be matched based on the aforementioned procedure of calculating the difficulty value and the division value of the test question. And after calculating the difficulty value and the division degree value of the test questions, the electronic device can judge whether the calculated division degree value of the test questions is within a preset division degree range. If the difficulty value is within the preset range of the discrimination, the discrimination of the test question is also proper, so step S100 can be executed to match the calculated difficulty value of the test question with the current ability value of the user; otherwise, the test question is discarded, and the difficulty value and the division value of the next test question are calculated continuously.
Step S100: and selecting the test questions with the difficulty values matched with the current capability value of the user from the test question library.
In this embodiment, the electronic device may randomly select one test question from the test question library, match the difficulty value of the test question with the current capability value of the user, and see whether the test question can be matched. For example, the electronic device presets a difficulty range of each test question, and presets a capability range matched with the difficulty range of each test question, for example, the difficulty range of the test question is (-1,1) matched with the capability range (-1,1), the difficulty range of the test question is [ -2,1) matched with the capability range [ -2,1), the difficulty range of the test question is [ -3,2) matched with the capability range [ -3,2), the difficulty range of the test question is (1,2] matched with the capability range (1,2], the difficulty range of the test question is (2,3] matched with the capability range (2, 3), and the like, so that the electronic device can determine whether the difficulty range of the difficulty value of the test question matches with the capability range of the current capability value of the user.
If the test questions are determined not to be matched, the electronic equipment can abandon the currently selected test questions and continue to randomly select the next test question for matching until the matched test questions are determined.
It should be noted that, if the current test is the first test of the user in the test process, the electronic device may default that the current capability value of the user is the preset initial level of the electronic device, for example, default that the current capability value of the user is 0. With the continuous progress of the test, the electronic device may continuously adjust the current ability value of the user based on the condition that the user answers the test question, and if the test is the nth test (N is an integer greater than 1) of the user in the test process, the current ability value of the user is the ability value adjusted based on the condition of the N-1 test.
If the matching is determined, it indicates that the test question is suitable for the current test, so the electronic device may further perform step S200.
Step S200: and pushing the selected test questions to the user.
The electronic device can push the selected test questions to the client used by the user, and the user can answer the test questions through the client.
Step S300: and acquiring the time consumed by the user to answer the test question and the answering result.
The client can monitor the answer of the user, and when the user answers the test question, the client can record the time spent by the user in answering the test question and record the answer result of the user to the test question through monitoring. The client can feed back the recorded time consumption and the recorded answer result to the electronic equipment in real time, so that the electronic equipment can obtain the time consumption and the answer result of the test question completed by the user answering.
After the electronic device obtains the response time and the response result, the electronic device may further perform step S400 to adjust the evaluation of the user capability.
Step S400: and adjusting the current ability value of the user according to the time spent on answering and the answering result to obtain the adjusted ability value of the user.
In this embodiment, for more accurate adjustment of the ability value of the user, the electronic device adjusts the ability value of the user based on the answer result, and the electronic device also adjusts the ability value of the user based on the time spent on answering.
As an exemplary manner, the electronic device may process the response result by using a preset IRT model, so as to obtain a first capability adjustment value of the user, wherein the first capability adjustment value calculated according to the response result may be positive or negative. Similarly, the electronic device may further process the response time and the current ability value of the user by using a preset time-to-ability relationship function to obtain a second ability adjustment value of the user, where the second ability adjustment value calculated according to the difference between the response time and the current ability value of the user may also be positive or negative. Finally, the electronic equipment can determine the adjusted capacity value based on the current capacity value of the user, the first capacity adjustment value and the second capacity adjustment value; for example, the electronic device sums the current ability value of the user, the first ability adjustment value and the second ability adjustment value, and the sum is the adjusted ability value.
In this embodiment, as a specific way of processing the response time and the current ability value of the user by using the relationship function, the electronic device may determine the correlation between the response time and the current difficulty of the user based on the current ability value and the response time of the user. Thus, the electronic device may obtain the second capability adjustment value by processing the response time, the determined correlation, the average value of all the response times preset for the test question, and the standard deviation of all the response times preset for the test question by using the preset relationship function. For example, the electronic device determines a difference between the response time and an average value of all response times preset for the test question, determines a quotient of the difference and a standard deviation of all response times preset for the test question, and determines a product of the quotient and the correlation, where the product is the second capability adjustment value.
It can be understood that, in order to accurately determine the correlation, the electronic device may preset a pearson correlation function, and calculate the current capability value and the response time using the pearson correlation function, so as to accurately determine the correlation. For example, the pearson correlation function may be represented by the following formula (3):
wherein, x in the formula (3) represents the current ability value of the user when answering, and y in the formula (3) represents the current ability value of the user.
In this embodiment, after the electronic device obtains the current capability value adjusted by the user, the electronic device may determine the standard deviation of the current capability value, the adjusted capability value, and all the historical capability values determined by the user in the history before determining the current capability value, and determine whether the standard deviation is smaller than the preset value. It can be understood that if the current capability value is the first determined capability value, indicating that there are no historical capability values before the current capability value, i.e., all historical capability values are empty, then the electronic device may directly determine the standard deviation of the current capability value and the adjusted capability value.
If the user ability value is not less than the standard deviation, the evaluation of the user ability value is not convergent, namely the adjusted ability value is not stable enough and cannot reflect the real ability of the user, then the electronic equipment continuously evaluates the ability of the user by selecting the test questions with the difficulty values of the test questions matched with the adjusted ability value from the test question library until the ability value is adjusted to be less than the standard deviation.
If the value is less than the preset value, the evaluation on the user capacity value is converged, namely the adjusted capacity value is stable enough, and the adjusted capacity value can reflect the real capacity of the user, so that the electronic equipment can finish evaluating the capacity of the user and push the adjusted capacity value to the client, and the user can know the self test result.
Referring to fig. 3, based on the same inventive concept, the embodiment of the present application provides an electronic device 10, and the electronic device 10 may include a communication interface 11 connected to a client, one or more processors 12 for executing program instructions, a bus 13, and a memory 14 in different forms, such as a disk, a ROM, or a RAM, or any combination thereof. Illustratively, a computer platform may also include program instructions stored in ROM, RAM, or other types of non-transitory storage media, or any combination thereof.
The memory 14 is used for storing programs, and the processor 12 is used for calling and executing the programs in the memory 14 to execute the aforementioned evaluation method of the user ability.
Referring to fig. 4, based on the same inventive concept, an embodiment of the present application further provides an apparatus 100 for evaluating user ability, where the apparatus 100 for evaluating user ability may include:
the test question selecting and pushing module 110 is used for selecting test questions from the test question library, wherein the difficulty values of the test questions are matched with the current capability value of the user; and pushing the test questions to the user.
The user ability adjusting module 120 is configured to obtain a time required for the user to complete the response of the test question and a response result; and adjusting the current ability value according to the response time and the response result to obtain the adjusted ability value of the user.
Optionally, the user ability adjustment module 120 is configured to process the response result by using a preset IRT model to obtain a first ability adjustment value of the user, and process the response time and the current ability value by using a preset relation function between time consumption and ability to obtain a second ability adjustment value of the user; and determining the adjusted capacity value according to the current capacity value, the first capacity adjustment value and the second capacity adjustment value.
Optionally, the user ability adjusting module 120 is configured to determine a correlation between the response time and the current difficulty based on the current ability value and the response time; and processing the answering time, the correlation degree, the average value of all preset answering times of the test questions and the standard deviation of all the answering times by using the relation function to obtain the second capacity adjustment value.
It should be noted that, as those skilled in the art can clearly understand, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Some embodiments of the present application further provide a computer-readable storage medium of a computer-executable nonvolatile program code, which can be a general-purpose storage medium such as a removable disk, a hard disk, or the like, and the computer-readable storage medium stores a program code thereon, which when executed by a computer, performs the steps of the method for evaluating user ability of any of the above embodiments.
The program code product of the method for evaluating user capability provided in the embodiment of the present application includes a computer-readable storage medium storing the program code, and instructions included in the program code may be used to execute the method in the foregoing method embodiment, and specific implementation may refer to the method embodiment, which is not described herein again.
In summary, in the process of testing and evaluating the ability of the user, the time spent on answering the test questions by the user is also taken into consideration, so that the ability of the user can be comprehensively evaluated in multiple dimensions through the time spent on answering and the answering result, and the real ability of the user can be evaluated.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A method for evaluating user capabilities, the method comprising:
selecting test questions with the difficulty values matched with the current capability values of the users from the test question library;
pushing the test questions to the user;
acquiring the time consumed by the user to answer the test question and the answering result;
and adjusting the current ability value according to the response time and the response result to obtain the adjusted ability value of the user.
2. The method for evaluating user's ability according to claim 1, wherein adjusting the current ability value according to the response time and the response result to obtain the adjusted current ability value of the user comprises:
processing the answer result by using a preset IRT model to obtain a first ability adjustment value of the user, and processing the answer time and the current ability value by using a preset relation function of time consumption and ability to obtain a second ability adjustment value of the user;
and determining the adjusted capacity value according to the current capacity value, the first capacity adjustment value and the second capacity adjustment value.
3. The method for evaluating user's ability according to claim 2, wherein the step of processing the response time and the current ability value by using a preset time-to-ability relationship function to obtain a second ability adjustment value of the user comprises:
determining the relevance of the response time and the current difficulty based on the current capacity value and the response time;
and processing the answering time, the correlation degree, the average value of all preset answering times of the test questions and the standard deviation of all the answering times by using the relation function to obtain the second capacity adjustment value.
4. The method of claim 3, wherein determining the relevance of the response time to the current difficulty level based on the current ability value and the response time comprises:
calculating the current capability value and the response time by utilizing a preset Pearson correlation function, and determining the correlation;
wherein the Pearson correlation function is: the values of p x are calculated,
x represents the time spent answering, and y represents the current ability value.
5. The method of assessing user competence of claim 1, wherein after obtaining the user adjusted current competence value, the method further comprises:
determining the current capacity value, the adjusted capacity value and the standard deviation of all historical capacity values of the user;
judging whether the standard deviation is smaller than a preset value or not; if so, ending the evaluation of the user capability; and if not, continuously evaluating the capability of the user by using the test questions selected from the test question library and having the difficulty values of the test questions matched with the adjusted capability values.
6. The method for evaluating user's ability according to claim 1, wherein the step of determining the difficulty value of the test question comprises:
and calculating all answer results obtained by answering the test questions in history by using a maximum likelihood estimation method, and determining the difficulty value of the test questions.
7. An apparatus for evaluating user's ability, the apparatus comprising:
the test question selecting and pushing module is used for selecting test questions with the difficulty values matched with the current capability values of the users from the test question library; pushing the test questions to the user;
the user ability adjusting module is used for acquiring the time spent by the user in answering the test question and the answering result; and adjusting the current ability value according to the response time and the response result to obtain the adjusted ability value of the user.
8. The apparatus for evaluating user's ability according to claim 7,
the user capacity adjusting module is used for processing the answer result by utilizing a preset IRT model to obtain a first capacity adjusting value of the user, and processing the answer time and the current capacity value by utilizing a preset relation function of time consumption and capacity to obtain a second capacity adjusting value of the user; and determining the adjusted capacity value according to the current capacity value, the first capacity adjustment value and the second capacity adjustment value.
9. The apparatus for evaluating user's ability according to claim 7,
the user ability adjusting module is used for determining the correlation degree between the response time and the current difficulty based on the current ability value and the response time; and processing the answering time, the correlation degree, the average value of all preset answering times of the test questions and the standard deviation of all the answering times by using the relation function to obtain the second capacity adjustment value.
10. A computer-readable storage medium having computer-executable non-volatile program code, wherein the program code causes the computer to perform the method for assessing user competence according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911373721.6A CN111311055A (en) | 2019-12-26 | 2019-12-26 | User capacity evaluation method and device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911373721.6A CN111311055A (en) | 2019-12-26 | 2019-12-26 | User capacity evaluation method and device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111311055A true CN111311055A (en) | 2020-06-19 |
Family
ID=71148195
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911373721.6A Pending CN111311055A (en) | 2019-12-26 | 2019-12-26 | User capacity evaluation method and device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111311055A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112860756A (en) * | 2021-04-23 | 2021-05-28 | 平安科技（深圳）有限公司 | Exercise test-based learning resource recommendation method and device and computer equipment |
| CN112966921A (en) * | 2021-03-01 | 2021-06-15 | 上海近屿智能科技有限公司 | Innovation ability evaluation method based on programming ability evaluation |
| CN113450611A (en) * | 2021-06-25 | 2021-09-28 | 平安科技（深圳）有限公司 | Test method, device, medium and electronic equipment based on answer form |
| WO2023045193A1 (en) * | 2021-09-27 | 2023-03-30 | 平安科技（深圳）有限公司 | Self-adaptive testing-based user capability grading method and apparatus, device, and medium |
| WO2023159754A1 (en) * | 2022-02-23 | 2023-08-31 | 平安科技（深圳）有限公司 | Ability level analysis method and apparatus, electronic device and storage medium |
-
2019
- 2019-12-26 CN CN201911373721.6A patent/CN111311055A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112966921A (en) * | 2021-03-01 | 2021-06-15 | 上海近屿智能科技有限公司 | Innovation ability evaluation method based on programming ability evaluation |
| CN112860756A (en) * | 2021-04-23 | 2021-05-28 | 平安科技（深圳）有限公司 | Exercise test-based learning resource recommendation method and device and computer equipment |
| CN113450611A (en) * | 2021-06-25 | 2021-09-28 | 平安科技（深圳）有限公司 | Test method, device, medium and electronic equipment based on answer form |
| WO2023045193A1 (en) * | 2021-09-27 | 2023-03-30 | 平安科技（深圳）有限公司 | Self-adaptive testing-based user capability grading method and apparatus, device, and medium |
| WO2023159754A1 (en) * | 2022-02-23 | 2023-08-31 | 平安科技（深圳）有限公司 | Ability level analysis method and apparatus, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111311055A (en) | User capacity evaluation method and device and storage medium | |
| CN108833458B (en) | Application recommendation method, device, medium and equipment | |
| US10140336B1 (en) | Accuracy testing of query optimizers | |
| CN111651677B (en) | Course content recommendation method, apparatus, computer device and storage medium | |
| CN110825969A (en) | Data processing method, device, terminal and storage medium | |
| CN113409174A (en) | Knowledge point evaluation method and device | |
| CN110348215B (en) | Abnormal object identification method, abnormal object identification device, electronic equipment and medium | |
| US20220163597A1 (en) | Battery residual value determination system | |
| CN110580265B (en) | ETL task processing method, device, equipment and storage medium | |
| CN111932160A (en) | Knowledge acquisition information processing method, knowledge acquisition information processing device, computer device, and storage medium | |
| CN111612783B (en) | Data quality assessment method and system | |
| CN114971240A (en) | Reading behavior risk assessment processing method and device | |
| CN114944219A (en) | Mental scale recommendation method and device based on artificial intelligence and storage medium | |
| CN111598390B (en) | Method, device, equipment and readable storage medium for evaluating high availability of server | |
| CN112311839B (en) | Information pushing method, device, equipment and readable medium | |
| CN113673811A (en) | Session-based online learning performance evaluation method and device | |
| CN113796834A (en) | Cognitive ability assessment method, device, equipment and storage medium | |
| CN110176225B (en) | Method and device for evaluating rhythm prediction effect | |
| CN110134575B (en) | Method and device for calculating service capacity of server cluster | |
| CN112580887A (en) | Weight determination method, device and equipment for multi-target fusion evaluation and storage medium | |
| CN113762401A (en) | Self-adaptive classification task threshold adjusting method, device, equipment and storage medium | |
| US20050130109A1 (en) | Training case selection | |
| CN112241447B (en) | Learning situation data processing method and device, computer equipment and storage medium | |
| CN111507639A (en) | Financing risk analysis method and device | |
| CN115329968B (en) | Method, system and electronic equipment for determining fairness of quantum machine learning algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |