KR20200091537A - An online examination service system based on difficulty of questions - Google Patents

Abstract

The present invention relates to an online trial examination service providing system based on a difficulty level of questions, which uses a correct answer ratio and an incorrect answer ratio with respect to individual questions of a question bank to automatically calculate a difficulty level, uses the difficulty level to extract the individual question, and considers the difficulty level to analyze a result of an applicant. According to the present invention, the online trial examination service providing system based on a difficulty level of questions comprises: an individual question registering unit establishing question bank by registering individual questions; a trial examination presenting unit extracting individual questions from the question bank to form and provide a trial examination; a trial examination evaluation unit receiving answers of each individual question of the trial examination and comparing the input answer with a stored correct answer corresponding to the individual question to store an evaluation result; an examination result analysis unit calculating an average and ranking of each applicant or all applicants in accordance with the evaluation result of the trial examination; and a difficulty level setting unit setting a difficulty level of each individual question and reflecting a level of the applicant on the evaluation result of the correct or incorrect answer of the applicant with respect to each individual question to set the difficulty level. Accordingly, the difficulty level is set in consideration of the average of the applicant, thereby correctly calculating the difficulty level even if the number of applicant samples of a corresponding question is less.

Description

Difficulty-based online simulation test delivery system {An online examination service system based on difficulty of questions}

The present invention is to construct a question bank by registering individual problems from the submitter in the system, and if the candidate has a request to take a test, construct and provide a mock test question with individual problems from the question bank, and provide the results and results of the analysis. Difficulty-based online simulation test delivery system.

In particular, the present invention is based on difficulty level, which automatically calculates a difficulty level using a correct answer rate or a wrong answer rate for individual questions in a question bank, extracts individual questions using the difficulty level, and analyzes the test taker's grades by reflecting the difficulty level. It relates to an online simulation test delivery system.

In general, elementary, middle and high school students or test takers who take the various qualification tests improve their learning skills through textbooks and various test books before taking the test. In other words, students take various qualification exams in schools and academies, etc., and learn by getting various materials for exams in academies, etc., and prepare for various exams through a collection of expected questions.

There is a limit to not sufficiently coping with the candidate's learning ability or qualification verification by simply solving the expected problem through the test. That is, in the SAT or National Qualification Test, various test questions in each subject are not presented in a specific order, but are presented in different arrangements.

However, students or candidates for qualification exams do not encounter many test questions in this way, so they are often embarrassed in practice and fail to fully demonstrate their skills. In particular, there is a problem in that it is difficult to judge which subject and which field to study further because the expected scores that one can receive are unknown.

In addition, because the preliminary test of the above method is mainly performed offline, students or candidates for the qualification test cannot frequently take the test, and there is a problem in that it takes a lot of time to check the scoring result after the test.

In order to solve this problem, a technique for providing a simulation test on a network has been proposed [Patent Documents 1,2,3]. In particular, the prior arts apply a difficulty level, and when a candidate sets the difficulty level, a test question is automatically configured according to the difficulty level. In addition, a technique for automatically determining the difficulty level of a problem by accumulating distribution data of correct and incorrect answers of candidates has been proposed [Patent Document 4].

However, all of the above prior arts generate and manage a problem in a service system, and an administrator sets a difficulty level for each problem. Therefore, the manager has the burden of collecting problems from the problem bank and evaluating the difficulty of each problem. In addition, even if the difficulty is automatically generated using the distribution data of the correct and incorrect answers of the test takers, there is a problem that the difficulty of the problem cannot be accurately set until the distribution data is accumulated.

Korean Registered Patent Publication No. 10-1438756 (2014.09.05. Announcement) Korean Registered Patent Publication No. 10-1101177 (2011.12.30. Announcement) Korean Registered Patent Publication No. 10-0432148 (Announcement of May 17, 2004) Korean Patent Publication No. 10-2004-0057219 (July 02, 2004)

The object of the present invention is to solve the problems as described above, to build a problem bank by registering the individual problems in the system from the submitter, and if the candidate is in the request to take the exam, a mock test problem is composed of the individual problems of the problem bank. It provides a system for providing online simulations based on difficulty, providing the results and results of the analysis.

In addition, an object of the present invention is to provide a system for providing a difficulty-based online simulation test, which automatically calculates the difficulty level of an individual problem according to the correct or incorrect answer rate of the candidates, and calculates the difficulty level by reflecting the average of the candidates.

In order to achieve the above object, the present invention relates to a system for providing an online simulation test based on a difficulty level, and an individual problem registration unit that registers individual problems to establish a problem bank; A mock test questionnaire for extracting individual questions from the question bank and constructing and providing a mock test question; A simulation test evaluating unit that receives an answer for each individual question in the mock test question and compares the received answer with the correct answer for the stored individual question to store an evaluation result; A test result analysis unit that calculates an average and a rank for each test taker or all test takers according to the evaluation result of the simulation test problem; And, it is characterized in that it comprises a difficulty setting unit for setting the difficulty level of each individual problem, but setting the difficulty level by reflecting the candidate's level in the evaluation result of the correct answer or incorrect answer for each individual problem.

In addition, in the present invention, in the difficulty-based online simulation test providing system, the individual problems are classified into fields, and the mock exam questionnaire receives input conditions for fields and difficulty, and extracts individual problems satisfying the examination conditions It is characterized by constituting a simulation test.

In addition, the present invention is characterized in that in the system for providing an online simulation test based on the difficulty level, the test result analysis unit calculates the average m(p) of the test taker p by the following [Equation 1] by reflecting the difficulty level.

[Equation 1]

However, L represents the number of difficulties, k represents the index of the difficulty or difficulty class, m _k (p) represents the average of individual problems of the difficulty k of the candidate p, and w _k represents the weight according to the difficulty, and the difficulty The weight w _k has a higher weight as the difficulty is higher.

In addition, in the present invention, in the difficulty-based online simulation test providing system, the difficulty setting unit calculates the difficulty score of the individual problem by reflecting the candidate's level in the correct or incorrect result of the candidate who solved the individual problem, but the candidate It is characterized by calculating a difficulty score with a value within the test taker's level when correct answer is made, and calculating a difficulty score with a value higher than the test taker's level if incorrect answer is given.

In addition, in the system for providing an online simulation test based on difficulty, the difficulty setting unit calculates the difficulty score when the candidate p solves the individual problem i with the following Equation 2.

[Equation 2]

However, Q _i (p) represents the difficulty score according to the correct or incorrect answer of candidate p for individual question i, Q _max and Q _min are the maximum or maximum value of the candidate level, and Q _p represents the candidate level .

In addition, in the present invention, in the system for providing a difficulty-based online simulation test, the system calculates a reward score for each question of the submitter, and calculates a reward amount for each question, but the reward score for each individual question is sampled. It is characterized in that it further comprises a question-and-compensation calculator that calculates a weighted difficulty score.

As described above, according to the difficulty-based online simulation test providing system according to the present invention, the problem banks are supplied from various sources to secure various problems by constructing the problem banks by directly registering the individual problems submitted by the submitter The effect that can be obtained is obtained.

In addition, according to the difficulty-based online simulation test providing system according to the present invention, by calculating the difficulty by reflecting the average of the candidates, even if there are not many test takers of the problem, an effect capable of accurately calculating the difficulty is obtained.

1 is a configuration diagram of an entire system for carrying out the present invention.
Figure 2 is a block diagram of the configuration of a system for providing a difficulty-based online simulation test according to an embodiment of the present invention.
Figure 3 is an exemplary table showing the degree of difficulty according to an embodiment of the present invention.
4 is a view showing the concept of calculating the difficulty of individual problems by reflecting the level of the test taker according to an embodiment of the present invention.

Hereinafter, specific contents for carrying out the present invention will be described in accordance with the drawings.

In describing the present invention, the same parts are denoted by the same reference numerals, and repeated explanation is omitted.

First, the configuration of the entire system for carrying out the present invention will be described with reference to FIG. 1.

As shown in FIG. 1, the entire system for implementing the present invention includes a test taker terminal 10 taking a mock test, a test taker terminal 20 registering individual problems on a server, and a problem bank by registering individual problems. It consists of a mock test server 30 that builds and extracts individual questions from the question bank to generate and provide a mock test. Additionally, it may be configured to further include a database 40 for storing question banks, test results of test takers, information of test takers, and the like.

First, the candidate terminal 10 is a computing terminal used by the candidate, and is a terminal equipped with normal computing functions such as a smartphone, phablet, tablet PC, PC, and laptop. The candidate performs the corresponding task through the candidate terminal 10 when performing the task related to the mock test. Therefore, for convenience of explanation, it will be described below that the candidate performs, but the corresponding tasks are considered to be performed by the candidate terminal 10.

Meanwhile, the test taker terminal 10 connects to the simulation test server 30 to request a simulation test. At this time, the test conditions, such as the test range and difficulty of the mock test, are input from the test taker and transmitted to the mock test server 30.

In addition, the test taker terminal 10 displays the mock test questions obtained from the mock test server 30 on a screen on the terminal, and receives an answer for each question input by the user. The input test taker's answer is sent to the mock test server 30.

In addition, the test taker terminal 10 may receive the test result of the test taker from the simulation test server 30, and display the result on the screen. At this time, the simulation test results consist of individual simulation test analysis results, or accumulated simulation test results.

Next, the presenter terminal 20 is a computing terminal used by the presenter, and is a terminal having normal computing functions such as a smartphone, phablet, tablet PC, PC, and laptop. When performing the work related to the mock test, the submitter performs the corresponding work through the submitter terminal 20. Therefore, hereinafter, it is described as being performed by the submitter for convenience of description, but the corresponding tasks are considered to be performed by the submitter terminal 20.

The presenter terminal 20 registers the individual questions raised by the presenter in the mock test server 30. That is, the individual questions and the correct answers to the questions are registered in the simulation server 30 together. Each registered question is registered with the question bank and can be sampled and used as a test question when constructing a simulation.

In addition, the number of times sampled by the mock test, difficulty, etc. (hereinafter referred to as the use information of the individual questions) are calculated for the individual questions registered by the examinee. The submitter terminal 20 may request a list of individual problems of the registered submitter and display it on the screen. At this time, usage information such as the number and difficulty of each individual problem may also be received and displayed.

On the other hand, individual problems of the submitter are compensated according to the sampling frequency and difficulty. The compensation of all the individual problems of the submitter is summed up and the reward of the submitter is calculated. The presenter terminal 20 may display the reward of the presenter on the screen at the request of the presenter.

Next, the mock test server 30 is a general service server provided on the web, and registers individual questions for the mock test, and configures and provides the mock test. In addition, the simulation test results are received and the simulation test results are calculated or analyzed, and the analysis results are provided to test takers.

That is, the simulation server 30 receives individual problems from the submitter terminal 20. At this time, register by receiving individual questions and their correct answers. In addition, preferably, fields of individual problems (or test subjects, units, etc.) are input. Each individual problem has at least one field and can have multiple fields.

In addition, the simulation server 30 builds into a question bank by making database of registered individual problems. The question bank is composed of a number of individual problems, and each individual problem is classified and stored according to the field.

In addition, the mock test server 30 constructs a mock test question at the request of the candidate terminal 10, and provides the mock test question to the candidate terminal 10. At this time, the mock test question is constructed by randomly extracting individual questions from the question bank.

In particular, upon requesting a test, a simulated test question is constructed by receiving a field of a simulated test question (test subject, unit, etc.) from the candidate terminal 10 and extracting individual questions belonging to the field from the question bank.

In addition, preferably, the test taker terminal 10 may set the difficulty level of the simulation test question and constitute a simulation test question according to the difficulty level.

And the simulation server 30 receives the answer of the simulation test questions, scores the corresponding simulation test questions and provides the results to the candidate terminal 10. That is, scoring is performed by comparing the answer to the received problem with the correct answer to the stored problem.

In addition, the simulation server 30 performs analysis on each individual problem of the simulation test questions, or analyzes the accumulated test results of the test takers. In addition, the analysis result may be transmitted to the candidate terminal 10.

In addition, the simulation server 30 calculates the usage status (or sampling status) of each individual problem. In other words, the sampling frequency and difficulty of each individual problem are calculated. Then, the reward score of each individual problem is calculated using the sampling number or difficulty. In addition, the reward scores of all the individual problems of each examiner are added up to calculate the reward scores of the examinees. The reward scores of the submitters are summed to determine the amount of the rewards.

Next, the database 40 includes a question bank DB 41 that stores individual questions for the mock test, a test result DB 42 that stores each test taker's mock test results and analysis results, usage information of each individual question, and It may be composed of a question compensation DB (43) for storing reward information. However, the configuration of the database 40 is only a preferred embodiment, and in developing a specific device, it may be configured in a different structure according to a database construction theory in consideration of the ease and efficiency of access and search.

Next, a system for providing a difficulty-based online simulation test according to an embodiment of the present invention will be described with reference to FIG. 2.

2, the difficulty-based online simulation test providing system 30 according to the present invention includes a user information collection unit 31 for collecting information about a user, and a clothing information collection unit 32 for collecting information about clothing. ; A motion index calculator 33 for calculating a user's motion level; A clothing index calculating unit 34 for calculating a degree of activity of clothing; And a clothing recommendation unit 35 that recommends clothing having a clothing index that matches a user's movement index.

First, the individual problem registration unit 31 receives the individual problems from the submitter terminal 20 and registers the individual problems in the problem bank.

That is, an individual question and a correct answer of the question are received and registered. Also, the field of the individual problem is entered. The field is divided into subjects (test subjects) and units. Preferably, the field can be categorized step-by-step, such as subject-end-to-end-to-end. Further, a plurality of fields for individual problems may be input and set.

In addition, the individual problem registration unit 31 also stores information about each individual problem. Therefore, with reference to the database 40, for each submitter, the individual problems that the submitter can submit can be managed.

In addition, the individual problem registration unit 31 initializes and sets the difficulty level for each individual problem. Preferably, the initial value may be set as the average value of the difficulty, or may be set as the difficulty value set by the submitter.

Next, the mock test submission unit 32 constructs a mock test question by extracting individual questions from the question bank when a mock test request is received from the candidate terminal 10.

That is, the mock exam questionnaire 32 receives the exam conditions of the mock exam from the test taker terminal 10 and randomly extracts individual problems that meet the exam conditions from the question bank.

Examination conditions include test coverage that limits the field of individual problems, and difficulty conditions that determine the difficulty of individual problems. In addition, the number of problems may be further included.

The test range is set to at least one field, and may be selected in plural.

As shown in FIG. 3, the difficulty levels are divided into grades and may be classified according to grades. That is, if the difficulty score falls within a certain range, the difficulty level is set as the grade of the corresponding range. In this case, when the difficulty level is configured as a grade, the candidate selects a specific difficulty level (difficulty level).

The mock test questionnaire 32 randomly extracts individual problems belonging to a corresponding difficulty (or class), and generates (submits) a mock exam question composed of a plurality of extracted individual problems.

The mock test submission unit 32 provides the generated (exposed) mock test questions to the candidate terminal 10.

Next, the simulation test evaluating unit 33 receives an answer of a mock test question from the test taker terminal 10, and evaluates the result of the test taker's mock test question. That is, it compares the input answer with the correct answer of the stored questions, and if it is the same, it determines that it is correct, and if it is different, it determines that it is wrong.

That is, the simulation test evaluator 33 determines whether each of the individual questions in the simulation test is correct or not, and then calculates the scores of the simulation questions.

In addition, the simulation test evaluation unit 33 stores the test result of the test taker's simulation test. At this time, in addition to the total score, whether or not the correct answer or incorrect answer is recorded for each individual question is stored together.

Next, the test result analysis unit 34 analyzes the evaluation results of the mock test questions for each test taker, saves the analysis result, or provides the analysis result at the request of the test taker terminal 10.

In particular, the test result analysis unit 34 analyzes an individual test for a specific mock test problem, or an analysis of the accumulated test results of the candidate. The former is called individual analysis, and the latter is called cumulative analysis.

First, the analysis results include results such as average score, correct answer rate, ranking, etc., and each result may include results subdivided according to field, difficulty, and the like. In addition, each result can be analyzed against the results of all other candidates.

That is, for each mock test, results such as overall average score, correct answer rate, and ranking are calculated. In addition, the average score, correct answer rate, ranking, etc. can be calculated for the accumulated tests. The ranking is based on the average score of other test takers. In addition to the correct answer rate, ranking, and average, other statistical values such as standard deviation and variance can also be calculated. In addition, it is possible to obtain a contrast analysis result in comparison with the overall average score or correct answer rates of other test takers.

In addition, it is possible to analyze and provide the results of simulation tests for each field. In other words, the average score, correct answer rate, ranking, etc. within a specific field (specific subjects and units) can be calculated. That is, whether the correct or incorrect answers of individual questions belonging to a specific field are extracted, the average of these results is obtained to obtain a score (average), a correct answer rate, or a ranking is calculated.

In addition, it is possible to analyze and provide the results of simulation tests by difficulty level. That is, the average score, correct answer rate, ranking, etc. within a specific difficulty (for example, difficulty B) are calculated.

In addition, by accumulating the evaluation results of all simulation tests, it is possible to calculate the cumulative results such as average score, correct answer rate, and ranking for the accumulated results. In addition, analysis results (average score, correct answer rate, ranking, etc.) can be calculated by subdividing the accumulated results into fields (specific subjects and units) or difficulty. That is, all individual problems have a difficulty level, a correct answer rate for each difficulty level, and a ranking for each difficulty level.

For example, if a high school examinee takes a mathematics exam, and the equations in the mathematics subject are classified as units, the examinee will report performance statistics (sexual statistics) such as high school grades, mathematics grades, averages, rankings for the grades of the equations, etc. Able to know. In addition, in the above three field problems, it is classified as a difficulty A, B, C. D type, and the correct answer rate of all test takers can be compared with the correct answer rate of the test takers.

On the other hand, the test result analysis unit 34 reflects the difficulty level and calculates the result of the average, correct answer rate, ranking, and the like of each candidate. These results will be called evaluation results (analysis results) reflecting the difficulty.

In particular, the average m(p) reflecting the difficulty level of the test taker p is calculated by the following equation.

[Equation 1]

Here, L denotes the number of difficulty levels, and k denotes an index of difficulty level or difficulty level. In the previous example of FIG. 3, since 4 difficulties are represented, L=4. Preferably, the higher the value of k, the higher the difficulty.

m _k (p) represents the average of individual problems of the difficulty k of test taker p, and w _k represents the weight according to the difficulty. The difficulty weight w _k has a higher weight as the difficulty is higher. Therefore, the higher the k-index value of the difficulty, the higher the difficulty, the difficulty weight w _k satisfies the following equation.

[Equation 2]

w ₁ <w ₂ <w ₃ <... <w _L

The correct answer rate reflecting the difficulty is calculated by assigning a weight according to the difficulty as in Equation 1 above.

In addition, as for the ranking of reflecting the difficulty, the average reflecting the difficulty of all test takers is determined by the average reflecting the difficulty. In addition, the ranking of each candidate is determined by the average reflecting the difficulty. At this time, the determined rank is the rank reflecting the difficulty.

As in the previous method of calculating the general analysis results, the analysis results reflecting the difficulty (average, correct answer rate, ranking) can be calculated for each field (subject and unit).

Next, the difficulty setting unit 35 sets the difficulty level for each individual problem.

The method of obtaining the difficulty or difficulty score (hereinafter referred to as the first difficulty score) of an individual problem according to the first embodiment uses a wrong answer rate of the individual problem. In other words, for each problem, the incorrect answer rate of all candidates who solved the problem is calculated as the difficulty score.

For example, if there were 1,000 test takers who solved individual question A and 350 of them were incorrect, the incorrect answer rate of 35% or 35 is the difficulty score. In addition, if there were 2,000 test takers who solved individual question B, and 1,500 of them were incorrect, 75% or 75 of the incorrect answer rate is the difficulty score.

And, as shown in FIG. 3, in a plurality of difficulty levels, the corresponding level is set as the difficulty level. In the previous example, since the individual problem A has a difficulty score of 35, the difficulty is grade B, and the individual problem B has a difficulty score of 75, so the difficulty is grade D.

However, the incorrect answer rate must be more than a certain number of test takers (or the number of sampling times of individual questions). That is, in order to have a meaning as a probability, the sampling size must be at least a reference value. Here, the sampling means that the individual question is extracted as a mock test question, and the individual question is solved by the candidate and the result of the correct answer or incorrect answer appears. That is, if 10 individual candidates are selected as the simulated test and 10 correct or incorrect answers are obtained, the number of samples or the sampling size is 10.

Next, the method of obtaining the difficulty or difficulty score (hereinafter referred to as the second difficulty score) of the individual problem according to the second embodiment reflects the candidate's level in the correct or incorrect result of the candidate.

As shown in Fig. 4, it is assumed that the level of candidate A is Q. If the minimum level is 0 and the maximum level is 100, as shown in FIG. 4, Q will be located at any point between 0 and 100.

Here, the test taker level is a level according to the test result of the test taker, and is preferably calculated as the average score of the test taker. More preferably, the test taker level is set to the difficulty reflecting average.

In Fig. 4(a), if candidate A solves an individual problem and is correct, the difficulty (or level) of the individual problem will be any point between 0 and Q. That is, when the candidate is correct, the difficulty score is calculated from the values in the candidate's level. In FIG. 4(a), the thick black point X will be the predicted difficulty level on average.

In addition, in FIG. 4(b), if candidate A is wrong about the individual problem, the difficulty (or level) of the individual problem will exceed the candidate's level Q. In other words, if the answer is incorrect, the difficulty score is calculated to be higher than the test taker's level. Therefore, the thick black point X in FIG. 4(b) will be the difficulty predicted on average.

Therefore, preferably, the difficulty score of the individual problem in case one candidate solves the individual problem can be defined by the following equation.

[Equation 3]

Here, p is the candidate and i is the index representing the individual problem.

Q _i (p) represents the difficulty score according to the correct or incorrect answer of test taker p for individual question i. Q _max and Q _min are the maximum or maximum values of the test taker level, and preferably represent 100 or 0. In addition, Q _p represents the test taker's level. Preferably, the candidate's level is the average of the candidate.

If N test takers solve for individual question i and the result of the correct or incorrect answer is obtained, the average value of N individual difficulty scores is set as the difficulty of the individual problem.

Meanwhile, the difficulty setting unit 35 weights and sums the first difficulty score and the second difficulty score to calculate a final difficulty score. Preferably, the final difficulty score is obtained by weighting according to the sampling size.

That is, the smaller the sampling size, the higher the weight of the second difficulty score, and the larger the sampling size, the higher the weight of the first difficulty score.

Next, the questionnaire compensation calculation unit 36 calculates a reward score for each question of the questionnaire and calculates the amount of compensation for each questionnaire.

The compensation score for each individual problem is calculated by adding a difficulty score to the number of sampling times. That is, the reward score is proportional to the sampling number and the difficulty score.

The more sampled individual questions are, the more rewards must be given to participants. Therefore, the compensation score is calculated in proportion to the sampling frequency.

In addition, since problems with high difficulty are difficult to ask, more reward points are given to individual problems with high difficulty.

Above, although the invention made by the present inventors has been specifically described according to the above-described embodiments, the present invention is not limited to the above-described embodiments, and it is needless to say that the invention can be changed in various ways without departing from the gist thereof.

10: test taker terminal 20: test taker terminal
30: mock test server 31: individual question register
32: mock test submission section 33: mock test evaluation section
34: test result analysis unit 35: difficulty setting unit
36: questionnaire compensation calculation unit
40: database 80: network

Claims (6)

In the difficulty-based online simulation test providing system,
An individual problem register that registers individual problems to build a problem bank;
A mock test questionnaire for extracting individual questions from the question bank and constructing and providing a mock test question;
A simulation test evaluating unit that receives an answer for each individual question in the mock test question and compares the received answer with the correct answer for the stored individual question to store an evaluation result;
A test result analysis unit that calculates an average and a rank for each test taker or all test takers according to the evaluation result of the simulation test problem; And,
A difficulty-based online simulation test providing system comprising setting a difficulty level for each individual problem, and including a difficulty setting unit for setting the difficulty level by reflecting the candidate's level in the evaluation result of the correct or incorrect answer for each individual problem.
According to claim 1,
The individual problems are classified into fields,
The mock test questionnaire is a difficulty-based online mock test providing system characterized by constructing a mock test question by extracting individual questions satisfying the test conditions by receiving the test conditions for the field and difficulty.
According to claim 1,
The test result analysis unit reflects the difficulty level, the difficulty-based online simulation test providing system, characterized in that for calculating the average m (p) of the candidate p by the following [Equation 1].
[Equation 1]

However, L represents the number of difficulties, k represents the index of the difficulty or difficulty class, m _k (p) represents the average of individual problems of the difficulty k of the candidate p, and w _k represents the weight according to the difficulty, and the difficulty The weight w _k has a higher weight as the difficulty is higher.
According to claim 1,
The difficulty setting unit calculates the difficulty score of the individual problem by reflecting the candidate's level in the correct or incorrect answer result of the candidate who solved the individual problem. Difficulty-based online simulation test providing system, characterized in that for calculating the wrong score, the difficulty score is higher than the test taker's level.
According to claim 4,
The difficulty setting unit is a difficulty-based online simulation test providing system, characterized in that for the candidate p to solve the individual problem i in the following formula (2).
[Equation 2]

However, Q _i (p) represents the difficulty score according to the correct or incorrect answer of candidate p for individual question i, Q _max and Q _min are the maximum or maximum value of the candidate level, and Q _p represents the candidate level .
According to claim 1,
The system calculates a reward score for each problem of the submitter, and calculates a reward amount for each submitter, but the reward score for each individual problem further includes a question compensation calculation unit for weighting the difficulty score to the sampling number Difficulty-based online simulation test providing system, characterized in that.

Images