KR102640034B1 - Automatic setting questions for examination - Google Patents

Abstract

The present invention relates to a method for automatically generating test questions, which includes the steps of connecting to a server that automatically generates test questions and having a test taker take the test; A recording step of grading and storing the test questions posed by the test taker and the test taker's test results; A classification step of classifying data on test results prepared in the recording step; Including,
By reflecting the classified problems in actual test questions or as practice questions to provide an automatic test question method, test takers are relieved of the burden of writing test questions, and test takers have the opportunity to test their capabilities and supplement insufficient sections. can be provided.

Description

How to automatically set exam questions {Automatic setting questions for examination}

The present invention relates to a method of automatically presenting test questions, and more specifically, to a method of automatically presenting test questions using a question bank method that provides test questions to each candidate non-face-to-face.

Recently, as computer, electronic, and communication technologies have developed rapidly, online evaluation tests using computer and communication technologies have been attracting attention as a new evaluation method. The scope of use of online evaluation tests is gradually expanding because it eliminates space constraints and makes it easy to process results. In addition, as remote lecture services are widely used, the application area of online evaluation tests along with distance lectures is broadening.

Such online evaluation tests can be presented in a question bank format. The question bank collects many questions in one place to build a database, and questions are created from the database, so questions can be created automatically. In addition, the question method using a question bank is widely used because it allows questions to be presented quickly, difficulty level can be easily adjusted, and evaluation tests can be created efficiently. In particular, recently, there are cases where self-tests are performed using online evaluation questions, and online evaluation questions in the question bank format are becoming more widely used.

Republic of Korea Patent No. 10-0675942

The test is a system conducted to verify the applicant's learning ability or qualifications, and its main purpose is to evaluate the applicant's skills. The existing test questions were at the level of arranging test options differently for each test taker, and did not provide alternatives to help test takers improve their test-taking skills.

The present invention seeks to provide test questions based on a question bank database and repeated learning tailored to each candidate. In addition, an automatic test question creation method can be proposed based on the database to reduce the test taker's trouble in creating test questions.

The present invention includes the steps of connecting to a server that automatically issues test questions and allowing the test taker to take the test; A recording step of grading and storing the test questions posed by the test taker and the test taker's test results; A classification step of classifying data on test results prepared in the recording step; Including,

It is possible to provide a method of automatically presenting test questions by reflecting the classified problems in actual test questions or as practice questions.

The present invention can subdivide test questions by subject and unit, and provide them to evaluate the test taker's exam competency.

In addition, the test questions are presented through a first classification stage in which test questions participated by a large number of test takers are classified according to the percentage of correct answers, and a second classification stage in which the test questions are classified according to the level of difficulty intended by the test giver, resulting in a fairer test when evaluating the test taker's learning ability. This can be done.

Additionally, during the practice test, a time limit may be given for each practice test question, and individual test takers may be given additional points based on the remaining time without exceeding the time limit for each question, so test takers taking the practice test are encouraged to do so. You can take the practice test in a prepared state, thereby improving your learning ability and increasing the percentage of correct answers in the actual test.

In addition, since the present invention can conduct a test in a non-face-to-face online manner, it can prevent coronavirus contagion in response to the recent coronavirus epidemic.

Figure 1 is a configuration diagram for implementing the automatic test question creation method of the present invention.
Figure 2 is a schematic diagram of the test taker's problem solving process.

The present invention relates to a method for automatically presenting test questions, which includes the steps of connecting to a server (100) that automatically issues test questions and allowing the test taker to take the test, and grading and storing the test questions submitted by the test taker and the test taker's test results. Step 120, a classification step 130 that classifies the data on the test results prepared in the recording step 120, the classified problems are reflected in the actual test questions or reflected as practice problems, and the test questions are automatically generated. A way can be found.

In the examination phase, the candidate can access the server 100 through the terminal 300. The server 100 may be provided with a login step 110 to confirm the applicant's identity. The terminal 300 may be, for example, one of the machines capable of network access, such as a smartphone, tablet, or PC.

The terminal 300 may be installed with an application 310 that connects to the server 100, delivers questions to the test taker, and transmits the answers submitted by the test taker to the server 100.

Questions can be classified according to their level of difficulty. Additionally, the level of difficulty perceived by each test taker may vary for each question. There is a need to classify the sections that the majority of test takers commonly find difficult. By providing information on test results to test takers, test takers can refer to this and adjust the difficulty level of test questions. In addition, test taker test result information can be provided to teachers such as professors or instructors, and teachers who receive the information can refer to it and use it when constructing the curriculum, such as taking care of units that many test takers find difficult. Therefore, the classification step 130 for this may be as follows.

The classification step 130 is a first classification step 131 in which the test taker's test results are analyzed in the recording step 120 and the questions are classified according to the percent correct for each unit, and a second classification step 132 in which the questions are classified according to the difficulty level of the test taker's intention. It includes, and the test questions can be extracted from the first classification step 131 or the second classification step, or the test questions can be extracted by matching the first classification step 131 and the second classification step 132.

The first classification step 131 may be prepared based on data accumulated by the candidate repeating the practice test process. The second classification step 132 is a classification step based on the intention of the test taker and can be classified according to the subjectivity of the test taker.

The test taker can make the test questions consist of only the questions prepared in the first classification step (131), or can make the test questions consist of only the questions prepared in the second classification step (132). In addition, certain questions may be selected and extracted in the first classification step 131 and the second classification step 132. In order to adjust the difficulty of test questions, the test taker may prepare difficulty standards for the questions prepared in the first classification step 131 and the second classification step 132 and reflect them on the server 100. To this end, in the test preparation step 140, a first test preparation step 141 may be prepared to provide common questions to a large number of test takers so that issues of fairness do not arise.

In addition to the first examination stage (141), a second examination stage (142) will be prepared to provide test takers with the opportunity to solve practice problems, analyze the results and use them to adjust difficulty, and provide practice test questions to each individual test taker. You can.

Additionally, in addition to the first question presentation step 141 or the second question presentation step 142, it may be necessary to provide a more detailed ranking.

Inferring the answer within the time limit through a lot of practice can be a criterion for evaluating whether a test taker is superior in terms of academic achievement ability than a test taker who spends the entire time limit. Reflecting this, in the second examination stage (142), there is a limit on the score and solution time for each practice test question, and a third examination stage ( 143) can be provided. It may be desirable for test takers to achieve a high score by solving problems without spending all of the time limit for each item.

Candidates can access the server 100 through the terminal 300 and take the test. The terminal 300 may be a device that can utilize a network, such as a smartphone, tablet, or PC. The terminal 300 may be provided with an application 310 that can access the server 100, register for the test, take the test, and check the results.

Since applicants can take the test using the terminal 300, they have the advantage of being able to take the test without being restricted by location. However, since students can take the exam without being restricted by location, concerns about cheating are bound to be higher. Therefore, a means to prevent this may be necessary. The terminal 300 may be provided with a first inspection step 320 as an inspection process that can prevent or detect cheating by test takers. The first inspection step 320 may be provided as a function inherent to the application 310.

In the first inspection step 320, when using a test-taking device, for example, a smartphone, the test taker's behavior can be observed and recorded using a smartphone camera, microphone, or screen recording. However, in the case of PCs, cameras are generally not installed, so in order to take the test using the test method of the present invention, it may be desirable to take the test with a PC equipped with a camera.

When a candidate takes a test using a smartphone, the first inspection step 320 may record the candidate's actions by operating a camera as an inspection to prevent cheating. Additionally, screen recording and ambient noise can be recorded with the built-in microphone and provided to the server 100.

The terminal 300 can record the test taker's actions and transmit them to the server 100, and the server 100 can provide data to determine whether or not there is cheating. In the first inspection step 320, the gaze direction of the applicant can be tracked using a camera. The first inspection step 320 may determine whether the test taker stares at something other than the screen for more than a certain period of time while taking the test. The first inspection step 320 may serve to alert the test taker's attention by displaying a message on the screen to caution against cheating.

In addition to inspection using a camera, the first inspection step 320 may utilize a microphone to detect noise around the candidate and detect the candidate's voice or the voice of another person. The first inspection step 320 may transmit the detected voice to the server 100. Later, the test taker or supervisor can check the transmitted voice record and use it as the basis for judging whether or not there was cheating.

The server 100 may provide a second inspection step 200 as a basis for determining whether the test taker has cheated. In the second inspection step 200, records such as screen recordings or recordings received from the first inspection step 320 may be stored. In the second inspection step 200, the same inspection process performed in the first inspection step 320 may be performed. For example, by inspecting camera records, we can check whether the test taker's eyes are looking at a place other than the screen for more than a certain period of time, and whether the test taker is talking to others in the surrounding noise through recording records, or whether other people's voices are interjected more than a certain frequency. can be inspected.

The second inspection step 200 can create a list so that the test taker or supervisor can check if staring off-screen for more than a certain period of time or the intervention of another person's voice more than a certain frequency is confirmed. Therefore, the test taker or supervisor can check this and use it as evidence to determine whether the test taker has cheated.

In addition to the methods for preventing fraud described above, a method to prevent fraud using a question bank can be prepared. In the case of math problems, even if the constant value is changed, there may be no difference in deriving the answer because the solution process is the same. Using this, the constant value of the math problem can be configured differently for each test taker to prepare a different answer for each test taker. In addition, in the case of multiple-choice questions, the order of answers can be structured differently for each test taker.

As a first step in using the automatic test questions, the test taker can access the server 100 using an individual ID. The server 100 may be provided with a question bank-type recording step 120. The test taker can submit test questions for each subject or unit and create a database of test questions on the server 100. The server may be equipped with a recording stage based on the test taker's examination records and database. The test taker can access the server 100 and solve the problems stored in the recording step 120.

The server 100 can collect the test taker's solution process and answers, analyze the parts of the questions that the test taker gets wrong, and analyze the test taker's weak parts and provide them individually. Additionally, this can be recorded in the recording step 120 to build a question bank customized for the test taker.

100...server 110...login step
120...recording step 130...classification step
131...First classification step 132...Second classification step
140...Examination stage 141...First examination stage
142...Second exam preparation stage 143...Third exam preparation stage
200...Second inspection stage 300...Terminal
310...Application 320...First inspection step

Claims (3)

An examination step in which the test taker's terminal connects to a server that automatically issues test questions;
A recording step in which the server scores and stores the test results of the test taker's terminal;
A classification step in which the server classifies data about the test results of the recording step;
A test preparation step in which the server presents actual test questions or practice questions based on data on the classified test results of the classification step; and
An inspection step in which the server prevents or detects cheating by test takers taking the test through the test taker terminal; Including,
The inspection step includes a first inspection step and a second inspection step,
In the first inspection step, the server displays a message on the screen of the candidate's terminal to caution against cheating,
In the first inspection step,
The candidate terminal observes and records the candidate's behavior using a recording device including a camera, or records surrounding sounds using a recording device including a microphone,
When the candidate terminal transmits the data of the photographing device and the recording device to the server, the server provides data to determine whether or not there is cheating to the candidate terminal,
The server uses the data of the photographing device and recording device provided to the server as basis for determining fraudulent activity,
The first inspection step is performed at or before the staring step,
The second inspection step is performed the same inspection process as the first inspection step,
The second inspection step is performed at or after the question presentation step,
The server configures the constant values of math questions differently to prepare different answers for each test taker, or configures the viewing order of multiple choice questions differently for each test taker,
The classification step includes a first classification step and a second classification step,
In the first classification step, the server analyzes the test results of the test taker in the recording step and classifies the questions according to the percent correct for each unit,
In the second classification step, the server classifies according to the difficulty level of the test taker's intention,
In the question presentation step, the server,
Extracting test questions based on the first classification step or the second classification step, or matching the first classification step and the second classification step to present test questions,
The test preparation step includes a first test preparation step, a second test preparation step, and a third test preparation step,
In the first question presentation step, the server provides common questions to the test taker's terminal,
In the second question presentation step, the server provides the test taker's terminal with an opportunity to solve practice problems in addition to the first question preparation step, analyzes the results, and provides practice test questions that can be used to adjust the difficulty level,
The third question presentation step is used to prepare a more detailed ranking in addition to the first or second question presentation step,
In the third question presentation step, the server,
A method of automatically presenting test questions in which points are assigned to each question and a time limit is set for the practice test questions provided in the second question presentation step, and additional points are provided to the test taker's terminal who solves the questions according to the remaining time without exceeding the time limit and answers correctly. .
delete delete