JP2005164965A - Method, system, server and program for evaluating level of understanding - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To properly evaluate the level of understanding of an examinee by one examination by preliminarily dividing questions into a plurality of stages and dynamically rearranging and giving questions of a next stage on the basis of answers. <P>SOLUTION: The system for evaluating the level of understanding has a server 20 for evaluating the level of understanding and an examinee terminal, and the the server is provided with; a question DB 22 where questions of one examination for evaluating the level of understanding are constituted of a plurality of stages and are stored; an analysis question DB23 where analysis questions corresponding to questions to which answers are not correct are stored; a transmission/reception means 21-2 for transmitting questions to the examinee terminal in order of stages; an answer discrimination means 21-3 for discriminating whether answers to received questions of a stage are correct or not; and a next question stage generation means 21-5 which extracts analysis questions corresponding to incorrect answers from the DB 23 and substitutes them with questions corresponding to incorrect answers in the next stage, which are stored in the DB 22, to generate questions of the next stage. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  In carrying out the comprehension evaluation test for a large number of examinees within a certain period of time, the present invention divides the test questions into a plurality of stages in advance, and dynamically The present invention relates to a comprehension evaluation system, comprehension evaluation server, comprehension evaluation method, and comprehension evaluation program for reassessing the next stage test questions.

Conventionally, various techniques for supporting learning have been studied and proposed.
For example, by presenting one of a number of tests on a student computer and repeatedly presenting the quizzes in the quiz group associated with the test if the answer is incorrect, the learning effect of the exercise is improved. An automatic education support device that can be used has been proposed (see, for example, Patent Document 1).

In addition, if the answer is correct, the same or higher-ranked questions will continue to be given. If the answer is incorrect, the same or lower-ranked questions will continue to be proposed. (For example, see Patent Document 2).
In addition, it is possible to go back and select the subordinate learning elements necessary to understand the question of the wrong answer and the question that is wrong, and the question is automatically selected. A test questioning device that can be presented to a learner has been proposed (see, for example, Patent Document 3).
According to these technologies, the problem that the learner has answered incorrectly can be presented to the learner with problems related to the class and lower learning elements, and the learning effect is enhanced, thereby improving the academic ability. It is possible to support.

In addition, a technique that focuses on grasping the learner's acquired knowledge and weak points has been proposed.
For example, there has been proposed an acquired knowledge determination device that can discriminate between a learner's acquired knowledge and an unacquired knowledge that is insufficiently understood by clarifying the learning process of the learner (for example, patent literature) 4).
With this acquired knowledge determination device, the learning process followed by the student becomes clear, so the accurate knowledge acquisition situation can be grasped, and it is possible to provide duplicate education on the knowledge already acquired by the student This reduces the possibility that the student may omit the education for knowledge that is insufficiently understood, and the possibility that the student cannot obtain a sufficient educational effect is reduced.

In addition, we conduct comprehensive tests consisting of questions that include multiple categories, identify the categories that are estimated to be weak from the results of the comprehensive tests, and use only the questions in the specified categories according to the learner's ability. We also propose a method for determining weak points of learning that can perform adaptive tests that perform adaptive tests, determine the ability values based on adaptive tests, and determine whether a category specified based on those ability values is a weak point. (For example, refer to Patent Document 5).
According to this learning weak point determination method and the like, it is possible to perform weak point determination in consideration of the degree of difficulty of the problem, improving the accuracy of the learner's weak point determination and feeding back more accurate information to the learner. It is possible.
JP 2000-181335 A JP-A-5-333760 Japanese Patent Laid-Open No. 11-143347 Japanese Patent Laid-Open No. 4-90030 JP 2003-66822 A

  However, the above-described acquired knowledge determination device (Patent Document 4) or the like makes it possible to grasp the knowledge acquisition state deeply for each problem, and does not evaluate the degree of understanding of a predetermined problem group. That is, this prior art was not devised for determining an ununderstood location in a predetermined problem group.

On the other hand, the above-described learning weak point determination method (Patent Document 5) is intended for a problem group including a plurality of categories, but in order to identify a category that is estimated to be a weak point, a comprehensive test is performed once. After that, it is necessary to execute again a test for determining whether or not the category specified in the first test is a weak point.
That is, according to this conventional technique, the examinee investigates in more detail what part or part of the problem group that was incorrect in the first test result was insufficiently understood. In order to analyze it, it was necessary to take a second test for the purpose of the investigation and analysis, and there was a problem that it was troublesome, and man-hour and opportunity loss occurred.
In addition, immediately after the first test, the candidate cannot recognize a detailed lack of understanding of the problem that has been wrongly answered, making it difficult to conduct timely learning. There was also a problem of inviting.

  The present invention has been considered in view of the above circumstances, and in carrying out the understanding evaluation test within a limited time for a large number of examinees, the problem for each understanding evaluation test is preliminarily determined. By dividing the test into multiple stages and dynamically incorporating analysis questions to evaluate the degree of understanding in the next stage of the test questions for the test taker, The purpose of the present invention is to provide an understanding level evaluation system, an understanding level evaluation server, an understanding level evaluation method, and an understanding level evaluation program capable of determining the proficiency level and unintelligible part of a test taker by a single test.

  In order to achieve the above-mentioned object, the understanding level evaluation system of the present invention evaluates the level of understanding of the examinee by a single test by dynamically reconfiguring the test questions based on the answers of the examinees. A comprehension evaluation system, which comprises a question question storage unit for storing a question for each comprehension evaluation test in two or more test question stages each holding one or more questions, and an incorrect answer An analysis problem storage unit that stores the analysis problem corresponding to the question that has become, and an examination question stage are sent to the examinee terminal one by one in order, and answers to the questions in the examination question stage are sent from the examinee terminal to each examination question stage. The transmission / reception means for receiving, the answer determination means for determining whether the answer to the question at the test question stage received from the examinee terminal is correct, and the analysis problem corresponding to the answer that is incorrect as a result of the determination are separated. The next test question stage is generated by extracting from the question memory and replacing this analysis question with the question corresponding to the incorrect answer in the next test question stage stored in the test question memory. An evaluation level evaluation server having a next test question stage generation means for receiving the test questions for each test question stage from the understanding level evaluation server, and sending the inputted answer to the understanding level evaluation server for each test question stage And a test taker terminal.

If the comprehension evaluation system is configured in this way, a single test question is divided into a plurality of test question stages, and analysis questions corresponding to each question in each test question stage are prepared. If the examinee makes a mistake in answering the question, the question that was supposed to be given when the question is correct will be replaced with an analysis question that corresponds to the incorrect answer question. As a result, it is possible to appropriately evaluate the degree of understanding of the examinee regarding a problem that was incorrect.
Furthermore, since various examination question stages corresponding to the degree of understanding of the examinee are generated in one examination and the examination is performed, the examinee does not have to take multiple examinations to evaluate the degree of understanding. In addition, it is possible to effectively evaluate the degree of understanding for a diverse group of examinees.
Note that “one test” refers to a group of tests performed within a limited time, and generally means a single test that is continuously performed from the start to the end of the test. doing.

  The comprehension evaluation system according to the present invention includes an examinee history storage unit that stores a determination result, and an examination in which the determination result is sequentially stored in the examiner history storage unit for each test question stage. If the results of judgment for all the test question stages in a single comprehension evaluation test are stored in the examiner history registration means and the examinee history storage unit, the comprehension evaluation test is taken based on the determination result. And an understanding level evaluation table creating means for creating an understanding level evaluation table for displaying the understanding level evaluation of the person.

If the understanding level evaluation system is configured in this way, for each question that the examinee has made an incorrect answer through a single level of understanding level evaluation, the corresponding analysis questions will be given at the next test question stage, It becomes possible to grasp the degree of understanding of the examinee in detail and accurately, and to create an understanding degree evaluation table that displays the degree of understanding of the examinee.
For this reason, educators can analyze in detail what parts the examinee was lacking in understanding based on this comprehension evaluation table, and understand what kind of education should be conducted. It is possible to conduct appropriate education for examinees.
In addition, since the examinee can point out the detailed ununderstood points for problems that are incorrect in a single test and recognize the necessary learning points in a timely manner using the comprehension evaluation table, It is possible to expect improvement in effect, improvement in understanding, improvement in learning motivation, and the like.

  Further, the understanding level evaluation server of the present invention is an understanding level evaluation server that evaluates an understanding level of a test taker by a single test by dynamically recombining test questions based on the answer of the test taker. In addition, the problem for each comprehension assessment test is composed of two or more test question stages each holding one or more questions, and the question problem storage unit stores incorrect questions. An analysis problem storage unit for storing the corresponding analysis problem, and a transmission / reception means for transmitting the test question stages to the examinee terminal one by one in order and receiving answers to the questions in the test question stage from the test taker terminal for each test question stage; The answer determination means for determining whether the answer to the question at the test question stage received from the examinee terminal is correct or not, and the analysis problem corresponding to the answer that is incorrect as a result of the determination is extracted from the analysis problem storage unit. Next test question stage generation means for generating the next test question stage by replacing this analysis question with a question corresponding to an answer that was an incorrect answer in the next test question stage stored in the test question storage unit It is set as the structure which has.

  The comprehension evaluation server according to the present invention includes a test taker history storage unit that stores the determination result, a test taker history registration unit that sequentially stores the determination result in each test question stage in the test taker history storage unit, When the results of judgment for all test question stages in a single comprehension evaluation test are stored in the person history storage section, the comprehension evaluation of the examinee of the comprehension evaluation test is displayed based on the determination result And an understanding level evaluation table creating means for creating an understanding level evaluation table.

  If the understanding evaluation server is configured in this way, a single test question is divided into a plurality of test question stages, and an incorrect answer is assigned to the incorrect answer problem at the next test question stage. By replacing the corresponding analysis problem with the problem that was scheduled to be answered for the incorrect answer problem, it becomes possible to provide an understanding evaluation server that can appropriately evaluate the understanding of the examinee. . It is also possible to create a comprehension evaluation table that displays the comprehension evaluation of the examinee.

  Further, the understanding level evaluation method of the present invention includes a test problem storage unit configured to store a problem for each understanding level evaluation test in two or more test problem stages each holding one or more problems. The comprehension evaluation server having an analysis problem storage unit for storing an analysis problem corresponding to an incorrect answer dynamically reconfigures the test problem based on the test taker's answer from the test taker terminal. In this way, it is an understanding level evaluation method for evaluating the understanding level of the candidate by one test, the understanding level evaluation server transmits the examination question stages one by one to the candidate terminal, and the candidate terminal The answer input for the question in the exam question stage is transmitted to the comprehension evaluation server, and the comprehension evaluation server determines whether the answer to the question in the test question stage received is correct or not. Vs. the answer that was The analysis problem to be extracted is extracted from the analysis problem storage unit, and this analysis problem is replaced with the problem corresponding to the answer that was incorrect in the next test question stage stored in the test problem storage unit. This is a method for generating a test question stage.

  Further, the understanding level evaluation method of the present invention is such that an understanding level evaluation server having a test taker history storage unit for storing a result of determination makes all test question stages in one understanding level evaluation test in the test taker history storage unit. When the result of the judgment is stored, the comprehension evaluation table that displays the comprehension evaluation of the examinee of the comprehension evaluation test is created based on the determination result, and this comprehension evaluation table is displayed on the examinee terminal. As a way to send to.

  If the comprehension evaluation method is such a method, a single test question is divided into a plurality of test question stages, and the problem corresponding to the incorrect answer question is replaced with an analysis question for each test question stage. By taking the questions, it is possible to appropriately evaluate the degree of understanding of the examinee regarding the problem that was incorrect, and to provide an understanding degree evaluation table that displays the degree of understanding to the examinee. It becomes possible.

  Further, the understanding level evaluation program of the present invention includes a test problem storage unit configured to store a problem for each understanding level evaluation test in two or more test problem stages each having one or more problems. By using a comprehension evaluation server with an analysis question storage unit that stores analysis questions corresponding to incorrect questions, the test questions are dynamically recombined based on the answers of the test takers. This is a program for evaluating the degree of comprehension of a test taker based on the number of examinations. The comprehension evaluation server sends the test question stages one by one to the test taker's terminal one by one, and responds to the questions in the test question stage. An answer is received for each test question stage from the examinee terminal, and the correctness of the answer to the question of the test question stage sent from the test taker terminal is judged. By extracting the corresponding analysis problem from the analysis problem storage unit and replacing this analysis problem with the problem corresponding to the answer that was incorrect in the next test question stage stored in the test problem storage unit, The test question stage is generated.

  If the understanding level evaluation program is configured in this way, the understanding level evaluation test server will respond to each question that the examinee has made an incorrect answer when conducting an understanding level evaluation test consisting of multiple test question stages. Analytical questions can be replaced with questions corresponding to the incorrect answer questions at the next exam question stage, so it is possible to appropriately evaluate the degree of understanding of the examinees by a single understanding assessment test It becomes.

According to the present invention, a single test question is divided into a plurality of test question stages, and an analysis question corresponding to each question in each test question stage is prepared. When the next exam question stage is given, the question that is given when the question is correct is replaced with the analysis question. It becomes possible to appropriately evaluate the degree of understanding of the examinee.
In addition, since various test question stages corresponding to the degree of comprehension of the test taker are generated and tested in a single test, there is no need to conduct multiple tests to evaluate the level of understanding. It is possible to effectively evaluate the understanding level for the examinee group.

In addition, since an understanding evaluation table can be created to display the understanding evaluation performed in this way, educators can use this to specifically determine what part of the examinee was insufficiently understood. It is possible to analyze in detail, grasp what kind of education should be performed, and implement appropriate education for examinees.
In addition, since the examinee can point out the detailed ununderstood points for problems that are incorrect in a single test and recognize the necessary learning points in a timely manner using the comprehension evaluation table, It is possible to expect improvement in effect, improvement in understanding, improvement in learning motivation, and the like.

Hereinafter, preferred embodiments of an understanding level evaluation system according to the present invention will be described with reference to the drawings.
Note that the understanding level evaluation system of the present invention shown in the following embodiments is operated by a computer controlled by a program. The program sends instructions to each component of the computer, and predetermined processing necessary for the operation of the understanding evaluation server, such as answer determination processing, examinee history registration processing, next examination question stage generation processing, understanding evaluation table Make the creation process etc. Thus, each process and operation in the understanding level evaluation system of the present invention can be realized by specific means in which the program and the computer cooperate.
The program is stored in advance in a recording medium such as a ROM and a RAM, and is executed by causing the computer to read the program from a recording medium mounted on the computer. For example, the program may be read by the computer via a communication line.
Further, the recording medium for storing the program can be constituted by, for example, a semiconductor memory, a magnetic disk, an optical disk, or any other recording means readable by any computer.

[Understanding level evaluation system 1]
First, with reference to FIGS. 1-7, the structure of the comprehension evaluation system which concerns on one Embodiment of this invention is demonstrated. FIG. 1 is a block diagram showing a configuration of an understanding level evaluation system according to an embodiment of the present invention. FIG. 2 is a block diagram showing the configuration of the examinee terminal in the comprehension evaluation system according to the present embodiment. FIG. 3 is a block diagram showing the configuration of an understanding level evaluation server in the understanding level evaluation system according to the present embodiment. 4 to 7 are respectively a diagram showing an example of test data stored in the examination question DB in the comprehension evaluation system according to the present embodiment, a diagram showing an example of data stored in the analysis question group DB, and data stored in the examinee history DB. It is a figure which shows another example (authentication and comprehension evaluation table data) of the data which show an example, and the storage data of examinee log | history DB.
The understanding level evaluation system 1 according to the present embodiment is a client / server type Web-type understanding level evaluation test system. As shown in FIG. 1, a plurality of examinee terminals 10 (10a, 10b to 10n), an understanding level An evaluation server 20 and a communication line 30 are included.

[Candidate terminal 10]
The examinee terminal 10 is an information processing apparatus used by examinees scattered in various places, and may be a personal computer, a mobile phone, a PHS, a PDA, or the like, for example.
As shown in FIG. 2, the examinee terminal 10 includes a processing device 11 and a test question DB 12.

The processing device 11 executes various processes in the examinee terminal 10 and is composed of a CPU, a RAM, etc., and a candidate registration means 11-1, a transmission / reception means 11-2, a test question storage means 11-3, a test. It has execution means 11-4.
The examinee registration means 11-1 causes the transmission / reception means 11-2 to access the comprehension evaluation server 20 to receive the examinee registration screen, and inputs examinee authentication information (for example, the name and password of the examinee). The candidate is registered by transmitting this to the comprehension evaluation server 20 by the transmission / reception means 11-2.
In addition, at the start of the examination, an examination start request is transmitted to the understanding level evaluation server 20 via the transmission / reception means 11-2, a logon screen is received from the understanding level evaluation server 20, and the above-mentioned examination person authentication information by the examinee is received. By inputting the information and transmitting it to the comprehension evaluation server 20, the examinee is authenticated.

The transmission / reception means 11-2 performs transmission / reception of information between the examinee terminal 10 and the understanding level evaluation server 20, receives a test question from the understanding level evaluation server 20, and understands the answer input by the examinee. It transmits to the evaluation server 20.
The test question storage unit 11-3 stores each test question stage sequentially transmitted from the understanding level evaluation server 20 via the transmission / reception unit 11-2 in the test question DB 12.

The test execution means 11-4 displays the test questions stored in the test question DB 12 on a display unit (not shown) in the examinee terminal 10, receives an answer input by the examinee, and sends the answer to the transmission / reception means 11-2. The test is executed by transmitting to the understanding level evaluation server 20 via.
The test question DB 12 is a storage device that stores each test question stage transmitted from the comprehension evaluation server 20. In the present embodiment, the database is configured as a database, but the present invention is not limited to this, and other storage methods may be used as long as each test question stage can be appropriately stored.

[Understanding Level Evaluation Server 20]
The understanding level evaluation server 20 is an information processing apparatus used by the provider of the understanding level evaluation test, and may be a workstation, a server, a personal computer, or the like. As shown in FIG. 3, the understanding level evaluation server 20 includes a processing device 21, a test question DB 22, an analysis question group DB 23, and an examinee history DB 24.
The processing device 21 executes various processes in the understanding level evaluation server 20 and is configured by a CPU, a RAM, and the like. By developing the understanding level evaluation program of the present invention on the RAM and executing it by the CPU, the processing device 21 is as follows. The processing of each means is realized. As shown in the figure, the processing device 21 includes an examinee authentication means 21-1, a transmission / reception means 21-2, an answer determination means 21-3, an examinee history registration means 21-4, and a next test question stage generation means 21. -5 and comprehension level evaluation table creating means 21-6.

In response to a test start request from the test taker terminal 10, the test taker authentication means 21-1 sends a log-on screen to the test taker terminal 10 by the send / receive means 21-2, and the test taker terminal 10 sends the send / receive means 21-2 to the test taker terminal 10. The test taker is authenticated by confirming that the test taker authentication information received via the test taker history DB 24 is registered.
The transmission / reception means 21-2 performs transmission / reception of information between the understanding level evaluation server 20 and the examinee terminal 10. In addition to transmission / reception of authentication related information, the result of authentication by the examiner authentication means 21-1, Can be confirmed to be registered in the examinee history DB 24, a series of test question stages 1 to n corresponding to each examinee are sequentially transmitted from the test question DB 22 to the examinee terminal 10. Moreover, when the answer corresponding to each test question stage transmitted from the examinee terminal 10 is received, it is passed to the answer determination means 21-3.

The answer determination means 21-3 determines whether the answer to each test question stage transmitted from the examinee terminal 10 is correct or incorrect. Then, the determination result is stored in the examinee history DB 24 using the examinee history registration means 21-4.
The examinee history registration unit 21-4 stores the determination result by the answer determination unit 21-3 in the examinee history DB 24. Further, when the test taker authentication information is transmitted from the test taker terminal 10, it is stored in the test taker history DB 24.

The next test question stage generation unit 21-5 receives the determination result for the answer corresponding to each test question stage from the answer determination unit 21-3, and extracts the analysis question group corresponding to the incorrect answer question from the analysis question group DB 23. To do. In addition, a question group at the next test question stage is extracted from the test question DB 22, and a deletion question group corresponding to the incorrect answer question at the next test question stage is specified.
Further, by replacing the identified deletion problem group with the analysis problem group extracted from the analysis problem group DB 23, the problem group in the next test problem stage is configured so as to be suitable for analysis of the incorrect answer part of the examinee. Instead, a problem group for the next examination question stage is generated. Further, the generated problem group of the next test question stage is replaced with the original problem group of the next test question stage in the test problem DB 22 and stored.
Then, the transmission / reception means 21-2 extracts the problem group of the next test question stage generated as described above from the test question DB 22 as the next test question stage for the corresponding examinee, It transmits to the examinee terminal 10 to be used.

  The next test question stage generation unit 21-5 does not receive the determination result directly from the answer determination unit 21-3, but indicates that the determination on a certain test question stage is completed from the answer determination unit 21-3. Accordingly, it is of course possible to extract the determination result corresponding to the examination question stage from the examinee history DB 24 in response to this. The transmission / reception unit 11-2 receives the next test question stage question group to be transmitted to the examinee terminal 10 directly from the next test question stage generation unit 21-5 instead of extracting from the test question DB 22. Of course it is also possible. In addition, if the next examination question stage as described above is generated and can be transmitted to the examinee terminal 10, the detailed processing procedure may be appropriately changed.

The comprehension evaluation table creating means 21-6 is based on the determination result of the answer by the examinee registered in the examinee history DB 24 when the examinee has completed all the examinations in the series of comprehension assessment test question stages. The incomprehension point is analyzed, an understanding level evaluation table indicating the learning points is created, and transmitted to the examinee terminal 10 used by the examinee.
By referring to this comprehension evaluation table, educators can grasp the detailed analysis of which part each examinee specifically lacked understanding and what kind of education should be conducted. It is possible to provide appropriate education to examinees.

  The test question DB 22 is a storage device (test question storage unit) that stores test questions in the scope of understanding evaluation evaluation divided into a plurality of test question stages, and a series of test question stages corresponding to each examinee. Is held. Each exam question stage has one or more questions, and when the scope of understanding assessment is the same, the initial value of the question content of each exam question stage for each examinee is the same. is there. Depending on the test results of each examinee, the contents of each test question stage are updated as needed except for the first test question stage. FIG. 4 shows an example of stored data in such a test question DB 22.

  The analysis problem group DB 23 is a storage device (analysis problem storage unit) that stores a test problem group prepared for extracting a replacement problem corresponding to a problem that has become an incorrect answer, excluding the first test problem stage. A group of ununderstood part analysis questions corresponding to each question in each test question stage is stored. This analysis problem is intended to investigate and analyze in more detail what kind of part or part was insufficiently understood. FIG. 5 shows an example of stored data in such an analysis problem group DB 23.

The examinee history DB 24 is a storage device (taker history storage unit) that stores the correct / incorrect answer determination results for each test question stage for each examinee. FIG. 6 shows an example of data stored in such an examinee history DB 24.
The examinee history DB 24 also holds examinee authentication information for each examinee. This examinee authentication information can be held in the examinee history DB 24 as a table separate from the information shown in FIG. 6, for example, as shown in FIG. The table shown in FIG. 7 is used not only for the test taker authentication by the test taker authentication means 21-1, but also for creating the comprehension evaluation table. Although not shown, it is also preferable that an identification code for specifying the examinee terminal 10a used by each examinee is held in the table shown in FIG.
The examination question DB 22, the analysis question group DB 23, and the examinee history DB 24 are configured by databases in this embodiment, but are not limited to this, and each data can be stored appropriately. If so, other storage methods may be used. Further, the examinee authentication information may be stored in a database separate from the examinee history DB 24.

[Communication line 30]
The communication line 30 may be any publicly known public line, commercial line, or dedicated line known in the art. In addition, each test taker terminal 10 and understanding level evaluation server 20 can be configured with the same or separate communication lines.
Further, the communication line 30 is a line that can be connected between each examinee terminal 10 and the comprehension evaluation server 20 by wireless or wired, for example, a public line network, a private line network, an Internet line network, and an intranet. It can be configured by a net.

Next, a processing procedure in the understanding level evaluation system of the present embodiment will be described with reference to FIGS. 4 to 7 and FIGS. FIG. 8 is an operation procedure diagram showing a processing procedure in the understanding level evaluation system of the present embodiment. FIG. 9 is a diagram showing an example of a test question stage in the understanding level evaluation system according to the present embodiment.
First, the examinee terminal 10 accesses the comprehension evaluation server 20 by the examinees scattered in various places, and starts the comprehension evaluation test by logging on the examinee (step A1).
This logon is performed by inputting examinee authentication information such as the name and password of the examinee on the logon screen displayed on the examinee terminal 10. This logon screen can be transmitted from the understanding level evaluation server 20 to the test taker terminal 10 in response to a request from the test taker terminal 10. The examinee terminal 10 may have a logon screen dedicated to the understanding level evaluation test.

  Upon receiving the test taker authentication information from the test taker terminal 10, the comprehension evaluation server 20 compares the test taker authentication information stored in the test taker history DB 24 to register the received test taker authentication information. Authenticate if it is a thing. If it is confirmed as a result of the authentication that the examinee is registered in the examinee history DB 24, the examinee's examinee code is acquired from the examiner history DB 24, and the test question DB 22 Reference to the examinee history DB 24, update processing, etc. are executed. If the test taker authentication information received from the test taker terminal 10 does not match that stored in the test taker history DB 24, an error message is returned to the test taker terminal 10 and the process is terminated (step A2).

When the scope of understanding evaluation of all examinees is the same, first, the understanding evaluation server 20 applies the same first test question stage as shown in FIG. Is transmitted (step A3).
The examinee terminal 10 stores the received test question stage in the test question DB 12 (step A4).
Here, the test taker terminal 10a is used by the test taker “Taro Yamada” (test taker code xxxxxxxx), and the test question stage as shown in FIG. 9 is transmitted from the understanding evaluation server 20 to this test taker terminal 10a. Assuming that this candidate “Taro Yamada” creates an answer to the first exam question stage S0 in the Express 5800 evaluation test (EXP001) question, the examinee terminal 10 inputs this answer and understands it. It transmits to the degree evaluation server 20 (step A5).

Next, the understanding level evaluation server 20 determines whether the received answer is correct / incorrect (step A6), and stores the determination result in the examinee history DB 24 as examination history information of the examinee “Taro Yamada” (step S6). A7).
Subsequently, when the test question stage is not the last stage (NO in step A8), the understanding level evaluation server 20 extracts the analysis question group corresponding to the incorrect answer question from the analysis question group DB 23, and the test question A question group at the next examination question stage is extracted from the DB 22. Further, a deletion problem group corresponding to the incorrect answer problem in the next test question stage is specified (step A9). Then, by replacing the identified deletion problem group with the analysis problem group extracted from the analysis problem group DB 23, the problem group of the next examination question stage is suitable for analyzing the incorrect answer part of the examinee “Taro Yamada”. Recombination, so as to generate a question group for the next test question stage. The generated problem group of the next test question stage is replaced with the original problem group of the next test question stage in the test problem DB 22 and stored (step A10).
Therefore, for the problem determined to be correct in step A6, in the next stage, the same problem as the problem in the original next test question stage in the test problem DB 22 is presented, and the problem determined to be incorrect in step A6. In the next stage, an analysis problem corresponding to the problem will be presented.

Here, the generation of the question group in the next test question stage will be described in more detail with reference to FIGS.
The examinee “Taro Yamada” first takes the first exam question stage S0 as shown in FIG. 4, and the determination result of the answer is shown as stored data in the examinee history DB 24 in FIG. Yes. As shown in the figure, in the exam question stage S0, the examinee “Taro Yamada” answered the question 2 (Q1) in question 2 (C1) and the question 1 (Q200) in question 3 (C2). It has become.

  For this reason, the understanding level evaluation server 20 extracts an analysis problem corresponding to the incorrect answer problem in the test question stage S1 as an analysis problem for the test question stage S0 from the analysis problem group DB 23 shown in FIG. . In this case, the problem 2 (P111) of the question 2 (C1) is the analysis problem corresponding to the problem 1 (Q200) of the question 3 (C2) as the analysis problem corresponding to the problem 2 (Q101) of the question 2 (C1). The problem 1 (P210) of the question 3 (C2) is extracted as a problem.

In addition, the understanding level evaluation server 20 extracts a question group of the test question stage S1, which is the next test question stage, from the test question DB 22, and specifies a problem to be deleted. In this case, question 2 (P101) of question 2 (C1) (P101) and question 1 (P200) of question 3 (C2) corresponding to the above-mentioned incorrect answer question are specified. Further, the understanding level evaluation server 20 replaces the problem 2 (P101) of the identified question 2 (C1) with the problem 2 (P111) of the question 2 (C1) that is the extracted analysis problem, and also identifies the identified question 3 The problem 1 (P200) of (C2) is replaced with the problem 1 (P210) of question 3 (C2), which is the extracted analysis problem, and a problem group S1 of the next test question stage is generated.
Then, the comprehension evaluation server 20 replaces the generated test question stage S1 with the question group S1 of the original next test question stage in the test question DB 22, and stores it. The question group S1 of the next test question stage shown in FIG. 4 shows the next test question stage generated and stored in this way.

Next, the understanding level evaluation server 20 transmits the test question stage S1 generated in this way to the examinee terminal 10a of the examinee “Taro Yamada” (step A11). Thereafter, in the same manner, the above-described processing is repeatedly executed until all the test question stages are completed.
That is, the examinee “Taro Yamada” next takes the second exam question stage S1 shown in FIG. 4, and the determination result of the answer is registered in the examinee history DB 24 as shown in FIG. . Here, question 1 (P210) of question 3 (C2) that has been recombined as an analysis question is correct, question 2 (P111) of question 2 (C1) and question 3 (P202) of question 3 (C2) ) Is incorrect.

  For this reason, the understanding level evaluation server 20 extracts the analysis problem corresponding to the incorrect answer problem in the test problem stage S2 as the analysis problem for the test problem stage S1 from the analysis problem group DB 23 shown in FIG. . In this case, the problem 2 (R111) of the question 2 (C1) is the analysis corresponding to the problem 3 (P202) of the question 3 (C2) as the analysis problem corresponding to the question 2 (P111) of the question 2 (C1). Problem 3 (P212) of question 3 (C2) is extracted as a problem.

  The comprehension evaluation server 20 extracts a problem group of the test problem stage S2 which is the next test problem stage from the test problem DB 22, identifies a problem to be deleted, and identifies the identified problem group and the extracted analysis problem. And a problem group S2 of the next test question stage is generated, and the generated test question stage S2 is replaced with the original question group S2 of the next test question stage in the test problem DB 22 and stored. The next test question stage S2 shown in FIG. 4 shows the next test question stage generated and stored in this way. Then, this next examination question stage S2 is transmitted to the examinee terminal 10a. In this way, the examinee “Taro Yamada” will answer each stage in sequence and answer.

As described above, when the answer to the last test question stage is completed (step A12), the examinee terminal 10a ends the process.
Further, when the comprehension / evaluation server 20 finishes storing the correct / incorrect answer determination result for the last test question stage in the test taker history DB 24 (YES in step A8), the test taker “Yamada” is determined from the test taker history information. Extract the unintelligible part of “Taro”, create an understanding evaluation table that displays the unintelligible part and necessary learning points together with the examinee history information, and send it to the examinee terminal 10a of the examinee “Taro Yamada” (Step A13).
In this way, the examinee “Taro Yamada” can recognize the future learning approach based on the received learning points.

  In addition, the specific processing content which displays an ununderstood location and a learning point on an understanding degree evaluation table | surface can be designed suitably. For example, for each question and question in the test question stage, a table having a message explaining the corresponding ununderstood location and the learning point is held in the understanding level evaluation server 20, and the number of incorrect answers for each question and question is a predetermined number or more. In this case, a corresponding message can be extracted from the table and displayed on the understanding level evaluation table. In addition, when the determination results for a certain question and problem are all correct, a message indicating that there is no ununderstood point and all can be understood may be displayed.

As described above, according to the understanding level evaluation system of the present embodiment, when the understanding level evaluation test is performed for a large number of examinees within a certain time limit, The question is divided into multiple stages in advance, and based on the answer of the test taker, the test questions of the next stage for the test taker are dynamically incorporated with analysis questions to evaluate the understanding level. Thus, the proficiency level of the examinee and the unintelligible location can be determined by a single test.
In other words, it is possible to collect incorrect answer history information at each test question stage of a test taker by a single comprehension evaluation test. Educators are able to analyze in detail what part of the examinee was lacking in understanding based on this information and understand what kind of education should be conducted. It is possible to conduct appropriate education for examinees.

In addition, this invention is not limited to the above embodiment, It cannot be overemphasized that a various change implementation is possible within the scope of the present invention.
For example, in the above embodiment, an understanding evaluation test is performed on a plurality of examinee terminals via a communication line such as the Internet. Of course, it is possible to realize the understanding level evaluation system of the invention and to use one test taker terminal. Moreover, it is possible to appropriately change the function separation of each means in the understanding level evaluation server.

It is a block diagram which shows the structure of the comprehension evaluation system which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the examinee terminal in the comprehension evaluation system which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the understanding level evaluation server in the understanding level evaluation system which concerns on one Embodiment of this invention. It is a figure which shows an example of the stored data of test question DB in the comprehension evaluation system which concerns on one Embodiment of this invention. It is a figure which shows an example of the storage data of analysis problem group DB in the comprehension evaluation system which concerns on one Embodiment of this invention. It is a figure which shows an example of the storage data of examinee log | history DB in the comprehension evaluation system which concerns on one Embodiment of this invention. It is a figure which shows another example of the data stored in the examinee history DB in the understanding level evaluation system according to an embodiment of the present invention. It is an operation | movement procedure figure which shows the process sequence in the comprehension evaluation system which concerns on one Embodiment of this invention. It is a figure which shows an example of the test question stage in the comprehension evaluation system which concerns on one Embodiment of this invention.

Explanation of symbols

10 (10a, 10b,..., 10n) Test taker terminal 11 Processing device 11-1 Test taker registration means 11-2 Transmission / reception means 11-3 Test question storage means 11-4 Test execution means 12 Test question DB
DESCRIPTION OF SYMBOLS 20 Comprehension evaluation server 21 Processing apparatus 21-1 Examiner authentication means 21-2 Transmission / reception means 21-3 Answer determination means 21-4 Examiner history registration means 21-5 Next examination question stage generation means 21-6 Comprehension evaluation table Preparation means 22 Exam question DB
23 Analysis problem group DB
24 examinee history DB
30 Communication line

Claims (7)

A comprehension evaluation system that evaluates the comprehension level of a candidate by a single test by dynamically recombining test questions based on the answers of the test takers,
A test question storage unit that stores and stores questions for each understanding level evaluation test in two or more test question stages each holding one or more questions, and an analysis corresponding to problems that are incorrect An analysis question storage unit for storing questions, and a transmission / reception means for transmitting the test question stages to the examinee terminal one by one in order, and receiving answers to the questions in the test question stage from the test taker terminal for each test question stage; Answer determination means for determining whether the answer to the question at the test question stage received from the test taker terminal is correct or not, and an analysis problem corresponding to the answer that was incorrect as a result of the determination is extracted from the analysis problem storage unit. By replacing this analysis problem with the problem corresponding to the incorrect answer in the next test question stage stored in the test question storage unit, And comprehension evaluation server with the next exam stage generating means for generating a test question stage,
The test taker terminal that receives the test question from the understanding level evaluation server for each test question stage and transmits the input answer to the understanding level evaluation server for each test question stage. Understanding level evaluation system. The comprehension evaluation server stores a test taker history storage unit that stores the result of the determination, a test taker history registration unit that sequentially stores the determination result in the test taker history storage unit for each test question stage, and When the results of determination for all of the test question stages in the one-time understanding evaluation test are stored in the examinee history storage unit, based on the determination results, the understanding of the examinees of the understanding evaluation test The understanding level evaluation system according to claim 1, further comprising an understanding level evaluation table creating means for creating an understanding level evaluation table for displaying the degree evaluation. A comprehension evaluation server that evaluates the comprehension of a candidate by a single test by dynamically recombining test questions based on the answers of the test takers,
A test question storage unit configured to store a problem for each comprehension evaluation test in two or more test question stages each holding one or two or more questions;
An analysis problem storage unit for storing an analysis problem corresponding to an incorrect answer;
Transmitting / receiving means for transmitting the test question stages one by one to the examinee terminal one by one, and receiving answers to the questions of the test question stage from the test taker terminal for each test question stage;
Answer determination means for determining whether or not the answer to the question of the test question stage received from the examinee terminal is correct;
As a result of the determination, an analysis question corresponding to an answer that is an incorrect answer is extracted from the analysis question storage unit, and the analysis question is extracted from the analysis question storage unit in the next test question stage stored in the test question storage unit. And a next test question stage generation means for generating a next test question stage by replacing with a question corresponding to the answer, which is an understanding level evaluation server. An examinee history storage unit for storing the result of the determination;
Test taker history registration means for sequentially storing the result of the determination for each test question stage in the test taker history storage unit;
When the result of determination for all the test question stages in the one understanding level evaluation test is stored in the test taker history storage unit, based on the result of the determination, The understanding level evaluation server according to claim 3, further comprising an understanding level evaluation table creating means for creating an understanding level evaluation table for displaying the understanding level evaluation. A test question storage unit that stores and stores questions for each understanding level evaluation test in two or more test question stages each holding one or more questions, and an analysis corresponding to problems that are incorrect A comprehension evaluation server having an analysis question storage unit for storing questions dynamically recombines the test questions based on the answer of the test taker from the test taker's terminal, thereby giving the test taker a single test. A comprehension evaluation method for performing comprehension evaluation of
The comprehension evaluation server sends the test question stages one by one to the examinee terminal,
The test taker terminal sends an answer inputted to the question at the examination question stage to the understanding level evaluation server,
The comprehension evaluation server determines whether the answer to the question of the received test question stage is correct or incorrect, and extracts the analysis problem corresponding to the answer that was incorrect as a result of the determination from the analysis problem storage unit. The next test question stage is generated by replacing the analysis question with a question corresponding to the answer that was the incorrect answer in the next test question stage stored in the test question storage unit. Understanding evaluation method. The comprehension evaluation server including a test taker history storage unit for storing the determination result,
When the result of determination for all the test question stages in the one understanding level evaluation test is stored in the test taker history storage unit, based on the result of the determination, Create a comprehension assessment table that displays the comprehension assessment,
6. The comprehension evaluation method according to claim 5, wherein the comprehension evaluation table is transmitted to the examinee terminal. A test question storage unit that stores and stores questions for each understanding level evaluation test in two or more test question stages each holding one or more questions, and an analysis corresponding to problems that are incorrect The comprehension evaluation server with an analysis question storage unit that stores questions is used to evaluate the comprehension level of the test taker in a single test by dynamically reconfiguring the test questions based on the test taker's answers. An understanding level evaluation program that
In the understanding level evaluation server,
The test question stages are transmitted one by one to the test taker terminal, and the answers to the questions in the test test stage stage are received from the test taker terminal for each test test stage,
Let us determine the correctness of the answer to the question of the exam question stage sent from the examinee terminal,
As a result of the determination, the analysis problem corresponding to the incorrect answer is extracted from the analysis problem storage unit,
By replacing this analysis question with a question corresponding to the answer that was the incorrect answer in the next test question stage stored in the test question storage unit, the next test question stage is generated. An understanding level evaluation program.

Images