SU1166164A1 - Device for checking knowledge levels of trainees - Google Patents

Abstract

A DEVICE FOR CONTROLLING KNOWLEDGE OF STUDENTS, containing consistently included response input block and response analysis block, the second input of which is connected to the first output of the question codes generator, the second output of which is connected to the first input of the evaluator, the first output of which is co1 ", - 1-- .-j) f -n 1 IB, i; .l I.-1. dinene with the input of the evaluation registrar, and the second input and output - with the first output and input of the question analysis block, the second output of which is connected to the first input of the question code generator, the second input of which is connected to the second output of the response input block, characterized in that expansion of didactic capabilities of the device, sequentially included memory block and comparison block, the second input of which is connected to the output of the response analysis block, the first output to the third input of the question codes, and the second the output — with the first input of the memory unit, the second input of which is connected to the third output of the question codes generator, and the series-connected § switch and pulse generator, the second input of which is connected to the output (L of the response analysis unit, and the output - with the cracking input of the evaluator The third input of the comparison unit is connected to the output of the switch.

Description

O5 Ot)

05

N

The invention relates to technical training tools and can be used to create programmed control systems, as well as automated training systems in various areas of national economy.

A device is known comprising a logic unit connected to an information presentation unit, an information input unit, an indication unit and a cross-correlation unit of the number of questions and correct answers connected to the rating unit. The device provides a certain reliability of knowledge assessment due to the mutual correlation of the number of questions and correct answers 1.

However, in the device, correlation is implemented without taking into account the complexity of the answered questions and the confidence of the answer. In addition, the device can only work with a program that has questions with the same

. ,about

values of cross-correlation coefficients.

A device is known that additionally contains a response evaluation unit and an analog-digital converter, the output of which is connected to the input of the mutual correlation unit of the number of questions and correct answers, and the inputs to the outputs of the logic unit and the response evaluation unit, the inputs of which are connected to the outputs of the logic unit and presentation unit information. The device also provides a certain reliability of the knowledge assessment due to the mutual correlation of the number of questions and the correct answers given their complexity 2. However, this device can also work only with a program that has questions with the same values of the mutual correlation coefficients and does not take into account the confidence students in their responses.

Closest to the present invention is a device comprising a response input unit connected to an answer analysis unit connected to a question forming unit and a rating counter connected to a calculator connected to a rating recorder and a question comparison unit connected to a question forming unit , question counter, coupled with the question formation unit and the question comparison unit.

The device makes it possible to estimate with certain accuracy the level of knowledge on a controlled topic on a limited number randomly selected from a common set of questions having the same values of cross-correlation coefficients numerically characterizing the degree of interconnection between course questions 3J However, the known device has two significant drawbacks. First of these

This is due to the fact that any real control program cannot consist of a set of control questions that have the same values of correlation coefficients, since even within one course individual concepts have different degrees of interconnection. In the case of knowledge assessment, using a known device by a real program (for control questions with different values of the mutual correlation coefficients) it is impossible to ensure high accuracy of the estimate due to the fact that with a random choice of controlled questions there is a high probability of presenting close questions (questions with large values of the mutual correlation coefficients) without the need for this. As a result, there is a significant distortion of the control results towards an overestimation.

Secondly, when analyzing the quality of the answer, taking into account the complexity of the answering questions, and when choosing the next question, it does not take into account how confidently the answer was given to the question (which the teacher clearly does both when assessing the student’s answer and when choosing the next question). The aspect of confidence in response is one of the determining factors in the assessment of students' knowledge, since it characterizes to a great extent the depth and strength of knowledge. The lack of consideration of this aspect in the known device also leads to a significant reduction in the accuracy of knowledge assessment.

Both deficiencies ultimately lead to a significant reduction in the effectiveness of the learning process as a whole.

The purpose of the invention is to expand the didactic capabilities of the device with an increase in the effectiveness of training by implementing knowledge control based on questions with different values of the mutual correlation coefficients, taking into account the confidence of the answer itself, both in the knowledge assessment and in the choice of questions.

The goal is achieved by the fact that the device for controlling students' knowledge, containing consistently included response input block and response analysis block, the second input of which is connected to the first output of the question codes generator, the second output of which is connected to the first input of the evaluator, the first output of which is connected to the input of the rating recorder, and the second input and output - with the first output and the input of the question analysis block, the second output of which is connected to the first input of the question codes, the second input of which connected to a second output of the input answers, administered in series within a memory unit and comparison unit, a second input coupled to an output response analysis unit, the first

the output is with the third input of the question code generator, and the second output is with the first input of the memory block, the second input of which is connected to the third output of the question code generator, and the switch and pulse generator connected in series, the second input of which is connected to the output of the response analysis block the output is with the third input of the evaluator; the third input of the comparison unit is connected to the output of the switch.

The proposed technical solution is based on a comparison of coefficients of mutual correlation of the next question with given maximum values and minimum values of correlation coefficients determined from pedagogical practice, and the impact of confidence on the readability of the question and the choice of the next question. At the same time, the effect of the confidence of the answer on the readable complexity of the answered question is determined as follows: if the answer is correct, the full weight of the question is read, if the answer is correct, half the weight of the question, if the answer is incorrect, nothing is read. The total amount of conditional points deducted is half the question weight. The effect of the confidence of the answer to the choice of the next question is as follows: if the answer is correct, the next question should have a coefficient of mutual correlation r г r, i.e. a question from another subsection; if the answer is uncertain, the next question should be 0.5 gx "xg 7T" u, i.e. a question from the same subsection, relatively close in meaning to the previous one; if the answer is incorrect and uncertain, the next question should have a mutual correlation coefficient Gl, lx g 0.5g, 4x, i.e. question, besma close in meaning with the previous one; if the answer is incorrect, the next question should be Mr. Gchzdk, i.e. need a question from the same subsection, very close in meaning to the previous one. Such an algorithm for selecting the next question allows for the implementation of automated knowledge control, which, by its didactic characteristics, most closely matches the ideal model of the training and control system.

The drawing shows a diagram of the proposed device.

The device contains a response input block 1, a response analysis block 2, a question code generator 3, a pulse generator 4, a rating evaluator 5, a rating recorder 6, a question analysis block 7, a memory block 8, a comparison block 9, a switch 10 (response confidence signals) .

The analysis block 2 includes a serially connected comparison node 11 and an inverter 12. Shaper 3 contains a series-connected OR circuit 13, a shaping element 14, a generator 15 and an analog-to-digital converter 16, the output of which is through a memory node 17 and circuit 18 connected to the inputs of the indicator 19, the storage node 20 of the standards and the storage node 21 of the scale, as well as the trigger 22 connected to the circuits 13 AND 18. The shaper 4 contains the matching circuits 23 and 24 connected to the circuit

0 25 OR, an inverter 26 connected to the matching circuit 24 and the OR circuit 27, and the matching circuit 28. The calculator 5 contains an adder 29, which is connected via a ring circuit to a memory node 30, the output of which is also connected to the input of the matching circuit 31. The input of the adder 29 is connected to the output of the OR circuit 32, the inputs of which are connected to the outputs of the divider 33 of the code and the coincidence circuit 34. The calculator 5 also includes an adder 35 and

0 memory node 36, interconnected by a ring pattern. Unit 6 contains chains of serially connected storage nodes 37 and code comparison circuits 38, as well as a rating indicator 39. Block 7

, contains a serially connected storage unit 40, a code comparison circuit 41 and an inverter 42. Block 8 contains a storage node 43, the outputs of which are connected to the buffer register 44 and the distributor 45. Block 9 consists of matching circuits 46-49, the outputs of which are connected respectively to the inputs circuits 50-53, in which the outputs are connected to an OR circuit 54, as well as a divider 55 connected to the circuits 51 and 52.

The device for monitoring students' knowledge works as follows.

Before starting work, the student in block 1 presses the Start button, as a result of which, at the output of block 1, a signal arrives at the trigger 22 and from its output

0 to the inputs of circuits 13 and 18 (with the same signal from the trigger 22, all the device nodes are reset, but the reset connections are omitted in the drawing to simplify the circuit). At the time when trigger 22 triggers according to the signal from circuit 13, element 14 triggers trigger 22 for triggering generator 15, which generates a pulse of random amplitude lying in the range. This pulse arrives at the converter 16, and from there at node 17,

 where it is remembered and to circuit 18. Considering that when the start button in block 1 is pressed, the first of the permitting inputs of circuit 18 is sent at the moment of triggering the trigger 22 allowing signal, the signal from the node

5 17 passes through circuit 18 and enters the inputs of nodes 20 and 21, where at the address of the question code it provides the sample with the answer standard code at node 20, and at node 21 with the code for the question weight that goes to block 2 and calculator 5, respectively. Signal The output of circuit 18 also enters indicator 19, where it is displayed as a question number that needs to be answered by the student (the substantive part of the monitoring program itself, i.e. questions and response elements, is given out by the student in advance as a special, for example, printed manual).

The response standard code arrives at the second input of node 11. After examining the question in the manual and preparing an answer to a question, the student enters the response code in block 1, from which he enters the first input of node 11. At the same time as entering the answer, the student switch 10 enters information about as far as he is confident in this answer (“Sure, or“ Unsure), and also presses the button “Answer in block 1. In the case of a confident response, the signal from switch 10 goes to circuits 24, 28, 46 and 49, and in the case of an uncertain answer the signal from switch 10 is supplied to circuits 23, 47 and 48. In this The rem in block 2 analyzes the response and, in the case of a correct response, the signal from the output of node 11 goes to the circuits

23,27, 28, 46 and 47, and in case of an incorrect answer, a signal appears at the output of the inverter 12, which is fed to the circuits

24.48 and 49.

Thus, in the case of a correct and reliable response, the signals will be at two inputs of circuit 46, from the output of which the signal will go to the input of the distributor 45 and the third input of the circuit 50. Considering that from the output of node 17, the signal also went to the input of node 43 and register 44, where remembered, by the signal received at the input of the distributor 45, a signal appears at its output providing the selection in the node 43 of the cell with the code corresponding to the minimum value of the correlation coefficient. r, dt, which from the second output of node 43 enters the inputs of circuits 50 and 51. When the learning button "Answer in block 1" is pressed, a signal appears at its output, which arrives at circuit 13, as a result of which the generator 15 is started, which randomly gives the number of the next question and feeds it to the converter 16 and further through the node 17 to the circuit 18 and the node 43.

Thus, on one of the inputs of node 43 there will be a signal of the code of the number of the first question (from register 44), and on the other input there will be a signal of the code of the number of the next selected question. Based on these signals from node 43, the value of the cross-correlation coefficient of the first and next questions is called. This value from the output of node 43 is fed to one input of circuits 50-53. Taking into account that all three inputs of circuit 50 have signals, this circuit will compare the values of the mutual correlation coefficient of questions with r (". At the output of the circuit 50, the signal is received only if the value of the mutual correlation coefficient of the questions meets the requirement (5Gt.d ". The signal from the output of circuit 50 through circuit 51 enters circuit 18, resulting in the output of circuit 18 appearing the code of the number of the selected question, which is displayed on indicator 19, and also fed to nodes 20 and 21 to select standards as described but earlier. The signal from the circuit 54 also enters the input of the circuit 13. As a result, the generator 15 is locked. If the signal from the circuits 50 and 54 is not received, i.e. d, does not meet the previously mentioned requirement, the number of this question is not the generator is presented and the generator 15 continues to issue random numbers. This sorting of the question numbers is carried out before the appearance of the signal at the output of the circuit 50.

If the student responded correctly, but uncertainly, then the signals are fed to the MC at both inputs of the circuit 47 and from the first and third outputs of the signal are sent to the first and second inputs of the distributor 45. As a result, at the second and third outputs of the node 43 Gstgch (on the second) and (on the third), which go respectively to the second inputs of the circuits 50 and 51, as well as to the second inputs of the circuits 52 and 53 directly and through the divider 55, providing division into two, to the third inputs of the circuits 51 and 52. At this time, in the imaging unit 3, as already described earlier, is selected as blowing the question number, which code is supplied to unit 8 where the selected value of the cross-correlation coefficient of the previous question selected and supplied to first inputs of circuits 50-53. The signal permitting the comparison process goes from the second output of the circuit 47 to the fourth input of the circuit 51, at the output of which the signal is obtained if the requirement G is satisfied (n "l r, t 4 0.5g," From the output of circuit 51 through the circuit 54, the signal enters the imaging unit 3, where, according to this signal, as described earlier, the formation of questions stops and the number of the question is presented to the student.

If the student responds uncertainly and incorrectly, the signals are transmitted to the TC at the inputs of the circuit 48. From the first output of the circuit 48, the signal arrives at the second input of the distributor 45, causing the appearance at the third output of the node 43 of the signal that goes directly to the inputs of the circuits 52 and 53 and through divider 55, the fourth inputs of circuits 51 and 52. At this time, the value of the cross-correlation coefficient of the previous question with the selected one appears at the same time as previously described at the first inputs of circuits 50-53. The resolution signal of the comparison process is fed from the second output of circuit 48 to the fourth input of circuit 52, the output of which shows the signal when the requirement Gp, r ,, 0, is fulfilled. Former 3 is similar to the previously described one. If the answer is incorrect, the circuit 49, from the first output of which the signal arrives at the second input of the distributor 45, as a result of which the signal G appears at the third output of the node 43 (This signal goes directly to the inputs of circuits 52 and 53, and through a divider 55 to the inputs of circuits 51 and 52. At this time, to As described earlier, in shaper 3, the next question is selected and the value of the cross-correlation coefficient of the previous question and the node 43 selected from the first output goes to the first inputs of circuits 50-53. The resolution signal of the comparison process goes from the second output of circuit 49 to the third input the circuit 53, at the output of which the signal is wits in the case of the fulfillment of the requirement Hz g,: At the same time, in the process of operation, the imaging unit 4 and the calculator 5 operate as follows. The question weight signal of node 21 is fed to the inputs of adder 35, circuit 34 and divider 33. Adder 35 and node 36 implement the operation of determining the minimum upper limit necessary to obtain an estimate by summing the weights of all the questions asked. In the case of a correct and sure answer, the output of circuit 28 is a signal that arrives at the input of circuit 34, resulting in a question weight signal passing through circuits 34 and 32 and fed to the input of adder 29, which, together with node 30, provides the summation of conditional points received by students for answering questions, taking into account the correctness and confidence of the answer. In this case, the adder 29 implements both a summation and a subtraction operation, depending on the value of the signal coming from the circuit 27. In the case of a correct answer, the output of the circuit 27 will be a signal meaning addition ("1) therefore, in the case of a correct and confident answer, sums up the weight of the answered question with the previously recorded information. If the student responded correctly, but uncertainly, then the output of the circuit 27 will also be an addition signal ("1). However, the signal of the weight of the question through the circuit 34 will not pass, but will pass through the divider 33, since the second input of the divider 33 in this case receives a signal from the circuit 23 through the circuit 25. Taking into account that the divider 33 provides division by two, to the adder 29 through the circuit 32, a signal is received equal to half the weight of the question, which is summed up there. If the student responded uncertainly and incorrectly, then there will be no signal at any of the outputs of driver 4, and therefore the question weight will not reach the adder 29 through any of the possible channels. If the student responded incorrectly and confidently, then at the output of circuit 24, the signal that passed through circuit 25 goes to divider 33. As a result, half of the question weight from divider 33 will go to adder 29 via circuit 32. However, the signal from the output of circuit 24 is inverted by inverter 26 and through circuit 27 is fed to the input of adder 29 as a subtraction signal ("O), with the result that in the adder 29 the signal of half the weight of the question will not be summed up with the previously recorded values, but subtracted from them. In the process, the value of the sum of the weights in node 36 is compared in circuit 41 with the value recorded in node 40. In this case, when the signal from node 36 compares or becomes larger than the signal from node 40, in which the minimum upper bound of the estimate is set, The circuit 41 will work and through the inverter 42 will arrive at the circuit 13 a signal locking the entire generator 15. The signal from the output of the circuit 41 is fed to the input of the circuit 31, with the result that the value of the dialed number of conventional points from the node 30 through the circuit 31 enters one of the inputs of the circuits 38. On the other inputs of the circuits 38 are received the signals from node 37, in which the codes of the respective estimates are stored. Based on the comparison, the evaluation signal is generated, which is indicated by the indicator 39. After that, the entire operation cycle of the device is fully repeated. Thus, the proposed device allows realizing students' knowledge control on the basis of questions with different values of mutual correlation coefficients, taking into account the confidence of the answer itself, both when assessing knowledge and when choosing questions. The main advantage of the proposed device is the ability to implement a knowledge control algorithm that provides for a program consisting of questions with different values of the cross-correlation coefficients, as well as taking into account the confidence of the answer when choosing subsequent questions and grading. This advantage allows, on the one hand, to increase the objectivity of control by taking into account the degree of confidence of the answer when grading, which is impossible in the well-known version. On the other hand, this advantage allows to increase the depth and reliability of the control by taking into account when choosing the next question at the same time a number of parameters: the correctness of the answers, the confidence of the answer and the value of the coefficient of mutual correlation of the questions, while in the known device the choice of the question is purely randomly.

The approximate demand of the national economy in such objects can be calculated by several (about ten) devices for each educational institution of the country, since in the field of public education various automated training systems and devices are widely used.

Ultimately, increasing the objectivity, reliability and depth of knowledge control provided by the proposed device with its wide use will lead to a significant increase in the effectiveness of training, and consequently, improve the quality of training of trainees in all spheres of public education.

Claims (1)

DEVICE FOR CONTROLLING KNOWLEDGE KNOWLEDGE, containing sequentially included response input block and answer analysis block, the second input of which is connected to the first output of the question code generator, the second output of which is connected to the first input of the grading calculator, the first output of which is connected to the input of the grades recorder, and the second input and output - with the first output and input of the question analysis unit, the second output of which is connected to the first input of the question code generator, the second input of which is connected to the second output of the input unit o vets, characterized in that, in order to expand the didactic capabilities of the device, sequentially connected memory unit and a comparison unit are introduced into it, the second input of which is connected to the output of the response analysis unit, the first output with the third input of the question code generator, and the second output with the first the input of the memory unit, the second input of which is connected to the third output of the question code generator, and the switch and pulse generator are connected in series, the second input of which is connected to the output of the response analysis unit and the output is with the third input of the evaluator, the third input of the comparison unit is connected to the output of the switch. SU,. „1166164