TW528984B - Result evaluation method for computer executable test - Google Patents

Abstract

The present invention provides a result evaluation for computer executable test, which is used to analyze a series of tests completed by the computer using people as the test objects. In accordance with the method disclosed by the present invention, it comprises recording the test results (right or wrong) associated with each other in the overall testing process, the testing objects, and the sequence; conducting the combined analysis with manual intelligence; then, generating a corresponding evaluation report, and the number of right or wrong in the testing process, wherein the sequence for right or wrong are all the variables influencing the final evaluation report. The present invention is characterized in breaking the conventional evaluation method for only calculating the ratio of numbers of right to wrong, and the evaluation corresponding to the quantity in the traditional method. Thus, the evaluation report in accordance with the present invention can provide the evaluation and suggestion on the testing object for a certain learning item.

Description

528984

___ Case No. 87116776 V. Description of the invention (1) [Scope of application of the invention] The present invention relates to a method for evaluating the results of computer-executable tests, in particular, a method that can be executed by a computer to analyze human-made tests. One of a series of test results methods, which in turn provides artificial intelligence evaluation methods for the test subject's comments and suggestions on a style item. ', Yu [Background of the invention] The way of using computers to implement tests is well known, and the big ones are: the learning results of the test objects are accepted. The test is stored by a computer. Read the # in the recording medium of the #: a certain number of quiz questions and require = = = elephant (person) to answer the series of quiz questions listed in it, and then answer yes or no in this set number of quiz questions Example of incorrect answer a. After J, according to this-number of ... answer rate), make a correspondence = report. For example: among the electronic products appearing on the market, the history of electronic publications for the purpose of each subject in the primary school. In the entertainment teaching, you can easily and easily play in the country. Ϊ = After the above-mentioned electronic product t has passed one test, the correct rate of the answer, or the answer is correct :, (example price, such as "Success is in sight, continue to work hard." For the corresponding evaluation of the user's next-stage tests and future machines, not the needle :, then: the test questions that appear in the next stage are still with the

The problem clearly has one ::; discussion, point and point selective and appropriate --------_ heading. In addition to the user because of the face ΙΙΙΗΙ 528984 — amendments, 5. Description of the invention (2) y η 匕, dagger_ answer the 94 questions on the heart or pass the level, whether he knows it. What are the weaknesses or strengths of passing 30% of the questions or passing the traditional test? And when the test object is cut off: point electricity; can not be based on the test results of the first-stage: Of course, it is not possible to teach in the next stage of study guide, level of entertainment. Really improve the learning of test subjects [Overview of the invention] The present invention is a recording I #, evaluation method, its purpose ::: computer-implemented test results test results assessment project test results; test objects in A certain-academic report and guidelines, through the evaluation report =: After the process, the evaluation report is obtained: the solution "about the test target: learning suggestions' and then can really be regarded as a kind of learning points), = = * factory (the so-called test target also According to the best learning effect of the present invention, according to the test object response method, the test is performed on a computer, and the computer executes the test result. Includes:. Table, here-quiz track record :: test data becomes-quiz track associated test target associated test = includes: test target information δ recorded sequence data; 纟. Fruit data, and each- Each test: Guoyu β. According to the test tracking data and sequence data, the test results of each test target in the table are displayed, and the steps are included in the corresponding evaluation report. VResult ----- the following steps . · Page 5 Month Five. Invention Cross-Eli evaluation report comparison table, which contains:-'' test result data in the table associated with the test, and test results, sequence data ,,

", Learning status data, '; and the appropriate evaluation term data related to" learning status data ";" Because Ten J "records" learning status data "in the evaluation report comparison table, compared with tracking, Find * ΐ '' second test result data, and the test data "sequence data," comparative material "learning status data that complement each other", the corresponding evaluation terms, and report. b3. Then display the "corresponding evaluation term data" and become a better way to become an evaluation report type, which is to match the wisdom of the intelligent test question bank: that is, the evaluation method disclosed in the present invention, The most: 2. In addition to the amount of test questions and test objectives, the learning status of the two factors (that is, the pair of answers): and this kind of factor can be regarded as three different directions c The two orientation dimensions constitute the test track record 2 in the present invention, and the piece 'changes according to the combination of these three vector dimensions, and then connects;:, * to the required evaluation report. The detailed technical content and better implementation of the present invention are described below. For example, please refer to the figure. [Detailed description of the embodiment] Please read the "Figure 1", which is used to implement the present invention, which includes the block diagram of the carcass, and the electricity reserve 1 D 'is used to implement human-made

A series of test objects moved case number 8711677 ^ Case number 8711677 ^ Amended the fifth description of invention (4)-(such as the test of language questions), the test results produce a corresponding floor assessment report f the entire test process, and according to a computer available Reading / Writing Recording Media ^ Discs, tapes, optical discs, or 2 0 (for example, a hard disk drive, a soft computer-readable / writeable recording medium, "as shown in" Figure 2 ", in the brain 1 0 The wisdom required for the test is stored: the mechanical code instructions used to provide electricity 10 to perform the test; two:, question bank 21, ordering the computer serial test results data just 2/24, record the test One of them is shown), and the corresponding test platinum i, trace § has been recorded in Table 2 2 (such as "Table 2 vs. Comparative Table 2 3 (such as" Table: Record the evaluation of the recorded content of Table 2 2 ": Test Tracking Record Table 22 ; ^)), And the computer 10 is the root of the :::, ... to find the right ::: = check the record, in the evaluation 4; to become an evaluation report; check the recorded information of the recorded person, and then turn An input unit 3 (for example, or a touch display) :: ： keyboard 1 mouse, light pen, digital: The test object selection is provided during the process: connect on 0 to execute the number of 4 times, < is the 4th answer; and the purpose of the card, for example: set the test unit-output unit 4 〇 (for example, computer 1 0 connection, use. Issuance of benefits, or printing devices, etc.), content. Rotating test questions or evaluation reports according to the present invention disclosed in accordance with the present invention-two types of smart test question library two, its preferred embodiment Matching: a three-dimensional vector-type test evaluation: = dynamic question mode f 'in order to provide the intelligent intelligent dynamic question mode, 2' and the so-called intelligent rigid test mode; the principle can be achieved through the brain? People 1 · ~ -— I will test the test questions according to different 528984 _case number 87116776_ year month day __ 5. Description of the invention (5)

The standard of the test (for example, in the English quiz with the test phrase as the purpose) is classified, and the answer options of each quiz include the wrong answer in addition to the correct answer, and the association with any wrong answer Test questions, and each test question in the test process is determined based on the number of test targets specified by the system or selected by the test object. The computer will randomly select test questions that belong to any kind of test target to test the test object. , And according to the answer selected by the test object, the associated test questions are generated until the test object completes each test target test question, that is to say the entire intelligent dynamic test mode is to verify the test object in a certain test The learning status of the subject is for the purpose of examining the learning results of the test subject through a series of test questions divided into different test subjects. The detailed implementation steps of the evaluation method of the present invention can be seen from "Figure 3", which includes: a. Computer 10 starts the test; b. Sets the test target; [the so-called test target refers to the same The type of quiz test type; for example: take the English test as an example, the so-called test target can be specified by the system or the test object from the phrase

The agreement between the subject and the predicate π, the replacement of the phrase π • •, etc. is determined by any one or a combination of more than one] c. Random selection of test questions to answer the test subjects; Read / write any of the test questions obtained in the recording medium 20] d. Determine the correctness of the answer. If the answer is correct, go to the next step. If the answer is wrong, skip to step 1. e. Log in to the test tracking record. Table; [in addition to the mark representing the correct identification information, you must also record the sequence of this answer in the test subject to which it belongs

Page 8 528984 _Case No. 87116776_ Year and month amendment_ V. Description of the invention (6), as shown in "Table 2" f. To determine whether a certain test target is over, if yes, go to the next step, If not, skip to step k; g · Stop (abandon) the test of this test subject; h. Determine whether the test of the smart quiz question bank is over, if yes, proceed to the next step, otherwise skip to step C; Whether the so-called smart quizzes test is over refers to whether all the quizzes have been completed. ] I. Generate a corresponding evaluation report according to the content of the test tracking record form; [This step also includes the same steps bl ~ b 3 as before to generate an evaluation report] j. End the test; k. Continue the test of this quiz target, and then skip to step c; and l. According to the wrong answer selected by the test subject, generate a test question associated with this wrong answer, and then skip to step e. Regarding the judgment of step f, it is assumed that a maximum of six quizzes can be used to determine whether each test target will be tested or not (that is, six test questions to determine whether the test target is familiar with this test target), of course this time The number is not necessarily constant, but it can be set according to actual needs, and to determine whether the test of any test target should be ended, in principle, to determine the existing answer records of a test target, whether the test object can be determined here The learning status of a test subject (whether, whether or not, or vague), these details will be explained below; in contrast, the traditional test method is an absolute dichotomy (either right or wrong, right or wrong), regardless of the process. In fact, there is a difference between the groups that are judged as "yes", but

528984 87 H77H correction

V. Description of the invention (7) The traditional test method that only asks for the result without asking the process. The individual difference analysis of the object provides the built-in test = ten pairs of tests. In the implementation example, it is assumed that we have two consecutive tests for each test target. *, J = three test results to determine whether they will be included in the final C er two ping er report, the test results that have been mistakenly corrected up to six times are two: b test results are called Oscillation type) I: In the assessment report. π,, 6 of the green

Then, the combination of the right answer and the wrong answer in the opportunity of Shishan A test is represented by a series of quiz process representing "Meeting": D ^ ς-person χ table error):! · QV table pair, although VVV ^^ χΓ ^, νχννν, VXXm, XVXVVV, vvxvvv ... Although the combination of right and wrong answers all represents "the essence of preparation is different, Ai Gantian-Ganri" Ren /, Summer π μ, check the performance of a certain Wu on a test target. It is not difficult to determine that, although the final result of both of them is two years later, there is actually a degree of difference between them and the future, "but the potential differences in the degree of familiarity between the subjects. , Π represents the quiz. Therefore, according to the present invention, the tests recorded during the quiz track the principal η η of the printing bowl, and the different sciences i: Logic:;! 2 of ... we can get the test to give different ^ 1% sadness, and for different understanding states, we do the following: b / analysis / and learning suggestions to avoid the use of results as a guideline, and / ¥, so you can lose. , Male's paranoia, and blind lack of headache and medical feet 528984 __Case No. 87116776_ Year Month _ Amendment _ V. Description of the invention (8) Table is correct, X is incorrect):

XXX, VXXX, VVXXX, XVXXX, XXVXXX, VXVXXX, XVVXXX In addition, there are several combinations of right and wrong answers that are impossible to take (take three consecutive errors to determine the end of a test target as an example), that is: XXX ?? The combination of? = 8 types of VXXX ?? The combination of = 4 types of VVXXX? The combination of = 2 types of XVXXX? The combination of = 2 types of reasoning is the same for three consecutive pairs to determine the end of a test target, so In this way, there will be 2 X (8 + 4 + 2 + 2) = 3 in total. 2 cases are impossible. Taking the maximum of six quizzes in this embodiment as an example, the number of permutations and combinations can be calculated. It can be seen that its "person,-" 4 3 2 = 1 8 kinds of answer combinations should be oscillating type, but also That is to say, if it is in the process of answering the j record in the test tracking record form, if it belongs to the oscillating type, it means that the learning concept of the test object = house = column target should be in a fuzzy state. There are seven kinds of reports in a report form of the Canadian state [a summary of the study in Table 2 at the meeting ". According to the evaluation of the habit in 2 2 3, except for the possibility of three consecutive pairs and the determination as “oscillating, there will be a total of 1 5 for 15 learning states. Table 2 3 provides the corresponding (Table 1) shows: among them the test result data and test status data]; and related terminology data]. In this way, the answer will not include the results, including the results, which are recorded in the score of seven degrees. Don't let this happen • In addition to the sequence record, there are three different ways to build ancient

528984 Fifth, the description of the invention (9) _ Tracking constituted by parameters other than the target and test questions = 2 degrees and 1 practice state. These three aspects are due to the essence of the present invention in c. In addition: In the case of the question mode embodiment, the intelligence of the question bank will be moved away, which will lead to the direction of the test; it will include more than one type of test; the need for this, by tracking, p ,, / It is more general and closer to the test object Γ to greatly improve the old process. The evaluation given is fully felt that it is helpful to learn = board and limitations, but also makes test 7 and r main-, _ analysis and recommendations are only for small objects. Can (Table 1), ,,, and greasy and thoughtful. According to (Table 2) the example of the newly checked vertical record table shown by the householder; and the content of the records in Table 1Γ f 2 2 will be compared from the Ping estimate report to generate a corresponding evaluation such as " As the hypothetical value), the evaluation report form shown in Figure 2 is as follows: We set Ϊ ::: 二:-The preferred embodiment is detailed with six questions to determine the maximum η, and each test target has a maximum of two. : 'View this quiz as $ 2 w㈣ There are three dynamic pairs of intelligent test questions in the test bank. Then, in the quiz; the number of changes in the record content of the quiz track record table will be based on the generated test (for example, Table 3) That is, the number of questions appears in a fixed number of questions (where V is correct, that is, 9 to 18 Siam questions show the order of the questions). χ indicates an error, V is related to the serial number before X. The result is: see = arbitrary, but it is completely the same as the previous complex. It is obtained by using 13 questions; '' is the target limit. As shown in (Table 3); continued on page 12 528984 Month of the Emperor 8711R77G 5. The description of the invention (10) is very vague, and there will be 18 quiz questions. "^ 2 These three quizzes have at least 9 quiz questions, but never: f 'will only be a question. 8 continued or less than 9 and the content of the evaluation report can refer to" Figure 4, of course, The evaluation method disclosed in the present invention is described in the following. Test results (that is, according to the test object: the answer can still achieve the same effect, including the following steps. The computer performs the following steps 1. Record the relevant test of the test process " record form, track the record in this test In the table, the data related to the test results of the “just-tested” test target include: 顺 the data of the test target ° and the J data; and each of the = fruit and fruit data and the sequence of information — ~ test green [invention Efficacy f + _ No-Correspondence of the test result 1 · Reflect the actual test in the test process, the overall test V result '; According to the present invention, the spleen: J situation, but the process is different in terms of data Although the same ^: ^ has different assessment reports, the order of right and wrong is not '7 standard and provide study guides. 茗 Help test subjects improve learning β 2. Provide study guides; Evaluate the relationship between the number of tests and the newly tested target. The number of questions must be based on the results of the test object = fruit. An important reference is to determine the result of ΙΙ_ ¥ ΐ »__ ι ^ ίΐί ^ Γ --- m kmUTi (ΦΤίΐ ^ κΗτ > ΠKtI m .... ------ 2Track records based on test results page 13 528984

Page 14

528984 _Case No. 87116776_ Year, Month, and Day Revised Schematic Brief Description No. 1 is a hardware block diagram for implementing the present invention. No. 2 is a data structure diagram of a computer-readable / writeable recording medium. No. 3 The figure is a flowchart of the steps of the evaluation method of the present invention. Figure 4 is an example of the evaluation report of the present invention. 0 [Illustration of Symbols] 1 0 Computer 2 0 • Computer-readable / writeable recording medium 2 1 Intelligent test bank 2 2 Test tracking record form 2 3 Evaluation report comparison Table 2 4 Mechanical code instructions 3 0 input unit 4 0 m output unit

Page 15

Claims (1)

528984 _Case No. 87116776_ YYYY__ VI. Application for Patent Scope 1. A computer-executable test result evaluation method is to use a computer to execute a test and answer the test results based on the test subjects (ie In order to get the answer right or wrong), the computer performs the following steps, including: a. Recording the relevant test data of the test process into a test track record table, the test track record table includes: a test target Data, a test result data associated with the test target, and sequence data for each test result; and b. According to the test result data and the sequence data for each test target in the test tracking record table, display A corresponding evaluation report. 2. The method for evaluating the results of a computer-executable test as described in item 1 of the scope of patent application, wherein the information of the test target refers to the test category of the test question belonging to the same type. 3. The method for evaluating the results of a computer-executable test as described in item 1 of the scope of patent application, wherein step b further includes: b 1. Establish an evaluation report comparison table, which includes: a tracking record table with the test Π learning status data π associated with the "test result data" and "sequence data" of the test result; and evaluation term data π corresponding to π of the "learning status data π"; b2. Compare the π learning status data in the evaluation report comparison table with the π test result in the tracking record table and the "sequence data" of the test result to find the π learning status that matches each other Data π for which π corresponds to the evaluation term data π; and Page 16 528984 Case No. 87116776 Amendment VI. Patent Application Scope b3. Displaying the "corresponding evaluation term information" becomes an evaluation report. 4. A computer-executable test result evaluation method is based on a The smart dynamic test mode of the smart test question bank is completed by the computer executing the test by the following steps, including: a. Starting the test of the smart test question bank; b. Setting a test target data to specify the wisdom Test questions belonging to the same test target in the type test library; c. Randomly select the test questions in the smart quiz question bank for the test subject to answer; d. Determine the correctness of the answer, if the answer is correct, go to the next step, if the answer is wrong, skip to step 1; e. Login to the Answer the test results and sequence to a test tracking record form, f. Determine whether a test target is over, if yes, proceed to the next step, if not, skip to step k; g · stop (abandon) the test target. test; h. Determine whether the test of the smart quiz question bank is over, if yes, proceed to the next step, if not, skip to step c; i. generate a corresponding evaluation report according to the content of the test tracking record; j. end the The test of the smart quiz question bank; k · Continue the test of the test target, and then skip to step c; and 1. According to the wrong answer selected by the test object, generate and Page 17 528984 Case No. 87116776 Month Amendment VI. Patent Application Scope The test question associated with the wrong answer, then skip to step e. 5. The method for evaluating the results of a computer-executable test as described in item 4 of the scope of patent application, wherein the information of the test target refers to the test category of the test question belonging to the same type. 6. The method for evaluating the results of a computer-executable test as described in item 5 of the scope of patent application, wherein the test subject information includes a test subject. 7. Results of computer-executable tests as described in item 5 of the scope of patent application Evaluation method, wherein the information of the test target includes more than one type of the test target. 8. The method for evaluating the results of a computer-executable test as described in item 4 of the scope of patent application, wherein the test result described in step e includes: discriminating information representing whether the answer is correct or not, and representing the discrimination The order of the data in the test subject to which it belongs. 9. Results of computer-executable tests as described in item 4 of the patent application The evaluation method, in which whether the test target referred to in step f is over, refers to whether the test result that already belongs to the test target can determine the learning status (yes, no, or vague) of the test target. 10. The method for evaluating the results of a computer-executable test as described in item 4 of the scope of the patent application, wherein whether the test of the smart test question bank at step h is complete refers to whether all the test targets have been completed. 1 1. Results of computer-executable tests as described in item 1 of the patent application Page 18 528984 _Case No. 87116776_ Amendment _ Sixth, the method of evaluating the scope of the patent application, the step i also includes: i 1. Establish an evaluation report comparison table, which contains: The "learning result data π" and the "sequence data" of the test result in the record table are related to the "learning status information π"; and the "corresponding evaluation term data" associated with the "learning status data" '; I 2. Compare the π learning status data π in the evaluation report comparison table with the π test result data π and the "sequence data" of the test results in the tracking record table to find a match between them The "corresponding evaluation term data" of the "learning status information"; and i 3. Display the evaluation term data π corresponding to the '' into an evaluation report 0 Page 19