KR101761562B1 - Method and apparatus for online test - Google Patents

Abstract

A method for providing an on-line test service according to an embodiment of the present invention includes: a step A in which a service server receives a test question data file of a predetermined format from an issuer device and builds a test question database; A step B of establishing an arbitrary online test according to a test method set by the issuer device; A step C of confirming an admission right of the candidate when an arbitrary candidate device requests to take the online test; And a step D for streaming a test document for the on-line test to the candidate device and receiving an examination result.

Description

[0001] METHOD AND APPARATUS FOR ONLINE TEST [0002]

The present invention relates to an online test method and apparatus. More specifically, the present invention relates to a method and an apparatus in which an examiner registers a test question at an online test service server and a candidate can take an online test.

With the recent rapid increase in the online infrastructure, the conventional offline-based test is expanding into the test using online media. The test used as a tool for evaluation and learning in the educational field is expanding from traditional paper method to online method using computer and internet.

The online test has various advantages compared to the paper media test because it is possible to reuse the test items by constituting the question bank, easy to use digital contents such as video, short test time, and easy analysis of test results.

However, there are some problems to be solved in order to efficiently utilize the question bank in the online test management. For example, it takes too much time to register a question at the question bank, or the applicant interface is configured inconveniently when examining a registered problem, or there is a problem of authentication of the exam right of the examination.

Korean Patent No. 10-1455907 (Apr. 31, 2014)

SUMMARY OF THE INVENTION The present invention aims at solving the above-mentioned problems, and aims at enhancing user convenience by constructing an online test system in a file format according to de facto standards such as Excel and PDF which have high user accessibility.

It is another object of the present invention to provide a method for authenticating a user of an online test service and measuring a usage amount thereof.

A method for providing an on-line test service according to an embodiment of the present invention includes: a step A in which a service server receives a test question data file of a predetermined format from an issuer device and builds a test question database; A step B of establishing an arbitrary online test according to a test method set by the issuer device; A step C of confirming an admission right of the candidate when an arbitrary candidate device requests to take the online test; And a step D for streaming a test document for the on-line test to the candidate device and receiving an examination result.

According to the present invention, it is possible to quickly register a large number of test questions using the Excel file format, thereby shortening the time for registering the test questions, and providing test questions, commentaries, and noon answers of the PDF file format to the candidates. The user convenience of the test system is increased.

Further, according to the present invention, the authority authentication for the examination can be carried out according to the setting of the applicant, and the charging for the examination service can be carried out by predetermined units, thereby expanding the area of the online examination service.

1 is a flowchart illustrating a process of providing an online test service according to an embodiment of the present invention;
2 is a view for explaining a problem configuration according to an embodiment of the present invention;
3 is a flow chart for explaining a problem registration procedure according to an embodiment of the present invention
4 is a flowchart for explaining a PDF test document generation procedure according to an embodiment of the present invention
FIG. 5 is an example of a test paper PDF, an item description PDF, and a noon PDF according to an embodiment of the present invention

It is to be understood that the present invention is not limited to the description of the embodiments described below, and that various modifications may be made without departing from the technical scope of the present invention. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

In the drawings, the same components are denoted by the same reference numerals. And in the accompanying drawings, some of the elements may be exaggerated, omitted or schematically illustrated. It is intended to clearly illustrate the gist of the present invention by omitting unnecessary explanations not related to the gist of the present invention.

1 is a flowchart illustrating a process of providing an online test service according to an embodiment of the present invention.

As shown in FIG. 1, a test service system according to an embodiment of the present invention may be configured to include a participant device 10, a service server 20, and a candidate device 30.

The applicant can subscribe to the online test service according to the embodiment of the present invention and register the problem data for the test application to the service server. (Steps 110 and 115)

Problem registration according to an embodiment of the present invention is characterized in that it can be uploaded using an Excel sheet according to a preset format. A more detailed description of the problem configuration and problem registration method will be described below with reference to FIGS. 2 and 3 attached hereto.

In step 120, the candidate can subscribe to the service server of the present invention, but this is an optional procedure. In other words, according to the embodiment of the present invention, membership of the candidate is optional, unlike the candidate.

At step 125, the examiner may set the details of the test method.

For example, the examiner can set the details of the exam such as the examination time of the specific exam, the start and end time, the prevention of the backlash, and the possibility of re-compliance. Particularly, the candidate can use the pre-registered problem pool to specify the problems included in the test process, test set, and test set. Furthermore, the examiner may set up a group of candidates who can take the exam, the test set, and the individual exam.

More specifically, the applicant can create a test procedure or generate a set of tests included in the test procedure. For example, in the examination process, the "Business English Professionals Course" is opened and the "Business English Professionals Course" is divided into "Business English Level Basic Assessment", "Business Writing Test", " And a plurality of test sets of a plurality of test sets.

Further, the test set may be composed of a plurality of tests. In the previous example, the "Business English Level Baseline Assessment" test set can consist of tests from Evaluation 1, Evaluation 2, and Evaluation 3.

In step 130, the service server can generate a test paper according to the setting.

A test sheet according to an embodiment of the present invention can be provided in a PDF format, and a more specific method of generating a test sheet PDF will be described later with reference to FIGS. 4 and 5 attached hereto.

On the other hand, in step 145, the examiner can purchase the test packet. The test packet is a unit for purchasing an online service according to the present invention, and may be set as a unit capable of providing one question to one candidate, for example.

When the investor purchases 500 packets, the investor will be able to use the service of the present invention to make a test including 50 questions for 10 persons. At this time, if the applicant wishes to host a test for two retakes, the candidate must purchase an additional 500 packets.

When the service server initiates a specific test and a specific candidate requests a test of the test, the server can confirm the candidate's entitlement to the corresponding test. (Steps 135 and 140)

The test procedure according to the embodiment of the present invention can be roughly classified into four types, and thus the same test taker's right to take a test can be changed.

First, the general process is the process by which everyone can take the test. Upon receipt of an enrollment request for the general course (step 135), the service server may provide the enrollee with the exam questions (step 140) without confirmation of the enrollment authority.

The test set belonging to the general course can be repeatedly applied. For example, it can be used for daily quizzes of broadcasters, open tests for recruiting students, and test applications for disseminating public information. When taking a test set belonging to the general course, it is preferable not to leave personal information such as an e-mail of a candidate and a mobile phone number.

Second, the qualification process is a process in which only candidates who are registered in the candidate group administered by the applicant can take the examination. For example, if a 1,000-person company registers all of its employees in a group of candidates who can take the exam (step 125), all the test sets in the qualification process are authorized to take part in that company's staff.

Unlike the general process, the restriction process is operated in a closed manner, and authentication for confirming the examination authority can be performed according to the prior art such as authentication e-mail confirmation. This limitation process can be used when the applicant sets the test method to a limited number of specific members in the applicant's institution. For example, it can be used for mock examinations, dissertation tests, enterprise technical tests, or online certification tests.

Third, the appointment process is a form in which only the person specified in advance is entitled to take the exam. The above-described delimitation process grants the right to take an examination to a person included in a group specified in advance, and the assigning process can grant the right to take the examination to a specified person.

For example, if the applicant enrolls 1,000 applicants in the candidate group and intends to conduct a competency diagnostic test for promotion to only 10 applicants who are exaggerated, the company will open a competency diagnostic test in the designated process, Only names can be designated as candidates. Designation courses can be used for exams, mock exams, and online qualification exams as well as for qualification courses.

Finally, the membership process is a test process that is provided to members of the test service provider. Unlike the general procedure, it can be used when minimum authentication is required. The authentication means can authenticate according to the prior art such as confirmation of e-mail receipt or input of a short message to a mobile phone. This can be used for quizzes, mock exams, expository exams, etc., and it can be used for writing paid test application because it can charge by members.

Returning to the description of FIG. 1, in step 150, the service server may provide a trial service to the candidate having the right to take the exam.

Thereafter, when the candidate takes the test (step 160), the result is provided to the service server in real time (step 165) and the candidate can monitor the test situation. (Step 155)

The service server 20 can collect the data of all the candidates at step 170 and report the statistics (step 175), and can provide the statistical and analysis data to the candidate by combining the feedback of the examiner. (Steps 175, 180, 185, 190)

According to a further embodiment of the present invention, the test result of the candidate can be analyzed according to each candidate and provided in the form of a wrong answer note, and the service server analyzes the vulnerability of the candidate using the data included in the wrong answer note, A highly customized problem can be recommended.

For example, if a user has a high probability of having a problem with a "verb", the service server can feed back to the user to learn a test question corresponding to the "verb" in the "grammar" test set in the "English" have.

More specifically, the service server can provide a test problem in which the learning effect of the user is maximized by using the user analysis data and the indexing information of the problem database.

According to conventional research on learning effectiveness, learning the problem that can yield a correct answer rate of 70 percent to 80 percent is the most effective for the trainee. If the degree of difficulty of the problem is too high or low, it can reduce the motivation to learn.

Therefore, the service server according to the embodiment of the present invention can use the analyzed information such as the candidate's vulnerable problem type, vulnerable unit, and the learning level of the group so that the user can score a score of 70 to 80 percent Can be provided.

Furthermore, the service server can provide the candidate's learning status.

For example, the service server may provide the candidate device with information on the user's learning status in the form of a statistical graph on the test results, or may provide a result of analyzing the cognitive tendency.

More specifically, the service server can analyze the user's cognitive tendency by using the data of the test result of the user and the information on the problem type, topic, or difficulty indexed in the problem.

For example, a service server may be able to determine if a candidate is "memorizing" the type of problem they are most likely to be "vulnerable" to the memorization problem, or if the topic is mostly "tense" Can be analyzed as vulnerable.

At this time, the analysis of vulnerable problem types, vulnerable members, etc. may be calculated as a relative value by comparing with other candidates classified into the same group, and the analysis result is provided to the user as visual data, .

FIG. 2 is a diagram for explaining a problem configuration according to an embodiment of the present invention. FIG.

As shown in FIG. 2, a test question according to an embodiment of the present invention may include a group item 210 and an individual item 250.

The group item 210 may include one directive 215 for a plurality of questions (questions 1 and 2 shown in FIG. 2), a group sentence or illustration 220, and the like. Further, each of the questions constituting the group item may include a problem directive 225, 235, an option 230, 245, and / or an example question 240.

Individual item 250 includes problem statements 255 and 280 as in Problems 3 and 4 shown in FIG. 2 and includes example sentences, illustrations or audio contents 260 and / or directives 270 for the problem, As a component.

According to the embodiment of the present invention, a group item or an individual item as shown in FIG. 2 is created using a local device without accessing the system, and a test system according to an embodiment of the present invention is accessed and uploaded at once .

It has been required to input a directive, an option, an example sentence, and the like in order to constitute a problem in a format required by the system by accessing the question bank system. For example, a participant who is connected to a conventional test system inputs examination test data in the form of an XML form or a text file, registers it on a server via FTP, or registers the question with a server using a problem editing tool.

In this process, the amount of time spent on accessing the question bank system, entering the problem of the item unit, and uploading the entered problem was significant. In particular, the conventional method of inputting each item has a problem editing tool, which can directly edit the problem, but there is a problem that a separate operation is required for conversion of the test paper form and registration of problem addition. The inconvenience of creating such a question bank database posed a substantial obstacle to the expansion of the online test service market.

In order to solve the above problems, the present invention provides a method for inputting a plurality of problems using a program generally used by a user and registering them at once, without separately connecting to a test system.

Test questions can generally include textual directives, example sentences or illustrations related to directives, options, commentaries, and so on. Furthermore, the test questions may include metadata about the problem category information, difficulty, source, annotation, and so on. On-line tests may include components of multimedia format other than text format such as voice and video .

According to the embodiment of the present invention, the test questions can be classified into group questions and individual questions. A group item is a form in which a plurality of problems are matched to one directive and / or example sentence, and each item means a problem in which one problem is matched to one directive.

Particularly, according to the embodiment of the present invention, it is possible to create a problem and upload a plurality of problems at once by using a general-purpose document creator which the applicant has already used. To this end, the question bank system according to the embodiment of the present invention can provide a problem input format to the applicant as a general purpose document creator file.

For example, the question bank system can provide the problem input format as an Excel file so that the problem can be uploaded using an Excel program. The problem input format according to an embodiment of the present invention can be configured to include problem sheets, group sheets, and illustrative sheets. If the group item does not exist at this time, the group sheet can be deleted, and if there is no description, the illustration sheet can be deleted.

Tables 1 and 2 below illustrate examples of problem input data formats according to an embodiment of the present invention. The problem input data format according to the embodiment of the present invention can not be interpreted as being limited to the items described in Table 1-2, and items may be added or deleted according to the convenience of the user.

Line number Item number Group code Classification code Category Item Contents Item form difficulty Selection index Multiple Minimum Multiple Most Option 1 Option 2 Option 3 Option 4 Choice 5 Option 6 Option 7 Include illustrations With example Include voice Include video Format of illustrations Voice format Video format Voice link Video link answer Correct answer Question Remarks Item creation date Example text Example text Example text

Table 1 shows the items required in the problem input data format.

In the row number column of Table 1, the issuer can record the row number for data management of the corresponding Excel file, and the test question data can be managed by the row number unit.

Further, in the item number item of Table 1, the applicant can write the problem number of an arbitrary test, and a code set in advance by combining texts and numbers such as S0001, S0002, M0001, M00002, Can be written in one Excel sheet.

In the group code item in Table 1, the candidate can distinguish whether the item is a group problem or not, and in the case of a group problem, the question group to which the item belongs can be distinguished. For example, group code 0 means that the problem is not a group problem but an individual problem. Group codes 1, 2, and 3 mean that the problem is a group problem and that the problem is group 1, group 2, It can be used as a code meaning a problem to belong to.

In the classification code item and classification name in Table 1, the applicant may list information identifying the subject to which the item belongs. For example, if row number 1 data is recorded as 1 in the classification code item, earth science in the classification name item, 2 in the classification code item in the row number 2 data, and space planet in the classification name column, row number 1 is a problem of earth science , The line number 2 item will be classified as a problem with the space planet subject.

In the item contents section of Table 1, the applicant can record the directive of the item.

Furthermore, it is possible to classify whether the item is a multiple choice question, whether it is a short answer question, a short answer question, or a narrative question, and classify the difficulty of the problem by using a preset code.

In the selection index item of Table 1, the applicant records the number of options of the problem, and the plurality of minimum, plural, and most items are the minimum and maximum number of choices that the candidate can select in the case of the problem in which the problem can select a plurality of options Can be set.

In addition, the applicant can fill in the optional items included in the question, and whether or not the question includes the illustration, the example, the voice, and the video includes the question, the example, the voice, and the video You can choose. In addition, if a problem is constituted including illustrations, voices, and videos, the file format of the illustrations, voices, and movies included in the description format, voice format, and video format items are recorded, Link information that can be linked can be described.

Furthermore, in the correct answer item, the candidate can write the correct answer to the question. In the correct answer description item, the candidate can record the commentary content to be included in the commentary of the question.

Table 2 shows the items related to the group problem among the items required in the problem input data format.

Group code Group name Group directive Group Example Group illustrations

The group code item in Table 2 is connected to the group code item in Table 1, and functions to group a plurality of items having the same group code into one group directive to form a problem.

In the group directive item of Table 2, the issuer may list one group directive covering a plurality of problems, and the group illustrative sentence item or the group expressive item may include a common sentence common to the corresponding group item, can do.

Meanwhile, the test question data format according to the embodiment of the present invention may include a separate excel sheet in which illustrations and the like can be uploaded without link information.

The illustrative sheet can be an example included in a group problem or an individual problem, and the illustrations included in the excel sheet can be converted into a predetermined format in the process of uploading and registering in the system.

Meanwhile, the illustrative sheet extracts the position or order of all images existing on the illustrative sheet to be associated with the item information of Table 1 or Table 2, and stores the data as a data value. In the example description, the "Q + G + group number "and the like, and associate the corresponding description with the item information.

3 is a flowchart illustrating a problem registration procedure according to an embodiment of the present invention.

Upon receipt of the data file for problem registration, the service server according to the embodiment of the present invention can register the test problem in the question bank database through each step in FIG.

In step 310, the service server may first determine whether the problem file requested to be registered complies with the predetermined format. For example, if a grade is assigned to each item in the problem data format and a weight is assigned to each grade, if the error probability exceeds a preset range, the file may be requested while the error content is reported to the issuer without going through the following steps .

The service server may first check the problem group information in step 330 and register it as a group problem if it is a group problem (steps 340 and 350)

If it is not a group problem, it can be configured as a separate issue and subdivisions can be registered. (Step 370) On the other hand, in the case of a group problem, individual items included in one group can be connected and sub-items of individual questions belonging to the group can be registered while sub-items of the group are registered. (Steps 360 and 370)

For example, in the case of a descriptive item, both the individual problem description and the group problem description can be changed and stored in a predetermined format. For example, it is appropriate that the above example is stored by changing the format at a 16: 9 ratio for screen layout and screen layout at the time of PDF change, or adjusted so that the horizontal X-height ratio does not exceed a maximum of 890 X 500.

4 is a flowchart for explaining a PDF test document generation procedure according to an embodiment of the present invention.

A PDF test document according to an embodiment of the present invention includes a PDF test sheet including illustrations, examples, options, and answer fields, and a PDF commentary sheet and a PDF commentary sheet with comments on a PDF test sheet, (O), a wrong sign (X), and a decision hold / partial mark (?).

5A is a test paper PDF, FIG. 5B is an item explanation PDF, and FIG. 5C is an example of a noon application PDF.

More specifically, FIG. 5A is an example of a test paper PDF document comprising a group directive, a group sentence, a group description, an item directive, and an option 520 item. Further, FIG. 5B is an example of a PDF explanatory document constituted not only of individual problems but also of correct answer (560) and commentary (570) items matched to the problem. Finally, FIG. 5C illustrates a correct answer of the candidate's answer (597) on the PDF commentary sheet, and shows a correct code (590) and a PDF noon reply including a wrong code.

In step 410, the service server generates a PDF test document in real time according to a subsequent procedure when a PDF test document request is received (that is, when a download of the PDF document is requested). That is, according to the embodiment of the present invention, it is appropriate that the PDF test document is not generated in advance but is generated in real time when a download request is received in order to fundamentally block the outflow possibility, and is set to be deleted after a predetermined time elapses.

More specifically, in step 420, the service server may generate a QR code for the test in addition to the test questions registered in advance. The QR code may include a "QR code for taking a test" and a "download QR code " for downloading a PDF document again.

For example, in the example of FIG. 5A, 520 is a QR code for taking a test, and 510 is a download QR code.

According to the embodiment of the present invention, in order to improve the service providing speed, when there are many PDF document download requests, the QR code file is generated only once at the first time, and the generated QR code file is a PDF And can be implemented to generate a PDF test document in a manner that combines with the test papers.

In step 430, the PDF test document may generate a PDF parameter associated with the submitter and / or the candidate other than the pre-registered test questions, commentary, and QR code.

For example, the service server can generate the name of the organization, the logo of the applicant, and the copyright sign of the applicant as the parameters of the applicant, and generate the test start time and the test end time of the candidate using the candidate parameters. Furthermore, the PDF noon response can be registered as a parameter with the feedback of the applicant as to the contents of the candidate's answer and the general feedback which gives the review opinion on the whole examination.

For example, in the example of FIG. 5A, reference numeral 530 denotes a petitioner's logo, and reference numeral 540 denotes a parameter corresponding to the name of the organization name.

In step 440, the service server may generate a PDF test document stream including the problem, QR code, submitter and candidate parameters, and so on.

For example, in the example of FIG. 5A, the PDF test paper is configured to include a problem 520, a participant logo parameter 530, a title organization name parameter 540, a download QR code 510, and a test challenge QR code 550.

Since the PDF test document must be generated in real time, it is created in the cache memory of the service server (step 440) and converted into a temporary file (step 450) and may be transmitted or streamed to the candidate device. (Step 460) At this time, the PDF test document may be set to be deleted to the candidate device when a predetermined time elapses for blocking the leakage possibility. (Step 460)

The embodiments of the present invention disclosed in the present specification and drawings are intended to be illustrative only and not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

Claims (4)

In a method for providing an online test service,
A step of the service server receiving a test question data file of a preset format from the issuer device and building a test question database;
A step B in which the service server establishes an arbitrary online test according to a test method set by the issuer device; And
When the candidate device requests the online test, the service server streams the test document generated in real time to the candidate device while generating the test document for the on-line test, and the test document is preset And a step C in which the candidate device is deleted from the candidate device when a time elapses,
Before the step B,
Further comprising the step of charging the test taker device with a packet for the test proceeding, wherein the packet is divided into units in which one candidate can take a problem once,
In the step B,
And requesting the purchaser device to purchase the packet further if the packet filled in the participant device is smaller than the number of questions included in the online test multiplied by the number of candidates for the online test,
Wherein the test document includes a code for taking the on-line test at the candidate device and a code for downloading the test document from the candidate device. The method according to claim 1,
Wherein the test question data file is in an Excel file format and includes an item of a constituent element of the individual problem and a constituent element of the group problem including a plurality of problems, the test document is in PDF format and includes a test paper, And an answer sheet. delete 3. The method of claim 2,
A first authority to grant an examination authority to all candidates for the test questions, a second authority to give to all candidates included in a predetermined group in advance, a third authority to be given to a specific candidate if it is included in a predetermined group, And a fourth authority to be given to a candidate who subscribes to the service.

Images