KR102482291B1 - Preventing dishonest acts for online examinations by using permissioned blockchain network and online examination server using the same - Google Patents

Abstract

A method for preventing cheating in an online test using a permissioned blockchain network, comprising: (a) configuring the permissioned blockchain network in a state where test question content is registered in a first distributed ledger of the permissioned blockchain network; An online test server, which is one of the nodes that (i) is allowed access to the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server managing the permissioned blockchain network When test-taking request information for the test-taking content is obtained from at least one examinee's terminal, the test-taking content corresponding to the test-taking request information is obtained from the first distributed ledger, and the test paper included in the test-taking content And, the corresponding answer sheet is provided to the test taker terminal so that the test taker terminal can perform a test on the test question content, and the test answer sheet content transaction for registering the answer sheet from the test taker terminal is the permissioned block When broadcast to the chain network, the validity of the test answer sheet content transaction is confirmed, and if the test answer sheet content transaction is confirmed to be valid, the test answer sheet content transaction is registered in the second distributed ledger of the permissioned blockchain network. , The test answer sheet content transaction ID indicating the registration position of the test answer sheet content transaction registered in the second distributed ledger is transmitted to the test taker terminal, thereby allowing the test taker terminal to perform the test answer sheet content transaction Using the ID, it is possible to check whether the test answer sheet contents transaction is registered in the second distributed ledger, and (ii) access to the second distributed ledger of the permissioned blockchain network is allowed by the administrator server. Video, audio, operation log of the test taker's terminal during each test for real-time supervision of the test taker from at least a part of the image recording device, audio recording device, and the test taker's terminal. When test supervision content including at least a part of the above is generated, the test supervision content is stored in a storage device, and when the test is completed, the integrity check result of the test supervision content is checked, and the integrity check result is stored in the second distributed ledger. registering for; and (b) the online test server obtains test supervision request information for the test from at least one test supervisor terminal allowed to access the second distributed ledger of the permissioned blockchain network by the administrator server. , the test supervision content corresponding to the test supervision request information is obtained from the storage device, and a first test supervision screen displaying at least a part of the test supervision content is provided to the test supervisor terminal, so that the test supervisor terminal When a cheating detection content transaction is broadcast from the test supervisor terminal to the permissioned blockchain network to record the cheating detection contents detected during the test, the cheating activity checking the validity of the fraud detection content transaction, and registering the fraud detection content transaction in the second distributed ledger of the permissioned blockchain network if it is confirmed that the fraud detection content transaction is valid; A method including a and an online test server using the same are disclosed.

Description

Preventing dishonest acts for online examinations by using permissioned blockchain network and online examination server using the same}

The present invention relates to a method for preventing cheating in an online test using a permissioned blockchain network and an online test server using the same, and more particularly, to processes before, during, and after an online test using a permissioned blockchain network. It relates to a method for preventing cheating that may occur in and an online test server using the same.

Currently, the most common test method worldwide is still the offline method of taking the test using paper test papers and answer sheets. However, offline tests not only waste a lot of physical and human assets such as paper and ink for printing question papers and answer sheets, but also take up a lot of space for storage of question papers and answer sheets. In addition, offline tests have revealed various vulnerabilities in security and management issues, such as leakage of question papers and loss of answer sheets.

In addition to the chronic problems of these existing offline tests, the global epidemic of Covid-19 has provided an opportunity for educational institutions, testing institutions, and various companies to consider online non-face-to-face testing as an alternative to offline testing. Accordingly, some countries and companies are already continuously trying and developing online test systems that can take tests using personal tablet PCs and laptops online.

However, in the conventional online test, it can be easy to manage test takers in that it identifies and manages test takers who access it through an online test server. There are limits to the difficulty.

In addition, the current online test system, which focuses on problem leakage prevention and test taker management, provides access rights and activities for various types of online test system user groups, including test takers, writers who create test questions, and scorers who grade the test. There are limitations in managing and recording.

Therefore, an improvement plan for solving the above problems is required.

The object of the present invention is to solve all of the above problems.

In addition, the present invention separates the distributed ledger for recording test question content such as question papers, answer sheet, answer sheet, and solution, and the distributed ledger for recording content related to test taking, test supervision, and test scoring, thereby providing a multi-level solution for online exams. It aims to create and manage distributed ledgers.

In addition, another object of the present invention is to classify users such as examiners, test takers, supervisors, and graders by using a multi-distributed ledger and manage access rights to each distributed ledger for each user group.

In addition, the present invention is to prevent various types of fraudulent acts such as leaking question papers, sharing answer sheets, and correcting answer sheets that may occur in the process before, during, and after the test through multi-distributed ledgers and management of access rights for each user group accordingly. for a different purpose.

In addition, another object of the present invention is to detect and prevent cheating during an exam by recording video, audio, and terminal operation logs during an exam of an examinee taking an exam.

In order to achieve the object of the present invention as described above and realize the characteristic effects of the present invention described later, the characteristic configuration of the present invention is as follows.

According to one aspect of the present invention, in a method for preventing cheating in an online test using a permissioned blockchain network, (a) in a state in which test content is registered in a first distributed ledger of a permissioned blockchain network, The online test server, which is one of the nodes constituting the permissioned blockchain network, (i) the first distributed ledger and the second distributed ledger of the permissioned blockchain network by an administrator server that manages the permissioned blockchain network. When test-taking request information for the test-taking content is obtained from at least one test-taker terminal allowed to access the distributed ledger, the test-taking request information corresponding to the test-taking request information is obtained from the first distributed ledger, A test sheet included in the test question content and an answer sheet corresponding thereto are provided to the test taker terminal so that the test taker terminal can perform a test on the test question content, and a test for registering the answer sheet from the test taker terminal When an answer sheet content transaction is broadcast to the permissioned blockchain network, the validity of the test answer sheet content transaction is checked, and if the test answer sheet content transaction is confirmed to be valid, the test answer sheet content transaction is transmitted to the permissioned blockchain network. By registering in the second distributed ledger and transmitting the test answer sheet content transaction ID indicating the registration position in the second distributed ledger of the test answer sheet content transaction registered in the second distributed ledger to the test taker terminal, the examinee enable a terminal to check whether the test answer sheet content transaction is registered in the second distributed ledger by using the test answer sheet content transaction ID; 2 Video, audio, and video during each test for real-time supervision of the test taker from at least some of the video recording device, audio recording device, and the test taker's terminal that are allowed access to the distributed ledger. When test supervision content including at least a part of the operation log of the examinee's terminal is generated, the test supervision content is stored in a storage device, and when the test is completed, an integrity check result of the test supervision content is checked, and the integrity check result registering in the second distributed ledger; and (b) the online test server obtains test supervision request information for the test from at least one test supervisor terminal allowed to access the second distributed ledger of the permissioned blockchain network by the administrator server. , the test supervision content corresponding to the test supervision request information is obtained from the storage device, and a first test supervision screen displaying at least a part of the test supervision content is provided to the test supervisor terminal, so that the test supervisor terminal When a cheating detection content transaction is broadcast from the test supervisor terminal to the permissioned blockchain network to record the cheating detection contents detected during the test, the cheating activity Checking the validity of the fraud detection content transaction, and if it is confirmed that the fraud detection content transaction is valid, registering the fraud detection content transaction in the second distributed ledger of the permissioned blockchain network. is initiated

As an example, prior to step (a), (a0) registering the test question content from at least one tester terminal allowed to access the first distributed ledger of the permissioned blockchain network by the administrator server. When a test question content transaction for a test is broadcast to the permissioned blockchain network, the online test server verifies the validity of the test question content transaction, and if the test question content transaction is confirmed to be valid, the test question content transaction is registered in the first distributed ledger of the permissioned blockchain network, and a test question content transaction ID indicating a registration position in the first distributed ledger of the test question content transaction registered in the first distributed ledger is given to the examiner. Further comprising the step of enabling the examiner terminal to check whether the test question content transaction is registered in the first distributed ledger by using the test question content transaction ID by transmitting the test question content transaction to a terminal. A method is disclosed.

As an example, after the step (b), (c) the online test server, (i) at least one automated When automatic scoring request information for the test is obtained from the scoring manager terminal, the test question contents and the test answer sheet contents corresponding to the automatic scoring request information are obtained from the first distributed ledger and the second distributed ledger, respectively; The answer sheet included in the test question content and correspondingly at least one or more answer sheets included in the test answer sheet content are provided to the automatic scoring manager terminal, so that the automatic scoring manager terminal automatically scores the answer sheet with reference to the answer sheet. and when an automatic scoring content transaction for registering an automatic scoring result from the automatic scoring manager terminal is broadcast to the permissioned blockchain network, the validity of the automatic scoring content transaction is checked, and the automatic scoring content If the transaction is confirmed to be valid, a process of registering the automatically scored content transaction in the second distributed ledger of the permissioned blockchain network, and (ii) the second distributed ledger of the permissioned blockchain network by the administrator server. When instructor scoring request information for the test is obtained from at least one instructor terminal allowed to access the ledger, the test question contents corresponding to the instructor scoring request information from the first distributed ledger and the second distributed ledger Each of the test answer sheet contents is obtained, and a problem sheet and an answer sheet included in the test question contents and at least one or more answer sheets included in the test answer sheet contents are provided to the instructor terminal, so that the instructor terminal performs the automatic scoring. and Instructor scoring content transaction for enabling writing of comments on the scoring sheet generated by the automatic scoring and registering the instructor scoring result from the instructor terminal. If the transaction is broadcast to the permissioned blockchain network, the validity of the instructor-graded content transaction is checked. 2 performing at least one of the processes of registering in the distributed ledger; a method characterized by further comprising is disclosed.

As an example, the online test server allows the test taker terminal, which is allowed to access the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server, during the period during which the test is in progress. Disclosed is a method characterized in that access to the first distributed ledger and the second distributed ledger is allowed only during a period in which the test result can be confirmed.

As an example, the operation log of the examinee's terminal includes (i) site information accessed by the examinee's terminal and corresponding timestamp information, (ii) application identifier information accessed by the examinee's terminal and corresponding timestamp information, ( iii) Identifier information for the shortcut key input by the test taker's terminal and corresponding timestamp information, and (iv) generating an IP address accessed by the test taker's terminal and corresponding timestamp information to track cheating of the test taker A method characterized by that is disclosed.

As an example, the operation log of the test taker's terminal further includes timestamp information for a time when a click was performed, item identifier information corresponding to the timestamp and selected item identifier information by the click, and view identifier information, among the item identifier information Second view identifier information and a second timestamp in a state in which the first view identifier information and the first timestamp among a plurality of view identifier information belonging to the specific item identifier information are matched and input - the second timestamp is the first time stamp When - succeeding in time to the stamp is entered in correspondence with, setting the priority of the second view identifier information and the second timestamp higher than the priority of the first view identifier information and the first timestamp. A method of characterization is disclosed.

As an example, the online test server obtains a storage location of the video generated from the video recording device and stored in the storage device and a hash value generated corresponding to the video to generate the integrity check result, and A method characterized by registering a check result in the second distributed ledger of the permissioned blockchain network is disclosed.

As an example, in the step (b), the online test server receives guest IDs and passwords only for a limited number of people on a first-come, first-served basis through prior notice for guest user terminals that are not registered as test supervisor terminals, and additional test supervisors providing the second test supervision screen to the guest user terminal permitted as the additional test supervisor so that the second test supervisor screen displaying at least a part of the test supervisor content can be viewed while the test is in progress. A method of characterization is disclosed.

As an example, the online test server, in response to the automatic scoring request information for the test acquired from the automatic scoring manager terminal or the instructor scoring request information for the test obtained from the instructor terminal, the first distributed ledger and acquiring the test question content and the test answer sheet content from the second distributed ledger, and additionally acquiring the cheating detection content from the second distributed ledger, thereby denying the test included in the cheating detection content. When the behavior detection content is provided to the automatic scoring manager terminal or the instructor terminal that performs the scoring, and the cheating detection content for the specific test taker of the test is confirmed, (i) the automatic scoring manager terminal causes the specific A process of reflecting the cheating detected content of the examinee in the automatic scoring result on the answer sheet of the specific examinee; A result of forgery or falsification determination for the video, audio, and manipulation log corresponding to the action detection content is generated, and the forgery or falsification determination result is reflected in the instructor's scoring result for the specific examinee's answer sheet. A method characterized by performing at least one of the processes to do is disclosed.

As an example, the online test server is allowed to access the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server, and the scoring result and commentary for the test are obtained from the test taker terminal. When reading request information is acquired, the test question content corresponding to the scoring result and commentary reading request information from the first distributed ledger and the automatic scoring content corresponding to the scoring result and commentary reading request information from the second distributed ledger and obtaining at least one of the instructor scoring content, and providing (i) the question paper and commentary included in the test question content and (ii) the automatic scoring result or the instructor scoring result corresponding thereto to the test taker terminal. A method characterized by enabling viewing of the scoring results and the commentary is disclosed.

As an example, the online test server synthesizes and analyzes at least one or more scoring results for at least one or more tests taken by each of the examinee's terminals, and subjects corresponding to the at least one or more tests for each of the examinee's terminals. A method is disclosed which is characterized by generating a statistical number on a per-, per-trial basis.

According to another aspect of the present invention, an online test server for preventing cheating in an online test using a permissioned blockchain network, comprising: a memory for storing instructions; and at least one processor configured to execute the instructions, wherein the processor: (1) in a state in which test question content is registered in a first distributed ledger of a permissioned blockchain network, (i) the permissioned block Acquisition of test application request information for the test question contents from at least one test taker terminal allowed access to the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server managing the chain network Then, the test question content corresponding to the test application request information is acquired from the first distributed ledger, and the test paper included in the test question content and the answer writing sheet corresponding thereto are provided to the test taker terminal, so that the test taker terminal When a test answer sheet content transaction for registering an answer sheet is broadcast from the test taker terminal to the permissioned blockchain network, the validity of the test answer sheet content transaction is confirmed; If it is confirmed that the test answer sheet content transaction is valid, the test answer sheet content transaction is registered in the second distributed ledger of the permissioned blockchain network, and the second distributed ledger of the test answer sheet content transaction registered in the second distributed ledger. By transmitting the test answer sheet content transaction ID indicating the registration location in the distributed ledger to the test taker terminal, the test taker terminal can check whether the test answer sheet content transaction is registered in the second distributed ledger using the test answer sheet content transaction ID. (ii) access to the second distributed ledger of the permissioned blockchain network by the administrator server is allowed, and at least some of the video recording device, audio recording device, and When test supervision content including at least a part of video, audio, and operation logs of the examinee's terminal is generated during each test taker's test for real-time supervision, the test supervisor's content is generated. A process of storing dog content in a storage device, checking the integrity check result of the test supervision content when the test is completed, and registering the integrity check result in the second distributed ledger; and (2) the permission given by the manager server. When test supervision request information for the test is obtained from at least one test supervisor terminal allowed to access the second distributed ledger of the blockchain network, the test supervisor corresponding to the test supervision request information from the storage device. content is obtained, and a first test supervision screen displaying at least a part of the test supervision content is provided to the test supervisor terminal so that the test supervisor terminal can supervise the test, and from the test supervisor terminal When a fraud detection content transaction for recording the fraud detection content detected during the test is broadcast to the permissioned blockchain network, the validity of the fraud detection content transaction is checked, and the fraud detection content transaction is valid. If confirmed, an online test server executing the above instructions to perform a process of registering the fraud detection content transaction to the second distributed ledger of the permissioned blockchain network is initiated.

As an example, the processor, prior to the (1) process, registers the test question contents from at least one tester terminal allowed to access the first distributed ledger of the permissioned blockchain network by the administrator server. When a test question content transaction is broadcast to the permissioned blockchain network, the validity of the test question content transaction is verified, and if the test question content transaction is confirmed to be valid, the test question content transaction is sent to the permissioned block. By registering in the first distributed ledger of the chain network and transmitting the test question content transaction ID indicating the registration position in the first distributed ledger of the test question content transaction registered in the first distributed ledger to the tester terminal. Disclosed is an online test server characterized in that it further performs a process for allowing the question maker terminal to check whether the test question content transaction is registered in the first distributed ledger using the test question content transaction ID. .

As an example, the processor, after the (2) process, (3) (i) at least one automatic scoring manager allowed access to the second distributed ledger of the permissioned blockchain network by the manager server When automatic scoring request information for the test is obtained from the terminal, the test question content and the test answer sheet content corresponding to the automatic scoring request information are obtained from the first distributed ledger and the second distributed ledger, respectively, and the test The answer sheet included in the question content and correspondingly at least one or more answer sheets included in the test answer sheet content are provided to the automatic scoring manager terminal, and the automatic scoring manager terminal refers to the answer sheet to automatically score the answer sheet. and when an automatic scoring content transaction for registering an automatic scoring result is broadcast from the automatic scoring manager terminal to the permissioned blockchain network, the validity of the automatic scoring content transaction is checked, and the automatic scoring content transaction is If confirmed to be valid, a process of registering the automatic scoring content transaction to the second distributed ledger of the permissioned blockchain network, and (ii) to the second distributed ledger of the permissioned blockchain network by the administrator server. When instructor scoring request information for the test is obtained from at least one instructor terminal allowed access to the test, the test question contents corresponding to the instructor scoring request information from the first distributed ledger and the second distributed ledger and the test Each of the answer sheet contents is obtained, and the problem sheet and the answer sheet included in the test question contents, and correspondingly, at least one or more answer sheets included in the test answer sheet contents are provided to the instructor terminal so that the instructor terminal can perform the automatic scoring and the automatic scoring. Instructor scoring content transaction for enabling comment writing on the scoring sheet generated by automatic scoring and registering the instructor scoring result from the instructor terminal When broadcast to the permissioned blockchain network, the validity of the instructor-graded content transaction is checked. An online test server characterized in that it performs at least one of the processes of registering in the ledger is disclosed.

As an example, the processor allows the test taker terminal, which is allowed access to the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server, to determine the period during which the test is conducted and the test An online test server is disclosed that allows access to the first distributed ledger and the second distributed ledger only during a period in which the result can be confirmed.

As an example, the operation log of the examinee's terminal includes (i) site information accessed by the examinee's terminal and corresponding timestamp information, (ii) application identifier information accessed by the examinee's terminal and corresponding timestamp information, ( iii) Identifier information for the shortcut key entered by the test taker's terminal and corresponding timestamp information, and (iv) IP address accessed by the test taker's terminal and corresponding timestamp information are additionally generated to track cheating of the test taker. An online test server characterized by doing is disclosed.

As an example, the operation log of the test taker's terminal further includes timestamp information for a time when a click was performed, item identifier information corresponding to the timestamp and selected item identifier information by the click, and view identifier information, among the item identifier information Second view identifier information and a second timestamp in a state in which the first view identifier information and the first timestamp among a plurality of view identifier information belonging to the specific item identifier information are matched and input - the second timestamp is the first time stamp When - succeeding in time to the stamp is entered in correspondence with, setting the priority of the second view identifier information and the second timestamp higher than the priority of the first view identifier information and the first timestamp. A characterized online test server is disclosed.

As an example, the processor obtains a storage location of the image generated from the image recording device and stored in the storage device and a hash value generated corresponding to the image to generate the integrity check result, and the integrity check result An online test server is disclosed, characterized in that for registering in the second distributed ledger of the permissioned blockchain network.

As an example, in the process (2), the processor receives guest IDs and passwords only for a limited number of people on a first-come, first-served basis through prior notice to guest user terminals that are not registered as test supervisor terminals, and performs the test as an additional test supervisor. Characterized in that the second test supervision screen is provided to the guest user terminal permitted as the additional test supervisor so that a second test supervision screen displaying at least a part of the test supervision content can be viewed while the test is in progress. An online test server is disclosed.

As an example, the processor may, in response to the automatic scoring request information for the test obtained from the automatic scoring manager terminal or the instructor scoring request information for the test obtained from the instructor terminal, transmit the first distributed ledger and the Obtain the test question contents and the test answer sheet contents from the second distributed ledger, and additionally obtain the cheating detecting contents from the second distributed ledger to detect cheating on the test included in the cheating detecting contents. When the content is provided to the automatic scoring manager terminal or the instructor terminal that performs the scoring, and the cheating detection information for the specific examinee in the test is confirmed, (i) the automatic scoring manager terminal is directed to the specific examinee. A process of reflecting the cheating detection details on the specific examinee's answer sheet to the automatic scoring result, and (ii) the instructor terminal detecting the cheating by referring to the cheating detection contents of the specific examinee. To generate forgery or alteration determination results for the video, audio, and operation log corresponding to the content, and to reflect the misconduct detection contents and the forgery or alteration determination result to the instructor scoring result for the specific examinee's answer sheet An online test server characterized by performing at least one of the processes is disclosed.

As an example, the processor requests a scoring result for the test and a reading of commentary from the test-taker terminal allowed to access the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server. When the information is obtained, the test question content corresponding to the scoring result and commentary reading request information from the first distributed ledger and the automatic scoring content corresponding to the scoring result and commentary reading request information from the second distributed ledger and the At least one of instructor scoring content is obtained, and (i) the question paper and commentary included in the test question content and (ii) the automatic scoring result or the instructor scoring result corresponding thereto are provided to the examinee's terminal to obtain the scoring result. And an online test server is disclosed, characterized in that it enables the reading of the commentary.

As an example, the processor synthesizes and analyzes at least one or more scoring results for at least one or more tests taken by each of the examinee terminals, and for each subject corresponding to the at least one or more tests for each of the examinee terminals, An online test server characterized in generating statistical values for each test is disclosed.

In addition to this, a computer readable recording medium for recording a computer program for executing the method of the present invention is further provided.

The present invention is a multi-distributed ledger for online exams by separately managing a distributed ledger that records test question contents such as question papers, answer sheets, answer sheets, and solutions, and a distributed ledger that records contents related to test taking, test supervision, and test scoring. There is an effect that can create and manage.

In addition, by using a multi-distributed ledger, the present invention has an effect of classifying users such as test takers, test takers, supervisors, and graders, and managing access rights to each distributed ledger for each user group.

In addition, the present invention can prevent various types of cheating such as leakage of question papers, sharing of answer sheets, and correction of answer sheets that may occur during the test before, during, and after the test through multi-distributed ledgers and management of access rights for each user group accordingly. It works.

In addition, the present invention has an effect of detecting and preventing cheating during the test by recording video, audio, and terminal operation logs during the test of the examinee taking the test.

The accompanying drawings for use in describing the embodiments of the present invention are only some of the embodiments of the present invention, and to those of ordinary skill in the art (hereinafter referred to as "ordinary technicians"), the invention Other drawings can be obtained based on these drawings without redundancy.
1 schematically illustrates an online test system based on a permissioned blockchain according to an embodiment of the present invention;
2 schematically illustrates a process in which a question maker terminal registers a problem in a permissioned blockchain network according to an embodiment of the present invention;
3 schematically illustrates a process in which an examinee's terminal registers an answer sheet in a permissioned blockchain network according to an embodiment of the present invention;
4 schematically illustrates a process of registering fraud detection information in a permissioned blockchain network by a test supervisor terminal according to an embodiment of the present invention;
5 schematically illustrates a method of performing a blind disclosure monitoring system according to an embodiment of the present invention;
6 schematically illustrates a process in which an automatic scoring manager terminal registers a scoring result in a permissioned blockchain network according to an embodiment of the present invention.
7 schematically illustrates a process in which an instructor terminal registers a scoring result in a permissioned blockchain network according to an embodiment of the present invention.
8 schematically illustrates a configuration diagram of a service layer of a system for conducting an online test according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description of the present invention refers to the accompanying drawings, which illustrate specific embodiments in which the present invention may be practiced in order to make the objects, technical solutions and advantages of the present invention clear. These embodiments are described in sufficient detail to enable a person skilled in the art to practice the present invention.

Also, throughout the description and claims of the present invention, the word "comprise" and variations thereof are not intended to exclude other technical features, additions, components or steps. Other objects, advantages and characteristics of the present invention will appear to those skilled in the art, in part from this description and in part from practice of the invention. The examples and drawings below are provided as examples and are not intended to limit the invention.

Moreover, the present invention covers all possible combinations of the embodiments shown herein. It should be understood that the various embodiments of the present invention are different from each other but are not necessarily mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be implemented in one embodiment in another embodiment without departing from the spirit and scope of the invention. Additionally, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the detailed description set forth below is not to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all equivalents as claimed by those claims. Like reference numbers in the drawings indicate the same or similar function throughout the various aspects.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily practice the present invention.

First, FIG. 1 schematically illustrates an online test system based on a permissioned blockchain according to an embodiment of the present invention.

According to FIG. 1, the online test system consists of an administrator server 100 of a permissioned blockchain network, an online test server 200, a permissioned blockchain network 300, a test writer terminal 400 of an examinee's institution, Composed of test taker terminal 500, video recording device and audio recording device 600, test supervisor terminal 700 of the first instructor institution, automatic scoring manager terminal 800 and instructor terminal 900 of the second instructor institution, etc. It can be.

First, the administrator server 100 of the permissioned blockchain network is a subject that manages the permissioned blockchain network 300 and manages the access rights of the permissioned blockchain network 300, and is a PC (Personal Computer), mobile It may include computers, PDAs/EDAs, mobile phones, smartphones, tablets, IoT devices, servers, and the like. However, the administrator server 100 of the permissioned blockchain network is not limited thereto, and may include any device capable of performing computational calculations, such as a portable game device having a wired/wireless communication function, a digital camera, and a personal navigation device.

In addition, the manager server 100 of the permissioned blockchain network stores instructions related to management of the permissioned blockchain network 300 and management of access rights of the permissioned blockchain network 300 in memory and instructions stored in the memory. Accordingly, it may include a processor that performs operations related to management of the permissioned blockchain network 300 and management of access rights of the permissioned blockchain network 300.

Specifically, the administrator server 100 of a permissioned blockchain network typically includes a computing device (e.g., a device that may include computer processes, memory, storage, input and output devices, and other components of existing computing devices; electronic communication devices such as routers, switches, etc.; electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (i.e., instructions that allow a computing device to function in a particular way). A combination may be used to achieve the desired system performance.

In addition, the processor of the computing device may include hardware components such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software component of an application performing a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium for implementing the present invention, a processor, and a memory are integrated.

Next, the online test server 200 is a subject that performs an operation for conducting an online test in relation to the online test on the permissioned blockchain network 300, and is a PC (Personal Computer), mobile computer, PDA / EDA, mobile It may include phones, smartphones, tablets, IoT devices, servers, and the like. However, the online test server 200 is not limited thereto, and may include any device capable of performing computing calculations, such as a portable game machine having a wired/wireless communication function, a digital camera, and a personal navigation device.

In addition, the online test server 200 includes a memory in which instructions for performing an operation for conducting an online test in relation to an online test on the permissioned blockchain network 300 are stored and a permissioned blockchain network according to the instructions stored in the memory. (300) may include a processor that performs an operation for conducting an online test.

Specifically, the online test server 200 is typically a computing device (e.g., a device that may include computer processors, memory, storage, input and output devices, and other components of conventional computing devices; routers, switches, etc.) A combination of electronic communication devices (electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (ie, instructions that cause a computing device to function in a particular way) It may be to achieve system performance.

In addition, the processor of the computing device may include hardware components such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software component of an application performing a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium for implementing the present invention, a processor, and a memory are integrated.

In addition, the online test server 200 may be one node constituting the permissioned blockchain network 300.

Next, the permissioned blockchain network 300 connects the first distributed ledger 310 and the second distributed ledger 320 to which access is permitted only by the access authority generated by the permissioned blockchain network manager server 100. As a subject to manage, it may include a personal computer (PC), a mobile computer, a PDA/EDA, a mobile phone, a smartphone, a tablet, an IoT device, a server, and the like. However, the permissioned blockchain network 300 is not limited thereto, and may include any device capable of performing computational calculations for generating a one-time ID, such as a portable game machine with wired/wireless communication capabilities, a digital camera, and a personal navigation device. there is.

Here, the first distributed ledger 310 can be used to record and manage test question content registered by a setter, such as question papers, answer sheets, and problem solving, and the second distributed ledger 320 performs online tests in addition to test question content. It can be used to record and manage information such as the test taker's answer sheet, test supervision information for the test taker, cheating detection details, and answer sheet scoring results generated in the process of taking the test.

Next, the question maker terminal 400 registers test question content, including question papers, answer sheets, and problem solutions, on the permissioned blockchain network 300 using the access rights generated by the permissioned blockchain network manager server 100 As a subject that does, it may include a PC (Personal Computer), a mobile computer, a PDA / EDA, a mobile phone, a smartphone, a tablet, an IoT device, a server, and the like. However, the presenter terminal 400 is not limited thereto, and may include any device capable of performing a computing operation for generating a one-time ID, such as a portable game machine having a wired/wireless communication function, a digital camera, and a personal navigation device.

In addition, the question maker terminal 400 stores instructions for registering test question contents in the permissioned blockchain network 300 using the access rights generated by the permissioned blockchain network manager server 100 and the memory. It may include a processor that performs an operation of registering test question content in the permissioned blockchain network 300 using the access rights generated by the permissioned blockchain network manager server 100 according to the stored instructions.

Specifically, the question maker terminal 400 is typically a computing device (eg, a computer process, a memory, a storage device, an input device and an output device, and a device that may include components of other conventional computing devices; electronic devices such as routers and switches). A desired system using a combination of communication devices; electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (ie, instructions that allow a computing device to function in a particular way) It may be to achieve performance.

In addition, the processor of the computing device may include hardware components such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software component of an application performing a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium for implementing the present invention, a processor, and a memory are integrated.

In addition, the presenter terminal 400 may operate as a node of the permissioned blockchain network 300 when obtaining access rights to the permissioned blockchain network 300 from the manager server 100 .

Next, the test taker terminal 500 is a subject that registers test answer sheet contents in the permissioned blockchain network 300 using the access authority generated by the permissioned blockchain network manager server 100, and is a PC (Personal Computer) ), mobile computers, PDAs/EDAs, cell phones, smartphones, tablets, IoT devices, servers, and the like. However, the test taker terminal 500 is not limited thereto, and may include any device capable of performing a computing operation for generating a one-time ID, such as a portable game machine having a wired/wireless communication function, a digital camera, and a personal navigation device.

In addition, the test taker terminal 500 stores instructions for registering test answer sheet contents in the permissioned blockchain network 300 using the access authority generated by the permissioned blockchain network manager server 100 and the memory. It may include a processor that performs an operation of registering test answer sheet contents in the permissioned blockchain network 300 using the access rights generated by the permissioned blockchain network manager server 100 according to the stored instructions.

Specifically, the test taker terminal 500 is typically a computing device (eg, a computer process, a memory, a storage device, an input device and an output device, and other devices that may include components of existing computing devices; electronic devices such as routers, switches, etc.) A desired system using a combination of communication devices; electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (ie, instructions that allow a computing device to function in a particular way) It may be to achieve performance.

In addition, the processor of the computing device may include hardware components such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software component of an application performing a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium for implementing the present invention, a processor, and a memory are integrated.

In addition, when obtaining access to the permissioned blockchain network 300 from the administrator server 100, the test taker terminal 500 may operate as a node of the permissioned blockchain network 300.

Next, the video recording device and the audio recording device 600 use the access authority generated by the permissioned blockchain network manager server 100 to transmit the permissioned blockchain network 300 to the test taker's video, audio, and video during the test. A subject that registers test supervision contents including the operation log of the examinee's terminal 500, and may include a PC (Personal Computer), mobile computer, PDA/EDA, mobile phone, smart phone, tablet, IoT device, server, and the like. However, the video recording device and the audio recording device 600 are not limited thereto, and include all devices capable of performing computational calculations for generating a one-time ID, such as a portable game machine having a wired/wireless communication function, a digital camera, and a personal navigation device. can do.

In addition, the video recording device and the audio recording device 600 contain instructions for registering test supervision content in the permissioned blockchain network 300 using the access right generated by the permissioned blockchain network manager server 100. A processor that performs an operation of registering test supervision content in the permissioned blockchain network 300 using the access rights generated by the permissioned blockchain network manager server 100 according to the stored memory and the instructions stored in the memory can include

Specifically, the video recording device and audio recording device 600 typically refer to a computing device (e.g., a device that may include computer processes, memory, storage, input and output devices, and other components of conventional computing devices; a router; A combination of electronic communication devices such as switches, switches, etc.; electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (ie, instructions that allow a computing device to function in a particular way). may be used to achieve desired system performance.

In addition, the processor of the computing device may include hardware components such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software component of an application performing a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium for implementing the present invention, a processor, and a memory are integrated.

In addition, the video recording device and the audio recording device 600 can operate as nodes of the permissioned blockchain network 300 when obtaining access rights to the permissioned blockchain network 300 from the manager server 100. .

Next, the test supervisor terminal 700 is a subject that registers cheating detection content in the permissioned blockchain network 300 using the access authority generated by the permissioned blockchain network manager server 100, and the PC ( Personal Computer), mobile computers, PDAs/EDAs, cell phones, smart phones, tablets, IoT devices, servers, and the like. However, the test supervisor terminal 700 is not limited thereto, and may include any device capable of performing a computing operation for generating a one-time ID, such as a portable game machine having a wired/wireless communication function, a digital camera, and a personal navigation device.

In addition, the test supervisor terminal 700 includes a memory in which instructions for registering cheating detection content in the permissioned blockchain network 300 are stored using the access authority generated by the permissioned blockchain network manager server 100 and It may include a processor that performs an operation of registering cheating detection content using access rights generated by the blockchain network manager server 100 according to instructions stored in the memory.

Specifically, proctor terminal 700 is typically a computing device (e.g., a device that may include computer processors, memory, storage, input and output devices, and other components of conventional computing devices; routers, switches, etc.) A combination of electronic communication devices (electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (ie, instructions that cause a computing device to function in a particular way) It may be to achieve system performance.

In addition, the processor of the computing device may include hardware components such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software component of an application performing a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium for implementing the present invention, a processor, and a memory are integrated.

In addition, the test supervisor terminal 700 may operate as a node of the permissioned blockchain network 300 when obtaining access rights to the permissioned blockchain network 300 from the administrator server 100 .

Next, the automatic scoring manager terminal 800 is a subject that registers automatic scoring content in the permissioned blockchain network 300 using the access authority generated by the permissioned blockchain network manager server 100, and the PC ( Personal Computer), mobile computers, PDAs/EDAs, cell phones, smart phones, tablets, IoT devices, servers, and the like. However, the automatic scoring manager terminal 800 is not limited thereto, and may include any device capable of performing a computing operation for generating a one-time ID, such as a portable game machine having a wired/wireless communication function, a digital camera, and a personal navigation device. .

In addition, the automatic scoring manager terminal 800 includes a memory in which instructions for registering automatic scoring contents in the permissioned blockchain network 300 are stored using the access right generated by the permissioned blockchain network manager server 100 and It may include a processor that performs an operation of registering automatic scoring content in the permissioned blockchain network 300 using the access right generated by the permissioned blockchain network manager server 100 according to the instructions stored in the memory. there is.

Specifically, the automatic scoring manager terminal 800 is typically a computing device (eg, a computer process, memory, storage, input and output devices, devices that may include other components of conventional computing devices; routers, switches, etc.) using a combination of electronic communication devices such as network attached storage (NAS) and electronic information storage systems such as storage area networks (SANs)) and computer software (ie, instructions that allow a computing device to function in a particular way) It may be to achieve desired system performance.

In addition, the processor of the computing device may include hardware components such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software component of an application performing a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium for implementing the present invention, a processor, and a memory are integrated.

In addition, the automatic scoring management terminal 800 may operate as a node of the permissioned blockchain network 300 when obtaining access to the permissioned blockchain network 300 from the manager server 100 .

Next, the instructor terminal 900 is a subject that registers the instructor scoring content in the permissioned blockchain network 300 using the access right generated by the permissioned blockchain network manager server 100, and is a PC (Personal Computer) ), mobile computers, PDAs/EDAs, cell phones, smartphones, tablets, IoT devices, servers, and the like. However, the instructor terminal 900 is not limited thereto, and may include any device capable of performing a computing operation for generating a one-time ID, such as a portable game machine having a wired/wireless communication function, a digital camera, and a personal navigation device.

In addition, the instructor terminal 900 stores instructions for registering instructor-graded content in the permissioned blockchain network 300 using the access authority generated by the permissioned blockchain network manager server 100 and the memory. It may include a processor that performs an operation of registering instructor scoring content in the permissioned blockchain network 300 using the access authority generated by the permissioned blockchain network manager server 100 according to the stored instructions.

Specifically, the instructor terminal 900 is typically a computing device (eg, a computer process, memory, storage, input device and output device, and other devices that may include components of existing computing devices; electronic devices such as routers, switches, etc.) A desired system using a combination of communication devices; electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (ie, instructions that allow a computing device to function in a particular way) It may be to achieve performance.

In addition, the processor of the computing device may include hardware components such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software component of an application performing a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium for implementing the present invention, a processor, and a memory are integrated.

In addition, the instructor terminal 900 can operate as a node of the permissioned blockchain network 300 when obtaining access rights to the permissioned blockchain network 300 from the administrator server 100 .

The present invention aims to prevent various fraudulent acts that may occur before, during, and after the exam by applying a permissioned blockchain, multi-distributed ledger, and a test supervision process applicable to non-face-to-face exams to the online exam system.

Accordingly, FIGS. 2 to 7 schematically illustrate how the permissioned blockchain-based online test server manages the main user groups participating in the online test system, namely the examiner, the test taker, the test supervisor, the instructor, and the automatic scoring manager. there is.

First, FIG. 2 schematically illustrates a process in which the question maker terminal 400 registers a problem in the permissioned blockchain network 300 according to an embodiment of the present invention.

Referring to FIG. 2, the administrator server 100 that manages the permissioned blockchain network 300 can set an issuer organization that can access the first distributed ledger 310 of the permissioned blockchain network 300. (S101). Here, the presenter organization registered in the permissioned blockchain network 300 refers to the presenter terminal 400, and information about the presenter organization includes server-related information of the presenter organization or individual applicants belonging to the presenter organization registered in the presenter organization. information related to the terminal may be included. In addition, information such as a certificate, ID and password, personal information, one-time password, and phone number may be requested in order for the server of the presenter organization and the terminal of the presenter to register and access the permissioned blockchain network 300. Accordingly, the permissioned blockchain network manager server 100 may permit registration and access to the permissioned blockchain network 300 based on the acquired authentication information.

Accordingly, test question contents are generated from at least one examiner terminal 400 allowed to access the first distributed ledger 310 of the permissioned blockchain network 300 by the administrator server 100 (S102) When the test question content transaction for registering the test question content is broadcast to the permissioned blockchain network 300 (S103), the online test server 200, which is one of the nodes constituting the permissioned blockchain network 300 A, the validity of the test question content transaction is checked (S104), and if the test question content transaction is confirmed to be valid, the test question content transaction is registered in the first distributed ledger 310 of the permissioned blockchain network 300 ( S105), by transmitting the test question content transaction ID indicating the registration position in the first distributed ledger 310 of the test question content transaction registered in the first distributed ledger 310 to the examiner terminal 400 (S106), The examiner terminal 400 may check whether the test question content transaction is registered in the first distributed ledger 310 using the test question content transaction ID (S107). Here, the test question content transaction may include the test question content and the public key generated by the examiner terminal 400, and in addition, a signature value for signing the test question content with the private key of the examiner terminal 400, a nonce and a nonce. may include a signature value signed with the private key of the questioner terminal 400.

Next, FIG. 3 schematically illustrates a process in which the test taker terminal 500 registers an answer sheet in the permissioned blockchain network 300 according to an embodiment of the present invention.

Referring to FIG. 3, the permissioned blockchain network manager server 100 first provides access to the first distributed ledger 310 and the second distributed ledger 320 in the permissioned blockchain network 300. , It is possible to set a video recording device and an audio recording device capable of accessing the second distributed ledger (S201). Here, the test taker institution registered in the permissioned blockchain network 300 means the test taker terminal 500, and the information about the test taker institution includes information related to the server of the test taker institution or registration of each examinee belonging to the test taker institution. information related to the terminal may be included. In addition, information such as certificates, IDs and passwords, personal information, one-time passwords, and phone numbers are required in order for test-takers' institutions and test-takers' terminals, as well as video recording devices and audio recording devices, to register and access the permissioned blockchain network 300. It can be. Accordingly, the permissioned blockchain network manager server 100 may permit registration and access to the permissioned blockchain network 300 based on the acquired authentication information.

Subsequently, the online test server 200 sends the administrator server 100, which manages the permissioned blockchain network, in a state where test content is registered in the first distributed ledger 310 of the permissioned blockchain network 300. Test application request information for test question content from at least one test taker terminal 500 allowed to access the first distributed ledger 310 and the second distributed ledger 320 of the permissioned blockchain network 300 by If it is obtained (S202), the test question content corresponding to the test application request information is obtained from the first distributed ledger 310 (S203), and the test paper included in the test question content and the answer writing paper corresponding thereto are acquired (S200). ) is provided (S204) so that the test taker terminal 500 can perform a test on the test question content (S205), and the test answer sheet content transaction for registering the answer sheet from the test taker terminal 500 is a permissioned blockchain network When broadcast to (300) (S206), the validity of the test answer sheet contents transaction is checked (S207). It is registered in the distributed ledger 320 (S208), and the test answer sheet content transaction ID indicating the registration position in the second distributed ledger 320 of the test answer sheet content transaction registered in the second distributed ledger 320 is transferred to the test taker terminal 500. ) (S209), it is possible to enable the test taker terminal 500 to check whether the test answer sheet content transaction is registered in the second distributed ledger 320 using the test answer sheet content transaction ID (S210). . Here, the test answer sheet content transaction may include the test answer sheet content and the public key generated by the test taker's terminal 500, and in addition, a signature value for signing the test answer sheet content with the private key of the test taker's terminal 500, a nonce and a nonce. may include a signature value signed with the private key of the examinee's terminal 500.

In addition, while the online test is being taken as above, the online test server 200. Test takers from at least some of the video recording device, audio recording device 600, and test taker terminal 500 allowed access to the second distributed ledger 320 of the permissioned blockchain network 300 by the administrator server 100. When test supervision content including at least a part of video, audio, and operation logs of the examinee's terminal is generated during each test taker's real-time supervision for real-time supervision (S205), the test supervision content is stored in a storage device (S207), and the test begins. Upon completion, the integrity check result of the test supervision content may be checked, and the integrity check result may be registered in the second distributed ledger 320 (S208).

Here, the operation log of the test taker's terminal 500 includes (i) site information accessed by the test taker's terminal 500 and corresponding timestamp information, (ii) application identifier information accessed by the test taker's terminal 500 and information corresponding thereto. Timestamp information, (iii) identifier information for the shortcut key input by the test taker's terminal 500 and corresponding timestamp information, and (iv) IP address accessed by the test taker's terminal 500 and timestamp information corresponding thereto It can be created to track the cheating of test takers. By managing such an operation log, you can use a program other than the online test server 200 or use a shortcut key during the test to open and refer to a window in which you have previously written references for preparing the answer sheet, and refer to it as a duplicate IP. It is possible to track cheating, such as taking a proxy test by a third party other than the test taker, by accessing it.

In addition, the operation log of the examinee's terminal 500 additionally includes timestamp information for the time when the click was performed, item identifier information selected by clicking corresponding to the timestamp, and view identifier information, and a specific item among item identifier information. Among a plurality of view identifier information belonging to the identifier information, in a state in which the first view identifier information and the first timestamp are matched and input, the second view identifier information and the second timestamp - the second timestamp is temporally related to the first timestamp If trailing - is correspondingly input, the priority of the second view identifier information and the second timestamp may be set higher than that of the first view identifier information and the first timestamp. In this way, the test taker's terminal 500 records the process of selecting or correcting a specific answer to a specific question at a specific time during the test, and if necessary, compares and contrasts with other content such as video and audio included in the test supervision content. Through this, hacking into the online test system, malicious manipulation of test results, and cheating can be detected.

On the other hand, the online test server 200 generates integrity check results for test supervision content. For example, an image generated by the video recording device 600 and stored in a storage device is stored in a storage location of the image and corresponding to the image. The generated hash value may be obtained to generate an integrity check result, and the created integrity check result may be registered in the second distributed ledger 320 of the permissioned blockchain network 300 .

Here, the process in which the examinee performs the online test is supervised by the test supervisor through the video, audio, and operation log generated by the video recording device, the audio recording device 600, and the test taker's terminal 500, and the supervision proceeds. The process is described with reference to FIG. 4 as follows.

First, the permissioned blockchain network manager server 100 may set a first instructor institution capable of accessing the second distributed ledger 320 of the permissioned blockchain network 300 (S301). Here, the first instructor institution registered in the permissioned blockchain network 300 refers to the test supervisor terminal 700, and information about the first instructor institution includes server-related information of the first instructor institution or information about the first instructor institution. Terminal-related information registered in the first instructor institution of each test supervisor belonging to the test supervisor may be included. In addition, information such as a certificate, ID and password, personal information, one-time password, and phone number may be required in order for the first instructor institution server and test supervisor terminal to register and access the permissioned blockchain network 300. Accordingly, the permissioned blockchain network manager server 100 may permit registration and access to the permissioned blockchain network 300 based on the acquired authentication information.

Subsequently, the online test server 200 tests from at least one test supervisor terminal 700 allowed to access the second distributed ledger 320 of the permissioned blockchain network 300 by the administrator server 100. When test supervision request information is acquired (S302), test supervision content corresponding to the test supervision request information is obtained from a storage device (S303), and a first test supervision screen displaying at least a portion of the test supervision content is displayed to the test supervisor. Provided to the terminal 700 (S304) so that the test supervisor terminal 700 can supervise the test (S305), and to record the detected misconduct detected during the test from the test supervisor terminal 700 When the fraud detection content transaction is broadcast to the permissioned blockchain network 300 (S306), the validity of the fraud detection content transaction is checked (S307), and when the fraud detection content transaction is confirmed to be valid, the fraud detection The content transaction may be registered in the second distributed ledger 320 of the permissioned blockchain network 300 (S308). Here, the cheating content transaction may include the cheating detection content and the public key generated by the test supervisor terminal 700, and in addition, a signature value obtained by signing the cheating detection content with the private key of the test supervisor device 700. However, a nonce and a signature value obtained by signing the nonce with a private key of the test supervisor terminal 700 may be included.

Here, in order to protect the privacy of test takers and improve the reliability of the above test supervision system for non-face-to-face online exams, the present invention allows a blind open monitoring system to be applied together as needed in addition to the above test supervision system.

When the blind open monitoring system is additionally applied, the online test server 200 inputs guest IDs and passwords only for the limited number of people on a first-come, first-served basis through prior notice for guest user terminals that are not registered as test supervisor terminals 700. A second test supervisor screen may be provided to a guest user terminal permitted as an additional test supervisor so as to be able to view a second test supervisor screen displaying at least a part of the test supervisor content while the test is being conducted as an additional test supervisor. . However, in the case of the blind open monitoring system, to protect the privacy of the test takers, additional test supervisors may use methods such as processing the video among the video, audio, and manipulation logs as confidential. 5 shows an example of a second test supervision screen provided to an additional test supervisor in such a blind open monitoring system.

Meanwhile, a method for managing an instructor or an automatic scoring manager who scores an answer sheet to prevent cheating after a test will be described with reference to FIGS. 6 and 7 .

First, the permissioned blockchain network manager server 100 may set a second instructor institution capable of accessing the second distributed ledger 320 of the permissioned blockchain network 300 (S401). Here, the second instructor organization registered in the permissioned blockchain network 300 refers to the automatic scoring manager terminal 800 and the instructor terminal 900, and the information on the second instructor organization includes server-related information of the second instructor organization. Information, an automatic grading manager belonging to the second instructor organization, and terminal-related information registered in the second instructor organization of each instructor may be included. In addition, information such as certificate, ID and password, personal information, one-time password, and phone number is required for the second instructor institution server, automatic scoring manager terminal, and instructor terminal to register and access the permissioned blockchain network 300. It can be. Accordingly, the permissioned blockchain network manager server 100 may permit registration and access to the permissioned blockchain network 300 based on the acquired authentication information.

On the other hand, the scoring of the test is performed by automatic scoring performed by the automatic scoring manager terminal 800 comparing the correct answer sheet and the answer sheet, and the instructor terminal 900 performing automatic scoring by comparing the correct answer sheet and the answer sheet, and comments on the scoring result. There may be a method for grading instructors who write and register together.

Accordingly, if the scoring method for a specific test is an automatic scoring method, the online test server 200 accesses the second distributed ledger 320 of the permissioned blockchain network 300 by the administrator server 100. When the automatic scoring request information for the test is obtained from the at least one allowed automatic scoring manager terminal 800 (S402), the automatic scoring request information from the first distributed ledger 310 and the second distributed ledger 320 is received. The content of the test question and the content of the test answer sheet are obtained (S403), and the answer sheet included in the test question content and at least one answer sheet included in the test answer sheet content are provided to the automatic scoring manager terminal 800 (S404). ) Allows the automatic scoring manager terminal 800 to perform automatic scoring of the answer sheet by referring to the answer sheet (S406), and the automatic scoring content transaction for registering the automatic scoring result from the automatic scoring manager terminal 800 is a permissioned block When broadcast to the chain network 300 (S407), the validity of the automatic scoring content transaction is checked (S408). A process of registering in the second distributed ledger 320 (S409) may be performed. Here, the automatic scoring content transaction may include automatic scoring manager contents generated by the automatic scoring manager terminal 800 and a public key, and in addition, a signature value obtained by signing the automatic scoring contents with the private key of the automatic scoring manager terminal 800. Alternatively, a nonce and a signature value obtained by signing the nonce with a private key of the automatic scoring manager terminal 800 may be included.

On the other hand, if the scoring method for a specific test is the instructor scoring method, the online test server 200 has access to the second distributed ledger 320 of the permissioned blockchain network 300 by the administrator server 100. When instructor scoring request information for the test is obtained from at least one instructor terminal 900 allowed (S412), test questions corresponding to the instructor scoring request information from the first distributed ledger 310 and the second distributed ledger 320 The content and the test answer sheet content are obtained (S413), and the question paper and the answer sheet included in the test question content and at least one answer sheet included in the test answer sheet content are provided to the instructor terminal 900 (S414). Instructor scoring content transaction for enabling the terminal 900 to perform automatic scoring and writing comments on the scoring sheet generated by automatic scoring (S416) and registering the instructor scoring result from the instructor terminal 900 is a permissioned blockchain When broadcast to the network 300 (S417), the validity of the instructor-graded content transaction is checked (S418). 2 A process of registering in the distributed ledger 320 (S419) can be performed. Here, the instructor scoring content transaction may include the instructor scoring content generated by the instructor terminal 900 and a signature value signed with the private key of the instructor terminal 900, or a nonce and a public key. Here, the instructor grading content transaction may include the instructor grading content generated by the instructor terminal 900 and the public key, and in addition, a signature value obtained by signing the instructor scoring content with the private key of the instructor terminal 900, a nonce and a nonce. may include a signature value signed with the private key of the instructor terminal 900.

In addition, the online test server 200, in response to the automatic scoring request information for the test obtained from the automatic scoring manager terminal 800 or the instructor scoring request information for the test obtained from the instructor terminal 900, the first distributed ledger 310 and the second distributed ledger 320 to obtain test question content and test answer sheet content, but additionally obtain cheating detection content from the second distributed ledger 320, so that the test included in the cheating detection content When the cheating detection contents for a specific test taker are confirmed by providing the cheating detection contents to the automatic scoring manager terminal 800 or instructor terminal 900 that proceeds with scoring (S405, S415), (i) A process of causing the automatic scoring manager terminal 800 to reflect cheating detection for a specific examinee on the automatic scoring result of the specific examinee's answer sheet (S406), and (ii) causing the instructor terminal 900 to By referring to the cheating detection contents for the cheating detection contents, the result of forgery determination for the video, audio, and manipulation log corresponding to the cheating detection contents is generated, and the cheating detection contents and the forgery determination result are the results of the instructor's scoring on the answer sheet of the specific test taker. At least one of the processes for reflecting on (S416) may be performed.

On the other hand, in the situation where the test and scoring are completed, if the test taker wants to check the test result or the explanation of the test problem, the online test system of the present invention can provide the necessary information to the test taker through the following process. there is.

Scoring results and commentary on the test from the test taker terminal 500 allowed to access the first distributed ledger 310 and the second distributed ledger 320 of the permissioned blockchain network 300 by the administrator server 100 When the reading request information is obtained, the online test server 200 reads the test question content corresponding to the scoring result and commentary reading request information from the first distributed ledger 310 and the scoring result and commentary from the second distributed ledger 320. At least one of automatic scoring content and instructor scoring content corresponding to the requested information is acquired, and (i) the question paper and commentary included in the test question content and (ii) the corresponding automatic scoring result or instructor scoring result are displayed on the examinee's terminal (500 ) so that the scoring results and commentary can be viewed.

Here, the online test server 200 is an examinee's terminal allowed to access the first distributed ledger 310 and the second distributed ledger 320 of the permissioned blockchain network 300 by the administrator server 100 ( 500) allows access to the first distributed ledger 310 and the second distributed ledger 320 only during the period in which the test is in progress and the test result can be checked, which means that the test taker can take the test and This is to block access to the online test system in advance other than to check the test results. In addition, the present invention facilitates control of access authority for each user group by dividing and managing the first distributed ledger 310 and the second distributed ledger 320. For example, the control of access rights to the first distributed ledger 310 prevents anyone except the examiner from having the right to add, modify, or delete the contents recorded in the first distributed ledger 310, so that the contents of the test questions Measures can be taken so that other users other than the presenter cannot influence it.

On the other hand, the online test server 200 synthesizes and analyzes at least one or more scoring results for at least one or more tests taken by each examinee's terminal 500, and at least one or more tests for each examinee's terminal 500. Reports for each subject and test can be generated. These reports for each subject and each test can help the examinee choose a career path or set future study strategies and directions, and the accuracy of the analysis can improve as the examinee takes more types of tests through the online test system. .

8 schematically shows a configuration diagram of service layers of a system for conducting an online test according to an embodiment of the present invention. It may include a service layer, a blockchain layer, a transport protocol layer, and the like.

First, referring to FIG. 8 , the transport protocol layer of the online test system may include a P2P network module, a gRPC service module, and an SSL/TLS encryption/decryption transport module. A blockchain layer that implements blockchain-related functions may be located above the transmission protocol layer, and a smart contract module, an access control module, a consensus module, and a ledger may compose the blockchain layer. Subsequently, a service layer that relays interactions between users of the online test system and the blockchain may be located on top of the blockchain layer, and an online test service module that interworks with a DAPP (Decentralized Application) service module and web application, and a database. A management system (Database Management System; DBMS) module or the like may constitute a service layer. In addition, a user interface layer providing an interface for access to the online test service may be located above the service layer, and a blockchain monitoring module, a REST API service module, and an online test management web browser service module are included in the user interface layer. can be configured. Next, the terminal layer, which can be located on top of the user interface layer, performs an online test in conjunction with a web application module and online test service that enables users to access the user interface layer through a tablet PC, laptop, desktop computer, etc. It may include modules that do.

Here, the permissioned blockchain network 300 may take the form of a Hyperledger Fabric network, etc., and identification used in controlling access rights may use a system such as Membership Service Providers (MSP). . If the permissioned blockchain network is implemented through the Hyperledger Fabric network, the organization of the author, the examinee's organization, and the instructor's organization can be configured by setting and applying configuration files, controlling access rights through certificate issuance for all nodes, You can set up and apply certificate issuance procedures for both administrators and users accessing the network. In addition, the certificate issuance procedure for all nodes, administrators and user modes accessing the network may follow a procedure for issuing an X.509 certificate of a public key infrastructure (PKI) through a certification authority.

In addition to this, the online test system of the present invention connects the blockchain and the online test service and not only records in the block chain, but also manages all the information necessary for the block chain service by linking with the big data database, and the online test service A decentralized application that can implement server-side functions implemented in can be used to implement an online test server.

In addition, the present invention can provide online application services to users, enable linkage with blockchain, and implement prevention and security technologies required for online test systems. Accordingly, the online application service is designed to use the function of managing content such as question papers, answer sheets, problem solving, answer sheets, and scoring sheets, and user interface functions to provide services to users such as administrators, questioners, test takers, supervisors, and instructors. can be configured.

In addition, the present invention is a method of issuing ECC (Elliptic Curve Cryptography) SSL (Secure Sockets Layer) lightweight certificates through a certification authority to improve security in communication between servers, between terminals, or between servers and terminals in an online test system. can also be applied. According to this, the application session key can be generated and used for each application session as a key for E2E (exchange-to-exchange) encryption in encrypted communication between the terminal and the online test gateway, the online test gateway and the blockchain section, and the block chain section. there is. In addition, key exchange uses Elliptic-Curve Diffie-Hellman (ECDH), which is a method of applying Diffie-Hellman key exchange to elliptic curves, and the generated application session key can be updated after session termination.

Embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded on a computer-readable recording medium. The computer readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. media), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter or the like as well as machine language codes such as those produced by a compiler. The hardware device may be configured to act as one or more software modules to perform processing according to the present invention and vice versa.

In the above, the present invention has been described by specific details such as specific components and limited embodiments and drawings, but these are provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , Those skilled in the art to which the present invention pertains may seek various modifications and variations from these descriptions.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and not only the claims described later, but also all modifications equivalent or equivalent to these claims belong to the scope of the spirit of the present invention. will do it

Claims (22)

A method for preventing online test cheating using a permissioned blockchain network,
(a) In a state where test content is registered in the first distributed ledger of the permissioned blockchain network, the online test server, which is one of the nodes constituting the permissioned blockchain network, (i) the permissioned blockchain When the test taker request information for the test question content is obtained from at least one test taker terminal allowed to access the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server managing the network , Obtaining the test question content corresponding to the test application request information from the first distributed ledger, and providing the test paper included in the test question content and the answer writing sheet corresponding thereto to the test taker terminal, so that the test taker terminal When a test answer sheet content transaction for registering the test answer sheet content is broadcast to the permissioned blockchain network from the test taker terminal, the validity of the test answer sheet content transaction is confirmed; , If the test answer sheet content transaction is confirmed to be valid, register the test answer sheet content transaction in the second distributed ledger of the permissioned blockchain network, and register the second distributed ledger of the test answer sheet content transaction registered in the second distributed ledger. 2 Transmitting the test answer sheet content transaction ID indicating the registration location in the distributed ledger to the test taker terminal, so that the test taker terminal registers the test answer sheet content transaction in the second distributed ledger using the test answer sheet content transaction ID. (ii) the administrator server allows access to the second distributed ledger of the permissioned blockchain network from at least some of the video recording device, audio recording device, and test taker terminal. When test supervision content including at least a part of video, audio, and manipulation logs of the test taker's terminal is generated during each test taker's real-time supervision, the test supervisor storing the content in a storage device, checking an integrity check result of the test supervision content when the test is completed, and registering the integrity check result in the second distributed ledger; and
(b) When the online test server obtains test supervision request information for the test from at least one test supervisor terminal allowed to access the second distributed ledger of the permissioned blockchain network by the administrator server obtaining the test supervision content corresponding to the test supervision request information from the storage device, and providing a first test supervision screen displaying at least a part of the test supervision content to the test supervisor terminal, so that the test supervisor terminal When a cheating detection content transaction for recording the cheating detection content detected during the test is broadcast from the test supervisor terminal to the permissioned blockchain network, the cheating detection checking the validity of the content transaction, and registering the fraud detection content transaction in the second distributed ledger of the permissioned blockchain network if it is confirmed that the fraud detection content transaction is valid;
How to include. According to claim 1,
Before step (a),
(a0) A test question content transaction for registering the test question content from at least one examiner terminal allowed to access the first distributed ledger of the permissioned blockchain network by the administrator server When broadcast to the network, the online exam server verifies the validity of the exam question content transaction, and if the test question content transaction is confirmed to be valid, the test question content transaction is sent to the first permissioned blockchain network. It is registered in the distributed ledger, and the test question content transaction ID indicating the registration position in the first distributed ledger of the test question content transaction registered in the first distributed ledger is transmitted to the examiner terminal, so that the test examiner terminal can determining whether the test question content transaction is registered in the first distributed ledger by using the test question content transaction ID;
A method characterized in that it further comprises. According to claim 1,
After step (b),
(c) the online test server, (i) a request for automatic scoring for the test from at least one automatic scoring manager terminal allowed to access the second distributed ledger of the permissioned blockchain network by the administrator server When the information is obtained, the test question content and the test answer sheet content corresponding to the automatic scoring request information are obtained from the first distributed ledger and the second distributed ledger, respectively, and the answer sheet included in the test question content and the corresponding answer sheet are obtained. To provide at least one or more answer sheets included in the test answer sheet content to the automatic scoring manager terminal so that the automatic scoring manager terminal can perform automatic scoring of the answer sheet by referring to the answer sheet, and from the automatic scoring manager terminal When an auto-scoring content transaction for registering auto-scoring content is broadcast to the permissioned blockchain network, the validity of the auto-scoring content transaction is checked, and if the auto-scoring content transaction is confirmed to be valid, the auto-scoring content transaction A process of registering the second distributed ledger in the permissioned blockchain network, and (ii) at least one instructor terminal allowed access to the second distributed ledger of the permissioned blockchain network by the manager server. When instructor scoring request information for the test is obtained from the first distributed ledger and the second distributed ledger, the test question content and the test answer sheet content corresponding to the instructor scoring request information are obtained, respectively, and the test question Question papers and answer sheets included in content, and correspondingly, at least one or more answer sheets included in the content of the test answer sheet are provided to the instructor terminal, so that the instructor terminal writes comments on the automatic scoring and scoring sheets generated by the automatic scoring. and the instructor-graded content transaction for registering the instructor-graded content from the instructor terminal is transferred to the permissioned blockchain network. If broadcast, the validity of the instructor-graded content transaction is confirmed, and if the instructor-graded content transaction is confirmed to be valid, at least one of the processes of registering the instructor-graded content transaction in the second distributed ledger of the permissioned blockchain network. performing either;
A method characterized in that it further comprises. According to claim 1,
The online test server allows the test taker terminal, which is allowed to access the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server, the period during which the test is in progress and the test result. characterized in that allowing access to the first distributed ledger and the second distributed ledger only during a period in which According to claim 1,
The operation log of the examinee's terminal includes (i) site information accessed by the examinee's terminal and corresponding timestamp information, (ii) application identifier information accessed by the examinee's terminal and corresponding timestamp information, (iii) Characterized in that cheating of the test taker is tracked by generating identifier information for the shortcut key input by the test taker's terminal and corresponding timestamp information, and (iv) IP address accessed by the test taker's terminal and corresponding timestamp information. How to. According to claim 5,
The operation log of the examinee's terminal additionally includes timestamp information for a time when a click was performed, item identifier information selected by the click corresponding to the timestamp, and view identifier information, and a specific item identifier among the item identifier information. Second view identifier information and a second timestamp in a state in which the first view identifier information and the first timestamp among a plurality of view identifier information belonging to the information are matched and inputted - the second timestamp is temporal to the first timestamp followed by - is input in correspondence with, the priority of the second view identifier information and the second timestamp is set higher than the priority of the first view identifier information and the first timestamp. method. According to claim 1,
The online test server obtains the storage location of the image generated from the video recording device and stored in the storage device and a hash value generated corresponding to the image to generate the integrity check result, and the integrity check result Registering in the second distributed ledger of the permissioned blockchain network. According to claim 1,
In step (b),
The online test server receives guest IDs and passwords only for a limited number of people on a first-come, first-served basis through prior notice to guest user terminals that are not registered as test supervisor terminals, and the test supervisor content while the test is in progress as an additional test supervisor. and providing the second test supervision screen to the guest user terminal permitted as the additional test supervisor so that the second test supervisor screen displaying at least a part of the test supervisor can be viewed. According to claim 3,
The online test server, in response to the automatic scoring request information for the test obtained from the automatic scoring manager terminal or the instructor scoring request information for the test acquired from the instructor terminal, is configured to connect the first distributed ledger and the first distributed ledger to the first distributed ledger and the first distributed ledger. 2 Obtain the test question content and the test answer sheet content from the distributed ledger, and additionally obtain the cheating detection content from the second distributed ledger, so that the cheating detection content for the test included in the cheating detection content is provided to the automatic scoring manager terminal or the instructor terminal that performs the automatic scoring, and when the detection of cheating for a specific examinee in the test is confirmed, (i) the automatic scoring manager terminal causes the specific examinee to A process of reflecting the cheating detection contents for the specific examinee in the automatic scoring contents on the answer sheet of the specific examinee, and (ii) the instructor terminal detecting the cheating by referring to the cheating detection contents for the specific examinee. To generate forgery and falsification determination results for the video, audio, and manipulation log corresponding to the contents, and to reflect the misconduct detection contents and the forgery and falsification determination results to the instructor scoring contents for the specific examinee's answer sheet A method comprising performing at least one of the processes. According to claim 3,
The online test server is allowed to access the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server, scoring results for the test and commentary reading request information from the test taker terminal. is obtained, the test question content corresponding to the scoring result and commentary reading request information from the first distributed ledger, and the automatic scoring content and instructor corresponding to the scoring result and commentary reading request information from the second distributed ledger. At least one of the scoring content is acquired, and (i) the question paper and commentary included in the test question content and (ii) the automatic scoring content or the instructor scoring content corresponding thereto are provided to the test taker's terminal to determine the scoring result and A method characterized in that the reading of the commentary is possible. According to claim 3,
The online test server aggregates and analyzes at least one or more scoring results for at least one or more tests taken by each of the examinee terminals, and for each subject terminal corresponding to the at least one or more tests, the test A method characterized by generating star statistical figures. In an online test server that prevents online test cheating by using a permissioned blockchain network,
memory for storing instructions; and
comprising at least one processor configured to perform the instructions;
The processor, (1) in a state in which test content is registered in the first distributed ledger of the permissioned blockchain network, (i) the permissioned blockchain network by the administrator server managing the permissioned blockchain network. When test-taking request information for the test question content is obtained from at least one test taker terminal allowed to access the first distributed ledger and the second distributed ledger, the test-taking request information corresponding to the test-taking request information from the first distributed ledger The test question content is acquired, and a test paper included in the test question content and an answer sheet corresponding thereto are provided to the examinee's terminal so that the test taker's terminal can perform a test on the test question content. When a test answer sheet content transaction for registering test answer sheet content from a terminal is broadcast to the permissioned blockchain network, the validity of the test answer sheet content transaction is checked, and when the test answer sheet content transaction is confirmed to be valid, the test answer sheet content transaction is confirmed to be valid. A content transaction is registered in the second distributed ledger of the permissioned blockchain network, and an exam answer sheet content transaction ID indicating a registration position in the second distributed ledger of the test answer sheet content transaction registered in the second distributed ledger is provided. By transmitting to the test taker's terminal, the test taker's terminal can use the test answer sheet content transaction ID to check whether the test answer sheet content transaction is registered in the second distributed ledger, (ii) to the manager server. During the test for real-time supervision of the test taker, the video, audio, and the When test supervision content including at least a part of the operation log of the examinee's terminal is generated, the test supervision content is stored in a storage device, and when the test is completed, the test supervision console A process of checking the integrity check result of contents and registering the integrity check result in the second distributed ledger, and (2) access to the second distributed ledger of the permissioned blockchain network is allowed by the administrator server When the test supervision request information for the test is obtained from at least one test supervisor terminal, the test supervision content corresponding to the test supervision request information is obtained from the storage device, and at least a portion of the test supervision content is displayed. 1 A test supervision screen is provided to the test supervisor's terminal so that the test supervisor's terminal can supervise the test, and cheating detection for recording cheating detection content detected during the test from the test supervisor's terminal When a content transaction is broadcast to the permissioned blockchain network, the validity of the fraud-detection content transaction is checked, and if the fraud-detection content transaction is confirmed to be valid, the fraud-detection content transaction is sent to the permissioned blockchain network. An online test server executing the above instructions to perform a process of registering with the second distributed ledger of the network. According to claim 12,
the processor,
Prior to the above (1) process,
A test question content transaction for registering the test question content is broadcast to the permissioned blockchain network from at least one question maker terminal allowed to access the first distributed ledger of the permissioned blockchain network by the administrator server. If cast, the validity of the test question content transaction is checked, and if it is confirmed that the test question content transaction is valid, the test question content transaction is registered in the first distributed ledger of the permissioned blockchain network, and the first distributed ledger is registered. The test question content transaction ID indicating the registration position of the test question content transaction registered in the distributed ledger in the first distributed ledger is transmitted to the examiner terminal, so that the test question content transaction ID is used by the test question content transaction ID. The online test server, characterized in that further performing a process for confirming whether the test question content transaction is registered in the first distributed ledger. According to claim 12,
the processor,
After the process (2) above,
(3) (i) When automatic scoring request information for the test is obtained from at least one automatic scoring manager terminal allowed to access the second distributed ledger of the permissioned blockchain network by the administrator server, the The test question content and the test answer sheet content corresponding to the automatic scoring request information are obtained from the first distributed ledger and the second distributed ledger, respectively, and the answer sheet included in the test question content and the test answer sheet content corresponding thereto are obtained. Providing at least one included answer sheet to the automatic scoring manager terminal so that the automatic scoring manager terminal can perform automatic scoring of the answer sheet by referring to the answer sheet, and registering automatic scoring content from the automatic scoring manager terminal When an auto-scoring content transaction is broadcast to the permissioned blockchain network, the validity of the auto-scoring content transaction is checked, and if the auto-scoring content transaction is confirmed to be valid, the auto-scoring content transaction is sent to the permissioned blockchain network. A process of registering in the second distributed ledger of the network, and (ii) an instructor for the test from at least one instructor terminal allowed access to the second distributed ledger of the permissioned blockchain network by the administrator server. When the scoring request information is acquired, the test question content and the test answer sheet content corresponding to the instructor scoring request information are acquired from the first distributed ledger and the second distributed ledger, respectively, and the test question content and An answer sheet, and correspondingly, at least one or more of the answer sheets included in the test answer sheet contents are provided to the instructor terminal so that the instructor terminal can perform the automatic scoring and comment writing on the scoring sheet generated by the automatic scoring, , When an instructor-graded content transaction for registering instructor-graded content is broadcast from the instructor terminal to the permissioned blockchain network, the professor Checking the validity of the student-graded content transaction, and if the instructor-graded content transaction is confirmed to be valid, performing at least one of the processes of registering the instructor-graded content transaction in the second distributed ledger of the permissioned blockchain network An online test server, characterized in that. According to claim 12,
the processor,
During the period during which the test is in progress and the test result can be checked, the test-taker terminal allowed to access the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server Online test server, characterized in that to allow access to the first distributed ledger and the second distributed ledger only. According to claim 12,
The operation log of the examinee's terminal includes (i) site information accessed by the examinee's terminal and corresponding timestamp information, (ii) application identifier information accessed by the examinee's terminal and corresponding timestamp information, (iii) Identifier information for the shortcut input by the test taker's terminal and corresponding timestamp information, and (iv) IP address accessed by the test taker's terminal and corresponding timestamp information are additionally generated to track cheating of the test taker. Online test server with . According to claim 16,
The operation log of the examinee's terminal additionally includes timestamp information for a time when a click was performed, item identifier information selected by the click corresponding to the timestamp, and view identifier information, and a specific item identifier among the item identifier information. Second view identifier information and a second timestamp in a state in which the first view identifier information and the first timestamp among a plurality of view identifier information belonging to the information are matched and inputted - the second timestamp is temporal to the first timestamp followed by - is input in correspondence with, the priority of the second view identifier information and the second timestamp is set higher than the priority of the first view identifier information and the first timestamp. Online test server. According to claim 12,
the processor,
A storage location of the image generated from the video recording device and stored in the storage device and a hash value generated corresponding to the image are obtained to generate the integrity check result, and the integrity check result is stored in the permissioned blockchain network. Online test server, characterized in that for registering in the second distributed ledger of. According to claim 12,
the processor,
In the process (2) above,
Guest user terminals that are not registered as test supervisor terminals receive guest IDs and passwords only for the limited number of people on a first-come, first-served basis through prior notice, and display at least some of the test supervisor content while the test is in progress as an additional test supervisor and providing the second test supervision screen to the guest user terminal permitted as the additional test supervisor so that the second test supervision screen can be viewed. According to claim 14,
the processor,
The test from the first distributed ledger and the second distributed ledger in response to the automatic scoring request information for the test obtained from the automatic scoring manager terminal or the instructor scoring request information for the test obtained from the instructor terminal The problem content and the test answer sheet content are obtained, but the cheating detection content is additionally obtained from the second distributed ledger, and the cheating detection content for the test included in the cheating detection content is automatically scored. provided to the automatic grading manager terminal or the instructor terminal, and when the cheating detection contents for a specific examinee of the test are confirmed, (i) the automatic scoring manager terminal causes the cheating detection contents for the specific examinee and (ii) the video corresponding to the detected misbehavior content by referring to the misbehavior detected content for the specific examinee, and (ii) having the instructor terminal refer to the misbehavior detected content for the specific examinee. , At least one of the processes of generating a forgery or alteration determination result for the voice and the manipulation log, and reflecting the misconduct detection content and the forgery or alteration determination result in the instructor scoring contents for the specific examinee's answer sheet. Online test server, characterized in that for performing. According to claim 14,
the processor,
When the scoring result for the test and commentary reading request information are obtained from the test-taker terminal allowed to access the first distributed ledger and the second distributed ledger of the permissioned blockchain network by the administrator server, the first distributed ledger of the permissioned blockchain network is obtained. 1 At least one of the test question content corresponding to the scoring result and commentary reading request information from the distributed ledger and the automatic scoring content and the instructor scoring content corresponding to the scoring result and commentary reading request information from the second distributed ledger (i) the question paper and commentary included in the test content, and (ii) the automatic scoring content or the instructor scoring content corresponding thereto are provided to the test taker terminal so that the scoring result and the commentary can be viewed. An online test server characterized in that it enables. According to claim 14,
the processor,
By synthesizing and analyzing at least one or more scoring results for at least one or more tests taken by each of the examinee's terminals, generating statistical values for each subject and each test corresponding to the at least one or more tests for each of the examinee's terminals An online test server, characterized in that.

Images