KR102221228B1 - Method for provide coding tests and scoring algorithms - Google Patents

Abstract

The present invention provides a UI that can conveniently generate various types of coding test problems to a tester's terminal, and provides different scoring UIs according to the problem UI, thereby providing an algorithm capable of performing various types of coding tests. have. In addition, it is possible to provide an algorithm capable of detecting fraudulent behavior by performing authentication for testers and checking source code similarity when scoring coding tests.

Description

How to provide coding test and scoring algorithm {METHOD FOR PROVIDE CODING TESTS AND SCORING ALGORITHMS}

The present invention relates to a method of providing a coding test and scoring algorithm, and more particularly, by providing a problem UI and a scoring UI for a coding test to a tester terminal, receiving a corresponding input value from the tester terminal, and performing a coding test. It relates to a method of providing to a terminal.

Due to convenience or distance, an increasing number of online education and evaluation users are demanding advanced evaluation fairness, and cheating, which may occur once, undermines test fairness and causes misunderstandings of discomfort for test takers and test takers. Several methods have been proposed to ensure fairness and reliability of the company.

Current questionnaires (especially cyber colleges) regard attempts to use other programs as warning measures or fraudulent behavior through the method of disabling or enabling the use of function keys and recording the use of function keys during the online evaluation, and the function key use detection function. As a means of securing data for this purpose, or by continuously changing testing systems and evaluation methods, they are passively responding to expected misconduct.

In other words, in the case of taking the online test so far, various methods have been proposed to verify the identity of the person. However, there is no way to detect or limit misconduct, such as an examinee searching for an answer while taking an online test or teaching someone the answer to a question submitted online, so the fairness of the online test could not be properly established. .

Registered Patent Publication No. 10-1846702 (Title: Programming Education System and Programming Education Method, Announcement Date: April 9, 2018 Announcement)

The present invention is to solve the problems of the prior art described above, and provides a problem UI for questioning various types of problems to a tester terminal, providing a scoring UI for scoring it, and providing authentication information from the tester terminal. The purpose is to receive it and provide it to the certified tester's terminal.

In addition, the purpose of this is to provide a method of detecting the tester's fraudulent behavior through source code similarity check.

As a technical means for achieving the above-described technical problem, according to an embodiment of the present invention, a method for providing a coding test and scoring algorithm performed by a server includes: (a) receiving a request for generating a coding test from a tester terminal. step; (b) receiving authentication information for one or more tester terminals to provide the coding test from the tester terminal; (c) receiving an input value corresponding to a problem UI (User Interface) and a scoring UI (User Interface) from the tester terminal; (d) generating a question according to the input value, and providing an invitation notification to a tester terminal designated by the tester terminal; Including, wherein in step (c), the problem UI and the scoring UI are differently generated according to the input value, and the coding test may include one or more of the problem UI and the scoring UI.

Further, according to an embodiment of the present invention, a server performing a coding test and scoring algorithm providing method includes: a memory storing a coding test and scoring algorithm providing program; And a processor executing the program, wherein the processor receives a request for generating a coding test from a tester terminal according to the execution of the program, and for one or more tester terminals to provide the coding test from the tester terminal. Receiving authentication information, receiving an input value corresponding to the problem UI and the scoring UI from the tester terminal, generating a problem according to the input value, and providing an invitation notification to the tester terminal designated by the tester terminal, According to the input value, the problem UI and the scoring UI are generated differently, and the coding test may include one or more of the problem UI and the scoring UI.

The present invention provides a UI that can conveniently generate various types of coding test problems to a tester's terminal, and provides different scoring UIs according to the problem UI, thereby providing an algorithm capable of performing various types of coding tests. have.

1 is a structural diagram of a system for performing a method of providing a coding test and scoring algorithm according to an embodiment of the present invention.
2 is an exemplary view of a UI for inputting authentication information in a method for providing a coding test and scoring algorithm according to an embodiment of the present invention.
3 is an exemplary diagram of a scratch problem UI in a method of providing a coding test and scoring algorithm according to an embodiment of the present invention.
4 is an exemplary diagram of a source code similarity check UI of a method for providing a coding test and scoring algorithm according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing a coding test and scoring algorithm according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in a number of different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

In the present specification, the "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized by using two or more hardware, or two or more units may be realized by one piece of hardware. Meanwhile,'~ unit' is not meant to be limited to software or hardware, and'~ unit' may be configured to be in an addressable storage medium or configured to reproduce one or more processors. Thus, as an example,'~ unit' refers to components such as software components, object-oriented software components, class components and task components, processes, functions, properties, and procedures. , Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays and variables. Components and functions provided in the'~ units' may be combined into a smaller number of elements and'~ units', or may be further separated into additional elements and'~ units'. In addition, components and'~ units' may be implemented to play one or more CPUs in a device or a security multimedia card.

The "terminal" mentioned below may be implemented as a computer or portable terminal that can access a server or other terminal through a network. Here, the computer is, for example, a notebook equipped with a web browser, a desktop, a laptop, a VR HMD (for example, HTC VIVE, Oculus Rift, GearVR, DayDream, PSVR, etc.). It may include. Here, VR HMD is for PC (for example, HTC VIVE, Oculus Rift, FOVE, Deepon, etc.), for mobile (for example, GearVR, DayDream, Storm Horse Racing, Google Cardboard, etc.) and console (PSVR) and It includes all stand alone models that are implemented independently (eg, Deepon, PICO, etc.). Portable terminals are, for example, wireless communication devices that ensure portability and mobility, as well as smart phones, tablet PCs, and wearable devices, as well as Bluetooth (BLE, Bluetooth Low Energy), NFC, RFID, and ultrasound. , Infrared, Wi-Fi, Li-Fi may include various devices equipped with a communication module such as. In addition, "network" refers to a connection structure in which information exchange is possible between nodes such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), and the Internet. (WWW: World Wide Web), wired and wireless data networks, telephone networks, wired and wireless television networks, etc. Examples of wireless data networks include 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, Bluetooth communication, infrared communication, and ultrasound. Communication, Visible Light Communication (VLC), LiFi, and the like are included, but are not limited thereto.

Hereinafter, a system for performing a method for providing a coding test and scoring algorithm according to an embodiment of the present invention will be described in detail with reference to FIG. 1. Meanwhile, hereinafter, “coding” and “programming” may be defined as terms having the same meaning.

The system 10 for performing a method for providing a coding test and scoring algorithm according to an embodiment of the present invention may include a server 100 and a user terminal 200, and a server 100 and a tester terminal ( 200) and the tester's terminal 300 may be connected to each other through a network.

The server 100 for performing a method for providing a coding test and scoring algorithm according to an embodiment of the present invention includes a memory storing a coding test and scoring algorithm providing program and a processor for executing the program. Depending on the execution, receiving a request to create a coding test from the tester terminal, receiving authentication information for one or more tester terminals to provide a coding test from the tester terminal, and from the tester terminal, the question UI (User Interface) and scoring UI Receives an input value corresponding to (User Interface), generates a question according to the input value, and provides an invitation notification to the tester's terminal designated by the tester's terminal, but the problem UI and the scoring UI are generated differently according to the input value. And the coding test may include one or more question UI and scoring UI.

According to an embodiment of the present invention, the tester terminal 200 for performing a method of providing a coding test and scoring algorithm may be a device possessed by the tester or a computing device installed in a specific place, and coding test and scoring Algorithm providing program may be installed.

The tester terminal 200 may receive a problem UI (User Interface) and a scoring UI from the server 100, and may provide the tester's input as an input value to the server.

In addition, the tester terminal 200 may be a terminal logged in with the tester's account, and it may be possible to generate a coding test by using a problem previously stored in the server.

As a further embodiment of the present invention, the contents of the problem and scoring generated from the tester terminal 200 through the problem UI and the scoring UI provided by the server 100 are disclosed or privately selected by the tester terminal 200. It may be set, and if it is set to be public, the server 100 may store the content of the problem and scoring in the server 100 and share it with other previously registered tester terminals.

That is, whether or not to disclose the problem UI and problem information may be received from the tester terminal, and when the problem UI is disclosed, the input value may be shared with the other tester terminal.

In this case, the problem information may be information including any one or more of a title, a difficulty level, a source, a classification, a problem description, and an intention to present a question.

At this time, the problem UI may include problem information, and may be composed of information including any one or more of title, difficulty, source, classification, problem description, and questionnaire intention.

In accordance with an embodiment of the present invention, the tester's terminal 300 for performing a method of providing a coding test and scoring algorithm may be a device possessed by the tester or a computing device installed in a specific place, and the coding test and scoring algorithm The provided program may be installed.

Even if the tester terminal 300 does not have a coding test and scoring algorithm providing program installed, when the authentication information provided from the tester terminal 200 by the server 100 matches the information input from the tester terminal 300, coding You can do the test.

As a further embodiment of the present invention, the server 100 may provide a coding test by designating a gaze time.

The same time zone can be provided on the same day for all tester terminals, and only the same test time zone can be designated and provided.

For example, it may be possible to provide the same to all tester terminals 300 by designating a specific date and time as'December 31, 2018 14:00 to 16:00'. Alternatively, the test time is limited to 2 hours, so that you can take the test at a desired time slot, but only the limited time may be set to 2 hours.

The above-described time zone is a limitation for explaining an additional embodiment of the present invention, and specific date and time settings and gaze time zones may be differently applied according to the settings of the examinee terminal 200.

Hereinafter, a method of providing a coding test and scoring algorithm according to an embodiment of the present invention will be described in detail with reference to FIG. 5.

The server 100 performing a method for providing a coding test and scoring algorithm according to an embodiment of the present invention may receive a request for generating a coding test from the tester terminal 200 (S410).

Thereafter, authentication information for one or more tester terminals 300 to provide a coding test may be received from the tester terminal 200 (S420).

Step (S420) is a step of inviting or designating the tester terminal 300 to be provided with the problem of the coding test, and in the case of the tester terminal 300 previously registered in the server 100, account information of the tester terminal 300 Can be authentication information.

In this case, the authentication information may include any one or more of a name, ID, phone number, and e-mail corresponding to the tester's terminal 300 registered in the server 100.

According to an embodiment of the present invention, the server 100 may generate a link address that can receive a coding test problem in order to invite an unregistered user as a tester, and provide it to the tester terminal 200 have.

When the tester terminal 300 is not registered in the server 100, the authentication information includes an email and name corresponding to the tester terminal 300, but among the test number and password according to the selection of the tester terminal 200 Any one or more may be further included, and authentication information may be set.

As shown in FIG. 2, only an e-mail and a name may be input, and additional information may be input or a file may be uploaded.

That is, according to the selection of the tester terminal 200, authentication information may be determined, and the authentication information may be an authentication key through which the tester terminal 300 can receive a coding test.

As a further embodiment of the present invention, one invitation URL including link information for the coding test may be generated for one coding test or the number of URLs corresponding to the tester's terminal 300 may be generated.

That is, when a plurality of testers exist for one coding test, the same one URL may be provided to the plurality of tester terminals 300 by selection of the tester terminal 300, and different URLs may be provided. have.

Thereafter, according to an embodiment of the present invention, the server 100 may receive an input value corresponding to the problem UI and the scoring UI from the tester terminal (S430).

At this time, when receiving a selection input for any one or more of a plurality of other questionnaire terminals pre-registered in the server 100 from the questioner terminal 200, authentication for the coding test from at least one other questionnaire terminal corresponding to the selection input In order to enable reception of information and input values, a plurality of tester terminals may correspond to one coding test.

That is, it is possible to add a joint questionnaire, and in this case, the additional collaborative questionnaire may be possible only for other questionnaire terminals previously registered in the server 100.

In step (S430), the input value may be one or more types of scratch, entry, general programming, unit test, web service, application development, HTML, CSS, and JS, and according to the input value, the problem UI and the scoring UI are It can be produced differently.

Hereinafter, a problem UI and a scoring UI according to an input value will be described in detail.

When the type of the input value is either a scratch or an entry, an input for a basic script and an object configuration may be received from the tester terminal 200.

The basic script and object configuration received from the tester terminal 200 may be provided from the beginning when the tester terminal 300 is connected. In this case, the provided UI may be provided with a UI as shown in FIG. 3.

When the type of the input value is general programming, guide information to be provided to the tester terminal 300 may be received from the tester terminal 200.

At this time, the guide information is text information provided before the answer is written in the answer area in which the source code can be entered, and is information on any one or more of the modification, addition, and contents of the source code provided to the tester's terminal 300. The scoring is based on whether the input and output values for each item constituting the answer received from the tester's terminal 300 are satisfied, but the correct answer for each item is already stored and the score ratio is different for each item. It is applied and can be performed based on the sum of the scores for each item based on the score ratio.

That is, a language available for problem solving may be received from the tester terminal 200 and a basic example code may be received.

In this case, the questioner terminal 200 may provide a code by writing it with an editor or through a file upload.

The server 100 may provide a general programming scoring UI and receive information on the number of input and output values, input values for each case, output values and ratios from the scoring UI from the tester terminal 200.

When the type of the input value is a unit test, a selection input for any one programming language among JUnit, CUnit, and PyUnit is received from the tester terminal 200, and the problem type of any one of a scoring problem, a submission problem, and an execution problem is received. Can receive selection input.

That is, a language available for problem solving from the questioner terminal 200 may be received and a basic example code may be received, and the usable language may be any one of JUnit, CUnit, and PyUnit. Additionally, you can receive optional inputs for version, build and run options in the language settings.

The above-described JUnit, CUnit, and PyUnit are limited to explain an embodiment of the present invention, and since all languages for the unit test framework may be used, they are not limited thereto.

Thereafter, from the tester terminal 200, a selection input for the version of the framework is received, a test function is received, and the test method recognizes the test function to perform scoring, and the reflection rate for each test method is determined by the tester. It may be determined differently according to the input of the terminal 200.

As a further embodiment of the present invention, when performing scoring in a test method, an option for a test result may be set.

That is, by designating whether or not to provide a message for a test result failure case to the tester terminal 300, a message regarding the test failure case may be provided to the tester terminal 300.

When the type of the input value is any one of web service, application development, HTML, CSS, and JS, a project file composed of a plurality of files may be received from the submitter terminal 200.

In this case, application development may be any one of development across the entire range of services/applications such as web services, web applications, desktop applications, and mobile applications.

That is, a project file consisting of a plurality of files is received from the tester terminal 200, but a file that can be modified by the tester terminal 300 among the plurality of files may be designated so that only the corresponding file can be modified.

For example, in the case of web services and applications, if they consist of only one file, they cannot take advantage of the strong features unique to web services such as moving between pages through hyperlinks, so unlike other types, multiple source code files can be modified. In order to be able to receive the incomplete web project, which is the basic frame, from the tester terminal 200 in a zip format, and designate a list of files accessible to the tester terminal 200, the tester terminal 300 modifies and completes the corresponding files. It can be provided so that it can be created as a web project.

In addition, the scoring script is received from the tester terminal 200, but the scoring script is a script based on JavaScript and node.js, and can be applied to a UI test framework.

That is, the scoring UI can calculate the score by performing scoring using the Web UI test code input by the applicant. In the case of the submission mode, the source code written by the applicant is submitted and provided to the applicant terminal 200. You can make it accessible.

The Web UI test code used for scoring uses a public API such as Nightwatch.JS, and details about this are obvious to those skilled in the art, and detailed descriptions will be omitted.

According to an embodiment of the present invention, the problem UI included in the coding test may further include UIs for O, X problems, short answer problems, multiple choice problems, line drawing problems, narrative problems, and file submission problems in addition to the types described above. have.

The server 100 may generate a coding test including one or more of the generated problem UIs according to the request of the questioner terminal 200.

That is, the coding test may consist of one or more problem UIs and one or more scoring UIs.

Thereafter, the server 100 may generate a question according to the input value and provide an invitation notification to the tester terminal 300 designated by the tester terminal 200 (S440).

That is, the server 100 according to an embodiment of the present invention may generate an invitation URL and provide an invitation notification by e-mail corresponding to the tester's terminal 300.

In this case, one invitation URL including link information for the coding test may be generated for one coding test or a number of URLs corresponding to the tester's terminal 300 may be generated.

As a further embodiment of the present invention, the coding test provided to the tester's terminal 300 is through the display of the tester's terminal 300, if a problem occurs during the test or changes in operation, the tester in real time A message may be provided to the terminal 300.

After step (S440), a plurality of answers to the coding test are received and scored from the plurality of tester terminals 300, but a source code similarity check is performed on the plurality of answers submitted by the plurality of tester terminals to detect fraudulent behavior. can do.

At this time, the source code similarity check may be to detect an answer having a similarity greater than or equal to a preset ratio, and the similarity is calculated based on the same degree of text constituting the answer, and the ratio is each coded by the submitter terminal. It can be set differently depending on the test.

As shown in FIG. 4, code comparison may be performed through a source code similarity check.

That is, it is possible to compare how similar the answers are between the plurality of tester terminals 300 that provided the answer to the corresponding coding test, and this can be a criterion for determining whether or not the coding test is cheated.

The ratio of the similarity of the answer may be provided from the questioner terminal 200, and may be applied differently to a problem in each coding test.

As a further embodiment of the present invention, when the tester's terminal 300 provides an environment in which photographing such as a web cam is possible, it may be photographed according to a preset time and provided to the server 100.

The server 100 can check the examination details of the tester based on the provided photo, and when an abnormal behavior is detected, it can leave a marking on the photo, which can be evidence for detection of fraudulent behavior. .

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

Although the methods and systems of the present invention have been described in connection with specific embodiments, some or all of their components or operations may be implemented using a computer system having a general-purpose hardware architecture.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that other specific forms can be easily modified without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

10: system 100: server
200: tester terminal 300: tester terminal

Claims (16)

In the method of providing a coding test and scoring algorithm performed by a server,
(a) receiving a request for generating a coding test from a tester terminal;
(b) receiving authentication information for one or more tester terminals to provide the coding test from the tester terminal;
(c) receiving an input value corresponding to a problem UI (User Interface) and a scoring UI (User Interface) from the tester terminal;
(d) generating a question according to the input value, and providing an invitation notification to a tester terminal designated by the tester terminal; And
(e) receiving and scoring a plurality of answers to the coding test from a plurality of tester terminals, but performing a source code similarity check on the plurality of answers submitted by the plurality of tester terminals to detect fraud; Including,
The step (c),
According to the input value, the problem UI and the scoring UI are generated differently,
The coding test,
Including one or more of the problem UI and the scoring UI,
Step (c) is
Further comprising the step of receiving information on whether or not to disclose the question UI from the questioner terminal, and after step (d), based on the selection of the questioner terminal, the scoring for the question and the question is made public or private. Set up,
When the question UI is disclosed, the input value is shared with the other questionnaire terminal, and the question information is information including any one or more of title, difficulty, source, classification, problem description, and questionnaire intention,
After step (d)
Determine whether to provide a message for a failed case to the tester's terminal according to the test result, and provide the message to the tester's terminal according to the selection of the tester's terminal,
The step (d) is
By generating an invitation URL, an invitation notification is provided by e-mail corresponding to the tester terminal, and the invitation URL including link information for the coding test is generated, respectively, different invitation URLs corresponding to the number of tester terminals. To do,
How to provide coding testing and scoring algorithms.
The method of claim 1,
If the tester's terminal is not registered in the server,
The authentication information,
Including an email and a name corresponding to the tester terminal, but further comprising any one or more of an examination number and a password according to the selection of the tester terminal,
How to provide coding testing and scoring algorithms.
delete The method of claim 1,
If the tester's terminal is already registered in the server,
The authentication information,
To include any one or more of the name, ID, phone number, and e-mail corresponding to the tester's terminal registered in the server,
How to provide coding testing and scoring algorithms.
The method of claim 1,
One coding test corresponds to one tester's terminal,
The step (c),
When receiving a selection input for any one or more of a plurality of other questionnaire terminals pre-registered in the server from the questionnaire terminal,
The method further comprising the step of correlating a plurality of tester terminals to one coding test to enable reception of the authentication information and the input value for the coding test from one or more other tester terminals corresponding to the selection input. ,
How to provide coding testing and scoring algorithms.
delete The method of claim 1,
The input value is,
For one or more types of scratch, entry, general programming, unit testing, web services, application development, HTML, CSS, and JS,
How to provide coding testing and scoring algorithms.
The method of claim 7,
If the type of the input value is any one of scratch and entry,
The step (c),
It further comprises the step of receiving an input for the basic script and object configuration from the tester terminal,
How to provide coding testing and scoring algorithms.
The method of claim 7,
If the type of the input value is general programming,
The step (c),
Further comprising the step of receiving guide information to be provided to the tester terminal from the tester terminal,
The guide information above,
Text information provided before the answer is written in the answer area where the source code can be entered, and is information on any one or more of the modification, addition, and contents of the source code provided to the tester's terminal,
The scoring is based on whether the input and output values for each item constituting the answer received from the tester's terminal are satisfied, but the correct answer for each item is previously stored, and the score ratio is applied differently according to each item. And, which is performed based on the sum of the scores for each item based on the score ratio,
How to provide coding testing and scoring algorithms.
The method of claim 7,
If the type of the input value is a unit test,
The step (c),
Receiving a selection input for any one programming language of JUnit, CUnit, and PyUnit from the tester terminal, and receiving a selection input for any one problem type of a scoring problem, a submission problem, and an execution problem. ,
How to provide coding testing and scoring algorithms.
The method of claim 7,
When the type of the input value is any one of web service, application development, HTML, CSS, and JS,
The step (c),
Further comprising the step of receiving a project file consisting of a plurality of files from the tester terminal,
The plurality of files,
The tester's terminal is provided in a form that can be viewed and modified,
The application development,
To be any one of a web application, a desktop application, and a mobile application,
How to provide coding testing and scoring algorithms.
The method of claim 11,
The step (c),
Further comprising the step of receiving a scoring script from the tester terminal,
The above scoring script,
It is applied to the UI test framework, and is a script used in the UI test framework,
How to provide coding testing and scoring algorithms.
delete The method of claim 1,
The source code similarity check,
It is to detect an answer with a similarity greater than or equal to a preset ratio,
The similarity is calculated based on the same degree of text constituting the answer,
The ratio is set differently according to each coding test by the applicant terminal,
How to provide coding testing and scoring algorithms.
The method of claim 1,
The source code similarity check,
It is to detect an answer with a similarity greater than or equal to a preset ratio,
The similarity is calculated based on the same degree in the structure, order of operation, and algorithm of the source code constituting the answer,
The ratio is set differently according to each coding test by the applicant terminal,
How to provide coding testing and scoring algorithms.
In the server that performs a coding test and scoring algorithm provision method,
A memory in which a program for providing coding test and scoring algorithms is stored; And
Including a processor that executes the program,
The processor according to the execution of the program,
Receiving a request to generate a coding test from the tester terminal, receiving authentication information for one or more tester terminals to provide the coding test from the tester terminal, and input values corresponding to the problem UI and the scoring UI from the tester terminal Receive, generate a question according to the input value, provide an invitation notification to the tester terminal designated by the tester terminal, receive and score a plurality of answers to the coding test from a plurality of tester terminals, but cheat For detection, a source code similarity check is performed on the plurality of answers submitted by the plurality of tester terminals,
According to the input value, the problem UI and the scoring UI are generated differently,
The coding test,
Including one or more of the problem UI and the scoring UI,
In the process of receiving the input value
Further comprising the step of receiving information on whether or not to disclose the question UI and question information from the questioner terminal, wherein after providing an invitation notification to the tester terminal, scoring for the question and the question is based on the selection of the questioner terminal. Make it public or private,
When the question UI is disclosed, the input value is shared with the other questionnaire terminal, and the question information is information including any one or more of title, difficulty, source, classification, problem description, and questionnaire intention,
After providing the invitation notification to the tester's terminal
Determine whether to provide a message for a failed case to the tester's terminal according to the test result, and provide the message to the tester's terminal according to the selection of the tester's terminal,
In the process of providing an invitation notification to the tester's terminal
By generating an invitation URL, an invitation notification is provided by e-mail corresponding to the tester terminal, and the invitation URL including link information for the coding test is generated, respectively, different invitation URLs corresponding to the number of tester terminals. To do,
A server that performs coding tests and methods of providing scoring algorithms.

Images