WO2020006756A1

WO2020006756A1 - Examination/selection system, examination/selection device, and examination/selection method

Info

Publication number: WO2020006756A1
Application number: PCT/CN2018/094843
Authority: WO
Inventors: 蔡清福
Original assignee: 道鑛有限公司
Priority date: 2018-07-06
Filing date: 2018-07-06
Publication date: 2020-01-09
Also published as: CN112088391A

Abstract

An examination/selection device, comprising: a user interface, for permitting a user to participate in, upon verification, an examination/selection; a substantial examination/selection participation module, for permitting the user to give an answer or score for an examination paper; and an examination/selection participation completion module, for uploading the answer or score onto a server when the user completes participation in the examination/selection.

Description

Examination system, examination device and examination method

Technical field

This application relates to, but is not limited to, a device and method for examination, examination, selection, and competition, and more particularly, a device and method for examination, examination, selection, and competition through the Internet.

Background technique

In the past, when conducting examinations and selections, especially when facing a large area, it was necessary to concentrate many participants at one place at the same time. The movement of a large number of people and the arrangement of time caused a considerable degree of Waste of resources and crowding out effects. For example, traffic congestion around the test center, the use of public transportation crowded out daily users, and the surge in traffic demand in a short period of time led to chaotic supply of taxis, rising prices, and illegal passenger car loading. Furthermore, another problem is that when the examination is held, the participants' answering methods are quite traditional, that is, writing on the answer sheet or writing on the answer card, which is very different from the actual paperwork performed in today's society. Most of the current paperwork is using computers to input and edit text. If the examination is still conducted by pen and paper, in addition to the gap with current daily practice, it is more important that handwritten answer sheets be electronic. Can only be performed by scanning into an image file, and the storage space occupied by the image file is much larger than that of a text file, and it is difficult to make standardized and clearly identifiable modifications to the image file. Modification of image files will inevitably lead to an increase in file space. Therefore, in the multi-stage screening and selection process, various image files will be multiplied, which will cause a certain degree of burden on the transmission and storage of information.

In addition, after each examination, some candidates actively check whether their answers are correct. Some of these candidates feel that participating in the examination is like a fantasy dream, and they forget what kind of answer they made? Other candidates, because of stage fright or timidity, did not dare to check whether they had answered correctly on a certain question. Although they participated in the examination, they did not know which questions were wrong and missed the opportunity to educate or learn from me. It is a pity. Therefore, if there is some way, candidates can easily obtain their answers, correct answers and guidance or correct the answers after participating in the election, which will further implement the learning effect.

Therefore, in view of the lack of known technology, the applicant proposes the “examination system, examination device, and examination method” of this application to improve the lack of the conventional methods and related measures.

Overview

The purpose of this application is to propose an examination system, examination device, and examination method that are more cost-effective in terms of manpower, material resources, and time, and more flexible and flexible in application. The implementation of the event utilizes network terminal verification technology, so that people involved in the event can perform related activities remotely, such as but not limited to answering and changing questions. Participants can use the design interface of a specific web page on the browser to answer or mark changes, or use an application to answer or mark changes. When the answer is completed, the answerer and the answer sheet will be linked by a password, and the scoring and modifying person cannot know who the answerer is. Those who mark and modify the question will change the question through the aforementioned interface or application, and the traces of modification can be designed to remain on the answer sheet and be separated from the candidate's response, for example, in a forced tracking revision mode. In addition, for the sake of fairness, this application can also copy the same answer sheet into several copies, so that a number of question changers can change the question. If the gap between the scores of these question changers on a particular answer question is greater than one The default value is to resubmit the specific answer sheet to another changer, or even conduct an online meeting to discuss the sub-criteria. This application is more efficient than the conventional technique of concentrating all people at a specific time and place to answer and mark papers, even though online meetings need to be conducted at the same time, but not necessarily at the same place. In addition, various screening methods can be easily implemented according to this application. For example, one is to specify a standard, and the answer to the standard is passed; the other is to sort the ranking according to the score, and select a specific ranking. Questionnaires that were before, or within a certain pre-percentage are selected, or can be further screened.

With the advancement of the times and the development of science and technology, people are nostalgic and cherish the tradition when they are pursuing or satisfying the new and tired sensory stimuli. It would be very moving to modernize tradition or to integrate modernity into the beautiful ideals of tradition. For example, a traditional snooze or imperial examination can prove that someone is the best in the world. Although the social division of labor is getting finer and better, the competition for society or the country is becoming increasingly fierce due to the growing population of the earth. Therefore, in modern society, to get ahead in a certain line, you must drill deeper and deeper in that line. Therefore, the phenomenon of "no one knows the window for ten years and become famous all over the world" is not extinct. In addition, society is increasingly evolving, and a job may mix multiple skills, for example, writing a patent specification, especially the scope of patent application. The traditional so-called "Pharaoh sells melon and sells himself and boasts". Under the purpose of social evolution, the formulation of a patent system to allow practitioners in the country to "communicate their skills on the same stage" will greatly help improve the patent level of a country. In detail, after the national candidates are screened through the same standards, several people are finally selected, and in a public occasion, credible reviewers or reviewers will make the final platform results, and determine the champions, second names and Searching for flowers must be of great help to the strength or level of a country. It can be seen that the present application greatly saves the waste of various resources through network operations in advance, and brings extremely great convenience.

The patent specification or claim mentioned in the previous paragraph is an example. As is known, the quality of a patent specification depends on the definition of the scope of the claim. The mastery and grasp of the scope of the request involves technical ability, depth of thought and breadth, and even humane culture. From a certain point of view, it is very suitable for the Taiwan competition. If the state intends to cultivate the ability of practitioners in this regard, the patent authority may also seek the cooperation of major technology companies to use a new technology as an exam question to test the candidates' ability. In order to protect the new technology, the patent authorities have been able to choose the date of application for the new technology.

In order to achieve the above purpose, the present application provides an examination and selection system, including: a first verification module for verifying whether a responder is qualified; an answer module for displaying a question and enabling the responder to perform an assignment, To generate an answer sheet; an answer sheet recovery module to associate the answerer and the answer sheet, to recover all the answer sheets to a server; a scoring assignment module to assign all the answer sheets to multiple first-time readers; A second verification module is used to verify the eligibility of a examiner; a first examination module is used to display the answer assigned to the examiner, and enable the examiner to perform a scoring operation, leaving a record of the examination on the answer To generate a read mark; a first mark return module for recovering all the read marks to the server after associating the mark taker and the read mark; and a first mark result storage module for storing all read marks Answer sheet and results.

In order to achieve the above purpose, this application further provides a test selection device, including: a user interface that allows a user to participate in a test after being verified; a substantive participation test module that allows the user to give a test paper An answer or a score; and a participation test completion module, which uploads the answer or the score to a server when the user finishes participating in the test.

In order to achieve the above object, the present application further provides a selection device, including: a personal computer device for accessing an Internet; and a user interface provided in the personal computer device to allow a user to authenticate through the Internet, Participate in a test; a substantive participation test module is set on the personal computer device to allow the user to give an answer or a score on an examination paper; and a participation test completion module is set on the personal computer device to When the user finishes participating in the examination, the answer or score is uploaded to a server.

In order to achieve the above purpose, the present application further provides an examination and selection device, including: a processing module configured to: process a responder input and generate a answer sheet; process a reviewer input, the reviewer performs Scoring and generating a read answer sheet; and processing a input of a selector who selects the read answer sheet and generates a selected answer sheet; a database storing a question, the answer sheet, the read answer sheet, the The selected answer sheet and a preset condition, wherein: the read answer sheet shows a tracked revision of the answer sheet; and the selector selects the read answer sheet based on the preset condition; or The read answer sheet is scored, and the selector only scores the read answer sheet that has not been scored.

In order to achieve the above purpose, the present application further provides a test selection system, including: a test module storing a test question, and including: an answer interface, displaying the test question, having a first answer button and an end answer button, and generating An answer sheet; and a scoring interface, displaying the answer sheet, forcing the answer sheet to be modified to display tracking revisions, having a start scoring button and an end scoring button, and generating a read scoring sheet; and a selection module for processing The read answer sheet has a preset condition so that the read answer sheet that meets the preset condition can pass the examination.

In order to achieve the above purpose, the present application further provides a method for selecting a test, which includes the following steps: providing a test module, the test module includes an answer interface and a scoring interface; displaying the content of a test question through the answer interface for one The examinee performs an answer assignment and generates an answer sheet; displaying the answer sheet through the marking interface to perform a batch of correction assignments on the answer sheet, leaving a mark of correction on the answer sheet and generating a read answer sheet; and passing a selection The module performs a first selection on the read answer sheet, thereby generating a first selection answer sheet.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of a first embodiment of a system of the present application; FIG.

2 is a schematic diagram of a second embodiment of the system of the present application;

3 is a schematic diagram of a third embodiment of the system of the present application;

4 is a schematic diagram of an implementation of the method of the present application;

FIG. 5 is a schematic diagram of steps of a method of the present application; FIG.

FIG. 6 is a schematic block diagram of the answering part in the system of the present application;

FIG. 7 is a schematic block diagram of a marking part in the system of the present application;

8 is a detailed schematic diagram of a marking assignment module part of the present application;

FIG. 9 is a schematic diagram of a module for re-marking in the system of the present application;

FIG. 10 is a schematic block diagram of a final marking part in the system of the present application; and

FIG. 11 is a schematic diagram of network load balancing of the present application.

detailed description

The following describes the embodiments of the "examination system, examination device, and examination method" of this application. Please refer to the accompanying drawings, but the actual configuration and implemented method do not have to completely conform to the content described. Those skilled in the art can make various changes and modifications without departing from the actual spirit and scope of this application, that is, this application is not limited to, but is particularly applicable to, exams, examinations, selections, competitions, and competitions .

Please refer to FIG. 1, which is a schematic diagram of a first embodiment of a system of the present application. FIG. 1 discloses a test selection device, including: a processing module 1 configured to process a responder input 3-1-1 and generate a answer sheet 21; The examiner scrutinizes the answer sheet and generates a read answer sheet 22; and processes a picker input 3-1-3, the selector selects the read answer sheet and generates a selected answer sheet 23; and a database 2 , A question 20, the answer sheet 21, the read answer sheet 22, the selected answer sheet 23, and a preset condition 24 are stored. Selectors may be first-time reviewers who have read a large number of all the answers and filtered out the second-level reviewers who have met the preliminary conditions. The answerer input 3-1-1, the reviewer input 3-1-2, and the checker input 3-1-3 are all considered as a user input 3-1, and after processing by the processing module 1, it becomes one. Processing signals 1-2 enter the database 2 for data input, writing, and modification. And the user input 3-1 and the processing signal 1-2 are transmitted through the Internet 4. Data reading 2-1 and display signals 1-3 are also transmitted through the Internet 4. The situation disclosed in FIG. 1 above is usually that the client is in a centralized place, that is, the user may be in the same centralized place, and the terminal device allocated by each person only has a keyboard, a mouse, a screen, and a wired / wireless network port. At this time, the processing module 1 is usually located on the cloud or server side, and is usually placed together with the database 2.

Please continue to refer to FIG. 1, user input 3-1 is usually performed on a terminal 3. The terminal 3 includes an input module 31, a display module 32, and a communication module 33. The input module 31 may be a mouse, a keyboard, or a touch pad, etc., the display module 32 is usually a display, and the communication module 33 is various modules related to wired, wireless, and mobile communications. As for the question 20, the answer sheet 21, the read answer sheet 22, and the selected answer sheet 23 stored in the database 2, they are usually stored in the database 2 in the form of a folder or a sub-database, and a sub-database, so as to facilitate archiving. The preset condition 24 is usually a value.

Please continue to refer to Figure 1. According to the idea of the present application, it can of course be designed to display the tracked amendments to the answer sheet 21 on the read answer sheet 21, that is, to show on the read answer sheet 21 the amendments made by the reviewer in a specific way. Traces, such as added or deleted words, are presented truthfully. Furthermore, the candidate of the present application may select the read answer sheet 22 based on the preset condition 24, or the selector may score the read answer sheet 22 again. If the nature of the work performed by the examiner and the examiner is the same, of course, this application can set that the examiner can only score the already-reviewed paper 22 that has not been examined by the examiner. This is because the examiner and the examiner usually perform the examination. , That is, the first stage of the selection and examination assignments. Therefore, in order to avoid the face-to-face selection, the applicants have a preference for a certain answer sheet in the previous scoring stage. Therefore, this application has deliberately made the selection of the second stage selection work not to be processed. In the first stage, I have read the already-reviewed paper 22.

In addition, the selection phase of this application can also be performed directly through the selection device of this application, without having to involve labor, that is, the preset condition 24 is a specific number of words. When a questionnaire is scored or modified by the reviewer, If the number of words is less than or equal to the evaluation criteria such as the number of words, the answer sheet is deemed to be selected. The other is that the selection module also includes a ranking module, which ranks at least one according to the number of modified words of each answer sheet, or ranks according to the evaluation score from high to low, and The read answer papers that are located before a specific top percentile ranking or a specific ranking will pass the examination, or further enter the next stage of screening.

Please refer to FIG. 2, which is a schematic diagram of a second embodiment of the system of the present application. Most of the contents disclosed in FIG. 2 are the same as those in FIG. 1, and will not be repeated here. It is only that the processing module 1 of FIG. 2 is disposed in the terminal device 3, and this terminal device 3 is usually but not limited to a computer or a handheld device. Therefore, the user of FIG. 1 inputs 3-1 and processing signals 1-2 in FIG. 2 That is integrated into a user processing signal 3-2. The data reading 2-1 directly arrives at the terminal device 3 and is displayed via the display module 32.

Please refer to FIG. 3 and FIG. 4, wherein FIG. 3 is a schematic diagram of a third embodiment of a system of the present application, and FIG. 4 is a schematic diagram of implementing a method of the present application. FIG. 3 discloses a test selection system, including a test module 5, storing a test question 20 (please cooperate with FIG. 1), and including an answer interface 51, displaying the test question 20, having a start answer button 511 and an end answer button 512, and generates a questionnaire 21 (please cooperate with FIG. 1); and a marking interface 52, displaying the questionnaire 21, so that the questionnaire is modified in a manner of forcibly displaying tracking revisions, and has a start marking button 521 and an end marking button 522, And generates a read answer sheet 22 (please cooperate with Fig. 1); and a selection module 25 for processing the read answer sheet 22 with a preset condition 24 (please cooperate with Fig. 1) so as to meet the preset condition The read answer sheet of 24 passed the examination. In addition, there is a fixed area 500 in the answering interface 51 and the marking interface 52 for displaying the test questions 20; and a writing area 501 for a responder or a reviewer to write the answering or marking in the writing area 501. On the other hand, what is disclosed in FIG. 3 and FIG. 4 is also a selection method. Please refer to FIG. 5. The examination method of the present application includes the following steps: The first step is to provide a test module 5, which includes an answering interface 51 and a marking interface 52; the subsequent steps are to be performed through the answering interface 51. Display a question content 20 for an examinee to perform an answer assignment and generate an answer sheet 21; the next step is to display the answer sheet 21 via the marking interface 52 to perform a batch of homework modification on the answer sheet on the answer sheet Leave correction marks and generate a read answer sheet 22; and the next step is to perform a first selection of the read answer sheet via a selection module 25, thereby generating a first selection answer sheet 23. Of course, if there are a large number of people or special circumstances, the first selection can be selected by a threshold, or the selected answer can be selected by a selection person.

Please continue to refer to FIG. 3 and FIG. 4. In detail, FIG. 4 is a schematic diagram of the implementation of the method of the present application, and also shows the status of the operation of this application. The disclosed client module is displayed on the display module 32 of the terminal device 3, and the screen can actually use a browser or an application program to display the answer interface 51 or the marking interface 52. When the answer interface 52 is in operation, a question bar 500 is displayed to display the questions (test questions) 20, and on the marking interface 52, it is possible to choose whether to display the questions 20. The answer interface 51 further includes an answer field 501, so that a responder can fill in the answer therein. On the marking interface 52, the answer column 501 is used to display an answer sheet 21, and enables a reviewer to directly correct the answer sheet 21. In order to clarify the operation steps, each of the answer interface 51 or the marking interface 52 has a start button and an end button. When answering a question, there are a start answer button 511 and an end answer button 512, and when marking, it is a start marking button 521 and an end marking button 522. In addition, on the marking interface 52, the reviewer can decide whether to display the title bar 500 to save the use of the screen. As for the selection of the already-reviewed questionnaires by a selector as described above, the same questionnaire interface 52 as shown in FIG. 4 can be used. To perform the second selection, the same marking interface 52 as that shown in FIG. 4 can also be used.

Please refer to FIG. 5, which is a schematic diagram of the steps of the method of the present application, and please cooperate with FIG. 3 and FIG. 4. Figure 5 discloses the selection method of this application, including the following steps: The first step is to provide test module 5 (S5), and the step (S5) of providing test module 5 includes providing an answer interface (S51) and / or providing scoring Interface (S52). The step after providing the answering interface (S51) is to generate the answer sheet (S21) via the answering interface 51. The steps after providing the scoring interface (S52) are to generate the scoring answer (S22), that is, the steps after the scoring is completed. The next step is to generate the first selection answer sheet (S23), which is the step after the selection is completed. If necessary, a second selection answer sheet is generated, which is the step after the second selection is completed. If the second reviewer has performed the review, marking work and / or the first screening, the second reviewer may only perform the first review answer that is not approved, reviewed and / or selected by the second reviewer. The second selection.

Please refer to FIG. 6 and FIG. 7, wherein FIG. 6 is a schematic diagram of a module of a question answering part in the system of the present application, and FIG. 7 is a schematic diagram of a module of a marking part in the system of the present application, and please cooperate with FIG. 1 and FIG. 2. FIG. 6 and FIG. 7 disclose a test selection system including a first verification module M1 for verifying whether an answerer is qualified. Usually, the first verification module M1 also includes an account secret module, which can be further combined with or replaced by a biometric module to notify the respondent or the examiner of a relevant user account and password during the selection period. . The examination and selection system also includes an answering module M2, which is used to display a question 20 and cause the answerer to perform an answer assignment to generate an answer sheet 21. The question 20 here is usually taken from a sub-database or a folder in the database 2 where the question 20 is stored. As for the answering, the answering interface 51 (see FIG. 4) is performed. The examination and selection system further includes an answer sheet recovery module M3, which is used to associate all the answerers and their answer sheet 21 to recover all the answer sheets to a server, which is usually the location of database 2. The examination and selection system also includes a scoring module M4, which is used to distribute all the answers to multiple first-time reviewers. In general, the scoring assignment module M4 can take out the answer sheet 21 from a sub-database or a folder in the database 2 in which the answer sheet 21 is stored. The test system also includes a second verification module M5 for verifying whether a reviewer is qualified; it also includes a first-time review module M6 for displaying the answer assigned to the reviewer and allowing the reviewer to perform a review Assignment, leaving a scoring record on the answer sheet, resulting in a read answer sheet 22. The generation of the already-reviewed paper 22 is generated after the reviewer performs the marking on the marking interface 52 (see FIG. 4). The examination and selection system also includes a first mark recovery module M7, which is used to associate the mark reader with the read mark, and then recover all the read marks to the server. Because it is necessary to associate the reviewer and the already-reviewed questionnaire, the first reviewing and recycling module M7 will be linked with the second verification module M5 to obtain the information of the reviewer and combine it with the already-reviewed questionnaire through appropriate coding, thereby Generated the Answer Sheet 22 for this application. The examination and selection system also includes a first test result storage module M8, which is used to store all the test papers and their scores 22 '. Generally, the score 22 'can be stored in a sub-database or folder in the database 2 for storing the score 22' (not shown in the figure). In addition, the examination and selection system may also include a registration module or a registration fee charging module. When the test question is not a non-yes or multiple-choice question, the reviewer is a human reviewer, that is, a natural person. In addition, the first test result storage module M8 may further include a comparison sub-module (not shown in the figure), which is used to compare the stored results of all the read test results and to select a predetermined number of better test results. In other words, the questionnaire before a certain ranking, or the previous fixed percentage of the scores from high to low in the ranking, is used as the candidate for the next stage of screening. The first marking result storage module M8 further includes a distribution sub-module (not shown in the figure), which is used to allocate the predetermined number of better score answers to multiple re-markers. In detail, the function of the dispatching sub-module described here is actually very similar to the re-marking dispatching module M10 of FIG. 9, except that the dispatching rule used here is to assign the predetermined number of better scores to multiple Therefore, it can also be said that the assignment sub-module is actually an assignment rule set in the re-examination assignment module M10, and this rule is the aforementioned assignment of the predetermined number of better scores to multiple re-examinations. By.

Please refer to FIG. 6 and FIG. 11 at the same time. FIG. 11 is a schematic diagram of the network load balancing of the present application, which reveals that a large number of candidates USER1 and the verification module M1, the answer module M2, and the answer recovery module M3 can be connected online through the network 4. Candidate USER1 must perform identity verification at the same time by the first verification module M1, the answer module M2 allows the candidate to answer the question, and the answer recovery module M3 to recover the answer 21 that the candidate has answered, which usually causes network congestion. For example, the first verification module M1, the answer module M2, and the answer question recovery module M3 can be built in a single application server or web server. At this time, a load balancing module SLB1 can be provided. As shown in FIG. 11, the load is configured. The balancing module SLB1 is used between a large number of test takers USER1 and multiple application (or web) servers APS1, APS2, and APS3. It can be used to evenly distribute network traffic NF1 from a large number of test takers USER1 at the same time to avoid processing by only a single application server. The load is too heavy or the processing load of one of the multiple application servers APS1, APS2, and APS3 is too heavy, thereby solving the problem of congestion. Preferably, at least one load balancing module SLB1 can be configured in different regions, and the load balancing module SLB1 responsible for the region can be separately configured in different regions, which can greatly reduce the load of a single server.

Similarly, referring to FIG. 7 and FIG. 11 at the same time, a plurality of reviewers USER2 and the review allocation module M4, the second verification module M5, the first review module M6, the first review recovery module M7, and the first review result storage module M8 are available. Linked online through the network 4, when multiple reviewers USER2 must at the same time perform identity verification by the second verification module M5, the review assignment module M4 and the first review module M6 allow the reviewer USER2 to correct the answer sheet 21, and by the first review When the recovery module M7 recovers the marked answer 22 that the reviewer has marked, it usually causes network congestion. For example, the marking assignment module M4, the second verification module M5, the first marking module M6, the first marking recovery module M7, and the first marking result storage module M8 can be built into a single application server or web server. At this time, a load balancing module SLB1 can be provided As shown in Figure 11, the load balancing module SLB1 is configured between multiple reviewers USER2 and multiple application (or web) servers APS1, APS2, and APS3. It can be used to evenly distribute the same time from multiple reviewers USER2. Network traffic NF2 to avoid overloading only a single application server or multiple application servers APS1, APS2, and APS3, thereby solving the problem of congestion.

In a preferred embodiment, the load balancing module SLB1 has a corresponding cache function, which can set the type, size, and survival time of the files being accessed, and the frequently accessed content will be It is stored on the load balancing module SLB1. When the candidate USER1 accesses, the load balancing module SLB1 can replace the application server APS1, server APS2, and server APS3, and transfer the more commonly used content to speed up the data access speed.

In addition, when verifying the identity of the examinee and the examiner, an encryption protocol such as an SSL encryption protocol is usually used, which will reduce the performance of the application server APS1, server APS2, and server APS3. The SLB1 load balancing module with SSL acceleration can share the load of the application server APS1, server APS2, and server APS3. In addition, in data transmission, the load balancing module SLB1 can also compress the data of these

answer papers

21 and 22 that have been read, such as Hypertext Transfer Protocol (HTTP) compression, and compress network traffic NF1 and NF2. Reduced to avoid network congestion.

Please refer to FIG. 8, which is a detailed schematic diagram of the marking assignment module part of this application. The grading assignment module M4 also includes an assignment sub-module M4a, which is used to assign all the answer sheets to two of the examiners one by one, and is also assigning the answer sheets to two first grading modules M6. Of course, the first grading module M6 itself has only one Species, but there can be multiple. The grading assignment module M4 also includes a comparison sub-module M4b, which is used to compare the scores of the answer sheets read by the two reviewers. If the difference is less than a default value, the average of the two scores is used as the answer sheet. Grades. After the two reviewers have completed the first marking, the score 22 'of the answer sheet is naturally stored in an appropriate position, so the comparison sub-module M4b can take the score 22' from this position for comparison. The marking assignment module M4 also includes a re-assignment sub-module M4c, which is connected to the comparison sub-module M4b. When the comparison sub-module M4b finds that the difference is greater than the default value, it notifies the re-assignment sub-module M4c to re-assign the answer sheet. Assigned to a third reviewer. Furthermore, at this time, the application will get three scores, including the first score, the second score, and the third score, where the difference between the first score and the second score is the first difference, the second score, and the third score. The difference between the three scores is the second difference, and the difference between the third score and the first score is the third difference. If a difference is less than or equal to the default value, the two sets of points from which it is derived are taken. Average. For example, if the third difference is less than or equal to the default value, an average of the third score and the first score is taken. If the above differences are greater than the default value, the average of the first score, the second score, and the third score is taken as the score of the answer sheet.

Please refer to FIG. 9, which is a schematic diagram of a module in the re-marking part of the system of the present application. The re-marking section includes a first screening module M9 for selecting the answer sheets 22 before a first specific position in the already-reviewed answer sheets, thereby generating a first group of screening answer sheets 220. It can be seen that the first screening module M9 takes each answer 22 from the sub-database or folder of the answer 22 and generates the first group of screening answers 220 after the first screening. Usually, the first group of screening answers 220 also has a dedicated sub-database or folder for storage. The re-marking section also includes a re-marking assignment module M10, which is used to assign all the first group of screening answers 220 to multiple re-markers for marking. The re-marking dispatching module M10 usually obtains the data of the reviewer from the point of having the review interface 52, and, if necessary, decides who can serve as the re-marker. The re-marking section also includes a third verification module M11, which is used to verify whether each re-marker is qualified. This module is the same as the previous verification modules and will not be repeated here. The re-marking section also includes a re-marking module M12, which is used to display one of the first group of screening answers 220, and enables the re-marker to perform a re-marking operation, thereby generating a re-marked answer. The screening questionnaire 220 is from a sub-database or a folder storing the questionnaire, and is displayed on the marking interface 52 for reviewers to review. The re-marking section also includes a re-marking recovery module M13, which is used to associate the re-marker and the re-reviewed question 23 to recover all the re-reviewed question 23 to the server. Here, the read-out answer sheet 23 is usually stored in a sub-database or a folder located in the database 2. The re-marking part also includes a re-marking result storage module M13 'for storing the re-reading answer sheet and the re-reading answer score 23g. Here, 23g of the re-reading result is usually stored in a sub-database or a folder located in the database 2.

Please refer to FIG. 10, which is a schematic diagram of a module of a final marking part in the system of the present application. FIG. 10 reveals that the final scoring section includes a final screening module M14, which is used to select all the answers before a second specific rank in the second-reviewed questionnaire 23 to generate a second group of screening questionnaires 230. As mentioned before, this application will set, for example, the top one percent or the top five as the criteria for entering the second group screening answer sheet 230. The final scoring section also includes a final scoring assignment module M15, which is used to display the second group of screening answers 230 in a test venue for an appointed candidate to comment, and give a final answer score 26 on the final test papers. . This is usually a large conference room, or a large auditorium, with appropriate display equipment to display the second group of screening answers 230. Furthermore, it can be extended with live broadcasts and videos to allow people with lofty ideals to participate across distances. The final scoring section also includes a final scoring result storage module M16, which is used to record the final answer scores of the second group of screening answers 230 one by one. This application also includes a server for building the first verification module M1, the answer module M2, the answer recovery module M3, the test assignment module M4, the second verification module M5, the first test module M6, and the first time Marking and recycling module M7, the first marking result storage module M8, the first screening module M9, the re-marking assignment module M10, the third verification module M11, the re-marking module M13, the re-marking recycling module M13, and the re-marking The result storage module M13 ', the final screening module M14, the final marking assignment module M15, and the final marking result storage module M16.

For example, in the embodiments shown in FIG. 1 and FIG. 2, the answering module M2, the first marking module M6, an account-secret module, and a re-marking module M12 can be further disposed in the terminal 3, that is, a client device. The aforementioned modules can also be executed by a special software installed in the client device.

Therefore, based on the above-mentioned drawings and their descriptions, in fact, this application can also be a type of selection device. Please refer to FIG. 2 and FIG. 4. This application includes a user interface (51, 52) to allow a user to participate in a verification after being authenticated (for example, the first verification module M1, the second verification module M5, and the third verification module M11). Field examination; a substantive participation in the examination module (such as various modules disclosed in Figures 6 to 10), allowing the user to give an answer to an examination paper (for example, the step of Figure 5: generate answer sheet (S21)) or Scoring (for example, the step in FIG. 5: generating a first selection answer sheet (S23)); and a participation examination completion module that answers the question when the user finishes participating in the examination (for example, the answer sheet recovery module M3 in FIG. 6) Or upload (for example, the first scoring module M7 in FIG. 7) to a server. In addition, the examination and selection device of this application can of course be designed to include a receipt module, and when the server confirms the answer or the score, it sends a receipt credential to the user. If there is a need to save the data, the loopback credential can include an unchangeable image file, so that in the event of data loss, this image file can be used for remediation, and it can also be combined with block refining technology to make any attempt to change this image Invalidation of the file.

Therefore, based on the above-mentioned drawings and their descriptions, the selection device of the present application may further include a verification module in the server to verify whether the user is qualified, that is, for example, through the first verification module described above. M1, the second verification module M5, and the third verification module M11 to verify whether each user is qualified. The server also includes a test paper module for displaying a test paper so that the user can provide the answer or score. For example, the client module shown in FIG. 4 can be downloaded to the terminal 3 every time it is used. (Please cooperate with Figure 1), or download and install it on the terminal 3 when installing the selection application. The server also includes a test paper recovery module for recovering all the test papers after associating the user (for example, the answer paper recovery module M3 of FIG. 6, the first test paper recovery module M7 of FIG. 7, and the retest paper recovery module M13 of FIG. 9); And a storage module for storing the test paper and all the test papers that have the answer or score, such as database 2 shown in FIG. 1 and FIG. 2. The server may further include the read answer sheet and its score 22 'of FIG. 7 and the read answer sheet and its score 23' of FIG. 9 again.

See Figure 2. Furthermore, referring to most of the usage conditions, another type of the selection device of this application may include a personal computer device (such as the terminal 3 in FIG. 2) for accessing an Internet 4; a user interface (Such as the answer interface 51 and / or the scoring interface 52 of FIG. 4), which are disposed on the personal computer device 3 to allow a user to pass the Internet authentication (for example, the first authentication module M1, the second authentication module M5, the third Verification module M11), participate in an examination. The examination and selection device of the present application also includes a substantive participation examination module (for example, the answering module M2 in FIG. 6 and the first marking module M6 in FIG. 7. The effect is the answering interface 51 and / or the marking interface 52 displayed on the display module 32. ) Is provided in the personal computer device 3 to allow the user to give an answer or a score on an examination paper. The examination and selection device of the present application further includes a completion module for participating in the examination (for example, the answering and retrieval module M3 in FIG. 6, the first examination and retrieval module M7 in FIG. 7, and the again examination and retrieval module M13 in FIG. 9), which are provided in the personal computer device 3 , So that when the user finishes participating in the examination, the answer or score is uploaded to a server.

As described in the previous paragraph, and in conjunction with FIG. 2, the server of the examination device of the present application further includes a test paper module, stores a test paper 20, and includes an answer or scoring interface (for example, the answer module M2 in FIG. 6 and FIG. 7). The first scoring module M6 can be integrated into the test module, and its effect is the answer interface 51 and / or scoring interface 52 displayed on the display module 32. The answer or scoring interface (such as the answer interface 51 and / or scoring) Interface 52) displays the test paper, and has an answer button and a grading button (such as a start button 511 and a grading button 521), an end button and a grading button (such as an end button 512 and an end button). 522); and a selection module (the first screening module M9 shown in FIG. 9 or the selection module 23 ′ shown in FIG. 3), which is used to process the test papers for which the answer or score is already present, and according to the score, Produce a selection result.

In summary, the purpose of the “examination system, examination device, and examination method” in the present application is to provide a more labor-saving, material-saving, and time-saving cost, and more flexible application. Flexible examination system, examination device and examination method, and can be used in the implementation of activities such as examinations, selections, competitions, etc., using network terminal verification technology, so that people participating in the activities can perform related activities remotely, such as But it is not limited to answering questions and marking changes. Participants can use the design interface of a specific web page on the browser to answer or mark changes, or use an application program to answer or mark changes. In addition, in terms of today's popular shows, this application can save a lot of manpower and material resources. The client module shown in Figure 4 can be used as a recording and playback interface, and connected to video and audio equipment such as cameras for recording, until the video is completed To upload. Selectors and referees can also watch and examine the performances of contestants through this interface. Through a unified format, the hardware gap between each contestant can be minimized as much as possible. content. It can be seen that this application is particularly suitable for various competitions, especially to compete for championships, and there are championships and runners-up, and third-place competitions, and competitions. Since there are many preliminaries before such competitions, this application can greatly reduce costs. Including the time cost of the contestants and the judges, so that the use of various resources will not be concentrated in a short period of time, a small area, and the reasonable allocation of social resources has extremely positive benefits, so for the technical field of this application and the environment In terms of protection, it has a great contribution.

Example:

Embodiment 1 provides an examination and selection device, including: a processing module configured to: process a responder input and generate a answer sheet; process a reviewer input, the reviewer mark the answer sheet, and generate a Read the answer sheet; and process the input of a picker who selects the read answer sheet and generates a selected answer sheet; a database storing a question, the answer sheet, the read answer sheet, the selected answer sheet, and A preset condition, in which the tracked revision of the answer sheet is displayed on the read answer sheet; and the checker selects the read answer sheet based on the preset condition; or the checker performs the read answer sheet Scoring, in which the candidate only scores the already-reviewed papers that have not been marked by him.

Embodiment 2 The apparatus as described in Embodiment 1, wherein the input of the responder, the input of the examiner, and the input of the candidate are performed through a terminal interface.

Embodiment 3 The apparatus according to Embodiment 1, wherein the answerer input, the reviewer input, and the checker input are transmitted through an Internet.

Embodiment 4 The apparatus as described in Embodiment 1, wherein the answerer input, the reviewer input, and the selector input are performed through a local area network.

Embodiment 5. The apparatus according to embodiment 1, wherein the default condition is a specific word count, the tracking revision has a modified word count, and the read answer sheet with the modified word count lower than the specific word count is selected as qualified.

Embodiment 6 provides an examination selection system, including: a test module storing a test question, and including: an answer interface, displaying the test question, having a start answer button and an end answer button, and generating an answer sheet; and The marking interface displays the answer sheet, so that the answer sheet can be modified in a manner of forcibly displaying tracked revisions. It has a start marking button and an end marking button, and generates a read answer sheet; and a selection module for processing the read answer sheet, It has a preset condition so that the read answer paper that meets the preset condition can pass the examination.

Embodiment 7 The system according to item 6 further includes a client module for displaying the answering interface or the marking interface.

Embodiment 8 The system as described in Embodiment 6, wherein the default condition is an upper limit of the number of words to be modified, and in the read answer sheet, anyone who has the number of modified words in the answer sheet lower than or equal to the upper limit of the number of words to be modified shall pass the present Elections.

Embodiment 9. The system according to embodiment 6, wherein the selection module further includes a ranking module, which is ranked from least to most according to the number of modified words of each of the read question papers, and will be placed in a specific place. The read papers with percentage rankings will pass the examination.

Embodiment 10 provides a test selection method, including the following steps: providing a test module, the test module includes an answer interface and a scoring interface; displaying the content of a test question through the answer interface for an examinee to perform an answer Work and generate an answer sheet; displaying the answer sheet through the marking interface to perform a batch of corrections on the answer sheet, leaving marks on the answer sheet and generating a read answer sheet; and selecting the read sheet via a selection module The answer sheet performs a first selection, resulting in a first selection answer sheet.

Embodiment 11 The method according to embodiment 10, wherein the first selection is automatically selected based on a threshold.

Embodiment 12 The method according to embodiment 10, wherein the first selection is performed by the first selection person on the read answer sheet to generate the first selection answer sheet.

Embodiment 13 The method as described in Embodiment 12, wherein if the first reviewer has performed the review assignment, the first reviewer may only select the review papers that have not been reviewed by the first reviewer.

Embodiment 14. The method according to embodiment 12, further comprising the following steps: performing a second selection on the first selection answer sheet, wherein the second selection is performed by the second selection candidate on the first selection answer sheet, Wherein, if the second selection person has performed the marking operation and / or the first selection, the second selection person may only perform the second selection of the first selection answer sheet that is not approved and / or selected by the second selection person. Selections.

Embodiment 15 provides an examination and selection system, including: a first verification module for verifying whether an answerer is qualified; an answering module for displaying a question and causing the answerer to perform an answer assignment to generate a Answer sheet; a answer sheet recovery module for associating the answerer and the answer sheet, recovering all the answer sheets to a server; a scoring assignment module for assigning all the answer sheets to multiple first-time scoring sheets; a second verification A module for verifying the eligibility of a reviewer; a first-time review module for displaying the answer assigned to the reviewer, and for the reviewer to perform a review operation, leaving a review record on the answer, resulting in A read mark; a first mark recovery module, which is used to associate the mark reader and the read mark, and recover all the read marks to the server; and a first mark result storage module, which stores all the read marks and their Grades.

Embodiment 16 The examination system according to Embodiment 15, wherein the verification module further includes an account module to notify the answerer or the examiner of a relevant user account and password during the examination period. The examination and selection system may further include a registration module or a registration fee charging module; and the reviewer is a human reviewer.

Embodiment 17, the examination and selection system according to embodiment 15, wherein the marking assignment module further comprises: an assignment sub-module for assigning all the answer sheets to two of the examiners for marking one by one; a comparison sub-module, using To compare the scores of each answer sheet read by the two reviewers, if the difference is less than a default value, the average of the two scores is used as the score of the answer sheet; and the sub-module is repeatedly assigned if the difference is greater than the By default, the answer sheet is assigned to a third reviewer.

Embodiment 18, the examination and selection system according to embodiment 15, further comprising: a first screening module for selecting the answers before a first specific rank in the read answers, thereby generating a first group of screening answers; A re-marking assignment module is used to assign all the first group of screening answers to a plurality of re-markers; a third verification module is used to verify the eligibility of each re-marker; a re-marking module is used to display The first group screens one of the answer sheets and causes the re-marker to perform a re-marking operation to form a re-marked answer sheet; and a re-marking recovery module for associating the re-marker with the re-marked sheet, Recovering all the re-reading answers to the server; and a re-reading result storage module for storing the re-reading answers and their results.

Embodiment 19, the examination and selection system according to embodiment 18, further comprising: a final screening module for selecting all the answers before a second specific position in the re-read answer sheet, thereby generating a second group of screening answer sheets ; A final scoring assignment module for displaying the second group of screening answers in a test venue for an appointed candidate to comment and give a final test score; a final scoring result storage module for recording one by one The final group of screening results of the second group; and a server for building the first verification module, the answer recovery module, the marking assignment module, the second verification module, the first marking recovery module, the first time Marking result storage module, the first screening module, the re-marking assignment module, the third verification module, the re-marking recycling module, the re-marking result storage module, the final screening module, the final marking assignment module, and the final marking Results storage module.

Embodiment 20, the examination and selection system according to embodiment 15, further comprising: a client device to enable the responder to operate the answer module, or the first time examiner to operate the first examination module; the client device is also constructed Placing the answering module, the first marking module, an account-secreting module and a re-marking module; and the client device is executed by a dedicated software.

Embodiment 21, the examination and selection system according to embodiment 15, wherein the first marking result storage module further comprises: a comparison sub-module for comparing the scores of all the already-scored examination results stored and filtering out a predetermined number of Better score answers; and an assignment sub-module for assigning the predetermined number of better score answers to multiple re-markers.

Embodiment 22 provides a test selection device, including: a user interface that allows a user to participate in a test after verification; a substantive participation test module that allows the user to give an answer or a score on a test paper; And a test completion module, which uploads the answer or score to a server when the user finishes participating in the test.

Embodiment 23, as in the examination and selection device of embodiment 22, further includes a receipt module, and when the server confirms the answer or the score, it sends a receipt credential to the user.

Embodiment 24. The examination and selection device according to embodiment 22, wherein the server further includes: a verification module for verifying whether the user is qualified; and a test paper module for displaying a test paper so that the user can provide the answer. Or a scoring module; a test module recovery module for recovering all the test papers after associating with the user; and a storage module for storing the test paper and all the test papers for which the answer or scoring is already available.

Embodiment 25 provides a test selection device, including: a personal computer device for accessing an Internet; and a user interface provided in the personal computer device to allow a user to participate in a test after being authenticated by the Internet. Election; a substantive participation examination module is provided on the personal computer device to allow the user to give an answer or a score on an examination paper; and a participation examination completion module is provided on the personal computer device for the user to complete When participating in the test, upload the answer or score to a server.

Embodiment 26 The examination and selection device according to embodiment 25, wherein the server further comprises: a test paper module, storing a test paper, and including an answer or scoring interface, wherein the answer or scoring interface displays the test paper, and has an initial provision An answer and scoring button and an end answer and scoring button; and a selection module for processing a test paper that already has the answer or scoring, and making a selection result based on the scoring.

Although the present application is disclosed in the preferred embodiment as above, it is not intended to limit the scope of the present application. Any changes and modifications made by those skilled in the art without departing from the spirit and scope of the present application shall belong to the present application. Coverage.

Symbol Description

1: processing module

1-2: Processing signals

1-3: display signal

2: database

20: Questions, Question Tickets

21: Answer sheet

22: Answered papers

22 ’: Results of the answer sheet

220: The first group of screening answers

23: Selected Answer Sheets

230: The second group of screening answers

23g: Read the answer sheet again

24: preset standard

25: Selection module

26: Final answer sheet

2-1: Data read

2-3: Data read

3: terminal

31: Input module

32: display module

33: communication module

3-1 (3-2): User input

3-1-1 (3-2-1): Respondent input

3-1-2 (3-2-2): input by the reviewer

3-1-3 (3-2-3): Selector input

4: Internet

5: user interface, user module, answer module, test module

500: fixed area

501: Writing area

51: Answer interface, answer module

511: Start answer button

512: End answer button

52: marking interface, marking module

521: Start marking button

522: End marking button

S5: Provide test module

S51: Provide answer interface

S52: Provide marking interface

S21: Generate answer sheet

S22: Generate read answer sheet

S23: Generate the first selection answer sheet

S23 ’: Generate the second selection answer sheet

APS1, APS2, APS3: Server

M1: first verification module

M2: Answer module

M3: Answer sheet recovery module

M4: Marking and dispatching module

M4a: dispatch submodule

M4b: Compare submodules

M4c: Reassign submodules

M5: second verification module

M6: First marking module

M7: First Mark Recovery Module

M8: First Marking Results Storage Module

M9: First screening module

M10: Marking and dispatching module again

M11: the third verification module

M12: Marking module again

M13: Marking and recycling module again

M13 ’: Re-marking result storage module

M14: Final Screening Module

M15: Final Grading Assignment Module

M16: Final Marking Results Storage Module

NF1, NF2: network traffic

SLB1: Load Balancing Module

USER1: Candidate

USER2: Marker

Claims

An examination and selection system, including:

The first verification module is used to verify whether the answerer is qualified;

An answering module for displaying the questions and causing the answerers to perform the answering assignments to generate answer sheets;

Answer sheet recovery module, which is used to recover all the answer sheets to the server after associating the answerer and the answer sheet;

A marking assignment module, for allocating all the answer sheets to a plurality of first-time markers for marking;

The second verification module is used to verify whether the examiner is qualified;

The first scoring module is used to display the answer sheet assigned to the reviewer, and to enable the reviewer to perform the scoring operation, leaving a scoring record on the answer sheet, and generating a scoring sheet;

The first mark recovery module is used for recovering all the read marks to the server after associating the mark taker and the read marks; and

The first test result storage module is used to store all the test papers and their scores.
The screening system of claim 1, wherein:

The verification module further includes an account secret module, which is used to notify the answerer or the examiner of the relevant user account and password during the examination period;

The examination and selection system may further include a registration module or a registration fee charging module; and

The reviewer is a human reviewer.
The examination and selection system according to claim 1, wherein the marking assignment module further comprises:

An allocating submodule, for allocating all the answer sheets one by one to two of the reviewers for marking;

A comparison sub-module for comparing the scores of each of the answer sheets read by the second reviewer; if the difference is less than a default value, the average of the second scores is used as the score of the answer sheet; and

Reassigning a sub-module, and if the difference is greater than the default value, reassigning the answer sheet to a third reviewer.
The screening system of claim 1, further comprising:

A first screening module, configured to select the answers before the first specific position in the read answers, thereby generating a first group of screening answers;

A re-marking assignment module, for allocating all of the first group of screening answers to a plurality of re-markers;

A third verification module, configured to verify whether each of the re-markers is qualified;

A re-marking module, which is used to display one of the first group of screening answers, and enables the re-marker to perform the re-marking operation and form a re-marked question;

A re-marking and recycling module for re-associating the re-marker and the re-reading questionnaire, and recovering all the re-reading questionnaire to the server; and

The re-marking result storage module is configured to store the re-reading mark and its score.
The screening system according to claim 4, further comprising:

The final screening module is used to select all the answers before the second specific position in the re-reading answer sheet, thereby generating a second group of screening answer sheets;

A final scoring assignment module for displaying the second group of screening and answering papers at the test venue for appointment by the candidates and giving the final test scores;

A final test result storage module for recording the final test scores of the second group of screening test answers one by one; and

The server is configured to build the first verification module, the answer test recovery module, the test allocation module, the second verification module, the first test recovery module, the first test result storage module, and the first test module. A screening module, the re-marking assignment module, the third verification module, the re-marking recovery module, the re-marking result storage module, the final screening module, the final marking assignment module, and the final marking Results storage module.
The screening system of claim 1, further comprising:

A client device to enable the answerer to operate the answering module, or the first-time reviewer to operate the first-time review module;

The client device also builds the answering module, the first marking module, the account-secreting module, and the re-marking module; and

The client device is executed in dedicated software.
The examination system according to claim 1, wherein the first marking result storage module further comprises:

A comparison sub-module for comparing the stored scores of all the read answer sheets and filtering out a predetermined number of better score answer sheets; and

An assigning sub-module for assigning the predetermined number of better score answers to a plurality of re-markers.
An examination and selection device includes:

User interface, allowing users to participate in a test after verification;

Substantive participation in the selection module, allowing the user to give answers or scores on the examination papers; and

The participation test completion module uploads the answer or score to the server when the user finishes participating in the field test.
The screening device according to claim 8, further comprising a receipt module, which sends the receipt credential to the user when the server confirms the answer or score.
The screening device according to claim 8, wherein the server further comprises:

A verification module for verifying whether the user is qualified;

A test paper module for displaying the test paper so that the user provides the answer or the score;

Test paper recovery module, configured to recover all the test papers after being associated with the user; and

The storage module is configured to store the test paper and all the test papers with the answers or scores.
An examination and selection device includes:

Personal computer device for accessing the Internet;

A user interface provided on the personal computer device to allow the user to participate in a test after being authenticated by the Internet;

A substantive participation examination module, which is provided on the personal computer device to allow the user to give an answer or a score on the examination paper; and

The participation examination completion module is set on the personal computer device, and when the user finishes participating in the examination, the answer or score is uploaded to the server.
The screening device according to claim 11, wherein the server further comprises:

The test paper module stores test papers and includes an answer or scoring interface, wherein the answer or scoring interface displays the test paper, and has a start providing answer and scoring button and an end answer and scoring button; and

A selection module is configured to process a test paper that already has the answer or score, and make a selection result according to the score.